Papers

2025

• Jiaju Ma, Lei Shi, Kenneth Robertsen, Peggy Chi. 2025. AmbigChat: Facilitating Ambiguous Open-Domain Question Answering via Hierarchical and Interactive Clarification. In Proceedings of ACM UIST 2025. [PDF]
• Peggy Chi, Senpo Hu, Lei Shi, Tanya Kraljic, Justin Secor, Tao Dong, Irfan Essa, Mike Cleron. 2025. WatchWithMe: LLM-Based Interactive Guided Video Watching. In Proceedings of ACM CUI 2025. [PDF]

2024

• Palash Nandy, Sigurdur Orn Adalgeirsson, Anoop Sinha, Tanya Kraljic, Mike Cleron, Lei Shi, Angad Singh, Ashish Chaudhary, Ashwin Ganti, Christopher Melancon, Shudi Zhang, David Robishaw, Horia Ciurdar, Justin Secor, Kenneth Robertsen, Kirsten Climer, Madison Le, Mathangi Venkatesan, Peggy Chi, Peixin Li, Peter McDermott, Rachel Shim, Selcen Önsan, Shilp Vaishnav, Stephanie Guamán. 2024. Bespoke: Using LLM Agents to Generate Just-in-Time Interfaces by Reasoning About User Intent. In Proceedings of ACM ICMI 2024 Demo. [PDF]
• Lei Shi, Rachel Campbell, Peggy Chi, Maria Cirimele, Mike Cleron, Kirsten Climer, Chelsey Fleming, Ashwin Ganti, Philippe Gervais, Pedro Gonnet, Tayeb Karim, Andrii Maksai, Chris Melancon, Rob Mickle, Claudiu Musat, Palash Nandy, Iris Qu, David Robishaw, Angad Singh, Mathangi Venkatesan. 2024. Inkeraction: An Interaction Modality Powered by Ink Recognition and Synthesis. In Proceedings of ACM CHI 2024. [PDF]
• Daniel Nkemelu, Peggy Chi, Daniel Castro Chin, Krishna Srinivasan, Irfan Essa. 2024. Automatic Multi-Path Web Story Creation From Structured Articles. Wikimedia Research Showcase -- April 2024. [Archive]

2023

• Wan-Chen Lee, Ching-Wen Hung, Chao-Hsien Ting, Peggy Chi, Bing-Yu Chen. 2023. TacNote: Tactile and Audio Note-Taking for Non-Visual Access. In Proceedings of ACM UIST 2023. [PDF]
• Yi-Hao Peng, Peggy Chi, Anjuli Kannan, Meredith Ringel Morris, Irfan Essa. 2023. Slide Gestalt: Automatic Structure Extraction in Slide Decks for Non-Visual Access. In Proceedings of ACM CHI 2023. [PDF]
• Xingyu "Bruce" Liu, Vladimir Kirilyuk, Xiuxiu Yuan, Alex Olwal, Peggy Chi, Xiang 'Anthony' Chen, Ruofei Du. 2023. Visual Captions: Augmenting Verbal Communication with On-the-fly Visuals. In Proceedings of ACM CHI 2023. [PDF]
• Xingyu "Bruce" Liu, Vladimir Kirilyuk, Xiuxiu Yuan, Peggy Chi, Alex Olwal, Xiang 'Anthony' Chen, Ruofei Du. 2023. Experiencing Augmented Communication with Real-time Visuals using Large Language Models in Visual Captions. In Extended Abstract of ACM UIST 2023 (demo). [PDF]

2022

• Peggy Chi, Tao Dong, Brian R. Colonna, Christian Frueh, Vivek Kwatra, Irfan Essa. 2022. Synthesis-Assisted Video Prototyping From a Document. In Proceedings of ACM UIST 2022. [PDF]

2021

• Peggy Chi, Nathan Frey, Katrina Panovich, and Irfan Essa. 2021. Automatic Instructional Video Creation from a Markdown-Formatted Tutorial. In Proceedings of ACM UIST 2021. [PDF]
• Mingyuan Zhong, Gang Li, Peggy Chi, and Yang Li. 2021. HelpViz: Automatic Generation of Contextual Visual Mobile Tutorials from Text-Based Instructions. In Proceedings of ACM UIST 2021. [PDF]
• Anh Truong, Peggy Chi, David Salesin, Irfan Essa, and Maneesh Agrawala. 2021. Automatic Generation of Two-Level Hierarchical Tutorials from Instructional Makeup Videos. In Proceedings of ACM CHI 2021. [PDF]
• Nathan Frey, Peggy Chi, Weilong Yang, and Irfan Essa. 2021. Automatic Non-Linear Video Editing Transfer. In AI for Content Creation (AICC) Workshop, CVPR 2021. [PDF]

2020

• Peggy Chi and Irfan Essa. 2020. Experimenting with Automatic Video Creation from a Web Page. Google AI Blog. [Live Post]
• Peggy Chi, Zheng Sun, Katrina Panovich, and Irfan Essa. 2020. Automatic Video Creation From a Web Page. In Proceedings of ACM UIST 2020. [PDF]
• Peggy Chi and Irfan Essa. 2020. Interactive Visual Description of a Web Page for Smart Speakers. In CUI@CHI Workshop: Mapping Grand Challenges for the Conversational User Interface Community, ACM CHI 2020. [PDF]

2019

• Peggy Chi, Matthew Long, Akshay Gaur, Abhimanyu Deora, Anurag Batra, and Daphne Luong. 2019. Crowdsourcing Images for Global Diversity. In Extended Abstract of ACM MobileHCI 2019 (Industrial Perspectives). [PDF]

2018

• Peggy Chi, Senpo Hu, and Yang Li. 2018. Doppio: Tracking UI Flows and Code Changes for App Development. In Proceedings of ACM CHI 2018. [PDF]
• Peggy Chi, Anurag Batra, and Maxwell Hsu. 2018. Mobile Crowdsourcing in the Wild: Challenges from a Global Community. In Extended Abstract of ACM MobileHCI 2018 (Industrial Perspectives). [PDF]
• James Atwood, D. Sculley, Eric Breck, Yoni Halpern, Erica Greene, Peggy Chi and Anurag Batra. 2018. InclusiveImages: A Challenge of Distributional Skew, Side Information, and Global Inclusion. NeurIPS 2018 Competition Proposal.

2016

• Peggy Chi, Mira Dontcheva, Wilmot Li, Daniel Vogel, and Björn Hartmann. 2016. Authoring Illustrations of Human Movements by Iterative Physical Demonstration. In Proceedings of ACM UIST 2016. [PDF]
• Peggy Chi, Yang Li, and Björn Hartmann. 2016. Enhancing Cross-Device Interaction Scripting with Interactive Illustrations. In Proceedings of ACM CHI 2016. Best Paper Award. [PDF]
• Tao Dong, Michael Nebeling, Dan Afergan, Elizabeth F. Churchill, Jeffrey Nichols, Elizabeth Goodman, Peggy Chi, Yang Li, and Daniel Wigdor. 2016. The Making of Cross-Device Experiences: A Hands-on Workshop. In ACM DIS 2016 Companion.

2015

• Peggy Chi and Yang Li. 2015. Weave: Scripting Cross-Device Wearable Interaction. In Proceedings of ACM CHI 2015. [PDF]

2014

• Peggy Chi, Bongshin Lee, and Steven Drucker. 2014. DemoWiz: Re-Performing Software Demonstrations for a Live Presentation. In Proceedings of ACM CHI 2014. [PDF]

2013

• Peggy Chi, Joyce Liu, Jason Linder, Mira Dontcheva, Wilmot Li, and Björn Hartmann. 2013. DemoCut: Generating Concise Instructional Videos for Physical Demonstrations. In Proceedings of ACM UIST 2013. [PDF]
• Peggy Chi, Sally Ahn, Amanda Ren, Mira Dontcheva, Wilmot Li, and Björn Hartmann. 2012. MixT: Automatic Generation of Step-by-Step Mixed Media Tutorials. In Proceedings of ACM UIST 2012. [PDF]
• Derrick Cheng, Peggy Chi, Taeil Kwak, Björn Hartmann, and Paul Wright. 2013. Body-Tracking Camera Control for Demonstration Videos. In Extended Abstract of ACM CHI 2013 (work-in-progress session). [PDF]

2012

• Peggy Chi, Sally Ahn, Amanda Ren, Björn Hartmann, Mira Dontcheva, and Wilmot Li. 2012. MixT: Automatic Generation of Step-by-Step Mixed Media Tutorials. In Extended Abstract of ACM CHI 2012 (work-in-progress session). [PDF]

2011

• Peggy Chi and Henry Lieberman. 2011. Intelligent Assistance for Conversational Storytelling Using Story Patterns. In Proceedings of ACM IUI 2011. [PDF]
• Peggy Chi and Henry Lieberman. 2011. Raconteur: Integrating Authored and Real-Time Social Media. In Proceedings of ACM CHI 2011. [PDF]

2010 and Prior

• Peggy Chi and Henry Lieberman. 2010. Raconteur: From Intent to Stories. In Adjunct Proceedings of ACM IUI 2010. [PDF]
• Jen-hao Chen, Peggy Chi, Hao-hua Chu, Cheryl Chia-Hui Chen, and Polly Huang, A Smart Kitchen for Nutrition-Aware Cooking, in IEEE Pervasive Computing, vol. 9 (4), Oct 2010, pp. 58-65. [PDF]
• Angela Chang, Peggy Chi, Nick Montfort, Cynthia Breazeal, and Henry Lieberman. 2010. Lessons Learned from Designing Children’s Interactive Narratives, In Proceedings of ELO 2010: the 4th International Conference & Festival of the Electronic Literature Organization. [PDF]
• Peggy Chi, Xiao Xiao, Keywon Chung, and Carnaven Chiu. 2009. Burn Your Memory Away: One-Time Use Video Capture and Storage Device to Encourage Memory Appreciation, In Extended Abstract of ACM CHI 2009. [PDF]
• Keywon Chung, Carnaven Chiu, Xiao Xiao, and Peggy Chi. 2009. Stress OutSourced: A Haptic Social Network via Crowdsourcing. In Extended Abstract of ACM CHI 2009. [PDF]
• Jin-ling Lo, Peggy Chi, Hsin-Yen Wang, Hao-hua Chu, and Seng-cho T. Chou, Pervasive Computing in Play-Based Occupational Therapy for Young Children, in IEEE Pervasive Computing, vol. 8 (3), July 2009, pp. 66-73. [PDF]
• Peggy Chi, Jen-hao Chen, Hao-hua Chu, and Jin-ling Lo. 2008. Enabling Calorie-Aware Cooking in a Smart Kitchen. In Proceedings of Persuasive 2008. [PDF]
• Yu-chen Chang, Jin-ling Lo, Nan-yi Hsu, Chao-ju Huang, Hao-hua Chu, Hsin-yen Wang, Peggy Chi, and Ya-lin Hsieh. 2008. Playful Toothbrush: Ubicomp Technology for Teaching Tooth Brushing to Kindergarten Children. In Proceedings of ACM CHI 2008. [PDF]
• Peggy Chi, Jen-hao Chen, Shih-yen Liu, and Hao-hua Chu. 2007. Designing Smart Living Objects - Enhancing vs. Distracting Traditional Human-Object Interaction. In Proceedings of HCI International 2007. (an invited paper) [PDF] [library]
• Peggy Chi, Jen-hao Chen, Hao-hua Chu, and Bing-yu Chen. 2007. Enabling Nutrition-Aware Cooking in a Smart Kitchen. In Extended Abstract of ACM CHI 2007. People’s Choice Award [PDF]
• Jen-hao Chen, Keng-hao Chang, Peggy Chi, and Hao-hua Chu. 2006. A Smart Kitchen to Promote Healthy Cooking. In Adjunct Proceedings of UbiComp 2006. [PDF]

Dissertation and Theses

• Peggy Chi, Designing Video-Based Interactive Instructions, Ph.D. Dissertation in Computer Science, University of California, Berkeley, USA, August 2016. [PDF] [Source Code] [Berkeley archive] [Advisor: Bjoern Hartmann]
• Peggy Chi, Raconteur: Intelligent Assistance for Conversational Storytelling with Media Libraries, M.S. Thesis in Media Arts and Sciences, Massachusetts Institute of Technology, USA, September 2010. [PDF] [MIT archive] [Advisor: Henry Lieberman]
• Peggy Chi, Enabling Calorie-Aware Cooking in a Smart Kitchen, M.S. Thesis in Computer Science, National Taiwan University, Taiwan, July 2008. [PDF] [Slides] [Advisor: Hao-hua Chu]