Publications

Journal Articles

[J4] Jeffrey Saltz, Michael Skirpan, Casey Fiesler, Micha Gorelick, Tom Yeh, Robert Heckman, Neil DeWard, and Nathan Beard. “Integrating Ethics within Machine Learning Courses,” To appear in the ACM Transactions on Computing Education (TOCE). 2019.

[J3] Mohammed Fathy, Vishal Patel, Tom Yeh, Yangmuzi Zhang, Rama Chellappa and Larry Davis. 2014. “Screen-based active user authentication,” Pattern Recognition Letters , 122--147, 26 pages.

[J2] Vishal Patel, Tom Yeh, Mohammed Fathy, Yangmuzi Zhang, Yan Chen, Rama Chellappa and Larry Davis. 2013. “Screen Fingerprints: A Novel Modality for Active Authentication,” IT Professional , 38--42, 5 pages.

[J1] Kimberly Voll, Tom Yeh and Veronica Dahl. 2001. “An Assumptive Logic Programming Methodology for Parsing,” International Journal on Artificial Intelligence Tools , 11--18, 8 pages.

Refereed Conference Papers

[CP52] Layne Jackson Hubbard*, Yifan Chen, Eliana Colunga, Pilyoung Kim, Tom Yeh. 2021. Child-Robot Interaction to Integrate Reflective Storytelling Into Creative Play. In Proceedings of the 2021 ACM Conference on Creativity and Cognition.

[CP51] Layne Jackson Hubbard*, Shanli Ding, Vananh Le, Pilyoung Kim, Tom Yeh. (2021, July). Voice Design to Support Young Children’s Agency in Child-Agent Interaction. In Proceedings of 2021 ACM Conference on Conversational User Interfaces.

[CP50] Nathan W Davis, Kristina M Shiroma, Bo Xie, Tom Yeh, Xu Han*, Atami S. De Main. 2021. "Designing eHealth tutorials with and for older adults," In Proceedings of the 84th Annual Meeting of the American Society for Information Science and Technology (ASIST). 13 pages.

[CP49] Xu Han*, Michelle Zhou, Matthew Turner, Tom Yeh. 2021. "Designing Effective Interview Chatbots: Automatic Chatbot Profiling and Design Suggestion Generation for Chatbot Debugging," In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems , Article 389, 15 pages, acceptance rate: 26%.

[CP48] Abigale Stangl*, Ann Cunningham , Lou Ann Blake, and Tom Yeh. 2019. “Defining Problems Of Practices To Advance Systems for Inclusive Tactile Media Consumption and Production,” In Proceedings of the 21st International ACM SIGACCESS Conference on Computers and Accessibility, 10 pages.

[CP47] Ryo Suzuki*, Clement Zheng, Yasuaki Kakehi, Mark Gross, Ellen Do, Tom Yeh, and Daniel Leithinger. 2019. “ShapeBots: Shape-changing Swarm Robots Towards Ubiquitous Shape-changing Interfaces,” In Proceedings of the 32nd ACM Symposium on User Interface Software and Technology, 10 pages.

[CP46] Ryo Suzuki*, Junichi Yamaoka, Tom Yeh, Mark Gross, Yoshihiro Kawahara and Yasuaki Kakehi. 2018. “Dynablock: Dynamic 3D Printing for Instant and Reconstructable Shape Formation,” In Proceedings of the 31st ACM Symposium on User Interface Software and Technology, 99--111, 10 pages, acceptance rate: 21%.

[CP45] Abigale Stangl*, Esha Kothari, Suyog Jain, Tom Yeh, Kristen Grauman and Danna Gurari. 2018. "BrowseWithMe: An Online Clothes Shopping Assistant for People with Visual Impairments," In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility, 107--118, 10 pages, acceptance rate: 26%.

[CP44] Jeeeun Kim*, Clement Zheng, Haruki Takahashi, Mark Gross, Daniel Ashbrook and Tom Yeh. 2018. “Expanding & Supporting Workflows Towards Compositional 3D Printing,” In Proceedings of the 2018 ACM Symposium on Computational Fabrication, 10 pages.

[CP43] Mike Skirpan*, Nathan Beard, Srinjita Bhaduri, Casey Fiesler and Tom Yeh. 2018. “Ethics Education in Context: A Case Study of Novel Ethics Activities for the CS Classroom,” In Proceedings of the 49th ACM Technical Symposium on Computer Science Education , 940--945, 6 pages, acceptance rate: 35%, Third Best Paper Award.

[CP42] Mike Skirpan*, Jacqueline Cameron* and Tom Yeh. 2018. "Quantified Self: An Interdisciplinary Immersive Theater Project Supporting a Collaborative Learning Environment for CS Ethics," In Proceedings of the 49th ACM Technical Symposium on Computer Science Education , 946--951, 6 pages, acceptance rate: 35%.

[CP41] Tom Yeh and Jeeeun Kim*. 2018. "CraftML: 3D Modeling is Web Programming," In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 527--538, 12 pages, acceptance rate: 26%.

[CP40] Ryo Suzuki*, Jun Kato, Mark Gross and Tom Yeh. 2018. "Reactile: Programming Swarm User Interfaces through Direct Physical Manipulation," In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 199--210, 12 pages, acceptance rate: 26%.

[CP39] Mike Skirpan*, Jacqueline Cameron* and Tom Yeh. 2018. "More Than a Show: Using Personalized Immersive Theater to Educate and Engage the Public in Technology Ethics," In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 464--476, 13 pages, acceptance rate: 26%.

[CP38] Mike Skirpan*, Tom Yeh and Casey Fiesler. 2018. "What's at Stake: Characterizing Risk Perceptions of Emerging Technologies," In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 70--81, 12 pages, acceptance rate: 26%.

[CP37] Anhong Guo, Jeeeun Kim*, Xiang 'Anthony' Chen, Tom Yeh, Scott Hudson and Jennifer Mankoff. 2017. "Facade: Auto-generating Tactile Interfaces to Appliances," In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 5826--5838, 13 pages, acceptance rate: 25%.

[CP36] Jeeeun Kim*, Anhong Guo, Tom Yeh, Scott Hudson and Jennifer Mankoff. 2017. "Understanding Uncertainty in Measurement and Accommodating its Impact in 3D Modeling and Printing," In Proceedings of the 2017 Conference on Designing Interactive Systems, 1067--1078, 12 pages, acceptance rate: 22%.

[CP35] Ryo Suzuki*, Abigale Stangl*, Mark Gross and Tom Yeh. 2017. "FluxMarker: Enhancing Tactile Graphics with Dynamic Tactile Markers," In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility, 190--199, 10 pages, acceptance rate: 22%.

[CP34] Abigale Stangl*, Rebecca Johnson, Arum Putri Budiani and Tom Yeh. 2016. "Inclusive Design of 3D Printed Tactile Picture Books in Indonesia," In FabLearn Europe, 8 pages.

[CP33] Claudia Daudén Roquet+, Jeeeun Kim* and Tom Yeh. 2016. "3D Folded PrintGami: Transforming Passive 3D Printed Objects to Interactive by Inserted Paper Origami Circuits," In Proceedings of the 11th ACM SIGCHI Conference on Designing Interactive Systems (DIS), 187--191, 4 pages, acceptance rate: 26%.

[CP32] Patrick Carrington, Shannon Hosmer, Tom Yeh, Amy Hurst and Shaun Kane. 2015. "Like This, But Better: Supporting Novices' Design and Fabrication of 3D Models Using Existing Objects," In Proceedings of the iConference, 1--11, 11 pages, acceptance rate: 36%.

[CP31] Mike Skirpan* and Tom Yeh. 2015. "Beyond the Flipped Classroom: Learning by Doing Through Challenges and Hack-a-thons," In Proceedings of the ACM Technical Symposium on Computer Science Education, 212--217, 6 pages, acceptance rate: 36%.

[CP30] Jeeeun Kim* and Tom Yeh. 2015. "Toward 3D-Printed Movable Tactile Pictures for Children with Visual Impairments," In Proceedings of the ACM Conference on Human Factors in Computing Systems , 2815--2824, 10 pages, acceptance rate: 23%.

[CP29] Khalid Alharbi* and Tom Yeh. 2015. "Collect, Decompile, Extract, Stats, and Diff: Mining Design Pattern Changes in Android Apps," In Proceedings of the International Conference on Human-Computer Interaction with Mobile Devices and Services Companion, 515--524, 10 pages, acceptance rate: 22%, Best Paper Honorable Mention.

[CP28] Abigale Stangl*, Caleb Hsu+ and Tom Yeh. 2015. "Transcribing Across the Senses: Community Efforts to Create 3D Printable Accessible Tactile Pictures for Young Children with Visual Impairments," In Proceedings of the International ACM SIGACCESS Conference on Computers and Accessibility, 127--137, 10 pages, acceptance rate: 26%.

[CP27] Abigale Stangl*, Brian Jernigan and Tom Yeh. 2015. "Write, Design, and 3D Print Tactile Stories for Visually Impaired: Critical Making in a Middle School Classroom," In Proceedings of the Conference on Creativity and Fabrication in Education, 4 pages.

[CP26] Jenny Preece, Kazjon Grace, Carol Boston, Mary Lou Maher, Tom Yeh and Abigale Stangl*. 2014. "Crowdsourcing Design and Citizen Science Data using a tabletop in a nature preserve," In European Conference on Social Media, 413--420, 8 pages, acceptance rate: 35%.

[CP25] Kazjon Grace, Mary Lou Maher, Jenny Preece, Tom Yeh, Abigale Stangl* and Carol Boston. 2014. "A process model for crowdsourcing design: A case study in citizen science," In Design Computing and Cognition, 245--22, 18 pages, acceptance rate: 29%.

[CP24] Abigale Stangl*, Jeeeun Kim* and Tom Yeh. 2014. "3D Printed Tactile Picture Books for Children with Visual Impairments: A Design Probe," In Proceedings of the International Conference on Interaction Design and Children, 321--324, 4 pages, acceptance rate: 43%.

[CP23] Mike Kasper, Nikolaus Correll and Tom Yeh. 2014. "Abstracting Perception and Manipulation in End-User Robot Programming using Sikuli," In IEEE International Conference on Technologies for Practical Robot Applications, 1--6, 6 pages.

[CP22] Paul Givens, Aleksandar Chakarov, Sriram Sankaranarayanan and Tom Yeh. 2013. "Exploring the internal state of user interfaces by combining computer vision techniques with grammatical inference," In NIER, 1165--1168 , 4 pages, acceptance rate: 22%.

[CP21] Katharina Reinecke, Tom Yeh, Luke Miratrix, Rahmatri Mardiko, Yuechen Zhao, Jenny Liu and Krzysztof Z. Gajos. 2013. "Predicting Users' First Impressions of Website Aesthetics With a Quantification of Perceived Visual Complexity and Colorfulness," In Proceedings of the ACM Conference on Human Factors in Computing Systems , 2049--2058 , 10 pages, acceptance rate: 20%, Best Paper Honorable Mention.

[CP20] Bo Xie, Tom Yeh, Greg Walsh, Ivan Watkin and Man Huang. 2012. "Co-designing an e-health tutorial for older adults," In Proceedings of the iConference, 240--247, 8 pages, acceptance rate: 32%.

[CP19] Jose San Pedro, Tom Yeh and Nuria Oliver. 2012. "Leveraging user comments for aesthetic aware image search reranking," In Proceedings of the International World Wide Web Conference, 439--448 , 10 pages, acceptance rate: 12%.

[CP18] Tsung-Hsiang Chang, Tom Yeh and Rob Miller. 2011. "Correlating the Visual Representation of User Interfaces with their Internal Structures and Metadata," In Proceedings of the ACM Symposium on User Interface Software and Technology, 245--256, 10 pages, acceptance rate: 25%.

[CP17] Tom Yeh, Tsung-Hsiang Chang, Bo Xie, Greg Walsh, Ivan Watkin, Krist Wongsuphasawat, Man Huang, Larry Davis and Benjamin Bederson. 2011. "Creating Contextual Help for GUIs Using Screenshots," In Proceedings of the ACM Symposium on User Interface Software and Technology, 145--154 , 10 pages, acceptance rate: 25%.

[CP16] Bo Xie, Tom Yeh, Greg Walsh, Ivan Watkin and Man Huang. 2011. "Co-designing Contextual Tutorials for Older Adults on Searching Health Information on the Internet," In Proceedings of the 74th Annual Meeting of the American Society for Information Science and Technology, 1--4, 4 pages.

[CP15] Tom Yeh, Brandyn White, Jose San Pedro, Boriz Katz and Larry Davis. 2011. "A Case for Query by Image and Text Content: Searching Computer Help Using Screenshots and Keywords," In Proceedings of the International World Wide Web Conference, 775--784, 10 pages, acceptance rate: 12%.

[CP14] Jeffery Bigham, Chandrika Jayant, Hanjie Ji, Greg Little, Andrew Miller, Rob Miller, Robin Miller, Aubrey Tatarowicz, Brandyn White, Samual White and Tom Yeh. 2010. "VizWiz: Nearly Real-time Answers to Visual Questions," In Proceedings of the ACM symposium on User interface software and technology, 333--342 , 10 pages, acceptance rate: 18%, Best Paper Award.

[CP13] Aniruddha Kembhavi, Tom Yeh and Larry Davis. 2010. "Why Did the Person Cross the Road (There)? Scene Understanding using Probabilistic Logic Models and Common Sense Reasoning," In Proceedings of the 11th European Conference on Computer Vision, 693--706, 14 pages, acceptance rate: 24.40%.

[CP12] Tsung-Hsiang Chang, Tom Yeh and Rob Miller. 2010. "GUI Testing Using Computer Vision," In Proceedings of the ACM Conference on Human Factors in Computing Systems , 1535--1544 , 10 pages, acceptance rate: 22%.

[CP11] Tom Yeh, Tsung-Hsiang Chang and Rob Miller. 2009. "Sikuli: Using GUI Screenshots for Search and Automation," In Proceedings of the ACM symposium on User interface software and technology, 183--192 , 8 pages, acceptance rate: 18%, Best Student Paper Award.

[CP10] Tom Yeh, John Lee and Trevor Darrell. 2009. "Fast Concurrent Object Localization and Recognition," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 280-- 287, 8 pages, acceptance rate: 26%.

[CP9] Tom Yeh, John Lee and Trevor Darrell. 2008. "Photo-based Question Answering," In Proceedings of the ACM International Conference on Multimedia, 389--398, 10 pages, acceptance rate: 20%.

[CP8] Tom Yeh and Trevor Darrell. 2008. "Multimodal Question Answering for Mobile Devices," In Proceedings of the ACM International Conference on Intelligent user interfaces, 405--408, 4 pages, acceptance rate: 27%.

[CP7] Tom Yeh and Trevor Darrell. 2008. "Dynamic Visual Category Learning," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1--8, 8 pages, acceptance rate: 31%.

[CP6] Tom Yeh, John Lee and Trevor Darrell. 2007. "Adaptive Vocabulary Forests for Dynamic Indexing and Category Learning," In Proceedings of the IEEE International Conference on Computer Vision, 1--8, 8 pages, acceptance rate: 23%.

[CP5] Tom Yeh, Kristen Grauman, Konrad Tollmar and Trevor Darrell. 2005. "A Picture is Worth a Thousand Keywords: Image-based Object Search on a Mobile Platform," In Proceedings of the ACM Conference on Human Factors in Computing Systems , 2025--2028, 4 pages.

[CP4] Tom Yeh and Trevor Darrell. 2005. "DoubleShot: An Interactive User-Aided Segmentation Tool," In Proceedings of the ACM International Conference on Intelligent user interfaces, 287--289, 3 pages, acceptance rate: 22%.

[CP3] Konrad Tollmar, Tom Yeh and Trevor Darrell. 2004. "IDeixis: Image-based Deixis for Finding Location-based Information," In Proceedings of the International Conference on Human-Computer Interaction with Mobile Devices and Services Companion, 286--299, 14 pages.

[CP2] Tom Yeh and Trevor Darrell. 2004. "Searching the Web with Mobile Images for Location Recognition," In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 76--81, 6 pages, acceptance rate: 23%.

[CP1] Kimberly Voll, Tom Yeh and Veronica Dahl. 2000. "An Assumptive Logic Programming Methodology for Parsing," In Proceedings of the IEEE International Conference on Tools with Artificial Intelligence , 8 pages.

Refereed Workshop and Other Publications

[W16] Xu Han* and Tom Yeh. 2020. "How does your Alexa behave?: Evaluating Voice Applications by Design GuidelinesUsing an Automatic Voice Crawler," In Proceedings of the 25th International Conference on Intelligent User Interfaces Companion 2nd workshop on user-aware conversational agents , 10 pages.

[W15] Tom Yeh, Bridget Dalton, and Eleanor Haberl. 2019. “Integrating AI Ethics into Robotics Learning Experiences,” In Proceedings of the the 20th International Conference on Artificial Intelligence in Education - Workshop on K12 AI education. 2 pages.

[W14] Xu Han* and Tom Yeh. 2019. “Evaluating Voice Applications by User-Aware Design Guidelines Using an Automatic Voice Crawler,” In Proceedings of the 23rd International Conference on Intelligent User Interfaces Workshop on User-Aware Conversational Agents. 4 pages.

[W13] Layne Hubbard*, Boskin Erkocevic, Dylan Cassady, Chen Hao Cheng, Andrea Chamorro and Tom Yeh. 2018. “MindScribe: Toward Intelligently Augmented Interactions in Highly Variable Early Childhood Environments,” In Proceedings of the 23rd International Conference on Intelligent User Interfaces Companion. 2 pages.

[W12] Jeeeun Kim*, Haruki Takahashi, Homei Miyashita, Michelle Annett and Tom Yeh. 2017. "Machines as Co-Designers: A Fiction on the Future of Human-Fabrication Machine Interaction," In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 790--805, 16 pages.

[W11] Mike Skirpan* and Tom Yeh. 2017. "Designing a Moral Compass for the Future of Computer Vision Using Speculative Analysis," In Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops. 10 pages.

[W10] Jeeeun Kim*, Hyunjoo Oh and Tom Yeh. 2015. "A Study to Empower Children to Design Movable Tactile Pictures for Children with Visual Impairments," In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction, 703--708, 6 pages, acceptance rate: 55%.

[W9] Esther Vasiete+ and Tom Yeh. 2015. "Multimodal Frustration Detection on Smartphones," In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, 1307--1312, 6 pages.

[W8] Abigale Stangl*, Jeeeun Kim* and Tom Yeh. 2014. "Technology to Support Emergent Literacy Skills in Young Children with Visual Impairments," In Proceedings of the ACM Conference on Human Factors in Computing Systems , 1249--1254, 6 pages, acceptance rate: 49%.

[W7] Jeeeun Kim*, Abigale Stangl*, Ann Eisenberg and Tom Yeh. 2014. "Evaluating Tactile User Experience with Tactile Picture Books for Children with Visual Impairment," In "Touch Me" - Tactile Evaluation Methods Workshop, 6 pages.

[W6] Khalid Alharbi*, Sam Blackshear, Emily Kowalczyk, Atif Memon, Evan Chang and Tom Yeh. 2014. "Android apps consistency scrutinized," In Proceedings of the ACM Conference on Human Factors in Computing Systems , 2347--2352, 6 pages, acceptance rate: 49%.

[W5] Jeeeun Kim*, Abigale Stangl*, Ann Eisenberg and Tom Yeh. 2014. "Tactile Picture Books for Young Children with Visual Impairment," In Proceedings of the International Conference on Tangible, Embedded, and Embodied Interaction, 6 pages, acceptance rate: 62%.

[W4] Daozheng Chen, Mustafa Bilgic, Lise Getoor, David Jacob, Lily Mihalkova and Tom Yeh. 2011. "Active Inference for Retrieval in Camera Networks," In Proceedings of the IEEE Workshop on Person Oriented Vision, 13--20, 8 pages.

[W3] Brandyn White, Tom Yeh and Larry Davis. 2010. "Web-Scale Computer Vision using MapReduce for Multimedia Data Mining," In Proceedings of the KDD Multimedia Data Mining Workshop, 1--10, 10 pages, acceptance rate: 58%.

[W2] Tom Yeh, John Lee and Trevor Darrell. 2008. "Scalable Classifiers for Internet Vision Tasks," In Proceedings of the First IEEE Workshop on Internet Vision , 1--8, 8 pages.

[W1] Justin Mazzola Paluska, David Saff, Tom Yeh and Kathryn Chen. 2003. "Footloose: A Case for Physical Eventual Consistency and Selective Conflict Resolution," In Proceedings of the 5th IEEE Workshop on Mobile Computing Systems and Applications , 10 pages.