| Screen recognition: Creating accessibility metadata for mobile applications from pixels X Zhang, L De Greef, A Swearngin, S White, K Murray, L Yu, Q Shan, ... Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems …, 2021 | 161 | 2021 |
| Rewire: Interface design assistance from examples A Swearngin, M Dontcheva, W Li, J Brandt, M Dixon, AJ Ko Proceedings of the 2018 CHI conference on human factors in computing systems …, 2018 | 73 | 2018 |
| Modeling mobile interface tappability using crowdsourcing and deep learning A Swearngin, Y Li Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems …, 2019 | 70 | 2019 |
| Scout: Rapid exploration of interface layout alternatives through high-level design constraints A Swearngin, C Wang, A Oleson, J Fogarty, AJ Ko Proceedings of the 2020 CHI conference on human factors in computing systems …, 2020 | 67 | 2020 |
| Ferret-ui: Grounded mobile ui understanding with multimodal llms K You, H Zhang, E Schoop, F Weers, A Swearngin, J Nichols, Y Yang, ... European Conference on Computer Vision, 240-255, 2025 | 50 | 2025 |
| Towards complete icon labeling in mobile applications J Chen, A Swearngin, J Wu, T Barik, J Nichols, X Zhang Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems …, 2022 | 41 | 2022 |
| Understanding screen relationships from screenshots of smartphone applications S Feiz, J Wu, X Zhang, A Swearngin, T Barik, J Nichols Proceedings of the 27th International Conference on Intelligent User …, 2022 | 29 | 2022 |
| Human performance regression testing A Swearngin, MB Cohen, BE John, RKE Bellamy 2013 35th International Conference on Software Engineering (ICSE), 152-161, 2013 | 20 | 2013 |
| User interface creation from screenshots ME Dixon, LA Dontcheva, JR Brandt, AM Swearngin US Patent 10,360,473, 2019 | 19 | 2019 |
| Versioning for mashups–an exploratory study SK Kuttal, A Sarma, A Swearngin, G Rothermel End-User Development: Third International Symposium, IS-EUD 2011, Torre …, 2011 | 19 | 2011 |
| Never-ending learning of user interfaces J Wu, R Krosnick, E Schoop, A Swearngin, JP Bigham, J Nichols Proceedings of the 36th Annual ACM Symposium on User Interface Software and …, 2023 | 16 | 2023 |
| Axnav: Replaying accessibility tests from natural language M Taeb, A Swearngin, E Schoop, R Cheng, Y Jiang, J Nichols Proceedings of the CHI Conference on Human Factors in Computing Systems, 1-16, 2024 | 15 | 2024 |
| Linking graphical user interface testing tools and human performance modeling to enable usability assessment RKE Bellamy, MB Cohen, BE John, P Santhanam, AM Swearngin US Patent 8,903,691, 2014 | 15 | 2014 |
| Genie: Input Retargeting on the Web through Command Reverse Engineering A Swearngin, AJ Ko, J Fogarty Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems …, 2017 | 14 | 2017 |
| ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations Y Jiang, E Schoop, A Swearngin, J Nichols arXiv preprint arXiv:2310.04869, 2023 | 12 | 2023 |
| Scraps: Enabling mobile capture, contextualization, and use of document resources A Swearngin, S Iqbal, V Poznanski, M Encarnación, PN Bennett, J Teevan Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems …, 2021 | 12 | 2021 |
| Easing the generation of predictive human performance models from legacy systems A Swearngin, M Cohen, B John, R Bellamy Proceedings of the SIGCHI Conference on Human Factors in Computing Systems …, 2012 | 12 | 2012 |
| Screen correspondence: Mapping interchangeable elements between uis J Wu, A Swearngin, X Zhang, J Nichols, JP Bigham arXiv preprint arXiv:2301.08372, 2023 | 8 | 2023 |
| Extracting replayable interactions from videos of mobile app usage J Chen, A Swearngin, J Wu, T Barik, J Nichols, X Zhang arXiv preprint arXiv:2207.04165, 2022 | 8 | 2022 |
| Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels. Association for Computing Machinery, New York, NY, USA X Zhang, L de Greef, A Swearngin, S White, K Murray, L Yu, Q Shan, ... | 8 | 2021 |
Jeffrey NicholsAppleVerified email at jeffreynichols.com
