Author: Shumin Zhai
Ph.D
Shumin Zhai is a Human-Computer Interaction research scientist at Google Inc. Prior to joning Google Research he worked at the IBM Almaden Research Center from 1996 to 2011. He is interested in both foundational issues of user interfaces and practical product and service innovations. He originated and led the ShapeWriter project that pioneered the touch screen gesture keyboard paradigm. He has published over 100 research papers and received 30 patents. He is active in the academic community and is currently the Editor-in-Chief of ACM Transactions on Computer-Human Interaction. He has been a visiting professor and lectured at universities in the US, Europe and China. He is a Fellow of the ACM and a Member of the CHI Academy.
Publications
Co-authors
Productive Colleagues
Publications
Bi, Xiaojun, Smith, Barton A., Zhai, Shumin (2012): Multilingual Touchscreen Keyboard Design and Optimization. In Eminds – International Journal of Human Computer Interaction, 27 (4) pp. 352-382. https://www.tandfonline.com/doi/abs/10.1080/07370024.2012.678241
Yin, Jibin, Ren, Xiangshi, Zhai, Shumin (2010): Pen pressure control in trajectory-based interaction. In Behaviour and Information Technology, 29 (2) pp. 137-148. https://www.informaworld.com/10.1080/01449290902904733
Apitz, Georg, Guimbretiere, Francois, Zhai, Shumin (2010): Foundations for designing and evaluating user interfaces based on the crossing paradigm. In ACM Transactions on Computer-Human Interaction, 17 (2) pp. 9. https://dx.doi.org/10.1145/1746259.1746263
Zhai, Shumin, Kristensson, Per-Ola, Smith, Barton A. (2005): In search of effective text input interfaces for off the desktop computing. In Interacting with Computers, 17 (3) pp. 229-250. https://dx.doi.org/10.1016/j.intcom.2003.12.007
Ingmarsson, Magnus, Dinka, David, Zhai, Shumin (2004): TNT: a numeric keypad based text input method. In: Dykstra-Erickson, Elizabeth, Tscheligi, Manfred (eds.) Proceedings of ACM CHI 2004 Conference on Human Factors in Computing Systems April 24-29, 2004, Vienna, Austria. pp. 639-646. https://doi.acm.org/10.1145/985692.985773
Lee, Paul Ung-Joon, Zhai, Shumin (2004): Top-down learning strategies: can they facilitate stylus keyboard learning?. In International Journal of Human-Computer Studies, 60 (5) pp. 585-598.
Zhai, Shumin (2004): Characterizing computer input with Fitts\' law parameters -- the information and non-infor. In International Journal of Human-Computer Studies, 61 (6) pp. 791-809. https://dx.doi.org/10.1016/j.ijhcs.2004.09.006
Zhai, Shumin, Kong, Jing, Ren, Xiangshi (2004): Speed-accuracy tradeoff in Fitts\' law tasks -- on the equivalency of actual and nominal p. In International Journal of Human-Computer Studies, 61 (6) pp. 823-856. https://dx.doi.org/10.1016/j.ijhcs.2004.09.007
Zhai, Shumin, Accot, Johnny, Woltjer, Rogier (2004): Human Action Laws in Electronic Virtual Worlds - An Empirical Study of Path Steering Perfo. In Presence: Teleoperators and Virtual Environments, 13 (2) pp. 113-127.
Zhai, Shumin, Kristensson, Per-Ola (2003): Shorthand writing on stylus keyboard. In: Cockton, Gilbert, Korhonen, Panu (eds.) Proceedings of the ACM CHI 2003 Human Factors in Computing Systems Conference April 5-10, 2003, Ft. Lauderdale, Florida, USA. pp. 97-104.
Albinsson, Par-Anders, Zhai, Shumin (2003): High precision touch screen interaction. In: Cockton, Gilbert, Korhonen, Panu (eds.) Proceedings of the ACM CHI 2003 Human Factors in Computing Systems Conference April 5-10, 2003, Ft. Lauderdale, Florida, USA. pp. 105-112.
Zhai, Shumin, Conversy, Stephane, Beaudouin-Lafon, Michel, Guiard, Yves (2003): Human on-line response to target expansion. In: Cockton, Gilbert, Korhonen, Panu (eds.) Proceedings of the ACM CHI 2003 Human Factors in Computing Systems Conference April 5-10, 2003, Ft. Lauderdale, Florida, USA. pp. 177-184.
Accot, Johnny, Zhai, Shumin (2003): Refining Fitts' law models for bivariate pointing. In: Cockton, Gilbert, Korhonen, Panu (eds.) Proceedings of the ACM CHI 2003 Human Factors in Computing Systems Conference April 5-10, 2003, Ft. Lauderdale, Florida, USA. pp. 193-200.
Zhai, Shumin (2003): What\'s in the eyes for attentive input. In Communications of the ACM, 46 (3) pp. 34-39. https://dl.acm.org/doi/10.1145/636772.636795
Zhai, Shumin, Sue, Alison, Accot, Johnny (2002): Movement model, hits distribution and learning in virtual keyboarding. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 17-24.
Accot, Johnny, Zhai, Shumin (2002): More than dotting the i's -- foundations for crossing-based interfaces. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 73-80.
Zhai, Shumin, Hunter, Michael, Smith, Barton A. (2002): Performance Optimization of Virtual Keyboards. In Human-Computer Interaction, 17 (2) pp. 229-269.
Accot, Johnny, Zhai, Shumin (2001): Scale Effects in Steering Law Tasks. In: Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA. pp. 1-8. https://www.acm.org/pubs/articles/proceedings/chi/365024/p1-accot/p1-accot.pdf
Wang, Jingtao, Zhai, Shumin, Su, Hui (2001): Chinese Input with Keyboard and Eye-Tracking: An Anatomical Study. In: Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA. pp. 349-356. https://www.acm.org/pubs/articles/proceedings/chi/365024/p349-wang/p349-wang.pdf
Zhai, Shumin, Hunter, Michael, Smith, Barton A. (2000): The Metropolis Keyboard -- An Exploration of Quantitative Techniques for Virtual Keyboard . In: Ackerman, Mark S., Edwards, Keith (eds.) Proceedings of the 13th annual ACM symposium on User interface software and technology November 06 - 08, 2000, San Diego, California, United States. pp. 119-128. https://acm.org/pubs/articles/proceedings/uist/354401/p119-zhai/p119-zhai.pdf
Zhai, Shumin, Morimoto, Carlos, Ihde, Steven, Center, Research (1999): Manual and Gaze Input Cascaded (MAGIC) Pointing. In: Altom, Mark W., Williams, Marian G. (eds.) Proceedings of the ACM CHI 99 Human Factors in Computing Systems Conference May 15-20, 1999, Pittsburgh, Pennsylvania. pp. 246-253. https://www.acm.org/pubs/articles/proceedings/chi/302979/p246-zhai/p246-zhai.pdf
Accot, Johnny, Zhai, Shumin (1999): Performance Evaluation of Input Devices in Trajectory-Based Tasks: An Application of The S. In: Altom, Mark W., Williams, Marian G. (eds.) Proceedings of the ACM CHI 99 Human Factors in Computing Systems Conference May 15-20, 1999, Pittsburgh, Pennsylvania. pp. 466-472. https://www.acm.org/pubs/articles/proceedings/chi/302979/p466-accot/p466-accot.pdf
Zhai, Shumin, Kandogan, Eser, Smith, Barton A., Selker, Ted (1999): In Search of the 'Magic Carpet': Design and Experimentation of a Bimanual 3D Navigation In. In J. Vis. Lang. Comput., 10 (1) pp. 3-17.
Zhai, Shumin, Milgram, Paul (1998): Quantifying Coordination in Multiple DOF Movement and its Application to Evaluating 6 DOF . In: Karat, Clare-Marie, Lund, Arnold, Coutaz, Joëlle, Karat, John (eds.) Proceedings of the ACM CHI 98 Human Factors in Computing Systems Conference April 18-23, 1998, Los Angeles, California. pp. 320-327. https://www.acm.org/pubs/articles/proceedings/chi/274644/p320-zhai/p320-zhai.pdf
Ark, Wendy, Dryer, D. Christopher, Selker, Ted, Zhai, Shumin (1998): Representation Matters: The Effect of 3D Objects and a Spatial Metaphor in a Graphical Use. In: Johnson, Hilary, Nigay, Laurence, Roast, C. R. (eds.) Proceedings of the Thirteenth Conference of the British Computer Society Human Computer Interaction Specialist Group - People and Computers XIII August 1-4, 1998, Sheffield, UK. pp. 209-219.
Leganchuk, Andrea, Zhai, Shumin, Buxton, Bill (1998): Manual and Cognitive Benefits of Two-Handed Input: An Experimental Study. In ACM Transactions on Computer-Human Interaction, 5 (4) pp. 326-359. https://www.acm.org/pubs/articles/journals/tochi/1998-5-4/p326-leganchuk/p326-leganchuk.pdf
Accot, Johnny, Zhai, Shumin (1997): Beyond Fitts' Law: Models for Trajectory-Based HCI Tasks. In: Pemberton, Steven (eds.) Proceedings of the ACM CHI 97 Human Factors in Computing Systems Conference March 22-27, 1997, Atlanta, Georgia. pp. 295-302. https://www.acm.org/pubs/articles/proceedings/chi/258549/p295-accot/p295-accot.pdf
Salem, Chris, Zhai, Shumin (1997): An Isometric Tongue Pointing Device. In: Pemberton, Steven (eds.) Proceedings of the ACM CHI 97 Human Factors in Computing Systems Conference March 22-27, 1997, Atlanta, Georgia. pp. 538-539. https://www.acm.org/pubs/articles/proceedings/chi/258549/p538-salem/p538-salem.pdf
Zhai, Shumin, Milgram, Paul, Buxton, Bill (1996): The Influence of Muscle Groups on Performance of Multiple Degree-of-Freedom Input. In: Tauber, Michael J., Bellotti, Victoria, Jeffries, Robin, Mackinlay, Jock D., Nielsen, Jakob (eds.) Proceedings of the ACM CHI 96 Human Factors in Computing Systems Conference April 14-18, 1996, Vancouver, Canada. pp. 308-315. https://www.acm.org/sigchi/chi96/proceedings/papers/Zhai/sz_txt.htm
Zhai, Shumin, Buxton, Bill, Milgram, Paul (1996): The Partial-Occlusion Effect: Utilizing Semitransparency in 3D Human-Computer Interaction. In ACM Transactions on Computer-Human Interaction, 3 (3) pp. 254-284. https://www.acm.org/pubs/articles/journals/tochi/1996-3-3/p254-zhai/p254-zhai.pdf
Zhai, Shumin, Buxton, Bill, Milgram, Paul (1994): The "Silk Cursor": Investigating Transparency for 3D Target Acquisition. In: Adelson, Beth, Dumais, Susan, Olson, Judith S. (eds.) Proceedings of the ACM CHI 94 Human Factors in Computing Systems Conference April 24-28, 1994, Boston, Massachusetts. pp. 459-464. https://www.acm.org/pubs/articles/proceedings/chi/191666/p459-zhai/p459-zhai.pdf
Drascic, David, Grodski, Julius J., Milgram, Paul, Ruffo, Ken, Wong, Peter, Zhai, Shumin (1993): ARGOS: A Display System for Augmenting Reality. In: Ashlund, Stacey, Mullet, Kevin, Henderson, Austin, Hollnagel, Erik, White, Ted (eds.) Proceedings of the ACM CHI 93 Human Factors in Computing Systems Conference April 24-29, 1993, Amsterdam, The Netherlands. pp. 521. https://www.acm.org/pubs/articles/proceedings/chi/169059/p521-drascic/p521-drascic.pdf
Waterworth, John A., Chignell, Mark, Zhai, Shumin (1993): From Icons to Interface Models: Designing Hypermedia from the Bottom Up. In International Journal of Man-Machine Studies, 39 (3) pp. 453-472.
Fitzmaurice, George W., Zhai, Shumin, Chignell, Mark (1993): Virtual Reality for Palmtop Computers. In ACM Transactions on Information Systems, 11 (3) pp. 197-218. https://www.acm.org/pubs/articles/journals/tois/1993-11-3/p197-fitzmaurice/p197-fitzmaurice.pdf
Kristensson, Per-Ola, Zhai, Shumin (2004): SHARK{sup:2}: a large vocabulary shorthand writing system for pen-based computers. In: Proceedings of the 2004 ACM Symposium on User Interface Software and Technology , 2004, . pp. 43-52. https://doi.acm.org/10.1145/1029632.1029640
Yin, Min, Zhai, Shumin (2005): Dial and see: tackling the voice menu navigation problem with cross-device user experience. In: Proceedings of the 2005 ACM Symposium on User Interface Software and Technology , 2005, . pp. 187-190. https://doi.acm.org/10.1145/1095034.1095066
Yin, Min, Zhai, Shumin (2006): The benefits of augmenting telephone voice menu navigation with visual browsing and search. In: Proceedings of ACM CHI 2006 Conference on Human Factors in Computing Systems , 2006, . pp. 319-328. https://doi.acm.org/10.1145/1124772.1124821
Kristensson, Per-Ola, Zhai, Shumin (2007): Command strokes with and without preview: using pen gestures on keyboard for command selec. In: Proceedings of ACM CHI 2007 Conference on Human Factors in Computing Systems , 2007, . pp. 1137-1146. https://doi.acm.org/10.1145/1240624.1240797
Cao, Xiang, Zhai, Shumin (2007): Modeling human performance of pen stroke gestures. In: Proceedings of ACM CHI 2007 Conference on Human Factors in Computing Systems , 2007, . pp. 1495-1504. https://doi.acm.org/10.1145/1240624.1240850
Cockburn, Andy, Kristensson, Per-Ola, Alexander, Jason, Zhai, Shumin (2007): Hard lessons: effort-inducing interfaces benefit spatial learning. In: Proceedings of ACM CHI 2007 Conference on Human Factors in Computing Systems , 2007, . pp. 1571-1580. https://doi.acm.org/10.1145/1240624.1240863
Zhai, Shumin (1993): Investigation of Feel for 6DOF Inputs: Isometric and Elastic Rate Control for Manipulation. In: Proceedings of the Human Factors and Ergonomics Society 37th Annual Meeting , 1993, . pp. 323-327.
Zhai, Shumin, Milgram, Paul (1994): Asymmetrical Spatial Accuracy in 3D Tracking. In: Proceedings of the Human Factors and Ergonomics Society 38th Annual Meeting , 1994, . pp. 245-249.
Qvarfordt, Pernilla, Zhai, Shumin (2005): Conversing with the user based on eye-gaze patterns. In: Proceedings of ACM CHI 2005 Conference on Human Factors in Computing Systems , 2005, . pp. 221-230. https://doi.acm.org/10.1145/1054972.1055004
Wang, Jingtao, Zhai, Shumin, Canny, John (2006): Camera phone based motion sensing: interaction techniques, applications and performance st. In: Proceedings of the ACM Symposium on User Interface Software and Technology , 2006, . pp. 101-110. https://doi.acm.org/10.1145/1166253.1166270
Smith, B. A., Zhai, Shumin (2001): Optimised Virtual Keyboards with and without Alphabetical Ordering - A Novice User Study. In: Proceedings of IFIP INTERACT01: Human-Computer Interaction , 2001, Tokyo, Japan. pp. 92-99.
Fels, D. I., Waalen, J. K., Zhai, Shumin, Weiss, P. (2001): Telepresence under Exceptional Circumstances: Enriching the Connection to School for Sick . In: Proceedings of IFIP INTERACT01: Human-Computer Interaction , 2001, Tokyo, Japan. pp. 617-624.
Matlock, T., Campbell, Christopher S., Maglio, Paul P., Zhai, Shumin, Smith, B. (2001): Designing Feedback for an Attentive Office. In: Proceedings of IFIP INTERACT01: Human-Computer Interaction , 2001, Tokyo, Japan. pp. 721-722.
Sallnas, Eva-Lotta, Zhai, Shumin (2003): Collaboration Meets Fitts\' Law: Passing Virtual Objects with and without Haptic Force Fee. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 97.
Ren, Xiangshi, Tamura, Kinya, Kong, Jing, Zhai, Shumin (2003): Candidate Display Styles in Japanese Input. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 868.
Qvarfordt, P., Beymer, D., Zhai, Shumin (2005): RealTourist - A Study of Augmenting Human-Human and Human-Computer Dialogue with Eye-Gaze . In: Proceedings of IFIP INTERACT05: Human-Computer Interaction , 2005, . pp. 767-780. https://www.springerlink.com/openurl.asp?genre=article&id=doi:10.1007/11555261_61
Zhai, Shumin, Kristensson, Per-Ola (2008): Interlaced QWERTY: accommodating ease of visual search and input flexibility in shape writ. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 593-596. https://doi.acm.org/10.1145/1357054.1357149
Kristensson, Per Ola, Zhai, Shumin (2008): Improving word-recognizers using an interactive lexicon with active and passive words. In: Proceedings of the 2008 International Conference on Intelligent User Interfaces , 2008, . pp. 353-356. https://doi.acm.org/10.1145/1378773.1378828
Lee, Seungyon, Zhai, Shumin (2009): The performance of touch screen soft buttons. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 309-318. https://doi.acm.org/10.1145/1518701.1518750
Appert, Caroline, Zhai, Shumin (2009): Using strokes as command shortcuts: cognitive benefits and toolkit support. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2289-2298. https://doi.acm.org/10.1145/1518701.1519052
Zhai, Shumin, Kristensson, Per Ola, Gong, Pengjun, Greiner, Michael, Peng, Shilei Allen, Liu, Liang Mico, Dunnigan, Anthony (2009): Shapewriter on the iPhone: from the laboratory to the real world. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2667-2670. https://doi.acm.org/10.1145/1520340.1520380
Maglio, Paul P., Matlock, Teenie, Campbell, Christopher S., Zhai, Shumin, Smith, Barton A. (2000): Gaze and Speech in Attentive User Interfaces. In: Tan, Tieniu, Shi, Yuanchun, Gao, Wen (eds.) Advances in Multimodal Interfaces - ICMI 2000 - Third International Conference October 14-16, 2000, Beijing, China. pp. 1-7. https://link.springer.de/link/service/series/0558/bibs/1948/19480001.htm
Zhai, Shumin (2008): On the ease and efficiency of human-computer interfaces. In: Räihä, Kari-Jouko, Duchowski, Andrew T. (eds.) ETRA 2008 - Proceedings of the Eye Tracking Research and Application Symposium March 26-28, 2008, Savannah, Georgia, USA. pp. 9-10. https://doi.acm.org/10.1145/1344471.1344473
Smith, Barton A., Ho, Janet, Ark, Wendy S., Zhai, Shumin (2000): Hand eye coordination patterns in target selection. In: Duchowski, Andrew T. (eds.) ETRA 2000 - Proceedings of the Eye Tracking Research and Application Symposium November 6-8, 2000, Palm Beach Gardens, Florida, USA. pp. 117-122. https://doi.acm.org/10.1145/355017.355041
Guiard, Yves, Beaudouin-Lafon, Michel, Bastin, Julien, Pasveer, Dennis, Zhai, Shumin (2004): View size and pointing difficulty in multi-scale navigation. In: Costabile, Maria Francesca (eds.) AVI 2004 - Proceedings of the working conference on Advanced visual interfaces May 25-28, 2004, Gallipoli, Italy. pp. 117-124. https://doi.acm.org/10.1145/989863.989881
Wang, Jingtao, Zhai, Shumin, Canny, John (2010): SHRIMP: solving collision and out of vocabulary problems in mobile predictive input with m. In: Proceedings of ACM CHI 2010 Conference on Human Factors in Computing Systems , 2010, . pp. 15-24. https://doi.acm.org/10.1145/1753326.1753330
Bi, Xiaojun, Smith, Barton A., Zhai, Shumin (2010): Quasi-qwerty soft keyboard optimization. In: Proceedings of ACM CHI 2010 Conference on Human Factors in Computing Systems , 2010, . pp. 283-286. https://doi.acm.org/10.1145/1753326.1753367
Zhai, Shumin, Milgram, Paul (1993): Human Performance Evaluation of Manipulation Schemes in Virtual Environments. In: VR 1993 , 1993, . pp. 155-161.
Zhai, Shumin, Woltjer, Rogier (2003): Human Movement Performance in Relation to Path Constraint - The Law of Steering in Locomot. In: IEEE Virtual Reality Conference 2003 VR 2003 22-26 March, 2003, Los Angeles, CA, USA. pp. 149-. https://csdl.computer.org/comp/proceedings/vr/2003/1882/00/18820149abs.htm
Weaver, Kimberly A., Yang, Huahai, Zhai, Shumin, Pierce, Jeff (2011): Understanding information preview in mobile email processing. In: Proceedings of 13th Conference on Human-computer interaction with mobile devices and services , 2011, . pp. 303-312. https://dx.doi.org/10.1145/2037373.2037420
Bao, Patti, Pierce, Jeffrey, Whittaker, Stephen, Zhai, Shumin (2011): Smart phone use by non-mobile business users. In: Proceedings of 13th Conference on Human-computer interaction with mobile devices and services , 2011, . pp. 445-454. https://dx.doi.org/10.1145/2037373.2037440
Azenkot, Shiri, Zhai, Shumin (2012): Touch behavior with different postures on soft smartphone keyboards. In: Proceedings of the 14th Conference on Human-computer interaction with mobile devices and services , 2012, . pp. 251-260. https://dx.doi.org/10.1145/2371574.2371612
Bi, Xiaojun, Chelba, Ciprian, Ouyang, Tom, Partridge, Kurt, Zhai, Shumin (2012): Bimanual gesture keyboard. In: Proceedings of the 2012 ACM Symposium on User Interface Software and Technology , 2012, . pp. 137-146. https://dx.doi.org/10.1145/2380116.2380136