Author: Robert J. K. Jacob
Ph.D
Robert Jacob is a Professor of Computer Science at Tufts University, where his research interests are new interaction modes and techniques and user interface software; his current work focuses on adaptive brain-computer interfaces. He was also a visiting professor at the Universite Paris-Sud and at the MIT Media Laboratory. Before coming to Tufts, he was in the Human-Computer Interaction Lab at the Naval Research Laboratory. He received his Ph.D. from Johns Hopkins University, and he is a member of the editorial board of Human-Computer Interaction and the ACM Transactions on Computer-Human Interaction. He was Papers Co-Chair of the CHI 2001 conference, Co-Chair of UIST 2007 and TEI 2010, and Vice-President of ACM SIGCHI. He was elected to the ACM CHI Academy in 2007, an honorary group of the principal leaders of the field of HCI, whose efforts have shaped the discipline and industry, and have led research and innovation in human-computer interaction.
Publications
Co-authors
Productive Colleagues
- Albrecht Schmidt
- Hiroshi Ishii
- Brad A. Myers
- 107
- 111
- 154
Publications
Shaer, Orit, Jacob, Robert J. K., Green, Mark, Luyten, Kris (2009): Introduction to the special issue on UIDL for next-generation user interfaces. In ACM Transactions on Computer-Human Interaction, 16 (4) pp. 16. https://dl.acm.org/doi/10.1145/1614390.1614391
Shaer, Orit, Jacob, Robert J. K. (2009): A specification paradigm for the design and implementation of tangible user interfaces. In ACM Transactions on Computer-Human Interaction, 16 (4) pp. 20. https://dl.acm.org/doi/10.1145/1614390.1614395
Petersen, Marianne Graves, Hallnäs, Lars, Jacob, Robert J. K. (2008): Introduction to special issue on the aesthetics of interaction. In ACM Transactions on Computer-Human Interaction, 15 (3) pp. 10. https://dl.acm.org/doi/10.1145/1453152.1453153
Petersen, Marianne Graves, Hallnäs, Lars, Jacob, Robert J. K. (2008): Introduction to special issue on the aesthetics of interaction. In ACM Transactions on Computer-Human Interaction, 15 (4) pp. 14. https://dl.acm.org/doi/10.1145/1460355.1460356
Hornecker, Eva, Jacob, Robert J. K., Hummels, Caroline, Ullmer, Brygg, Schmidt, Albrecht, Hoven, Elise van den, Mazalek, Ali (2008): TEI goes on: Tangible and Embedded Interaction. In IEEE Pervasive Computing, 7 (2) pp. 91-96. https://doi.ieeecomputersociety.org/10.1109/MPRV.2008.27
Hong, Dongpyo, Hollerer, Tobias, Haller, Michael, Takemura, Haruo, Cheok, Adrian David, Kim, Gerard Jounghyun, Billinghurst, Mark, Woo, Woontack, Hornecker, Eva, Jacob, Robert J. K., Hummels, Caroline, Ullmer, Brygg, Schmidt, Albrecht, Hoven, Elise van den, Mazalek, Ali (2008): Advances in Tangible Interaction and Ubiquitous Virtual Reality. In IEEE Pervasive Computing, 7 (2) pp. 90-96. https://doi.ieeecomputersociety.org/10.1109/MPRV.2008.27
Jacob, Robert J. K., Girouard, Audrey, Hirshfield, Leanne M., Horn, Michael, Shaer, Orit, Solovey, Erin Treacy, Zigelbaum, Jamie (2007): CHI2006: what is the next generation of human-computer interaction?. In Interactions, 14 (3) pp. 53-58. https://dl.acm.org/doi/10.1145/1242421.1242459
Shaer, Orit, Leland, Nancy, Calvillo-Gamez, Eduardo H., Jacob, Robert J. K. (2004): The TAC paradigm: specifying tangible user interfaces. In Personal and Ubiquitous Computing, 8 (5) pp. 359-369. https://dx.doi.org/10.1007/s00779-004-0298-3
Jacob, Robert J. K., Ishii, Hiroshi, Pangaro, Gian, Patten, James (2002): A tangible interface for organizing information using a grid. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 339-346.
Jacob, Robert J. K. (2001): Elements of next-generation non-WIMP user interfaces. In: Graphics Interface 2001 June 7-9, 2001, Ottawa, Ontario, Canada. pp. 235-235.
Tanriverdi, Vildan, Jacob, Robert J. K. (2000): Interacting with Eye Movements in Virtual Environments. In: Turner, Thea, Szwillus, Gerd, Czerwinski, Mary, Peterno, Fabio, Pemberton, Steven (eds.) Proceedings of the ACM CHI 2000 Human Factors in Computing Systems Conference April 1-6, 2000, The Hague, The Netherlands. pp. 265-272. https://www.acm.org/pubs/articles/proceedings/chi/332040/p265-tanriverdi/p265-tanriverdi.pdf
Sibert, Linda E., Jacob, Robert J. K. (2000): Evaluation of Eye Gaze Interaction. In: Turner, Thea, Szwillus, Gerd, Czerwinski, Mary, Peterno, Fabio, Pemberton, Steven (eds.) Proceedings of the ACM CHI 2000 Human Factors in Computing Systems Conference April 1-6, 2000, The Hague, The Netherlands. pp. 281-288. https://www.acm.org/pubs/articles/proceedings/chi/332040/p281-sibert/p281-sibert.pdf
Jacob, Robert J. K., Deligiannidis, Leonidas, Morrison, Stephen (1999): A Software Model and Specification Language for Non-WIMP User Interfaces. In ACM Computing Surveys (CSUR), 6 (1) pp. 1-46. https://www.acm.org/pubs/articles/journals/tochi/1999-6-1/p1-jacob/p1-jacob.pdf
Jacob, Robert J. K., Feiner, Steven K., Foley, James D., Mackinlay, Jock D., Olsen Jr, Dan R. (1997): UIST'007: Where Will We Be Ten Years From Now?. In: Robertson, George G., Schmandt, Chris (eds.) Proceedings of the 10th annual ACM symposium on User interface software and technology October 14 - 17, 1997, Banff, Alberta, Canada. pp. 115-118. https://www.acm.org/pubs/articles/proceedings/uist/263407/p115-jacob/p115-jacob.pdf
Jacob, Robert J. K. (1996): Human-Computer Interaction: Input Devices. In ACM Computing Surveys, 28 (0) pp. 177-179.
Hix, Deborah, Templeman, James N., Jacob, Robert J. K. (1995): Pre-Screen Projection: From Concept to Testing of a New Interaction Technique. In: Katz, Irvin R., Mack, Robert L., Marks, Linn, Rosson, Mary Beth, Nielsen, Jakob (eds.) Proceedings of the ACM CHI 95 Human Factors in Computing Systems Conference May 7-11, 1995, Denver, Colorado. pp. 226-233. https://www.acm.org/sigchi/chi95/proceedings/papers/dh_bdy.htm
Jacob, Robert J. K., Sibert, Linda E., McFarlane, Daniel C., Mullen Jr, M. Preston (1994): Integrality and Separability of Input Devices. In ACM Transactions on Computer-Human Interaction, 1 (1) pp. 3-26. https://www.acm.org/pubs/articles/journals/tochi/1994-1-1/p3-jacob/p3-jacob.pdf
Durbin, Jim, Jacob, Robert J. K., Hinckley, Ken (1994): Laying the Foundation for the Information Super Highway: Human-Computer Interaction Resear. In ACM SIGCHI Bulletin, 26 (4) pp. 56-58.
Jacob, Robert J. K., Sibert, Linda E., McFarlane, Daniel C., Mullen, M. P. (1994): Integrality and Separability of Input Devices. In ACM Transactions on Computer-Human Interaction, 1 (0) pp. 3-26.
Jacob, Robert J. K., Leggett, John, Myers, Brad A., Pausch, Randy (1993): Interaction Styles and Input/Output Devices. In Behaviour and Information Technology, 12 (2) pp. 69-79.
Jacob, Robert J. K., Sibert, Linda E. (1992): The Perceptual Structure of Multidimensional Input Device Selection. In: Bauersfeld, Penny, Bennett, John, Lynch, Gene (eds.) Proceedings of the ACM CHI 92 Human Factors in Computing Systems Conference June 3-7, 1992, Monterey, California. pp. 211-218. https://www.acm.org/pubs/articles/proceedings/chi/142750/p211-jacob/p211-jacob.pdf
Jacob, Robert J. K. (1991): The Use of Eye Movements in Human-Computer Interaction Techniques: What You Look At is Wha. In ACM Transactions on Information Systems, 9 (2) pp. 152-169. https://www.acm.org/pubs/articles/journals/tois/1991-9-2/p152-jacob/p152-jacob.pdf
Jacob, Robert J. K. (1990): What You Look At is What You Get: Eye Movement-Based Interaction Techniques. In: Carrasco, Jane, Whiteside, John (eds.) Proceedings of the ACM CHI 90 Human Factors in Computing Systems Conference , 1990, Seattle, Washington,USA. pp. 11-18.
Jacob, Robert J. K. (1986): A Specification Language for Direct-Manipulation User Interfaces. In ACM Transactions on Graphics, 5 (4) pp. 283-317.
Jacob, Robert J. K. (1985): A State Transition Diagram Language for Visual Programming. In IEEE Computer, 18 (8) pp. 51-59.
Jacob, Robert J. K. (1983): Executable Specifications for a Human-Computer Interface. In: Smith, Raoul N., Pew, Richard W., Janda, Ann (eds.) Proceedings of the ACM CHI 83 Human Factors in Computing Systems Conferenc December 12-15, 1983, Boston, Massachusetts, United States. pp. 28-34.
Jacob, Robert J. K. (1983): Using Formal Specifications in the Design of a Human-Computer Interface. In Communications of the ACM, 26 (4) pp. 259-264.
Jacob, Robert J. K. (1982): Using Formal Specifications in the Design of a Human-Computer Interface. In: Nichols, Jean A., Schneider, Michael L. (eds.) Proceedings of the SIGCHI conference on Human factors in computing systems March 15-17, 1982, Gaithersburg, Maryland, United States. pp. 315-321.
Mynatt, Elizabeth D., Jacob, Robert J. K. (eds.) Proceedings of the 11th annual ACM symposium on User interface software and technology November 01 - 04, 1998, San Francisco, California, United States.
Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA.
Chang, Angela, O\'Modhrain, Sile, Jacob, Robert J. K., Gunther, Eric, Ishii, Hiroshi (2002): ComTouch: design of a vibrotactile communication device. In: Proceedings of DIS02: Designing Interactive Systems: Processes, Practices, Methods, & Techniques , 2002, . pp. 312-320. https://doi.acm.org/10.1145/778712.778755
Shiaw, Horn-yeu, Jacob, Robert J. K., Crane, Gregory (2004): The 3D vase museum: a new approach to context in a digital library. In: JCDL04: Proceedings of the 4th ACM/IEEE-CS Joint Conference on Digital Libraries , 2004, . pp. 125-134. https://doi.acm.org/10.1145/996350.996381
Bahna, Eric, Jacob, Robert J. K. (2005): Augmented reading: presenting additional information without penalty. In: Proceedings of ACM CHI 2005 Conference on Human Factors in Computing Systems , 2005, . pp. 1909-1912. https://doi.acm.org/10.1145/1056808.1057054
Zigelbaum, Jamie, Horn, Michael S., Shaer, Orit, Jacob, Robert J. K. (2007): The tangible video editor: collaborative video editing with active tokens. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 43-46. https://doi.acm.org/10.1145/1226969.1226978
Horn, Michael S., Jacob, Robert J. K. (2007): Designing tangible programming languages for classroom use. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 159-162. https://doi.acm.org/10.1145/1226969.1227003
Girouard, Audrey, Solovey, Erin Treacy, Hirshfield, Leanne M., Ecott, Stacey, Shaer, Orit, Jacob, Robert J. K. (2007): Smart Blocks: a tangible mathematical manipulative. In: Proceedings of the 1st International Conference on Tangible and Embedded Interaction , 2007, . pp. 183-186. https://doi.acm.org/10.1145/1226969.1227007
Ullmer, Brygg, Ishii, Hiroshi, Jacob, Robert J. K. (2003): Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 279.
Ullmer, Brygg, Ishii, Hiroshi, Jacob, Robert J. K. (2003): Tangible Query Interfaces: Physically Constrained Tokens for Manipulating Database Queries. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 1004?.
Jacob, Robert J. K., Girouard, Audrey, Hirshfield, Leanne M., Horn, Michael S., Shaer, Orit, Solovey, Erin Treacy, Zigelbaum, Jamie (2008): Reality-based interaction: a framework for post-WIMP interfaces. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 201-210. https://doi.acm.org/10.1145/1357054.1357089
Shaer, Orit, Jacob, Robert J. K., Green, Mark, Luyten, Kris (2008): User interface description languages for next generation user interfaces. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 3949-3952. https://doi.acm.org/10.1145/1358628.1358964
Horn, Michael S., Solovey, Erin Treacy, Jacob, Robert J. K. (2008): Tangible programming and informal science learning: making TUIs work for museums. In: Proceedings of ACM IDC08 Interaction Design and Children , 2008, . pp. 194-201. https://doi.acm.org/10.1145/1463689.1463756
Horn, Michael S., Solovey, Erin Treacy, Crouser, R. Jordan, Jacob, Robert J. K. (2009): Comparing the use of tangible and graphical programming languages for informal science edu. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 975-984. https://doi.acm.org/10.1145/1518701.1518851
Hirshfield, Leanne M., Solovey, Erin Treacy, Girouard, Audrey, Kebinger, James, Jacob, Robert J. K., Sassaroli, Angelo, Fantini, Sergio (2009): Brain measurement for usability testing and adaptive interfaces: an example of uncovering . In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2185-2194. https://doi.acm.org/10.1145/1518701.1519035
Bean, Alex, Siddiqi, Sabina, Chowdhury, Anila, Whited, Billy, Shaer, Orit, Jacob, Robert J. K. (2008): Marble track audio manipulator (MTAM): a tangible user interface for audio composition. In: Schmidt, Albrecht, Gellersen, Hans-Werner, Hoven, Elise van den, Mazalek, Ali, Holleis, Paul, Villar, Nicolas (eds.) TEI 2008 - Proceedings of the 2nd International Conference on Tangible and Embedded Interaction February 18-20, 2008, Bonn, Germany. pp. 27-30. https://doi.acm.org/10.1145/1347390.1347398
Tanriverdi, Vildan, Jacob, Robert J. K. (2001): VRID: a design model and methodology for developing virtual reality interfaces. In: VRST 2001 , 2001, . pp. 175-182. https://doi.acm.org/10.1145/505008.505042
Jacob, Robert J. K. (1996): A Visual Language for Non-WIMP User Interfaces. In: VL 1996 , 1996, . pp. 231-238.
Shaer, Orit, Jacob, Robert J. K. (2006): A Visual Language for Programming Reality-Based Interaction. In: VL-HCC 2006 - IEEE Symposium on Visual Languages and Human-Centric Computing 4-8 September, 2006, Brighton, UK. pp. 244-245. https://doi.ieeecomputersociety.org/10.1109/VLHCC.2006.6
Diep, Ellen, Jacob, Robert J. K. (2004): Visualizing E-mail with a Semantically Zoomable Interface. In: InfoVis 2004 - 10th IEEE Symposium on Information Visualization 10-12 October, 2004, Austin, TX, USA. https://doi.ieeecomputersociety.org/10.1109/INFOVIS.2004.75
Calvillo-Gamez, Eduardo H., Leland, Nancy, Shaer, Orit, Jacob, Robert J. K. (2003): The TAC paradigm: unified conceptual framework to represent Tangible User Interfaces. In: Proceedings of the 2003 Latin American conference on Human-computer interaction , 2003, . pp. 9-15. https://portal.acm.org/citation.cfm?id=944519.944521
Jacob, Robert J. K. (2001): Open syntax: improving access for all users. In: Proceedings of the 2001 EC/NSF Workshop on Universal Accessibility of Ubiquitous Computing , 2001, . pp. 84-89. https://doi.acm.org/10.1145/564526.564549
Christou, Georgios, Jacob, Robert J. K. (2003): Evaluating and Comparing Interaction Styles. In: Jorge, Joaquim A., Nunes, Nuno Jardim, Cunha, Joao Falcao e (eds.) DSV-IS 2003 - Interactive Systems. Design, Specification, and Verification, 10th International Workshop June 11-13, 2003, Funchal, Madeira Island, Portugal. pp. 406-409. https://link.springer.de/link/service/series/0558/bibs/2844/28440406.htm
Christou, Georgios, Jacob, Robert J. K., Cheng, Pericles Leng (2006): Modeling the Task - Leveraging Knowledge-in-the-Head at Design Time. In: Manolopoulos, Yannis, Filipe, Joaquim, Constantopoulos, Panos, Cordeiro, José (eds.) ICEIS 2006 - Proceedings of the Eighth International Conference on Enterprise Information Systems Databases and Information Systems Integration May 23-27, 2006, Paphos, Cyprus. pp. 131-134.
Girouard, Audrey, Solovey, Erin Treacy, Mandryk, Regan, Tan, Desney, Nacke, Lennart, Jacob, Robert J. K. (2010): Brain, body and bytes: psychophysiological user interaction. In: Proceedings of ACM CHI 2010 Conference on Human Factors in Computing Systems , 2010, . pp. 4433-4436. https://doi.acm.org/10.1145/1753846.1754167
Solovey, Erin Treacy, Girouard, Audrey, Chauncey, Krysta, Hirshfield, Leanne M., Sassaroli, Angelo, Zheng, Feng, Fantini, Sergio, Jacob, Robert J. K. (2009): Using fNIRS brain sensing in realistic HCI settings: experiments and guidelines. In: Proceedings of the ACM Symposium on User Interface Software and Technology , 2009, . pp. 157-166. https://doi.acm.org/10.1145/1622176.1622207
Deligiannidis, Leonidas, Jacob, Robert J. K. (2002): DLoVe: Using Constraints to Allow Parallel Processing in Multi-User Virtual Reality. In: VR 2002 , 2002, . pp. 49-. https://csdl.computer.org/comp/proceedings/vr/2002/1492/00/14920049abs.htm
Solovey, Erin Treacy, Lalooses, Francine, Chauncey, Krysta, Weaver, Douglas, Parasi, Margarita, Scheutz, Matthias, Sassaroli, Angelo, Fantini, Sergio, Schermerhorn, Paul, Girouard, Audrey, Jacob, Robert J. K. (2011): Sensing cognitive multitasking for a brain-based adaptive user interface. In: Proceedings of ACM CHI 2011 Conference on Human Factors in Computing Systems , 2011, . pp. 383-392. https://dx.doi.org/10.1145/1978942.1978997
Jacob, Robert J. K. (2012): Engineering next generation interfaces: past and future. In: ACM SIGCHI 2012 Symposium on Engineering Interactive Computing Systems , 2012, . pp. 1-2. https://dx.doi.org/10.1145/2305484.2305486