Jun Rekimoto

Author: Jun Rekimoto

Ph.D

Dr. Jun Rekimoto is an interaction researcher and designer. His work in the field of Human Computer Interaction has created lasting and highly significant impact that is present in a multitude of interfaces and devices used by millions of people worldwide everyday. Dr. Rekimoto received his Ph.D. in Information Science from Tokyo Institute of Technology in 1996. Since 1994 he has conducting advanced research at Sony Computer Science Laboratories (CSL) in Tokyo. In 1999 he formed and directed the Sony CSL Interaction Laboratory that was tasked with invention of novel interaction paradigms. He has been serving as a Deputy Director of Sony CSL since 2011. From 2007 he has been also directing his own research laboratory at The University of Tokyo. Over the length of his research career Jun Rekimoto invented a range of highly innovative interactive systems and sensing technologies, including marker-based video see-through augmented reality (NaviCam), marker-based 3D tracking and registration for augmented reality applications(i.e., CyberCode), direct-manipulation techniques for multiple displays and devices (Pick-and-Drop), diffused IR hands and object tracking for augmented surfaces (HoloWall), and some of the earliest projective capacitive multi-touch sensing techniques and interfaces (i.e., SmartSkin) to name a few.

He has published hundreds of articles in some of the most prestigious international research conferences, released his research on the market in Sony products and span-off entire companies. He received the Multi-Media Grand Prix Technology Award from the Multi-Media Contents Association Japan in 1998, iF Interaction Design Award in 2000, the Japan Inter-Design Award in 2003, and iF Communication Design Award in 2005. In 2007, he was elected to ACM SIGCHI Academy.

Jun Rekimoto's current research interests include human-computer interaction, computer augmented environments and computer augmented human (human-computer integration)

Publications

Publication period start: 2012
Number of co-authors: 37

Co-authors

Number of publications with favourite co-authors
Michimune Kohno
7
Yuji Ayatsuka
9
Takashi Miyaki
10

Productive Colleagues

Most productive colleagues in number of publications
Shwetak N. Patel
35
Ivan Poupyrev
37
Gregory D. Abowd
116

Publications

Rekimoto, Jun (2008): Organic interaction technologies: from stone to skin. In Communications of the ACM, 51 (6) pp. 38-44. https://dl.acm.org/doi/10.1145/1349026.1349035

Rekimoto, Jun (2004): SyncTap: synchronous user operation for spontaneous network connection. In Personal and Ubiquitous Computing, 8 (2) pp. 126-134. https://dx.doi.org/10.1007/s00779-004-0262-2

Rekimoto, Jun, Ishizawa, Takaaki, Schwesig, Carsten, Oba, Haruo (2003): PreSense: interaction techniques for finger sensing input devices. In: Proceedings of the 16th annural ACM Symposium on User Interface Software and Technology November, 2-5, 2003, Vancouver, Canada. pp. 203-212. https://doi.acm.org/10.1145/964696.964719

Rekimoto, Jun (2002): SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In: Terveen, Loren (eds.) Proceedings of the ACM CHI 2002 Conference on Human Factors in Computing Systems Conference April 20-25, 2002, Minneapolis, Minnesota. pp. 113-120.

Poupyrev, Ivan, Maruyama, Shigeaki, Rekimoto, Jun (2002): Ambient touch: designing tactile interfaces for handheld devices. In: Beaudouin-Lafon, Michel (eds.) Proceedings of the 15th annual ACM symposium on User interface software and technology October 27-30, 2002, Paris, France. pp. 51-60. https://doi.acm.org/10.1145/571985.571993

Rekimoto, Jun, Ullmer, Brygg, Oba, Haruo (2001): DataTiles: A Modular Platform for Mixed Physical and Graphical Interactions. In: Beaudouin-Lafon, Michel, Jacob, Robert J. K. (eds.) Proceedings of the ACM CHI 2001 Human Factors in Computing Systems Conference March 31 - April 5, 2001, Seattle, Washington, USA. pp. 269-276. https://www.acm.org/pubs/articles/proceedings/chi/365024/p269-rekimoto/p269-rekimoto.pdf

Kohtake, Naohiko, Rekimoto, Jun, Anzai, Yuichiro (2001): InfoPoint: A Device that Provides a Uniform User Interface to Allow Appliances to Work Tog. In Personal and Ubiquitous Computing, 5 (4) pp. 264-274. https://springerlink.metapress.com/openurl.asp?genre=article&issn=1617-4917&volume=5&issue=4&spage=264

Rekimoto, Jun, Sciammarella, Eduardo (2000): ToolStone: Effective Use of the Physical Manipulation Vocabularies of Input Devices. In: Ackerman, Mark S., Edwards, Keith (eds.) Proceedings of the 13th annual ACM symposium on User interface software and technology November 06 - 08, 2000, San Diego, California, United States. pp. 109-117. https://acm.org/pubs/articles/proceedings/uist/354401/p109-rekimoto/p109-rekimoto.pdf

Matsushita, Nobuyuki, Ayatsuka, Yuji, Rekimoto, Jun (2000): Dual Touch: A Two-Handed Interface for Pen-Based PDAs. In: Ackerman, Mark S., Edwards, Keith (eds.) Proceedings of the 13th annual ACM symposium on User interface software and technology November 06 - 08, 2000, San Diego, California, United States. pp. 211-212. https://acm.org/pubs/articles/proceedings/uist/354401/p211-matsushita/p211-matsushita.pdf

Rekimoto, Jun, Saitoh, Masanori (1999): Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In: Altom, Mark W., Williams, Marian G. (eds.) Proceedings of the ACM CHI 99 Human Factors in Computing Systems Conference May 15-20, 1999, Pittsburgh, Pennsylvania. pp. 378-385. https://www.acm.org/pubs/articles/proceedings/chi/302979/p378-rekimoto/p378-rekimoto.pdf

Rekimoto, Jun (1999): Time-Machine Computing: A Time-Centric Approach for the Information Environment. In: Zanden, Brad Vander, Marks, Joe (eds.) Proceedings of the 12th annual ACM symposium on User interface software and technology November 07 - 10, 1999, Asheville, North Carolina, United States. pp. 45-54. https://www.acm.org/pubs/articles/proceedings/uist/320719/p45-rekimoto/p45-rekimoto.pdf

Rekimoto, Jun (1998): A Multiple Device Approach for Supporting Whiteboard-Based Interactions. In: Karat, Clare-Marie, Lund, Arnold, Coutaz, Joëlle, Karat, John (eds.) Proceedings of the ACM CHI 98 Human Factors in Computing Systems Conference April 18-23, 1998, Los Angeles, California. pp. 344-351. https://www.acm.org/pubs/articles/proceedings/chi/274644/p344-rekimoto/p344-rekimoto.pdf

Ayatsuka, Yuji, Rekimoto, Jun, Matsuoka, Satoshi (1998): Popup Vernier: A Tool for Sub-Pixel-Pitch Dragging with Smooth Mode Transition. In: Mynatt, Elizabeth D., Jacob, Robert J. K. (eds.) Proceedings of the 11th annual ACM symposium on User interface software and technology November 01 - 04, 1998, San Francisco, California, United States. pp. 39-48. https://www.acm.org/pubs/articles/proceedings/uist/288392/p39-ayatsuka/p39-ayatsuka.pdf

Rekimoto, Jun (1997): Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments. In: Robertson, George G., Schmandt, Chris (eds.) Proceedings of the 10th annual ACM symposium on User interface software and technology October 14 - 17, 1997, Banff, Alberta, Canada. pp. 31-39. https://www.acm.org/pubs/articles/proceedings/uist/263407/p31-rekimoto/p31-rekimoto.pdf

Matsushita, Nobuyuki, Rekimoto, Jun (1997): HoloWall: Designing a Finger, Hand, Body, and Object Sensitive Wall. In: Robertson, George G., Schmandt, Chris (eds.) Proceedings of the 10th annual ACM symposium on User interface software and technology October 14 - 17, 1997, Banff, Alberta, Canada. pp. 209-210. https://www.acm.org/pubs/articles/proceedings/uist/263407/p209-matsushita/p209-matsushita.pdf

Rekimoto, Jun (1997): A Magnifying Glass Approach to Augmented Reality Systems. In Presence: Teleoperators and Virtual Environments, 6 (4) pp. 399-412.

Ayatsuka, Yuji, Matsuoka, Satoshi, Rekimoto, Jun (1996): Penumbrae for 3D Interactions. In: Kurlander, David, Brown, Marc, Rao, Ramana (eds.) Proceedings of the 9th annual ACM symposium on User interface software and technology November 06 - 08, 1996, Seattle, Washington, United States. pp. 165-166. https://www.acm.org/pubs/articles/proceedings/uist/237091/p165-ayatsuka/p165-ayatsuka.pdf

Rekimoto, Jun (1996): Tilting Operations for Small Screen Interfaces. In: Kurlander, David, Brown, Marc, Rao, Ramana (eds.) Proceedings of the 9th annual ACM symposium on User interface software and technology November 06 - 08, 1996, Seattle, Washington, United States. pp. 167-168. https://www.acm.org/pubs/articles/proceedings/uist/237091/p167-rekimoto/p167-rekimoto.pdf

Rekimoto, Jun, Nagao, Katashi (1995): The World through the Computer: Computer Augmented Interaction with Real World Environment. In: Robertson, George G. (eds.) Proceedings of the 8th annual ACM symposium on User interface and software technology November 15 - 17, 1995, Pittsburgh, Pennsylvania, United States. pp. 29-36. https://www.acm.org/pubs/articles/proceedings/uist/215585/p29-rekimoto/p29-rekimoto.pdf

Rekimoto, Jun (1995): Augmented Interaction: Interacting with the Real World through a Computer. In: Proceedings of the Sixth International Conference on Human-Computer Interaction July 9-14, 1995, Tokyo, Japan. pp. 255-260.

Ayatsuka, Yuji, Rekimoto, Jun (2005): tranSticks: physically manipulatable virtual connections. In: Proceedings of ACM CHI 2005 Conference on Human Factors in Computing Systems , 2005, . pp. 251-260. https://doi.acm.org/10.1145/1054972.1055008

Rekimoto, Jun (2001): Interacting with a Computer Augmented Environment. In: Proceedings of IFIP INTERACT01: Human-Computer Interaction , 2001, Tokyo, Japan. pp. 14-16.

Rekimoto, Jun, Ayatsuka, Yuji, Kohno, Michimune, Oba, Hauro (2003): Proximal Interactions: A Direct Manipulation technique for wireless networking. In: Proceedings of IFIP INTERACT03: Human-Computer Interaction , 2003, Zurich, Switzerland. pp. 511.

Kohno, Michimune, Rekimoto, Jun (2005): Searching common experience: a social communication tool based on mobile ad-hoc networking. In: Proceedings of 7th conference on Human-computer interaction with mobile devices and services , 2005, . pp. 15-22. https://doi.acm.org/10.1145/1085777.1085781

Rekimoto, Jun (2008): Brightshadow: shadow sensing with synchronous illuminations for robust gesture recognition. In: Proceedings of ACM CHI 2008 Conference on Human Factors in Computing Systems April 5-10, 2008, . pp. 2769-2774. https://doi.acm.org/10.1145/1358628.1358759

Rekimoto, Jun (2009): SenseableRays: opto-haptic substitution for touch-enhanced interactive spaces. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 2519-2528. https://doi.acm.org/10.1145/1520340.1520356

Tamaki, Emi, Miyaki, Takashi, Rekimoto, Jun (2009): Brainy hand: an ear-worn hand gesture interaction device. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 4255-4260. https://doi.acm.org/10.1145/1520340.1520649

Iwasaki, Ken, Miyaki, Takashi, Rekimoto, Jun (2009): Expressive typing: a new way to sense typing pressure and its applications. In: Proceedings of ACM CHI 2009 Conference on Human Factors in Computing Systems , 2009, . pp. 4369-4374. https://doi.acm.org/10.1145/1520340.1520668

Matsushita, Nobuyuki, Hihara, Daisuke, Ushiro, Teruyuki, Yoshimura, Shinichi, Rekimoto, Jun, Yamamoto, Yoshikazu (2003): ID CAM: A Smart Camera for Scene Capturing and ID Recognition. In: 2003 IEEE and ACM International Symposium on Mixed and Augmented Reality ISMAR 2003 7-10 October, 2003, Tokyo, Japan. pp. 227-236. https://csdl.computer.org/comp/proceedings/ismar/2003/2006/00/20060227abs.htm

Kohno, Michimune, Rekimoto, Jun (2002): New Generation of IP-Phone Enabled Mobile Devices. In: Paterno, Fabio (eds.) Mobile Human-Computer Interaction - 4th International Symposium - Mobile HCI 2002 September 18-20, 2002, Pisa, Italy. pp. 319-323. https://link.springer.de/link/service/series/0558/bibs/2411/24110319.htm

Kohno, Michimune, Rekimoto, Jun (2005): Searching common experience: a social communication tool based on mobile ad-hoc networking. In: Tscheligi, Manfred, Bernhaupt, Regina, Mihalic, Kristijan (eds.) Proceedings of the 7th Conference on Human-Computer Interaction with Mobile Devices and Services - Mobile HCI 2005 September 19-22, 2005, Salzburg, Austria. pp. 15-22. https://doi.acm.org/10.1145/1085777.1085781

Rekimoto, Jun, Ayatsuka, Yuji, Kohno, Michimune (2003): SyncTap: An Interaction Technique for Mobile Networking. In: Chittaro, Luca (eds.) Human-Computer Interaction with Mobile Devices and Services - 5th International Symposium - Mobile HCI 2003 September 8-11, 2003, Udine, Italy. pp. 104-115. https://link.springer.de/link/service/series/0558/bibs/2795/27950104.htm

Ayatsuka, Yuji, Kohno, Michimune, Rekimoto, Jun (2004): Real-World Oriented Access Control Method with a Displayed Password. In: Masoodian, Masood, Jones, Steve, Rogers, Bill (eds.) Computer Human Interaction 6th Asia Pacific Conference - APCHI 2004 June 29 - July 2, 2004, Rotorua, New Zealand. pp. 19-29. https://link.springer.de/link/service/series/0558/bibs/3101/31010019.htm

Ayatsuka, Yuji, Matsuoka, Satoshi, Rekimoto, Jun (1998): Layered Penumbrae: An Effective 3D Feedback Technique. In: Third Asian Pacific Computer and Human Interaction July 15-17, 1998, Kangawa, Japan. pp. 202-209. https://csdl.computer.org/comp/proceedings/apchi/1998/8347/00/83470202abs.htm

Rekimoto, Jun (1998): Matrix: A Realtime Object Identification and Registration Method for Augmented Reality. In: Third Asian Pacific Computer and Human Interaction July 15-17, 1998, Kangawa, Japan. pp. 63-69. https://csdl.computer.org/comp/proceedings/apchi/1998/8347/00/83470063abs.htm

Kohtake, Naohiko, Rekimoto, Jun, Anzai, Yuichiro (1999): InfoStick: An Interaction Device for Inter-Appliance Computing. In: Gellersen, Hans-Werner (eds.) Handheld and Ubiquitous Computing - First International Symposium - HUC99 September 27-29, 1999, Karlsruhe, Germany. pp. 246-258. https://link.springer.de/link/service/series/0558/bibs/1707/17070246.htm

Beigl, Michael, Intille, Stephen S., Rekimoto, Jun, Tokuda, Hideyuki (eds.) UbiComp 2005 Ubiquitous Computing - 7th International Conference September 11-14, 2005, Tokyo, Japan.

Rekimoto, Jun (2009): Sensonomy: intelligence penetrating into the real space. In: Proceedings of the 2009 International Conference on Intelligent User Interfaces , 2009, . pp. 3-4. https://doi.acm.org/10.1145/1502650.1502653

Hamakawa, Rei, Rekimoto, Jun (1993): Object Composition and Playback Models for Handling Multimedia Data. In: ACM Multimedia 1993 , 1993, . pp. 273-281.

Rekimoto, Jun, Ayatsuka, Yuji (2000): CyberCode: designing augmented reality environments with visual tags. In: Designing Augmented Reality Environments 2000 , 2000, . pp. 1-10. https://doi.acm.org/10.1145/354666.354667

Patel, Shwetak N., Rekimoto, Jun, Abowd, Gregory D. (2006): iCam: Precise at-a-Distance Interaction in the Physical Environment. In: Fishkin, Kenneth P., Schiele, Bernt, Nixon, Paddy, Quigley, Aaron J. (eds.) PERVASIVE 2006 - Pervasive Computing 4th International Conference May 7-10, 2006, Dublin, Ireland. pp. 272-287. https://dx.doi.org/10.1007/11748625_17

Rekimoto, Jun, Miyaki, Takashi, Kohno, Michimune (2004): ProxNet: Secure Dynamic Wireless Connection by Proximity Sensing. In: Ferscha, Alois, Mattern, Friedemann (eds.) PERVASIVE 2004 - Pervasive Computing, Second International Conference April 21-23, 2004, Vienna, Austria. pp. 213-218. https://link.springer.de/link/service/series/0558/bibs/3001/30010213.htm

Tamaki, Emi, Miyak, Takashi, Rekimoto, Jun (2010): BrainyHand: a wearable computing device without HMD and it's interaction techniques. In: Proceedings of the 2010 International Conference on Advanced Visual Interfaces , 2010, . pp. 387-388. https://doi.acm.org/10.1145/1842993.1843070

Miyaki, Takashi, Rekimoto, Jun (2009): GraspZoom: zooming and scrolling control model for single-handed mobile interaction. In: Proceedings of 11th Conference on Human-computer interaction with mobile devices and services , 2009, . pp. 11. https://doi.acm.org/10.1145/1613858.1613872

Mujibiya, Adiyan, Miyaki, Takashi, Rekimoto, Jun (2010): Anywhere touchtyping: text input on arbitrary surface using depth sensing. In: Proceedings of the 2010 ACM Symposium on User Interface Software and Technology , 2010, . pp. 443-444. https://doi.acm.org/10.1145/1866218.1866262

Higuchi, Keita, Shimada, Tetsuro, Rekimoto, Jun (2011): Flying sports assistant: external visual imagery representation for sports training. In: Proceedings of the 2011 Augmented Human International Conference , 2011, . pp. 7. https://dx.doi.org/10.1145/1959826.1959833

Ishiguro, Yoshio, Rekimoto, Jun (2011): Peripheral vision annotation: noninterference information presentation method for mobile a. In: Proceedings of the 2011 Augmented Human International Conference , 2011, . pp. 8. https://dx.doi.org/10.1145/1959826.1959834

Tamaki, Emi, Miyaki, Takashi, Rekimoto, Jun (2010): PossessedHand: a hand gesture manipulation system using electrical stimuli. In: Proceedings of the 2010 Augmented Human International Conference , 2010, . pp. 2. https://doi.acm.org/10.1145/1785455.1785457

Ishiguro, Yoshio, Mujibiya, Adiyan, Miyaki, Takashi, Rekimoto, Jun (2010): Aided eyes: eye activity sensing for daily life. In: Proceedings of the 2010 Augmented Human International Conference , 2010, . pp. 25. https://doi.acm.org/10.1145/1785455.1785480

Tamaki, Emi, Miyaki, Takashi, Rekimoto, Jun (2011): PossessedHand: techniques for controlling human hands using electrical muscles stimuli. In: Proceedings of ACM CHI 2011 Conference on Human Factors in Computing Systems , 2011, . pp. 543-552. https://dx.doi.org/10.1145/1978942.1979018

Tsujita, Hitomi, Rekimoto, Jun (2011): HappinessCounter: smile-encouraging appliance to increase positive mood. In: Proceedings of ACM CHI 2011 Conference on Human Factors in Computing Systems , 2011, . pp. 117-126. https://dx.doi.org/10.1145/1979742.1979608

Higuchi, Keita, Ishiguro, Yoshio, Rekimoto, Jun (2011): Flying eyes: free-space content creation using autonomous aerial vehicles. In: Proceedings of ACM CHI 2011 Conference on Human Factors in Computing Systems , 2011, . pp. 561-570. https://dx.doi.org/10.1145/1979742.1979627

Rekimoto, Jun, Miyaki, Takashi, Ishizawa, Takaaki (2007): LifeTag: WiFi-Based Continuous Location Logging for Life Pattern Analysis. In: Hightower, Jeffrey, Schiele, Bernt, Strang, Thomas (eds.) Location- and Context-Awareness - Third International Symposium - LoCA 2007 September 20-21, 2007, Oberpfaffenhofen, Germany. pp. 35-49. https://dx.doi.org/10.1007/978-3-540-75160-1_3

Kawauchi, Kensaku, Miyaki, Takashi, Rekimoto, Jun (2009): Directional Beaconing: A Robust WiFi Positioning Method Using Angle-of-Emission Informatio. In: Choudhury, Tanzeem, Quigley, Aaron J., Strang, Thomas, Suginuma, Koji (eds.) Location and Context Awareness - Fourth International Symposium - LoCA 2009 May 7-8, 2009, Tokyo, Japan. pp. 103-119. https://dx.doi.org/10.1007/978-3-642-01721-6_7

Misawa, Kana, Ishiguro, Yoshio, Rekimoto, Jun (2012): Ma petite chérie: what are you looking at?: a small telepresence system to support . In: Proceedings of the 2012 Augmented Human International Conference , 2012, . pp. 17. https://dx.doi.org/10.1145/2160125.2160142

Tsujita, Hitomi, Rekimoto, Jun (2011): Smiling makes us happier: enhancing positive mood and communication with smile-encouraging. In: Proceedings of the 2011 International Conference on Uniquitous Computing , 2011, . pp. 1-10. https://dx.doi.org/10.1145/2030112.2030114

Rekimoto, Jun (1998): Multiple-Computer User Interfaces: A Cooperative Environment Consisting of Multiple Digita. In: Streitz, Norbert A., Konomi, Shin'ichi, Burkhardt, Heinz Jürgen (eds.) Cooperative Buildings, Integrating Information, Organization, and Architecture, First International Workshop, CoBuild98, Darmstadt, Germany, February 1998, Proceedings , 1998, . pp. 33-40. https://link.springer.de/link/service/series/0558/bibs/1370/13700033.htm

Rekimoto, Jun (2012): Squama: modular visibility control of walls and windows for programmable physical architec. In: Proceedings of the 2012 International Conference on Advanced Visual Interfaces , 2012, . pp. 168-171. https://dx.doi.org/10.1145/2254556.2254587

Misawa, Kana, Ishiguro, Yoshio, Rekimoto, Jun (2012): LiveMask: a telepresence surrogate system with a face-shaped screen for supporting nonverb. In: Proceedings of the 2012 International Conference on Advanced Visual Interfaces , 2012, . pp. 394-397. https://dx.doi.org/10.1145/2254556.2254632

Rekimoto, Jun (2012): Squama: a programmable window and wall for future physical architectures. In: Proceedings of the 2012 International Conference on Uniquitous Computing , 2012, . pp. 667-668.

New to UX Design? We're Giving You a Free eBook!

The Basics of User Experience Design

Download our free ebook “The Basics of User Experience Design” to learn about core concepts of UX design.

In 9 chapters, we’ll cover: conducting user interviews, design thinking, interaction design, mobile UX design, usability, UX research, and many more!

A valid email address is required.
314,847 designers enjoy our newsletter—sure you don’t want to receive it?

New to UX Design? We're Giving You a Free eBook!

The Basics of User Experience Design

Download our free ebook “The Basics of User Experience Design” to learn about core concepts of UX design.

In 9 chapters, we’ll cover: conducting user interviews, design thinking, interaction design, mobile UX design, usability, UX research, and many more!

A valid email address is required.
314,847 designers enjoy our newsletter—sure you don’t want to receive it?