Jean Oh, Ph.D.

Jean Oh
Jean Oh is a Systems Scientist (research faculty) at the Robotics Institute at Carnegie Mellon University. Her research interests lie in the areas of AI in robotics including autonomy, language understanding, multimodal perception, path planning, and machine learning. Currently, she is leading the perception and the learning tasks for the DARPA Aircrew-Labor In-Cockpit Automation System (ALIAS) program that aims to bring intelligence to cockpits through semantic perception and learning new skills from observing experienced pilots. She is also a PI on the intelligence architecture subtask of the ARL RCTA program where her team’s work on language understanding on robot navigation won the Best Cognitive Robotics Paper Award at the IEEE International Conference on Robotics and Automation (ICRA) in 2015. Jean received her Ph.D. in Language and Information Technologies at Carnegie Mellon University, M.S. in Computer Science at Columbia University, and B.S. in Biotechnology at Yonsei University. 

 Ad: Matt Walter, Zhou Yu and I are organizing a AAAI Fall Symposium on Natural Communication for Human-Robot Collaboration in D.C. in Nov. 9-11, 2017:

This event will be an interdisciplinary gathering of researchers in the field of robotics, natural language technologies, computer vision, human-robot interaction and more. Please share this information with anyone who might be interested. We look forward to seeing you in D.C.!

Anirudh Vemula (RI MS student), co-advise with Katharina Muelling
Sz-Rung Shiang (LTI MS student), co-advise with Anatole Gershman 
Junjie Hu (LTI MS student), co-advise with Anatole Gershman, Jaime Carbonell

Demo videos:

Commanding a ground vehicle robot using speech commands (a complex mission) [AAAI'15, ICRA'15, IJCAI'16, ISER'16]:

RCTA Capstone 2014: Screen the back door.

Commanding a ground vehicle robot using speech commands (semantic navigation)

RCTA: Semantic Navigation

Commanding a ground vehicle robot using speech commands (semantic navigation from the robot's view)

RCTA: Semantic Navigation (Robot's view)

Instructing robot arms via speech commands (2):

Project Andy: Instructing robot arms via speech commands

Instructing robot arms using speech commands (1):

Robot following verbal instructions

Contact Information:
National Robotics Engineering Center, Carnegie Mellon University,
Ten 40th Street, Pittsburgh, PA 15201, Room 275 (NREC)

The Robotics Institute, Carnegie Mellon University,
5000 Forbes Ave, Pittsburgh, PA 15213, NSH 4521 (Main campus)