Jean Oh, Ph.D.

  
Jean Oh is a Robotics Commercialization Specialist, a special faculty at the Robotics Institute at Carnegie Mellon University where she leads projects in the areas of AI in robotics including autonomy, language understanding, multimodal perception, path planning, and machine learning. Currently, she is leading the perception and the learning tasks for the DARPA Aircrew-Labor In-Cockpit Automation System (ALIAS) program that aims to bring intelligence to cockpits through semantic perception and learning new skills from observing experienced pilots. She is also a PI on the intelligence architecture subtask of the ARL RCTA program where her team’s work on language understanding on robot navigation won the Best Cognitive Robotics Paper Award at the IEEE International Conference on Robotics and Automation (ICRA) in 2015. Jean received her Ph.D. in Language and Information Technologies at Carnegie Mellon University, M.S. in Computer Science at Columbia University, and B.S. in Biotechnology at Yonsei University. 

Students:
Anirudh Vemula (RI MS student), co-advise with Katharina Muelling
Sz-Rung Shiang (LTI MS student), co-advise with Anatole Gershman 
Junjie Hu (LTI MS student), co-advise with Anatole Gershman, Jaime Carbonell

Demo videos:

Commanding a ground vehicle robot using speech commands (a complex mission):

RCTA Capstone 2014: Screen the back door.

Commanding a ground vehicle robot using speech commands (semantic navigation)

RCTA: Semantic Navigation


Commanding a ground vehicle robot using speech commands (semantic navigation from the robot's view)

RCTA: Semantic Navigation (Robot's view)

Instructing robot arms via speech commands (2):

Project Andy: Instructing robot arms via speech commands

Instructing robot arms using speech commands (1):

Robot following verbal instructions

Contact Information:
National Robotics Engineering Center / Carnegie Mellon University,
Ten 40th Street, Pittsburgh, PA 15201, Room 275 / NSH 4521 (on campus)
jeanoh@nrec.ri.cmu.edu