Abstract: “Despite decades of progress, machines remain intelligent tools rather than collaborative partners in individual human enterprise. A key reason is that machine perception of inter-personal communication is largely unsolved and a computationally accessible representation of such behavior remains elusive. In this talk, I will describe our research arc over the past decade at CMU to make human signaling a perceptible channel of information for machines. This research includes the construction of the Panoptic Studio, a multisensor facility designed to capture social behavior, and the development of Open Pose, a realtime 2D pose estimation approach whose demo you may have encountered on the fourth floor of NSH. I will share recent progress in moving from the lab to the real world and discuss futures in this research expedition.”