Picture taken by Tao Pang

Nicholas Ezra Pfaff
nepfaff at mit dot edu

I am a second-year PhD student at MIT, where I am advised by Prof. Russ Tedrake in the Robot Locomotion Group.

My research aims to scale realistic simulations for generating training data for robotic manipulation foundation models. I enjoy combining model-based and learning-based methods to tackle this challenge.

Before joining MIT, I completed my MEng at Imperial College London and spent nine months at Ocado Technology, where I worked on parallel yaw pick-and-place systems at scale.

Outside of academia, I am passionate about rock climbing, backpacking, Latin social dancing, and specialty coffee.

Github / Google Scholar / Twitter / YouTube / LinkedIn

News

Research

Steerable Scene Generation with Post Training and Inference-Time Search

Nicholas Pfaff, Hongkai Dai, Sergey Zakharov, Shun Iwase, Russ Tedrake
Under Review
Website  •   ArXiv  •   GitHub

Scalable Real2Sim: Physics-Aware Asset Generation Via Robotic Pick-and-Place Setups

Nicholas Pfaff, Evelyn Fu, Jeremy Binagia, Phillip Isola, Russ Tedrake
International Conference on Intelligent Robots and Systems (IROS 2025)
New England Manipulation Symposium (NEMS 2025), Oral
Website  •   ArXiv  •   GitHub

Empirical Analysis of Sim-and-Real Cotraining of Diffusion Policies for Planar Pushing from Pixels

Adam Wei, Abhinav Agarwal, Boyuan Chen, Rohan Bosworth, Nicholas Pfaff, Russ Tedrake
International Conference on Intelligent Robots and Systems (IROS 2025)
Website  •   ArXiv

Outside the Lab

I enjoy staying active in my free time. These days, that means bouldering and Latin social dancing (Salsa & Bachata) several times a week. In the past, I competed in long-distance running and rowing. During holidays, I often trek, backpack, or cycle in different parts of the world.

Camping in Bulgaria Bouldering indoors Kilimanjaro Uhuru peak Imperial College London Dance Showcase