Hi, I'm Himanshu!

I am a Ph.D. student in Reinforcement Learning and I'm currently on the job hunt! My thesis work is on speeding up reinforcement learning in particularly challenging environments, such as visual navigation with sparse rewards, or partially observable domains. I am also interested in hierarchical learning and compositionality. I have published at top ML conferences such as NeurIPS, ICML, and AAMAS (click here for a full list). I have also interned at Microsoft Research, Tesla Autopilot, Facebook, and Offworld Inc. My thesis advisor is Dr. Charles Isbell in the Pfunk research group. I graduated with a B. Tech. from IIT Delhi in 2011.