Teaching a Robot to Seek Rewards Autonomously

In this demo, Eman walks through recent updates to his robotics project, focusing on improvements to the camera setup and the robot configuration within the Isaac Lab environment. These changes help create a more stable and accurate system for perception, simulation, and future autonomous development.

Check out Muhammad Eman Aftab ’s work from our Budapest research lab. Eman is one of our AI researchers, working on inspiring research projects and, most importantly, building in public, with the good, the bad, and the ugly!

In this demo, Eman walks through two key steps in advancing his vision-based control system. First, he calibrates the camera, upgrading the model from a 2D guess-based approach to a proper 3D calibration setup for more accurate perception. He then sets up the Isaac environment, laying the groundwork for testing, simulation, and future autonomous behavior.

In this introductory video, Eman shares the vision behind his project at the Lightbloom AI Lab in Budapest: building a system that can transform simple hand-drawn sketches into fully playable board games.