Updating the Camera and Robot Setup in Isaac Lab

In this update Eman showcases a major update to his robotics project. The robot can now move autonomously toward rewards with high accuracy, making decisions based on its environment rather than following predefined paths.

Check out Muhammad Eman Aftab ’s work from our Budapest research lab. Eman is one of our AI researchers, working on inspiring research projects and, most importantly, building in public, with the good, the bad, and the ugly!

In this demo, Eman walks through two key steps in advancing his vision-based control system. First, he calibrates the camera, upgrading the model from a 2D guess-based approach to a proper 3D calibration setup for more accurate perception. He then sets up the Isaac environment, laying the groundwork for testing, simulation, and future autonomous behavior.

In this introductory video, Eman shares the vision behind his project at the Lightbloom AI Lab in Budapest: building a system that can transform simple hand-drawn sketches into fully playable board games.