Skip to main content

Capstone Project: The Autonomous Humanoid

Project Overview​

Create an autonomous humanoid that receives a voice command, navigates to an object, identifies it, and manipulates it.

Milestones​

  1. Milestone 1 (Voice): Integrate Whisper to turn speech into text.
  2. Milestone 2 (Planning): Use LLM to decompose commands and send goals to Nav2.
  3. Milestone 3 (Perception): Integrate object detection to identify the target.
  4. Milestone 4 (Manipulation): Execute grasping logic.
  5. Milestone 5 (Integration): Final system assembly in Gazebo/Isaac Sim.

Takeaways​

  • Integration is where the most complex robotic challenges arise.
  • Successful projects require robust, modular components.

Review Questions​

  1. What is the most critical integration challenge in this project?