Capstone Project: The Autonomous Humanoid
Project Overview
Create an autonomous humanoid that receives a voice command, navigates to an object, identifies it, and manipulates it.
Milestones
- Milestone 1 (Voice): Integrate Whisper to turn speech into text.
- Milestone 2 (Planning): Use LLM to decompose commands and send goals to Nav2.
- Milestone 3 (Perception): Integrate object detection to identify the target.
- Milestone 4 (Manipulation): Execute grasping logic.
- Milestone 5 (Integration): Final system assembly in Gazebo/Isaac Sim.
Takeaways
- Integration is where the most complex robotic challenges arise.
- Successful projects require robust, modular components.
Review Questions
- What is the most critical integration challenge in this project?