This project demonstrates how CrowBot can be controlled using VoxControl, combining natural voice input and motion-based control into a single, intuitive interface.
-
Voice control — issue commands in natural language, without memorizing fixed phrases
-
Motion control — steer and adjust behavior using device orientation (IMU)
Instead of predefined commands, VoxControl understands intent and variations in speech, enabling more flexible and human-like interaction. (See the AI Voice Control Without Memorizing Commands)
The same approach can be extended with new commands and behaviors by adding your own words and phrases as plain text, allowing the robot to understand and respond to voice commands that were not predefined at design time. (See the next-gen VoiceAI overview article)
A racing scenario where voice commands are used to start, control, and manage the robot during a race. (See the CrowBot Racing article for details)
Once you flash our program to the CrowBot (see how to do it), the robot can receive commands from the Vox Control Board via Bluetooth.
- Turn on the robot and the VoxControl.
- Enable Bluetooth on the robot by sliding the switch.
- The robot will automatically connect to the VoxControl, and a connection icon will appear on the board.
https://www.hackster.io/Grovety/next-gen-voiceai-opening-new-ground-for-makers-to-explore-52813d
After the connection is established, the robot can process voice commands, which are then converted into movement commands or other actions.
You can use two modes to control CrowBot-BOLT:
- Recognizing voice commands from a predefined list.
- Reading the board's tilt along the X and Y axes.
Demo: https://youtu.be/RoclNdVzP7A
The board "listens" to user commands through its built-in microphones and recognizes them using a neural network. The recognized command is transmitted to CrowBOT.
| Voice Command | Action |
|---|---|
| ROBOT WAKE UP | The DevBoard wakes up. The robot performs no action. |
| ROBOT SLEEP | The DevBoard goes into sleep mode and stops responding to voice commands. The robot performs no action. |
| MANUAL CONTROL | The DevBoard switches to tilt control mode. The robot enters tilt control mode and stops responding to voice movement commands. |
| VOICE CONTROL | Tilt control mode is disabled, returning to voice control mode. |
| GO RIGHT | Turn right. |
| GO LEFT | Turn left. |
| GO FORWARD | Move forward and then stop. |
| GO BACK | Move backward and then stop. |
| GO HOME | No action. |
| SLOWER SPEED | No action. |
| FASTER SPEED | No action. |
| LIGHTS ON | Turn on the LED backlight on the Ultrasonic Sensor (simulating headlights). |
| LIGHTS OFF | Turn off the LED backlight on the Ultrasonic Sensor (simulating headlights). |
| PLAY MUSIC | The robot plays a preset melody. |
Demo: https://youtu.be/FIsmTgkFIoI
To activate tilt control mode, say 'Manual Control' or press the USER button.
Once activated, the display on the DevBoard will update, and the robot will no longer respond to voice commands for movement.
Make sure to place the Board on a flat surface before starting, as it will calibrate when entering tilt control mode. When you see a circle on two intersecting lines appear on the screen, the calibration is done, and you’re ready to start controlling the robot.
Tilt the Board forward, backward, left, or right to control the robot's movement. The tilt angle determines the robot's speed.
You can use voice commands 'Play Music' and 'Lights On' or 'Lights Off' in Tilt mode.
To quit say 'Voice Control' or press USER button.