Your Misty II robot has been designed and built by the Misty Robotics team. This document provides some quick, out-of-box setup steps and helpful details about using Misty II.
To avoid the risk of driving Misty off a high surface, we recommend either working with your robot on the floor, or temporarily elevating the treads so the robot cannot drive. To do this, you can place Misty on the the foam block stand that arrived in the box. While Misty is designed to automatically detect obstacles and ledges, placing her on this foam block will ensure that she doesn’t accidentally roll off the table while you're coding.
Misty II arrives packed safely inside her carrying case. The easiest and safest way to remove Misty from her case is to open the latches and position the case vertically, so the robot is fully upright. With the case open, grip the Misty II by its torso (never by the arms) and gently slide it out of or into the case.
Note: The robot’s arms and related components can become damaged under excessive force. To avoid damaging your robot, never remove the Misty II from its packaging by pulling on its arms.
Misty II arrives with her magnetic headpiece and backpack attachments connected. In addition to the robot, the carrying case includes the following items:
- charging station
- charging station AC power supply (thin barrel jack)
- foam block stand for Misty II
- legal guide
- printed User Guide
Warning: Do not attempt to connect the AC power supply for the charging station to the port underneath Misty's base.
A separate AC power supply for charging Misty II via a wired connection may be shipped as an optional accessory. The barrel jack on this power supply is thicker than the power supply for the wireless charging station, and is designed to fit the power port underneath Misty's base. This power supply uses a different voltage than the power supply for Misty's wireless charging station. Do not attempt to use these power supplies interchangeably.
Tip: Misty's packaging has been specially designed to protect your robot during shipping. You can keep the original packaging for shipping or for traveling with your robot in the future.
We recommend powering up Misty on the floor, if possible, to avoid the risk of driving your robot off the edge of a table or other high surface. If you are experimenting with Misty on a table top, place her on the foam block stand that arrived in her carrying case to elevate her treads above the surface of the table.
- Toggle the power switch on Misty's base (located between the treads beneath the rear time-of-flight sensor).
- The Misty Robotics logo first appears on the screen. Then Misty’s eyes appear, beginning in a closed state. The eyes gradually open as Misty boots up.
- When the eyes appear fully open, Misty is done booting up. This should take a little more than a minute.
Note: Your Misty II arrives with her battery charged and should not require additional charging before first use. When her battery is low, Misty may fail to respond to some API commands. If this happens you can restore functionality by connecting your robot to a power source and performing a manual reboot.
If you need to restart Misty:
- Turn off the power switch on Misty's base.
- Wait 10 seconds.
- Turn on the power switch on Misty's base again. Misty has rebooted when her eyes are fully open.
To turn off your robot, turn off the power switch on Misty’s base.
Note: There is no graceful shutdown at this time. When Misty’s battery gets below about 7 volts, she abruptly powers down.
You send REST commands to Misty and install skills on her system over your local Wi-Fi connection. When your robot is powered on, you can set up Misty's internet connection with the Misty App.
You can charge Misty with her wireless charging station, or you can plug Misty’s AC power supply (optional accessory) directly into the port on her base. When charging while powered on, Misty's chest LED pulses orange.
Note: Misty's fans turn on while the robot is charging, even when Misty is turned off. These fans stay on for as long as the robot is charging.
Warning: The AC power supply for charging Misty via a wired connection is not interchangeable with the power supply for the wireless charging station. Do not attempt to charge Misty by connecting her directly to the power supply for the wireless charging station, and do not attempt to connect the charging station to the AC power supply that connects directly to the port underneath Misty's base.
To use Misty's wireless charging station, follow these steps:
- Connect the power supply for the wireless charging station to power. To prevent tripping hazards, wrap any extra length of the power cable around the nodes inside the rear compartment of the charging station.
- Place the charging station on the floor.
- Place Misty on the center of the charging station. Position her to be facing out, with her back against the rear compartment of the charging station, and make sure the arrows on Misty's base are lined up with the arrows on the charging station.
Note: When Misty is turned off, she automatically stops receiving a charge from the wireless charging station after charging for about four hours. This timeout occurs whether the robot is fully charged or not. To make sure Misty receives a full charge, we recommend powering her on before setting her on the wireless charging station.
Follow these steps to charge Misty via a wired connection:
- Remove the rubber flap covering the power port underneath Misty’s base.
- Connect Misty’s AC power supply (not the power supply for the wireless charging station) to her power port.
- Connect the power supply to an outlet.
As you develop skills and robot applications, it can be helpful to understand a few key details about Misty's coordinate system and the range of movement allowed for her head and arm motors.
Tip: For a graphical representation of Misty's coordinate system and movement ranges, be sure to download the Misty II Coordinate System & Movement Ranges PDF.
- Misty uses a right-handed coordinate frame when orienting her body, head, and arms relative to her surroundings, when interpreting movement and locomotion commands, and when publishing sensor data.
- Most of Misty's commands and event types ingest and publish angular measurement data using degrees (instead of radians) as the default unit of measurement. As such, we recommend using degrees to calculate position and movement whenever you can.
- Misty's inertial measurement unit (IMU) orients its heading to
0/360degrees each time Misty boots up. For Misty, an IMU
0/360degrees does not represent true north unless Misty is facing true north when the IMU orients its heading.
- Because the IMU is located in Misty's torso, readings from the IMU only change when Misty's body moves. They do not change relative to the position of Misty's head.
- A positional value of 0 degrees orients Misty's arms to point horizontally forward, directly in front of the robot. To prevent interference between the arms and the plastic lens protecting Misty's display, her arms cannot move higher than -29 degrees. Additionally, they cannot move lower than 90 degrees (pointing straight down).
- A positional value of 0 degrees for head movement in the roll, pitch, and yaw directions orients Misty's head to face straight forward, directly in front of the robot.
- The system returns audio localization data relative to the direction Misty's head is facing (instead of her torso). The heading of Misty's face is the
0/360angle relative to incoming audio localization data.
Misty II exhibits certain behaviors that override commands she receives from skills and robot applications. Some of these default behaviors are cosmetic, and others help prevent Misty from executing commands that could cause harm to Misty, the people around her, or her environment. The sections below describe some of these behaviors in detail, so you can understand how to work with (or around) them in your skill development.
The following chest LED notifications are enabled by default. You can turn them off by sending a request to the
SetNotificationSettings endpoint in Misty's REST API.
- Recording Audio - While Misty is recording audio or listening for the "Hey, Misty!" key phrase, her chest LED pulses blue.
- Charging - While Misty is powered on and charging, her chest LED pulses orange. When her battery is fully charged and she is on/connected to her charger, the LED turns solid orange.
- Face Training - When you are training Misty on a new face, her chest LED displays the following notifications:
- When the face detection phase of the training process is complete, the LED turns green.
- When training is complete, the LED blinks green three times.
- If training fails, the LED blinks red three times.
- If Misty sees more than one face, the LED blinks yellow three times.
- If Misty doesn't see a face, the LED turns yellow.
- System Updates - While Misty is performing a system update, the LED blinks white.
The following audio notifications are enabled by default. You can turn them off by sending a request to the
SetNotificationSettings endpoint in Misty's REST API.
- Wake Word - When Misty recognizes the "Hey, Misty!" key phrase, she plays the system audio file
s_SystemWakeWord.wav. You can change the default wake word sound by sending a request to the
SetNotificationSettingsendpoint in Misty's REST API.
Misty ignores all commands she receives for as long as she detects someone touching the
CapTouch_Scruff sensor in the handle on the back of her head. This behavior is designed is to prevent Misty from moving in ways that could damage her (or the human holding her) if she’s picked up while running a skill. This behavior does not cancel any running skills. It only causes Misty to ignore commands those skills invoke. When the
CapTouch_Scruff touch sensor is released, Misty resumes execution of any new commands she receives.
Misty's software includes a built-in hazards system that is intended to prevent your robot from executing commands that could cause her harm. This system uses data from Misty's sensors to prevent Misty from driving off of surfaces that could cause her to tip or fall, such as tables, desks, or stairs. It also stops Misty from continuing to drive when she senses an obstacle nearby, or when she detects that she has bumped into an object.
In addition to protecting your robot from harm, the hazards system sends an event message each time Misty enters or exits a hazards state. You can use these messages to programmatically alter Misty's course when she detects cliffs or obstacles while autonomously navigating her environment. See the Event Types section of these docs for details on using this data in your skills.
By default, Misty's bump and time-of-flight sensors put the robot into a hazard state in the following circumstances:
- when her edge time-of-flight sensors detect a drop distance of 0.06 meters (60 mm) or greater in the direction she is moving.
- when her range time-of-flight sensors detect an obstacle 0.215 meters (215 mm) or closer in the direction she is moving.
- when one of her bump sensors becomes activated, indicating she has collided with an object.
When Misty detects an obstacle or an edge, she ignores any commands that would move her in the direction of the sensors that are in a hazard state. For example, when Misty is driving forward, she stops driving if one or more of the following happens:
- if one of her front-facing bump sensors is pressed
- if the front edge time-of-flight sensors detect a high ledge
- if the front range sensors detect an obstacle nearby
In this situation, after she stops driving, Misty ignores any forward drive commands until the system indicates none of her front bump or time-of-flight sensors are in a hazard state. To get out of a hazard state, you can code Misty to reverse directions and choose a new path.
To enable the hazards system to work effectively, Misty's max speed is limited to ~450 mm/s. This is the highest speed at which Misty can safely detect most ledges and stop moving, without being carried over the edge by any built-up momentum. The hazards system will be enhanced in future updates to allow for increased performance and to increase Misty's default max speed.
Note: While edge detection has proven effective in most of our testing, there are still situations in which the robot may fail to catch herself. It's more difficult for the hazards system to detect an edge when Misty is driving backwards or on tables with rounded edges. The larger the radius of the curve, the harder it is for Misty to stop moving in time to prevent falling. Until further enhancements to the hazards system are in place, we recommend you continue to operate Misty using the foam block on high surfaces like tables, counter-tops, and desks, unless you are supervising Misty and can safely catch her in the event of a fall and have also done extensive testing with the robot in your specific environments.
You can access your robot's file system by connecting to the her file server over your local network connection.
- Power Misty on and make sure she is connected to the same network as your computer.
- Connect to your robot's file system.
- On a Mac:
- Open Finder
- Select Go → Connect to Server from the top menu
- On Windows 10:
- Open File Explorer
- Navigate to the path
- On a Mac:
- When prompted, enter the username and password printed on the sticker on the bottom of your robot's base.
Misty is packed with sophisticated hardware and software features that contribute to her ruggedness and extensibility as a platform.
- Height: 35.56 cm / 14 in
- Depth: 25.4 cm / 10 in
- Width: 20.32 cm / 8 in
- Weight: 2.7 kg / 6 lbs
- Qualcomm® Snapdragon 820™ mobile processor
- Qualcomm® Snapdragon 410™ processor
- Occipital Structure Core depth sensor for 3D maps
- 166° diagonal field of view wide-angle Structure Core camera (106° horizontal x 60° vertical)
- 4K camera
- Facial recognition
- Deep-learning AI using Qualcomm® Snapdragon™ Neural Processing
- 3 far-field microphones using Qualcomm® FluenceTM PRO
- 2 high-fidelity speakers with engineered sound box and bass port
- 6 capacitive touch sensors on head and chin
- 8 IR-based time-of-flight sensors (3 forward, 1 rear, 4 edge/downward)
- 10 bump sensors (3 tied in parallel on each front corner, 2 tied in parallel on each rear corner)
- Patent-pending 3-degree of freedom neck
- Easily customizable moving arms
- Sturdy track-driving tread system
- Trailer hitch to pull a payload
- 4” LCD image display/screen
- Bright LED flashlight
- Multi-color LED chest light
- 2.4 and 5 Ghz Wi-Fi connection
- Bluetooth and Bluetooth Low Energy capabilities
- USB/Serial-connected backpack for hardware extension
- Arduino-compatible Backpack (optional)
- Magnetic helmet connection point
- Windows IoT Core™ (Main)
- Android™ 8 (navigation/computer vision)