Skip to content

Preview dashboard: egocentric and wrist views, depth, odometry and IMU, with the current action label. The full-resolution streams are in the MCAP.

Action timeline

4 labelled actions

Sensor streams in the MCAP

16 topics
MCAP topics, message schemas and rates
TopicSchemaRateMessages
/ego/zed_head/depth/camera_infosensor_msgs/msg/CameraInfo29.2 Hz5,669
/ego/zed_head/depth/image/compressedsensor_msgs/msg/CompressedImage29.2 Hz5,669
/ego/zed_head/imu/datasensor_msgs/msg/Imu200.1 Hz38,822
/ego/zed_head/left/camera_infosensor_msgs/msg/CameraInfo29.2 Hz5,669
/ego/zed_head/left/image/compressedfoxglove.CompressedVideo29.2 Hz5,669
/ego/zed_head/odomnav_msgs/msg/Odometry29.2 Hz5,669
/ego/zed_head/right/camera_infosensor_msgs/msg/CameraInfo29.2 Hz5,669
/ego/zed_head/right/image/compressedfoxglove.CompressedVideo29.2 Hz5,669
/tftf2_msgs/msg/TFMessage29.2 Hz5,669
/tf_statictf2_msgs/msg/TFMessage3 Hz575
/wrist_left/image/camera_infosensor_msgs/msg/CameraInfo29.2 Hz5,671
/wrist_left/image/compressedfoxglove.CompressedVideo29.2 Hz5,671
/wrist_left/imu/datasensor_msgs/msg/Imu199.3 Hz38,671
/wrist_right/image/camera_infosensor_msgs/msg/CameraInfo29.2 Hz5,669
/wrist_right/image/compressedfoxglove.CompressedVideo29.2 Hz5,669
/wrist_right/imu/datasensor_msgs/msg/Imu199.8 Hz38,752

Annotation

39c1322d626f336e6ed91f95c21954d3.json
{
  "duration_s": 194,
  "segments": [
    {
      "start_s": 0,
      "end_s": 28,
      "title": "Arranging plastic trays on rack",
      "description": "The worker pushes clear plastic trays along a sloped rack."
    },
    {
      "start_s": 28,
      "end_s": 43,
      "title": "Sorting bagged items into bin",
      "description": "The worker takes bagged items from a bin and places them into another."
    },
    {
      "start_s": 43,
      "end_s": 44,
      "title": "Idle"
    },
    {
      "start_s": 44,
      "end_s": 97,
      "title": "Organizing plastic containers",
      "description": "The worker sorts plastic containers within a green bin and places them onto an adjacent rack."
    },
    {
      "start_s": 97,
      "end_s": 106,
      "title": "Idle"
    },
    {
      "start_s": 106,
      "end_s": 194,
      "title": "Sorting plastic items into bin",
      "description": "The worker sorts plastic items, some bagged, into a green bin."
    }
  ]
}