Skip to content

Preview dashboard: egocentric and wrist views, depth, odometry and IMU, with the current action label. The full-resolution streams are in the MCAP.

Action timeline

5 labelled actions

Sensor streams in the MCAP

16 topics
MCAP topics, message schemas and rates
TopicSchemaRateMessages
/ego/zed_head/depth/camera_infosensor_msgs/msg/CameraInfo30 Hz7,830
/ego/zed_head/depth/image/compressedsensor_msgs/msg/CompressedImage30 Hz7,830
/ego/zed_head/imu/datasensor_msgs/msg/Imu199.4 Hz52,054
/ego/zed_head/left/camera_infosensor_msgs/msg/CameraInfo30 Hz7,830
/ego/zed_head/left/image/compressedfoxglove.CompressedVideo30 Hz7,830
/ego/zed_head/odomnav_msgs/msg/Odometry30 Hz7,830
/ego/zed_head/right/camera_infosensor_msgs/msg/CameraInfo30 Hz7,830
/ego/zed_head/right/image/compressedfoxglove.CompressedVideo30 Hz7,830
/tftf2_msgs/msg/TFMessage30 Hz7,830
/tf_statictf2_msgs/msg/TFMessage2.9 Hz767
/wrist_left/image/camera_infosensor_msgs/msg/CameraInfo30 Hz7,830
/wrist_left/image/compressedfoxglove.CompressedVideo30 Hz7,830
/wrist_left/imu/datasensor_msgs/msg/Imu199.6 Hz52,092
/wrist_right/image/camera_infosensor_msgs/msg/CameraInfo30 Hz7,830
/wrist_right/image/compressedfoxglove.CompressedVideo30 Hz7,830
/wrist_right/imu/datasensor_msgs/msg/Imu199 Hz51,940

Annotation

b4c27711558df5a938b15917e44a6867.json
{
  "duration_s": 261,
  "segments": [
    {
      "start_s": 0,
      "end_s": 60,
      "title": "Inspecting and sorting parts",
      "description": "The worker picks parts from bins, inspects them, and sorts them with a coworker."
    },
    {
      "start_s": 60,
      "end_s": 65,
      "title": "Idle"
    },
    {
      "start_s": 65,
      "end_s": 99,
      "title": "Weighing items on scale",
      "description": "The worker places bins and parts on a scale to weigh them."
    },
    {
      "start_s": 99,
      "end_s": 148,
      "title": "Idle"
    },
    {
      "start_s": 148,
      "end_s": 202,
      "title": "Checking and recording inventory",
      "description": "The worker checks items in crates, points to a scale, and discusses with another worker who records information."
    },
    {
      "start_s": 202,
      "end_s": 208,
      "title": "Idle"
    },
    {
      "start_s": 208,
      "end_s": 245,
      "title": "Reviewing documents",
      "description": "The worker holds and reviews a paper document, then walks while looking at it."
    },
    {
      "start_s": 245,
      "end_s": 246,
      "title": "Idle"
    },
    {
      "start_s": 246,
      "end_s": 261,
      "title": "Scanning items from bins",
      "description": "The worker scans items from the red and yellow bins."
    }
  ]
}