Skip to content

Preview dashboard: egocentric and wrist views, depth, odometry and IMU, with the current action label. The full-resolution streams are in the MCAP.

Action timeline

7 labelled actions

Sensor streams in the MCAP

16 topics
MCAP topics, message schemas and rates
TopicSchemaRateMessages
/ego/cam_head/depth/camera_infosensor_msgs/msg/CameraInfo30 Hz8,095
/ego/cam_head/depth/image/compressedsensor_msgs/msg/CompressedImage30 Hz8,095
/ego/cam_head/imu/datasensor_msgs/msg/Imu199.6 Hz53,880
/ego/cam_head/left/camera_infosensor_msgs/msg/CameraInfo30 Hz8,095
/ego/cam_head/left/image/compressedfoxglove.CompressedVideo30 Hz8,095
/ego/cam_head/odomnav_msgs/msg/Odometry30 Hz8,095
/ego/cam_head/right/camera_infosensor_msgs/msg/CameraInfo30 Hz8,095
/ego/cam_head/right/image/compressedfoxglove.CompressedVideo30 Hz8,095
/tftf2_msgs/msg/TFMessage30 Hz8,095
/tf_statictf2_msgs/msg/TFMessage2.9 Hz794
/wrist_left/image/camera_infosensor_msgs/msg/CameraInfo30 Hz8,098
/wrist_left/image/compressedfoxglove.CompressedVideo30 Hz8,098
/wrist_left/imu/datasensor_msgs/msg/Imu200 Hz53,999
/wrist_right/image/camera_infosensor_msgs/msg/CameraInfo30 Hz8,098
/wrist_right/image/compressedfoxglove.CompressedVideo30 Hz8,098
/wrist_right/imu/datasensor_msgs/msg/Imu199.8 Hz53,940

Annotation

5dd29aa361bf8220d7739d7029977763.json
{
  "category": "Material Handling & Transport",
  "duration_s": 270,
  "segments": [
    {
      "start_s": 0,
      "end_s": 43,
      "title": "Pulling pallet jack",
      "description": "The worker positions and pulls a pallet jack loaded with crates across the floor."
    },
    {
      "start_s": 43,
      "end_s": 46,
      "title": "Idle"
    },
    {
      "start_s": 46,
      "end_s": 63,
      "title": "Stacking empty wooden pallet",
      "description": "The worker lifts an empty wooden pallet and places it onto a stack."
    },
    {
      "start_s": 63,
      "end_s": 75,
      "title": "Idle"
    },
    {
      "start_s": 75,
      "end_s": 120,
      "title": "Pulling loaded pallet jack",
      "description": "The worker pulls a pallet jack loaded with crates across the floor."
    },
    {
      "start_s": 120,
      "end_s": 138,
      "title": "Maneuvering empty pallet jack",
      "description": "The worker lowers the pallet, pulls out the jack, and maneuvers it to a new position."
    },
    {
      "start_s": 138,
      "end_s": 179,
      "title": "Loading and pulling pallet with jack",
      "description": "The worker positions the pallet jack under a new pallet, lifts it, and pulls it across the floor."
    },
    {
      "start_s": 179,
      "end_s": 180,
      "title": "Idle"
    },
    {
      "start_s": 180,
      "end_s": 254,
      "title": "Pulling loaded pallet jack",
      "description": "The worker pulls a pallet jack loaded with boxes and bins across the floor."
    },
    {
      "start_s": 254,
      "end_s": 255,
      "title": "Idle"
    },
    {
      "start_s": 255,
      "end_s": 270,
      "title": "Maneuvering empty pallet jack",
      "description": "The worker maneuvers an empty pallet jack across the factory floor."
    }
  ]
}