Skip to content

[BUG] XVLA async inference error #2622

@eliasab16

Description

@eliasab16

I'm running the following async inference script:

server_address: localhost:8080

robot:
  type: so101_follower
  port: /dev/tty.usbmodem5A680122821
  id: right_follower
  cameras:
    wrist_top:
      type: opencv
      index_or_path: 0
      width: 800
      height: 600
      fps: 30
    overview_top:
      type: opencv
      index_or_path: 1
      width: 800
      height: 600
      fps: 30
    overview_bottom:
      type: opencv
      index_or_path: 2
      width: 800
      height: 600
      fps: 30
    wrist_bottom:
      type: opencv
      index_or_path: 3
      width: 800
      height: 600
      fps: 30


policy_type: xvla
policy_device: mps
actions_per_chunk: 50
chunk_size_threshold: 0.8
aggregate_fn_name: weighted_average
debug_visualize_queue_size: true
pretrained_name_or_path: {hf_username}/{name}
task: {task_name}

rename_map:
  observation.images.overview_bottom: observation.images.image
  observation.images.overview_top: observation.images.image2
  observation.images.wrist_bottom: observation.images.image3
  observation.images.wrist_top: observation.images.image4

But I'm running into the following error (not very descriptive):

INFO 2025-12-10 23:33:04 y_server.py:227 Running inference for observation #0 (must_go: False)
ERROR 2025-12-10 23:33:04 y_server.py:267 Error in StreamActions: 'observation.images.wrist_top'

I tried to replace the camera names in the "cameras" field to match the names used in the training, but I still run into the same error with just the camera name updated in the error message.

For context, the camera names are the ones I used when collecting the data, then I mapped them to the standardized format ("image", "image2", etc.) during training. I'm passing the exact format to the "rename_map" parameter*.

Resources consulted:
-> https://huggingface.co/docs/lerobot/en/introduction_processors.

*Note: I locally updated the async inference script to accept the "rename_map" parameter (the logic handling the mapping already exists, just the script isn't yet updated by lerobot to accept the param).

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions