Skip to content

Libero Dataset Simulation Errors (smolvla v0.3.2/v0.4.2 + lerobot 0.3.4) #2624

@xiongjie1234

Description

@xiongjie1234

Title
ModuleNotFoundError: No module named 'libero' when Evaluating smolvla v0.3.2-Trained Libero Dataset Model with lerobot 0.3.4
Body
I am encountering a persistent ModuleNotFoundError: No module named 'libero' error when evaluating a model trained on the Libero dataset using smolvla v0.3.2 (old version) with lerobot 0.3.4 (compatible with both smolvla v0.3.2 and v0.4.2). My core goal is to resolve this error and successfully complete the evaluation of the model trained with smolvla v0.3.2. Below are the detailed issue description and environment information:

  1. Core Environment Details
    OS: Ubuntu (x86_64 architecture)
    Python Version: 3.10 (Anaconda virtual environment)
    lerobot Version: 0.3.4 (installed via pip install -e ".[libero]" / pip install -e ".[gym_manipulator]")
    smolvla Versions Tested: v0.3.2 (old version, used for model training) / v0.4.2 (latest version)
    Evaluation Target: Model trained on the Libero dataset using smolvla v0.3.2
    Evaluation Command Executed:
    python lerobot/scripts/eval.py
    --policy.path="/home/ubuntu/xj/output_jiucuo/my_libero_train6/checkpoints/200000/pretrained_model"
    --env.type=gym_manipulator
    --env.task=libero_spatial
    --eval.batch_size=1
    --eval.n_episodes=10
    --policy.device=cuda
    --policy.use_amp=false
    --output_dir="/home/ubuntu/xj/output_ceshi/jiuban/my_libero_eval_spatial"
  2. Critical Errors Encountered
    Core Error Common to Both smolvla Versions
    plaintext
    libero is not installed. Please install it with pip install 'lerobot[gym_manipulator]'
    Traceback (most recent call last):
    File "/home/ubuntu/xj/lerobot-main/lerobot/src/lerobot/scripts/eval.py", line 510, in
    main()
    File "/home/ubuntu/xj/lerobot-main/lerobot/src/lerobot/scripts/eval.py", line 506, in main
    eval_main()
    File "/home/ubuntu/xj/lerobot-main/lerobot/src/lerobot/configs/parser.py", line 225, in wrapper_inner
    response = fn(cfg, *args, **kwargs)
    File "/home/ubuntu/xj/lerobot-main/lerobot/src/lerobot/scripts/eval.py", line 474, in eval_main
    env = make_env(cfg.env, n_envs=cfg.eval.batch_size, use_async_envs=cfg.eval.use_async_envs)
    File "/home/ubuntu/xj/lerobot-main/lerobot/src/lerobot/envs/factory.py", line 69, in make_env
    raise e
    File "/home/ubuntu/xj/lerobot-main/lerobot/src/lerobot/envs/factory.py", line 66, in make_env
    importlib.import_module(package_name)
    File "/home/ubuntu/anaconda3/envs/lerobot/lib/python3.10/importlib/init.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
    File "", line 1050, in _gcd_import
    File "", line 1027, in _find_and_load
    File "", line 1004, in _find_and_load_unlocked
    ModuleNotFoundError: No module named 'libero'
    Additional Observations
    smolvla v0.3.2 (Training & Evaluation Environment):
    Warning when running pip install -e ".[libero]": WARNING: lerobot 0.3.4 does not provide the extra 'libero'
    Wheel build error for egl_probe (non-blocking but notable):
    plaintext
    ERROR: Failed building wheel for egl_probe
    Failed to build egl_probe
    ERROR: Failed to build installable wheels for some pyproject.toml-based projects (egl_probe)
    smolvla v0.4.2 (Evaluation-Only Environment):
    Libero dataset downloads successfully, but the core libero module missing error persists
    Additional distutils-related warning (non-blocking):
    plaintext
    Error processing line 1 of /home/ubuntu/anaconda3/envs/lerobot_new/lib/python3.10/site-packages/distutils-precedence.pth:
    ModuleNotFoundError: No module named '_distutils_hack'
  3. Troubleshooting Steps Attempted (No Resolution)
    Reinstalled lerobot via pip install -e ".[gym_manipulator]" as suggested in the error message
    Attempted reinstalling lerobot via pip install -e ".[libero]" (despite the "extra not found" warning)
    Upgraded pip to the latest version (ran pip install --upgrade pip to v25.3)
    Verified all lerobot dependencies are installed (no missing packages in pip list)
    Tested evaluation in both smolvla v0.3.2 and v0.4.2 environments (same core error occurs)
  4. Questions
    Why does the libero module remain missing even after installing lerobot[gym_manipulator]?
    Is there a separate libero package/repository that needs to be installed manually for lerobot 0.3.4?
    How to resolve the "lerobot 0.3.4 does not provide the extra 'libero'" warning?
    Is the egl_probe wheel build failure related to the missing libero module?
    For a model trained on the Libero dataset with smolvla v0.3.2, what environment configuration is required to successfully complete the evaluation?
    My core objective is to fix the aforementioned error and properly test the results of the Libero dataset-trained model (trained with smolvla v0.3.2). Any guidance would be greatly appreciated!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions