Skip to content

Latest commit

 

History

78 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

GrandTour Logo


The GrandTour Dataset

A project brought to you by RSL - ETH Zurich.

ReferencesBenchmarkHugging FaceROS1ContributingNewsCitation

References

Please first visit the official webpage to learn more about the available data, hardware setup, and registration.

Visit our sponsors and partners, including Leica Geosystems (Hexagon).



COMFORT Localization Benchmark (IROS 2026)

The COMFORT Localization Benchmark evaluates state-estimation and localization methods on GrandTour. It is organized with the IROS 2026 workshop Data in Field Robotics: From State Estimation to Navigation – IROS 2026.

Phase Dates Files for a complete score Submission limit
Validation July 13, 2026 at 00:00 UTC – August 3, 2026 at 00:00 UTC heap-1.tum, arc-3.tum 20/day, 100 total
Test August 3, 2026 at 00:00 UTC – October 30, 2026 at 23:59 UTC arc-2.tum, arc-7.tum, con-4.tum, eig-1.tum, snow-2.tum, spx-2.tum 15/day, 60 total

Only test-phase submissions count toward the final ranking, which uses average Absolute Trajectory Error (ATE); lower is better. Test reference trajectories remain hidden. Award-eligible submissions must be made from August 3, 2026 at 00:00 UTC through September 21, 2026 at 23:59 Anywhere on Earth (September 22 at 11:59 UTC). Award recipients must present their results at the IROS 2026 workshop. Novel methods are prioritized during award selection, which is distinct from leaderboard ranking.

Critical trajectory-frame requirement

Every submitted TUM row must represent T_world_prism(t): the pose of the robot's prism frame at the Leica RTS reference point, expressed in the estimator's map or odometry frame. Do not directly submit the origin of base, an IMU, LiDAR, camera, or another sensor frame.

If an estimator tracks a rigidly attached frame named source, obtain the mission-specific T_source_prism from TF and right-multiply every pose:

T_world_prism(t) = T_world_source(t) T_source_prism

p_world_prism(t) = p_world_source(t)
                   + R_world_source(t) p_source_prism

The source-to-prism lever arm is expressed in source and must rotate with the robot. A position-only source trajectory cannot generally be converted exactly without R_world_source(t). See the ROS 1 prism-conversion guide for TF commands, transform conventions, common mistakes, and a complete Python converter.

Submission essentials

  • Upload one zip archive containing the phase's TUM files at the archive root; do not add subdirectories.
  • Each non-comment row must contain exactly eight finite numeric values: timestamp x y z qx qy qz qw.
  • Each mission file needs at least 100 poses and nonzero quaternions. Strictly increasing timestamps are recommended.
  • Each missing phase mission receives 9999 m for ATE, RTE, and Last Error, including in the phase average.
  • The evaluator performs rigid SE(3) alignment, so a different fixed world origin or orientation is acceptable; scale is not corrected.
  • All released sensor streams may be used. The CPT7 IMU stream is redacted and unavailable. Methods must be applicable in real time; post-processing is not allowed.

Use the official Codabench benchmark page for submissions and the leaderboard. The GrandTour localization page contains the benchmark information and rules; these official pages are authoritative if anything changes.



Projects using the GrandTour Dataset

This is a growing list of known public projects and papers that use GrandTour data directly or as curated source data. Last literature check: August 17, 2026. Citation-only mentions and dataset-comparison tables are not included.

Project / paper How GrandTour is used Preview
Physical Terrain Parameter Learning Learns terrain and simulation parameters from RGB and proprioception.
Forward Dynamics Model Learning (FDM) Learns platform-aware forward dynamics for safer navigation.
Holistic Fusion Evaluates task- and setup-agnostic factor-graph state estimation.
RESPLE: Recursive Spline LIO Benchmarks recursive-spline LiDAR-inertial odometry on GrandTour sequences.
CAT: Capability-Aware Traversability Uses GrandTour as the primary source of quadrupedal examples for capability-aware traversability estimation.
GaussGym Converts GrandTour scenes into collision-aware 3D Gaussian Splatting simulators for high-throughput navigation and locomotion.
LiMo: Less Is More (Scalable Visual Navigation) Extends GrandTour deployments with large-scale embodiment-specific navigation trajectories.
VLD: Visual-Language Goal Distance for RL Navigation Adds five hours of GrandTour trajectories to its self-supervised visual-language distance training corpus.
ViLiNT: Multimodal Embodiment-Aware Navigation Transformer Adds six hours of GrandTour RGB and LiDAR trajectories to heterogeneous navigation-policy training.
DeFM: Learning Foundation Representations from Depth Uses GrandTour in a large real-world depth pretraining corpus.
WildOS: Open-Vocabulary Object Search in the Wild Trains frontier prediction using annotated GrandTour images.
NaviTrace: Evaluating Embodied Navigation of VLMs Curates GrandTour image scenarios for embodied VLM navigation evaluation.
Green for Go, Red for No Uses the ETH-2 mission to evaluate visual grounding and waypoint selection for OmniVLA.
CaLiSym Learns and evaluates contact-constrained quadruped dynamics from GrandTour locomotion trajectories.
LIMOncello Evaluates an iterated error-state LiDAR-inertial odometry method on GrandTour.
BIEVR-LIO Evaluates robust LiDAR-inertial odometry on ARC-4, LEE-1, LEICA-2, and TRIM-1.
Iterated Invariant EKF for Quadruped Robot Odometry Evaluates proprioceptive odometry on the Pilatus-Hike2 mission.
A Proprioceptive-Only State-Estimation Benchmark Compares MUSE, IEKF, and an invariant smoother on CYN-1, including accuracy and runtime.
Sensor Configuration Matters Systematically evaluates visual, visual-inertial, and LiDAR-visual-inertial SLAM across seven GrandTour missions and multiple sensor configurations.
Ultra-Fusion Evaluates robust cross-platform sensor fusion on multiple GrandTour legged-robot missions.
G-PROBE Evaluates cross-sensor LiDAR place recognition and localization between SBB-1 and SBB-2.
Chalito Validates an extensible filter-based quadruped state-estimation library on Pilatus-Hike2.
Model-Based and Neural-Aided Approaches for Dog Dead Reckoning Trains and evaluates inertial dead reckoning on 17 GrandTour ANYmal trajectories.
Vernata: Self-Supervised LiDAR Point Representations Pretrains multi-teacher LiDAR representations on GrandTour and annotates 3D frames from the Grindelwald-Canyon missions.
FARM: Find Anything using Relational Spatial Memory Builds three of the seven FARM-Scenes benchmark scenes (warehouse, construction site, automotive museum) from GrandTour data.
COIN-BIEVR Evaluates intensity-augmented LiDAR-inertial odometry on ETH-1 with the Livox Mid-360, including a range-capped degenerate variant.
X-IONet Trains and evaluates cross-platform learned inertial odometry on GrandTour CPT7 IMU data against RoNIN and Go2 baselines.


Hugging Face Instructions

You can find Jupyter notebooks and scripts with full instructions in the examples_hugging_face directory.

Installation Instructions

Click for installation details

These steps assume you are using uv for dependency management.

1. Install using uv

pip3 install uv
uv sync
cd examples_hugging_face
uv sync
uv run scripts/download_data.py

📒 Jupyter Notebook Examples

🐍 Python Scripts



ROS1 Instructions

For ROS 1 replay tools, TF conventions, calibration extraction, and detailed COMFORT prism-frame conversion instructions, see the grand_tour_ros1 package guide.

Download

Click here

To access and download the GrandTour dataset ROS bags, please follow these steps:

1. Register for Access

2. Download ROS bags

Option 1 – Command Line Interface (Recommended):

Install the CLI tool and log in:

pip3 install kleinkram
klein login
  • You can now explore the CLI using tab-completion or the --help flag.

Download multiple files via Python scripting:

python3 examples_kleinkram/kleinkram_cli_example.py

Directly convert ROS bags to PNG images (requires ROS1 installation):

python3 examples_kleinkram/kleinkram_extract_images.py

Option 2 – Web Interface:

Installation

Click here

Create Folders

mkdir -p ~/grand_tour_ws/src
mkdir -p ~/git

Clone and Link Submodules

⚠️ Note: The repository structure is under active development (ROS2/MCAP support is being added). Commands below may evolve.

# Clone the repository
cd ~/git
git clone git@github.com:leggedrobotics/grand_tour_dataset.git
cd grand_tour_dataset; git submodule update --init

# Checkout only the required packages from the grand_tour_box repository for simplicity
cd ~/git/grand_tour_dataset/examples_ros1/submodules/grand_tour_box
git sparse-checkout init --cone
git sparse-checkout set box_model box_calibration box_drivers/anymal_msgs box_drivers/gnss_msgs

# Link the repository to the workspace
ln -s ~/git/grand_tour_dataset/examples_ros1 ~/grand_tour_ws/src/

Setup and Build Catkin Workspace

cd ~/grand_tour_ws
catkin init
catkin config --extend /opt/ros/noetic
catkin config --cmake-args -DCMAKE_BUILD_TYPE=RelWithDebInfo
catkin build grand_tour_ros1
source devel/setup.bash

Download Example Mission

mkdir -p ~/grand_tour_ws/src/examples_ros1/data
cd ~/grand_tour_ws/src/examples_ros1/data
pip3 install kleinkram
klein login
klein download --mission 3c97a27e-4180-4e40-b8af-59714de54a87

Examples

Terminal 1: Launch LiDARs

roslaunch grand_tour_ros1 lidars.launch

# URDFs are automatically loaded by:
#    Boxi:     box_model box_model.launch
#    ANYmal:   anymal_d_simple_description load.launch

Terminal 2: Replay Bags

cd ~/grand_tour_ws/src/examples_ros1/data
# We provide an easy interface to replay the bags
rosrun grand_tour_ros1 rosbag_play.sh --help
rosrun grand_tour_ros1 rosbag_play.sh --lidars --tf_model

# We provide two tf_bags
#   tf_model contains frames required for the URDF model of ANYmal and Boxi.
#   tf_minimal contains only core sensor frames.

You can also try the same for cameras.launch.

Example Output:

LiDAR Visualization Camera Visualization
LiDAR Visualization
Visualization of LiDAR data using lidars.launch.
Camera Visualization
Visualization of images using cameras.launch.

Image Uncompression and Rectification

We provide a launch file to uncompress images and publish rectified images. Install the required dependencies:

sudo apt-get install ros-noetic-image-transport
sudo apt-get install ros-noetic-compressed-image-transport
roslaunch grand_tour_ros1 cameras_helpers.launch

IMUs Visualization

We use rqt-multiplot to visualize the IMU measurements.

Install rqt_multiplot:

sudo apt-get install ros-noetic-rqt-multiplot -y

Start rqt_multiplot and replay the bags:

roslaunch grand_tour_ros1 imus.launch
cd ~/grand_tour_ws/src/examples_ros1/data
rosrun grand_tour_ros1 rosbag_play.sh --imus --ap20

Example Output:
assets/rqt-multiplot.png



Contributing

We welcome contributions to help improve and expand this project. Whether you're interested in adding new examples, enhancing existing ones, or offering suggestions, feel free to open an issue or reach out directly.

We are particularly looking for contributions in the following areas:

  • New and interesting benchmarks
  • ROS2 integration and conversion (MCAP / ROS2 tooling)
  • Visualization tools (e.g., Viser, etc.)
  • Hosting and deployment support in Asia


News



Citation

If you use the GrandTour dataset, please cite the dataset paper:

@article{frey2026grandtour,
  title={GrandTour: A Legged Robotics Dataset in the Wild for Multi-Modal Perception and State Estimation},
  author={Frey, Jonas and Tuna, Turcan and Fu, Frank and Patterson, Katharine and Xu, Tianao and Fallon, Maurice and Cadena, Cesar and Hutter, Marco},
  journal={arXiv preprint arXiv:2602.18164},
  year={2026}
}

*Equal contribution: Jonas Frey and Turcan Tuna.

If you use the Boxi payload/software or cite hardware/payload design decisions, please also cite:

@INPROCEEDINGS{Tuna-Frey-Fu-RSS-25,
    AUTHOR    = {Jonas Frey AND Turcan Tuna AND Lanke Frank Tarimo Fu AND Cedric Weibel AND Katharine Patterson AND Benjamin Krummenacher AND Matthias Müller AND Julian Nubert AND Maurice Fallon AND Cesar Cadena AND Marco Hutter},
    TITLE     = {{Boxi: Design Decisions in the Context of Algorithmic Performance for Robotics}},
    BOOKTITLE = {Proceedings of Robotics: Science and Systems},
    YEAR      = {2025},
    ADDRESS   = {Los Angeles, United States},
    MONTH     = {June}
}

*Shared first authorship: Frey, Tuna, Fu.

About

The GrandTour Dataset: A Legged Robotics Dataset in the Wild

Resources

Stars

156 stars

Watchers

6 watching

Forks

Releases

Packages

Contributors

Languages