README.md

Benchmark

Requirements

• Install splatstream
  • From local build:

    $ pip install ./binding

  • Or from public package:

    $ pip install splatstream

• Install torch>=2.6, with cuda version of your choice.
• Then install gsplat and other dependencies

  $ pip install -r ./bench/requirements.txt

Usage

$ python bench/bench.py

Examples

$ python .\bench\bench.py --ply_path models/train_30000.ply --colmap_path models/tandt_db/tandt/train --scale 0.5 --target splatstream --first 20
...
PSNR: 23.20 ± 1.35
FPS: 438.01

$ python .\bench\bench.py --ply_path models/train_30000.ply --colmap_path models/tandt_db/tandt/train --scale 0.5 --target gsplat --first 20 --chunk_size 10
...
PSNR: 22.50 ± 1.73
FPS: 380.52

Results

• Test environment:
  • NVIDIA GeForce RTX 5080
  • CPU memory 17GB (total 32GB, used 15GB constantly on background)
  • Windows
  • CUDA 13.0
  • torch 2.9.0+cu130
• Notes:
  • chunk_size = 30. When chunk size is over some threshold like 30~60, rendering time greatly increases rendering time for Instead of rendering hundreds of images, the set is splitted by chunks and draw one by one. There's no options but to split them by chunks.
  • FPS includes rendering time plus data transfers of image from GPU to CPU. For gsplat, data transfer happens every chunk. Be careful when interpreting FPS!
  • scale = 0.5, to match the image size with ground truth.
  • near = 0.1.
  • far = 1000. Too high value reduces the depth precisions near camera.
• Dataset

  Dataset	#imgs	scale	resolution	#points
  bicycle	194	4	1237x822	6131954
  bonsai	292	2	1559x1039	1244819
  counter	240	2	1558x1038	1222956
  garden	185	4	1297x840	5834784
  kitchen	279	2	1558x1039	1852335
  room	311	2	1557x1038	1593376
  truck	251	1	979x546	2541226
  train	301	1	980x545	1026508

• Benchmakr Result

  Implementation	Dataset	chunk size	PSNR	FPS
  gsplat	bicycle	2	19.18 ± 1.60	245.70
  splatstream	bicycle	N/A	19.22 ± 1.67	373.08
  gsplat	bonsai	2	30.91 ± 2.35	380.56
  splatstream	bonsai	N/A	31.06 ± 2.22	345.84
  gsplat	counter	2	29.35 ± 1.40	295.98
  splatstream	counter	N/A	29.42 ± 1.40	470.86
  gsplat	garden	2	18.96 ± 0.74	196.80
  splatstream	garden	N/A	19.11 ± 0.74	320.93
  gsplat	kitchen	2	29.69 ± 1.88	186.26
  splatstream	kitchen	N/A	29.90 ± 1.84	362.70
  gsplat	room	2	32.37 ± 1.88	339.28
  splatstream	room	N/A	32.08 ± 1.78	348.78
  gsplat	truck	2	20.59 ± 1.66	392.87
  splatstream	truck	N/A	20.48 ± 1.60	655.51
  gsplat	train	2	22.29 ± 2.41	431.35
  splatstream	train	N/A	22.04 ± 2.27	821.12