Repository of automated test results with a web-based viewer.
- Dynamic Report Discovery: Automatically discovers test reports in the directory structure
- Interactive Navigation: Tree-based navigation with URL routing for permalinks
- Version-Level Analytics: Stacked area charts showing test statistics over time for each backend
- Backend Comparison: Side-by-side comparison of different backends (Doris vs PostgreSQL)
- Detailed Test Analysis: View individual test cases with pass/fail status and performance deltas
- Error Inspection: Modal-based error viewing with syntax highlighting and navigation
Reports are organized as:
reports/
├── manifest.json # Auto-generated index of summary files
└── {component}/
└── {test-type}/
└── {version}/
├── summary.json # Contains build information and metrics
└── {build-date}_{hash}/ # Build directories (referenced in summary.json)
├── doris.json
└── postgres.json
The manifest.json file is automatically generated and contains only the locations of summary.json files. Each summary.json file contains the detailed information about all builds for that version, including which backend files are available.
- Open
reports/index.htmlin a web browser - Navigate through the tree structure on the left
- Click on a version to see analytics graphs showing test statistics over time
- Use "View Individual Builds" to see specific build comparisons
- Click "Details" to view individual test cases
- Click on failed test cases to see error details
- Add your report files to the appropriate directory structure
- Run
./update-manifest.shto regenerate the manifest - Commit and push the changes
The repository includes a GitHub Actions workflow that automatically:
- Regenerates the manifest when reports are updated
- Commits the updated manifest back to the repository
- Enables GitHub Pages to serve the reports
# Using the convenience script
./update-manifest.sh
# Or directly with Python
python3 scripts/generate-manifest.py- Serve the reports directory with a local web server:
cd reports python3 -m http.server 8000 - Open http://localhost:8000 in your browser
- summary.json: Contains high-level metrics and comparison data
- doris.json/postgres.json: Contains detailed test case results with error information