Responsibilities
Commands
--test-id 001 - Run single test by ID
--regression - Run all tests in tests/ directory
--list-tests - Show available test files
Functionalities
Auto-discover test files (extract ID from filename)
Execute tests as subprocesses
Capture pass/fail from exit codes (0=pass, 1=fail)
Track execution time per test
Handle test timeouts (maybe 30 min?)
also specific/additional tags per test script, outlining requirements
Output
Console: Show which tests passed/failed with timing
Summary: Total tests, passed count, failed count, runtime of each test
Failed test details: Show specific failed test(s) ID
Exit Codes
Exit 0 if all tests pass
Exit 1 if any tests fail
Example
project/
├── test_orchestrator.py
├── tests/
│ ├── test_001_login.py
│ ├── test_002_database.py
│ ├── test_003_api.py
│ └── test_004_integration.py
Responsibilities
Commands
--test-id 001 - Run single test by ID
--regression - Run all tests in tests/ directory
--list-tests - Show available test files
Functionalities
Auto-discover test files (extract ID from filename)
Execute tests as subprocesses
Capture pass/fail from exit codes (0=pass, 1=fail)
Track execution time per test
Handle test timeouts (maybe 30 min?)
also specific/additional tags per test script, outlining requirements
Output
Console: Show which tests passed/failed with timing
Summary: Total tests, passed count, failed count, runtime of each test
Failed test details: Show specific failed test(s) ID
Exit Codes
Exit 0 if all tests pass
Exit 1 if any tests fail
Example
project/
├── test_orchestrator.py
├── tests/
│ ├── test_001_login.py
│ ├── test_002_database.py
│ ├── test_003_api.py
│ └── test_004_integration.py