Add proper support for inactive points #473

Job	Run time
Run Tests (Julia min - macos-14)	15m 25s
Run Tests (Julia 1 - ubuntu-latest)	25m 19s
Run Tests (Julia 1 - macos-14)	21m 21s
Run Tests (Julia 1 - windows-latest)	26m 26s
Run Tests (Julia min - ubuntu-latest)	20m 46s
Run Tests (Julia min - windows-latest)	22m 54s
	2h 12m 11s

Provide feedback