ci: balance fixture-aware test groups #16928

Job	Run time
Build source distribution	16s
Build wheels for cp311-win_amd64	5m 3s
Build wheels for cp311-macosx_x86_64	6m 31s
Build wheels for cp310-manylinux_aarch64	4m 22s
Build wheels for cp311-manylinux_x86_64	7m 26s
Build wheels for cp311-macosx_arm64	3m 32s
build_pypi_index	10s
build_docker (12)	8m 4s
upload_pypi	0s
deploy_pypi_index	-1s
Pass testing build wheels	9s
	35m 32s

Provide feedback