Keep states ordered by quality in CKF

[stephenswat]

This commit allows the find_tracks kernel in the CKF to keep the best measurements instead of keeping random ones, which will hopefully allow us to significantly reduce the branching factor of the CKF. The logic here works by employing a series of mutexes, allowing threads to lock a critical section and insert their own measurement, overwriting the previous ones.

[stephenswat]

To-do list:

• Update the SYCL CKF.
• Update the Alpaka CKF.
• Update to use vecmem CAS.
• Performance measurements.
• Physics performance measurements.

Tagging @paradajzblond, @beomki-yeo, @niermann999, @asalzburger as interested parties.

[stephenswat]

This is now ready for review.

[stephenswat]

Performance summary

Here is a summary of the performance effects of this PR:

Graphical

Tabular

Kernel	1edca0f	c83e7ab	Delta
fit	280.68 ms	281.27 ms	0.2%
propagate_to_next_surface	118.21 ms	117.46 ms	-0.6%
find_tracks	26.36 ms	27.44 ms	4.1%
count_triplets	14.16 ms	14.16 ms	0.0%
find_triplets	5.98 ms	5.99 ms	0.1%
build_tracks	1.07 ms	1.07 ms	0.5%
find_doublets	901.37 μs	890.88 μs	-1.2%
Thrust::sort	777.50 μs	776.94 μs	-0.1%
prune_tracks	672.26 μs	685.92 μs	2.0%
ccl_kernel	680.91 μs	681.78 μs	0.1%
count_doublets	628.16 μs	626.30 μs	-0.3%
select_seeds	354.61 μs	360.48 μs	1.7%
apply_interaction	132.61 μs	127.37 μs	-3.9%
update_triplet_weights	96.29 μs	96.25 μs	-0.0%
fill_sort_keys	68.20 μs	67.73 μs	-0.7%
estimate_track_params	34.15 μs	34.11 μs	-0.1%
populate_grid	30.41 μs	30.42 μs	0.0%
count_grid_capacities	29.24 μs	29.21 μs	-0.1%
form_spacepoints	13.49 μs	13.48 μs	-0.1%
reduce_triplet_counts	6.65 μs	6.66 μs	0.1%
static_kernel	1.76 μs	1.75 μs	-0.5%
make_barcode_sequence	988.79 ns	991.71 ns	0.3%
fill_prefix_sum	165.49 ns	165.50 ns	0.0%
Total	450.89 ms	451.82 ms	0.2%

Important

All metrics in this report are given as reciprocal throughput, not as wallclock runtime.

Note

This is an automated message produced on the explicit request of a human being.

[stephenswat]

Tagging @CrossR and @StewMH as this affects the Alpaka code.

[stephenswat]

Nice, we're back to SYCL crashing on our code:

lld: error: <unknown>:0:0: in function _ZTSN6traccc4sycl7details7kernels11find_tracksINS0_7kernels37ckf_constant_field_telescope_detectorEEE : invalid addrspacecast
lld: error: <unknown>:0:0: in function _ZTSN6traccc4sycl7details7kernels11find_tracksINS0_7kernels37ckf_constant_field_telescope_detectorEEE_with_offset : invalid addrspacecast
llvm-foreach: 

[sonarqubecloud]

Quality Gate passed

Issues
4 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud

[stephenswat]

Okay, the problem has been resolved. 👍

[beomki-yeo]

Looks good to me

[stephenswat]

@fiedlerp What's your timeline for #933? I'd like to get this in quickly but if you can get #933 done we can merge that first to save you the headache of rebasing it.