Analysis plan

[tsalo]

The primary goal here should be to directly compare results from NiMARE to existing libraries, in order to (1) validate NiMARE's approach and (2) potentially identify bugs in the more conceptually-based implementations (e.g., KDA).

ALE vs. GingerALE
ALESubtraction vs. GingerALE subtraction analysis
MKDADensity vs. MKDA MATLAB library
MKDAChi2 vs. MKDA MATLAB library

Are there existing tools for any of our other algorithms?

We also need to figure out what metrics we should use to evaluate tool performance.

1. Memory usage
   • How do we measure memory for an app (GingerALE) or MATLAB code (MKDA)?
2. Duration
3. Dice coefficient between thresholded and binarized statistical maps.

[hcp4715]

Hi, Taylor,
The comparisons between NiMARE and other libraries are very valuable! Just wondering whether there are any updates?

I collaborated with Simon and used his code (sent by him a while ago). If needed, I can help to compare the NiMARE with ALE matlab code using our previous meta-data.

Looking forward to hearing from you.

[tsalo]

Hello. Help would be much appreciated, thank you! The comparison analyses haven't been a top priority for anyone lately, so we haven't gotten around to them. One thing though- we want to compare NiMARE to GingerALE, rather than Simon's MATLAB code.

[hcp4715]

Hi, Taylor,

Thanks for your response! Looking forward to seeing the details about the comparison between NiMARE and GingerALE. Free to contact me if you need someone as an external tester.

Best
Chuan-Peng