First off, nice work!
Running on matbench and posting to matbench would help with one-to-one comparisons with other composition-based models. Here are some instructions for matbench: https://matbench.materialsproject.org/How%20To%20Use/1install/
It would be particularly interesting to see the results on the smaller (often experimental) tasks using transfer learning from the larger tasks. For example, I'd love to see how it compares with CrabNet matbench performance.