Benchmark against FastPLMs implementation

[Hrovatin]

I have been previously using FastPLM implementations and got suggested this repo as alternative. Are you by any chance planning to compare against FastPLMs versions as well?

Edit: Also potentially esm-efficient

[pengzhangzhi]

sorry i've limited bandwidth. Happy to take a pr if u'd like to do some benchmarking

[Hrovatin]

Is there a script you used to generate the current plots speedup? If yes I may do it in the future.

[pengzhangzhi]

sorry! Missed ur msg in 2 weeks... Please take a look at https://github.com/pengzhangzhi/faplm/tree/main/tests

https://github.com/pengzhangzhi/faplm/blob/main/tests/test_compare_esm.py
This is for numerical comparison.

https://github.com/pengzhangzhi/faplm/blob/main/tests/benchmark.py
This is for Efficiency benchmarking.

[Hrovatin]

Thank you. Will try to make a benchmark once I find some time.