How does torchtune's offerings compare with what LitGPT provides?

[karrtikiyer]

I am currently in the process of fine-tuning a LLM and I am exploring different options and two of them are torchtune and LitGPT which is built on top of Torch Lightning.
Wondering if anyone over here have a view on comparison between these two options?
Thanks in advance!

[ebsmothers]

Hi @karrtikiyer thanks for asking! Rather than reinventing the wheel here, I am just gonna point to this previous comment which I think gives a clear and comprehensive answer to this question. If you do have any specific follow-ups please let me know and I'll be happy to share more.