"May I ask what the minimum GPU VRAM requirement is for model training? Is the 3090 sufficient?"

[archernsy]

"May I ask what the minimum GPU VRAM requirement is for model training? Is the 3090 sufficient?"

[tianrun-chen]

An NVIDIA A100 is suggested. If you are using 3090, the batchsize should be changed, and the layer number of xLSTM should be adjusted to a smaller value.