GPU Acceleration on M3 Mac?

[yashdubey132]

Hello! By default the model inference runs on the CPU for M3 Macs. Has anyone used the GPU to speed up inference using GPU? How could I do this?

[JonathanFly]

Look at https://github.com/PABannier/bark.cpp for better M3 support.