How to use Alpa to serve BERT models

[Jessssssie99]

Hi,

As title, are we able to run BERT models with Alpa backends? The llm_serving package includes OPT, BLOOM, and CodeGen models, and I'm wondering if we have similar ways to run BERT or other non-autoregressive models with Alpa.

Thanks