model info utility?

[sroussey]

Question

How do I get what languages a translation model supports?

How do I know what number of dimensions an embedding model supports?

What about a Named Entity Recognition output?

I want to add search for new model function, and then configure it without the user having to know these things.

[xenova]

This is very model dependent, so it's difficult to give you a full answer.
For embedding dimension model, you can get it from config.hidden_size. e.g., https://huggingface.co/onnx-community/all-MiniLM-L6-v2-ONNX/blob/main/config.json#L10 shows dim=384.

for NER output, you can look at the id2label or label2id values in config. e.g., https://huggingface.co/onnx-community/distilbert-NER-ONNX/blob/main/config.json#L12-L34

translation models don't have a set way, and depend on the type/architecture/etc.

[sroussey]

For embedding models, it is always called hidden_size? Is there a flag if it is a Matryoshka type model?

[xenova]

For embedding models, it is always called hidden_size?

For 99% of cases, yes. The only exception is when there are additional dense layers (a sentence-transformers thing), and they have a projection different to what's hidden_size. You can see if there's a folder in the repo e.g., 1_Dense, and inside the final one is a output dimension is different to hidden size

Is there a flag if it is a Matryoshka type model?

Nope, this is model creator dependent, and they usually include info about it in the README :)