OpenSource strategy

[sebastianlutter]

AlephAlpha has repeatedly emphasised in various publications and statements that it is committed to OpenSource. Looking at the activity in this repository and the available trained weights, the reality is different.

Apart from positive marketing, what role does OpenSource play at AlephAlpha? The French company Mistral has shown how important the OpenSource idea is, and has set international standards with its released models.

All I see are academic advances that are used as arguments for further funding rounds. The model code in this repository is two years out of date, as are the available checkpoints. There are no publications on Huggingface nor any other engagement in the community of LLM's tools. Once again it seems to be a special German way of compartmentalisation, combined with the belief that enough money will take care of it.

So what is AlpehAlpha's actual strategy regarding OpenSource?

[bm777]

They will not

[stefan-it]

After two years, signs of life w.r.t. open weights:

• Aleph-Alpha/Pharia-1-LLM-7B-control see here
• Aleph-Alpha/Pharia-1-LLM-7B-control-aligned see here

[bm777]

@stefan-it do you work for Aleph-Alpha? 😆