How do we use a hugging face gated model on oobabooga ?

[Tum1370]

Hi, I have got access to a couple of gated models on hugging face, but they do not work on oobabooga.
How do i setup oobabooga to allow these gasted models to work please ?

[Laurent-tw]

I spent some time finding it so I'm giving you what I found.

After login in Hugging Face,
in the model card that you want:
with mistralai for exemple:
You need to agree to share your contact information to access this model
Click on "Agree and access repository"

after, if you do not have a "hf_xxxxx" Token for reading you must create one and above all save it somewhere.
It's done here:
https://huggingface.co/settings/tokens
=>
+Create new token
with permission READ => Now you've got a TOKEN Value Like this "hf_xxxxxxxxx"
All you need is one which will allow validation for all readings thereafter.

after, on my PC, in ..\text-generation-webui-main\download-model.py
I added to line l28:

HF_USER="My_HF_Username"
HF_PASS="My_HF_Password"
My_HF_token="My_HF_TOKEN_Value" # the "hf_xxxxxxxxx"

After I modified get_session(self)
l39:

def get_session(self):
    session = requests.Session()
    if self.max_retries:
        session.mount('https://cdn-lfs.huggingface.co', HTTPAdapter(max_retries=self.max_retries))
        session.mount('https://huggingface.co', HTTPAdapter(max_retries=self.max_retries))

    if os.getenv('HF_USER') is not None and os.getenv('HF_PASS') is not None:
        session.auth = (os.getenv('HF_USER'), os.getenv('HF_PASS'))

    session.headers = {'authorization': f'Bearer {My_HF_token}'}

    return session

Now, for me, it's working.