When I try to load a model, I only get this, and the assistant not working

[pandamontok]

Traceback (most recent call last):
File “E:\oobabooga-windows\text-generation-webui\[server.py](http://server.py/)”, line 103, in load_model_wrapper
shared.model, shared.tokenizer = load_model(shared.model_name)
File “E:\oobabooga-windows\text-generation-webui\modules\[models.py](http://models.py/)”, line 103, in load_model
model = load_quantized(model_name)
File “E:\oobabooga-windows\text-generation-webui\modules\GPTQ_loader.py”, line 142, in load_quantized
exit()
File “E:\oobabooga-windows\installer_files\env\lib_sitebuiltins.py”, line 26, in call
raise SystemExit(code)
SystemExit: None

[PestToast]

Please format like this.

Traceback (most recent call last):
File “E:\oobabooga-windows\text-generation-webui[server.py]([http://server.py/)”](http://server.py/)%E2%80%9D), line 103, in load_model_wrapper
shared.model, shared.tokenizer = load_model(shared.model_name)
File “E:\oobabooga-windows\text-generation-webui\modules[models.py]([http://models.py/)”](http://models.py/)%E2%80%9D), line 103, in load_model
model = load_quantized(model_name)
File “E:\oobabooga-windows\text-generation-webui\modules\GPTQ_loader.py”, line 142, in load_quantized
exit()
File “E:\oobabooga-windows\installer_files\env\lib_sitebuiltins.py”, line 26, in call
raise SystemExit(code)
SystemExit: None

How are you trying to run it? I know there have been some sort of issues with GPTQ

[pandamontok]

from the oobabooga webui. Model TAB. I tried to load some model, such as, facebook.

[PestToast]

Which model, specifically? There are a million different models and they are all quantized differently and have various other variables that make them not work.
Which flags are you using when you start server.py?
Are you sure that you have all of the config files?
Are you sure that this is the whole error message? What happens if you use the --model flag?

[pandamontok]

Model: facebook_opt-6.7b
This is the start-webui.bat:

@echo off

@echo Starting the web UI...

cd /D "%~dp0"

set MAMBA_ROOT_PREFIX=%cd%\installer_files\mamba
set INSTALL_ENV_DIR=%cd%\installer_files\env

if not exist "%MAMBA_ROOT_PREFIX%\condabin\micromamba.bat" (
  call "%MAMBA_ROOT_PREFIX%\micromamba.exe" shell hook >nul 2>&1
)
call "%MAMBA_ROOT_PREFIX%\condabin\micromamba.bat" activate "%INSTALL_ENV_DIR%" || ( echo MicroMamba hook not found. && goto end )
cd text-generation-webui

call python server.py --auto-devices --chat --wbits 4 --groupsize 128 

:end
pause

Are you sure that you have all of the config files?
It's from the oobabooga webui. "Model" TAB.

Are you sure that this is the whole error message? What happens if you use the --model flag?
Pretty sure.
Don't know how to use --model flag