libdcudart.so.12 missing on install

[Sorry-Im-Stupid]

First install attempt the typing module wouldn't install, second attempt manged that, but now it's stuck on this:

Finished init app.

Traceback (most recent call last):
  File "/home/USER/Stable/tts-webui-installer/installer_files/env/lib/python3.10/site-packages/torch/__init__.py", line 377, in _load_global_deps
    ctypes.CDLL(global_deps_lib_path, mode=ctypes.RTLD_GLOBAL)
  File "/home/USER/Stable/tts-webui-installer/installer_files/env/lib/python3.10/ctypes/__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libcudart.so.12: cannot open shared object file: No such file or directory

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/home/USERStable/tts-webui-installer/server.py", line 7, in <module>
    from tts_webui.utils.torch_load_patch import apply_torch_load_patch
  File "/home/USER/Stable/tts-webui-installer/tts_webui/utils/torch_load_patch.py", line 9, in <module>
    import torch
  File "/home/USER/Stable/tts-webui-installer/installer_files/env/lib/python3.10/site-packages/torch/__init__.py", line 441, in <module>
    _load_global_deps()
  File "/home/USER/Stable/tts-webui-installer/installer_files/env/lib/python3.10/site-packages/torch/__init__.py", line 400, in _load_global_deps
    ctypes.CDLL(global_deps_lib_path, mode=ctypes.RTLD_GLOBAL)
  File "/home/USER/Stable/tts-webui-installer/installer_files/env/lib/python3.10/ctypes/__init__.py", line 374, in __init__
    self._handle = _dlopen(self._name, mode)
OSError: libcudart.so.12: cannot open shared object file: No such file or directory
Failed to start the app, exiting...

[rsxdalv]

How did you install it?

This appears to be an error in PyTorch installation which can happen in many different ways. To the best of my knowledge, the PyTorch package should already have CUDA libraries included for Linux distribution too, regarding the OSError: libcudart.so.12: cannot open shared object file: No such file or directory

[Sorry-Im-Stupid]

I downloaded the installer from the main page, extracted it to the folder I want to use, opened a a terminal in said folder, and ran the installer shell script in that terminal.
I should say, I'm on Linux Mint, AMD CPU, Nvidia 4060Ti 16gb GPU.

[rsxdalv]

Yes sounds all good.
Did you see any network issues or other potential disruptions? I think Mint should work.
After the first failure, did you try running it again in the same place or start with a fresh folder?
You can go to installer scripts folder, tools, and open_terminal.sh where you can install packages manually. Maybe just trying to reinstall PyTorch manually will work.

[Sorry-Im-Stupid]

open_terminal.sh
is just

#!/bin/bash

# Get repository root from this script's path
ROOT_DIR="$(cd "$(dirname "${BASH_SOURCE[0]}")/../.." && pwd)"
cd "$ROOT_DIR"

export MICROMAMBA_EXE="$ROOT_DIR/installer_files/mamba/micromamba"

"$MICROMAMBA_EXE" run -p "$ROOT_DIR/installer_files/env" bash

Is that right? It seems to be doing something but it's not telling me what it's doing.

[rsxdalv]

It's for opening the conda environment, then you are able to install what you need.

For example
pip3 install torch torchvision --index-url https://download.pytorch.org/whl/cu128

But it might want a force reinstall flag to do anything

[Sorry-Im-Stupid]

Ok, that did help move it along. It did install after that. Now it won't start. It says 'localhost is not available'.
It did open a page in my browser before it terminated. localhost:3000, but it said somewhere it should be localhost 7774?
And the terminal displaying the following message is now back at commandline, I don't think it's still running but I can't be sure.

'/home/USER/Stable/tts-webui-installer/start_tts_webui.sh' 
/usr/bin/curl
/usr/bin/tar
/usr/bin/bzip2
Checking if the Micromamba/Conda environment is already installed
Micromamba/Conda environment already installed in /home/USER/Stable/tts-webui-installer/installer_files/env, skipping installation
/usr/bin/gcc
Unified server started on port 7771
Web console and log viewer available at http://localhost:7771


Starting init app (version: 0.2.0)...


Checking conda installation...

>[async] conda info --envs
>[async] node --version
>[async] python --version
>[async] pip --version
>[async] conda --version
Python 3.10.11
v22.9.0
pip 26.0.1 from /home/USER/.local/lib/python3.10/site-packages/pip (python 3.10)

# conda environments:
#
# * -> active
# + -> frozen
base                 *   /home/USER/Stable/tts-webui-installer/installer_files/env

conda 26.3.2
Pulling updates from tts-webui
>[async] git pull
Already up to date.
Current git version: cce3a2a9647c3fac523d5f7eb68c7c1540d9a7fd

No updates found, skipping...
>[async] pip show torch torchvision torchaudio


Finished init app.


> tts-webui-react@0.4.0 start
> next start -p 3000

INFO:     Started server process [38511]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://127.0.0.1:7774 (Press CTRL+C to quit)
⨯ Failed to start server
Error: listen EADDRINUSE: address already in use :::3000
    at <unknown> (Error: listen EADDRINUSE: address already in use :::3000)
    at new Promise (<anonymous>) {
  code: 'EADDRINUSE',
  errno: -98,
  syscall: 'listen',
  address: '::',
  port: 3000
}
Starting TTS WebUI... 
Starting React UI...
Using SQLite database directory: data/sqlite
Database REST API server starting on http://127.0.0.1:7774
Starting Gradio server: http://127.0.0.1:7770
  • Server   > server_name: "127.0.0.1", server_port: 7770, max_threads: 40, prevent_thread_lock: False, quiet: True
  • Display  > inline: False, inbrowser: True, width: "100%", height: 500, show_api: True
  • Access   > share: False, auth_message: None
  • Security > ssl_keyfile: None, ssl_certfile: None, ssl_keyfile_password: None, ssl_verify: True
  • Debug    > debug: False, show_error: False

Starting TTS WebUI Database API server...
  • URL: http://127.0.0.1:7774
  • Database: data/sqlite/webui.db
  • Docs: http://127.0.0.1:7774/docs
Database initialized at: data/sqlite/webui.db
Loading decorator Save Ogg.........................   .00 seconds.
  Loaded: decorator_save_flac, decorator_save_flac_generator, decorator_save_ogg, decorator_save_ogg_generator
Loading decorator Save Waveform....................   .23 seconds.
  Loaded: decorator_save_waveform_plot, decorator_save_waveform_plot_generator
Loading decorator Average Time.....................   .00 seconds.
  Loaded: decorator_average_execution_time
Loading MiniMax Cloud TTS.....................   .00 seconds.
Loading Vall-E-X..............................   .08 seconds.
Loading Seamless M4T..........................   .02 seconds.
Loading MMS...................................   .02 seconds.
Loading Tortoise TTS..........................   .01 seconds.
Loading Bark..................................Bark Voice Clone not installed or failed to load.
   .86 seconds.
Loading Vocos.................................   .00 seconds.
Loading Demucs................................   .00 seconds.
Loading History...............................   .01 seconds.
Loading Gallery History.......................   .00 seconds.
Loading FFMPEG Metadata.......................   .00 seconds.
Loading External Extensions Installer.........   .00 seconds.
Loading Extensions List.......................   .00 seconds.
Loading Decorator Extensions List.............   .00 seconds.
Loading OpenAI TTS API........................   .01 seconds.
Loading Whisper...............................   .00 seconds.
Loading Huggingface Cache Manager.............   .00 seconds.
Loading Model Downloader......................   .00 seconds.
Loading Simple Remixer........................   .01 seconds.
Loading Conda Storage Optimizer...............   .00 seconds.
Loading Gradio Settings.......................   .01 seconds.
Loading GPU Info..............................   .00 seconds.
Loading Installed Packages....................   .00 seconds.
Loading Model Location Settings...............   .00 seconds.
Loading Log Viewer............................   .01 seconds.
Loading YouTube Tutorials.....................   .00 seconds.

Gradio UI loaded
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 789, in __call__
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 714, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 734, in app
    await route.handle(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 214, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/concurrency.py", line 37, in run_in_threadpool
    return await anyio.to_thread.run_sync(func)
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2470, in run_sync_in_worker_thread
    return await future
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 967, in run
    result = context.run(func, *args)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 584, in main
    gradio_api_info = api_info(request)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 615, in api_info
    api_info = utils.safe_deepcopy(app.get_blocks().get_api_info())
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/blocks.py", line 3083, in get_api_info
    python_type = client_utils.json_schema_to_python_type(info)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 931, in json_schema_to_python_type
    type_ = _json_schema_to_python_type(schema, schema.get("$defs"))
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 985, in _json_schema_to_python_type
    des = [
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 986, in <listcomp>
    f"{n}: {_json_schema_to_python_type(v, defs)}{get_desc(v)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 993, in _json_schema_to_python_type
    f"str, {_json_schema_to_python_type(schema['additionalProperties'], defs)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 939, in _json_schema_to_python_type
    type_ = get_type(schema)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 898, in get_type
    if "const" in schema:
TypeError: argument of type 'bool' is not iterable
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 789, in __call__
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 714, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 734, in app
    await route.handle(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 214, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/concurrency.py", line 37, in run_in_threadpool
    return await anyio.to_thread.run_sync(func)
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2470, in run_sync_in_worker_thread
    return await future
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 967, in run
    result = context.run(func, *args)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 584, in main
    gradio_api_info = api_info(request)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 615, in api_info
    api_info = utils.safe_deepcopy(app.get_blocks().get_api_info())
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/blocks.py", line 3083, in get_api_info
    python_type = client_utils.json_schema_to_python_type(info)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 931, in json_schema_to_python_type
    type_ = _json_schema_to_python_type(schema, schema.get("$defs"))
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 985, in _json_schema_to_python_type
    des = [
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 986, in <listcomp>
    f"{n}: {_json_schema_to_python_type(v, defs)}{get_desc(v)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 993, in _json_schema_to_python_type
    f"str, {_json_schema_to_python_type(schema['additionalProperties'], defs)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 939, in _json_schema_to_python_type
    type_ = get_type(schema)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 898, in get_type
    if "const" in schema:
TypeError: argument of type 'bool' is not iterable
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 789, in __call__
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 714, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 734, in app
    await route.handle(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 214, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/concurrency.py", line 37, in run_in_threadpool
    return await anyio.to_thread.run_sync(func)
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2470, in run_sync_in_worker_thread
    return await future
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 967, in run
    result = context.run(func, *args)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 584, in main
    gradio_api_info = api_info(request)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 615, in api_info
    api_info = utils.safe_deepcopy(app.get_blocks().get_api_info())
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/blocks.py", line 3083, in get_api_info
    python_type = client_utils.json_schema_to_python_type(info)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 931, in json_schema_to_python_type
    type_ = _json_schema_to_python_type(schema, schema.get("$defs"))
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 985, in _json_schema_to_python_type
    des = [
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 986, in <listcomp>
    f"{n}: {_json_schema_to_python_type(v, defs)}{get_desc(v)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 993, in _json_schema_to_python_type
    f"str, {_json_schema_to_python_type(schema['additionalProperties'], defs)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 939, in _json_schema_to_python_type
    type_ = get_type(schema)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 898, in get_type
    if "const" in schema:
TypeError: argument of type 'bool' is not iterable
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 789, in __call__
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 714, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 734, in app
    await route.handle(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 214, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/concurrency.py", line 37, in run_in_threadpool
    return await anyio.to_thread.run_sync(func)
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2470, in run_sync_in_worker_thread
    return await future
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 967, in run
    result = context.run(func, *args)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 584, in main
    gradio_api_info = api_info(request)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 615, in api_info
    api_info = utils.safe_deepcopy(app.get_blocks().get_api_info())
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/blocks.py", line 3083, in get_api_info
    python_type = client_utils.json_schema_to_python_type(info)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 931, in json_schema_to_python_type
    type_ = _json_schema_to_python_type(schema, schema.get("$defs"))
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 985, in _json_schema_to_python_type
    des = [
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 986, in <listcomp>
    f"{n}: {_json_schema_to_python_type(v, defs)}{get_desc(v)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 993, in _json_schema_to_python_type
    f"str, {_json_schema_to_python_type(schema['additionalProperties'], defs)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 939, in _json_schema_to_python_type
    type_ = get_type(schema)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 898, in get_type
    if "const" in schema:
TypeError: argument of type 'bool' is not iterable
ERROR:    Exception in ASGI application
Traceback (most recent call last):
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/protocols/http/httptools_impl.py", line 409, in run_asgi
    result = await app(  # type: ignore[func-returns-value]
  File "/home/USER/.local/lib/python3.10/site-packages/uvicorn/middleware/proxy_headers.py", line 60, in __call__
    return await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/applications.py", line 1054, in __call__
    await super().__call__(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/applications.py", line 112, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 187, in __call__
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/errors.py", line 165, in __call__
    await self.app(scope, receive, _send)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/route_utils.py", line 789, in __call__
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/middleware/exceptions.py", line 62, in __call__
    await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 714, in __call__
    await self.middleware_stack(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 734, in app
    await route.handle(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 288, in handle
    await self.app(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 76, in app
    await wrap_app_handling_exceptions(app, request)(scope, receive, send)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
    raise exc
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
    await app(scope, receive, sender)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/routing.py", line 73, in app
    response = await f(request)
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 301, in app
    raw_response = await run_endpoint_function(
  File "/home/USER/.local/lib/python3.10/site-packages/fastapi/routing.py", line 214, in run_endpoint_function
    return await run_in_threadpool(dependant.call, **values)
  File "/home/USER/.local/lib/python3.10/site-packages/starlette/concurrency.py", line 37, in run_in_threadpool
    return await anyio.to_thread.run_sync(func)
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/to_thread.py", line 56, in run_sync
    return await get_async_backend().run_sync_in_worker_thread(
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 2470, in run_sync_in_worker_thread
    return await future
  File "/home/USER/.local/lib/python3.10/site-packages/anyio/_backends/_asyncio.py", line 967, in run
    result = context.run(func, *args)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 584, in main
    gradio_api_info = api_info(request)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/routes.py", line 615, in api_info
    api_info = utils.safe_deepcopy(app.get_blocks().get_api_info())
  File "/home/USER/.local/lib/python3.10/site-packages/gradio/blocks.py", line 3083, in get_api_info
    python_type = client_utils.json_schema_to_python_type(info)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 931, in json_schema_to_python_type
    type_ = _json_schema_to_python_type(schema, schema.get("$defs"))
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 985, in _json_schema_to_python_type
    des = [
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 986, in <listcomp>
    f"{n}: {_json_schema_to_python_type(v, defs)}{get_desc(v)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 993, in _json_schema_to_python_type
    f"str, {_json_schema_to_python_type(schema['additionalProperties'], defs)}"
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 939, in _json_schema_to_python_type
    type_ = get_type(schema)
  File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 898, in get_type
    if "const" in schema:
TypeError: argument of type 'bool' is not iterable
Failed to launch Gradio server: When localhost is not accessible, a shareable link must be created. Please set share=True or check your proxy settings to allow access to localhost.

[Sorry-Im-Stupid]

It is still running, and the web interface seems to function, but everything I do just throws a fetch error.

Error: TypeError: fetch failed
    at async s (.next/server/chunks/[root-of-the-server]__10vwe21._.js:1:1378)
    at async Module.u [as handler] (.next/server/chunks/[root-of-the-server]__10vwe21._.js:1:10479)

[rsxdalv]

Something in the way your OS has set up Python beats all expectations:

File "/home/USER/.local/lib/python3.10/site-packages/gradio_client/utils.py", line 898, in get_type
if "const" in schema:

it should NOT use your USER/.local packages ever.

From my research it seems that if you have installed something to your system (to your .local) folder including pip, it can completely mess with python's ability to find packages.

Claude suggests that you can try this:

Alternatively, set this environment variable before launching to suppress .local from sys.path:

export PYTHONNOUSERSITE=1
   ./start_tts_webui.sh

But I highly suggest reevaluating your system - why is there a gradio (and potentially pip) installed on .local, what purpose does it serve.

I will consider options on strengthening the WebUI to handle such a case, but you might see many other ML/AI projects break on your system similarly.

[Sorry-Im-Stupid]

I don't know, I have a lot of AI stuff installed, they all have their own folders. So many copies of python everywhere...
So what do you actually suggest?
Also I can't find user.env anywhere, do I just add it to the base .env?

[rsxdalv]

You can run this in your terminal:

export PYTHONNOUSERSITE=1
./start_tts_webui.sh

and if it seems to work we can figure out where to save it for future use

[Sorry-Im-Stupid]

That worked.
Ok, it installed, didn't throw any errors and the interface does seem to actually work.
I still don't see a user.env in the folder anywhere though.
I will try some things out and see if I hit any errors.

Update:
I have had to launch it with a workaround shell script containing

export PYTHONNOUSERSITE=1
./start_tts_webui.sh

if I try to run it from the default webui.sh it still tries to load the system python.