-
Notifications
You must be signed in to change notification settings - Fork 2.2k
Open
Description
模型下载相关
常见问题1
- 问题表现:下载模型时报错,提示无法连接到Hugging Face
Traceback (most recent call last):
File "/root/PaddleFormers/test.py", line 3, in <module>
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-0.6B-Base")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/PaddleFormers/paddleformers/transformers/auto/tokenizer.py", line 320, in from_pretrained
config = AutoConfig.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
resolved_config_file = cached_file(
^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/utils/hub.py", line 322, in cached_file
file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/root/miniconda3/lib/python3.12/site-packages/transformers/utils/hub.py", line 553, in cached_files
raise OSError(
OSError: We couldn't connect to 'https://huggingface.co' to load the files, and couldn't find them in the cached files.
Check your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.- 解决方案:可能是您本地网络问题,请设置可以访问Hugging Face的代理,或者参考 如何下载模型 设置下载源为modelscope或者aistudio
包导入相关
常见问题1
- 问题表现:提示 No package metadata was found for torchcodec
Traceback (most recent call last):
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/utils/lazy_import.py", line 80, in __getattr__
value = self._get_module(name)
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/utils/lazy_import.py", line 108, in _get_module
raise e
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/utils/lazy_import.py", line 106, in _get_module
return importlib.import_module(f".{module_name}", self.__name__)
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/importlib/__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 883, in exec_module
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/cli/launcher.py", line 18, in <module>
from paddleformers.cli.train.tuner import run_tuner
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/cli/train/tuner.py", line 20, in <module>
from .auto_parallel import run_auto_parallel
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/cli/train/auto_parallel/__init__.py", line 15, in <module>
from .workflow import run_auto_parallel
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/cli/train/auto_parallel/workflow.py", line 27, in <module>
from paddleformers.trainer.trainer import Trainer
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/trainer/trainer.py", line 120, in <module>
from ..transformers.image_processing_utils import ImageProcessingMixin
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/transformers/image_processing_utils.py", line 29, in <module>
from transformers.image_processing_utils import (
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/transformers/image_processing_utils.py", line 23, in <module>
from .processing_utils import ImagesKwargs, Unpack
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/transformers/processing_utils.py", line 35, in <module>
from .audio_utils import AudioInput, load_audio
File "/home/aistudio/external-libraries/lib/python3.10/site-packages/transformers/audio_utils.py", line 55, in <module>
TORCHCODEC_VERSION = version.parse(importlib.metadata.version("torchcodec"))
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/importlib/metadata/__init__.py", line 996, in version
return distribution(distribution_name).version
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/importlib/metadata/__init__.py", line 969, in distribution
return Distribution.from_name(distribution_name)
File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/importlib/metadata/__init__.py", line 548, in from_name
raise PackageNotFoundError(name)
importlib.metadata.PackageNotFoundError: No package metadata was found for torchcodec- 解决方案:这个是因为5.0 以上 transformers接口发生变化导致,请将transformers版本降级至4.x
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels