Skip to content

常见问题处理 #3699

@nepeplwu

Description

@nepeplwu

模型下载相关

常见问题1

  • 问题表现:下载模型时报错,提示无法连接到Hugging Face
Traceback (most recent call last):
  File "/root/PaddleFormers/test.py", line 3, in <module>
    tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen3-0.6B-Base")
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/PaddleFormers/paddleformers/transformers/auto/tokenizer.py", line 320, in from_pretrained
    config = AutoConfig.from_pretrained(
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/miniconda3/lib/python3.12/site-packages/transformers/models/auto/configuration_auto.py", line 1332, in from_pretrained
    config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs)
                                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/miniconda3/lib/python3.12/site-packages/transformers/configuration_utils.py", line 662, in get_config_dict
    config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs)
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/miniconda3/lib/python3.12/site-packages/transformers/configuration_utils.py", line 721, in _get_config_dict
    resolved_config_file = cached_file(
                           ^^^^^^^^^^^^
  File "/root/miniconda3/lib/python3.12/site-packages/transformers/utils/hub.py", line 322, in cached_file
    file = cached_files(path_or_repo_id=path_or_repo_id, filenames=[filename], **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/root/miniconda3/lib/python3.12/site-packages/transformers/utils/hub.py", line 553, in cached_files
    raise OSError(
OSError: We couldn't connect to 'https://huggingface.co' to load the files, and couldn't find them in the cached files.
Check your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.
  • 解决方案:可能是您本地网络问题,请设置可以访问Hugging Face的代理,或者参考 如何下载模型 设置下载源为modelscope或者aistudio

包导入相关

常见问题1

  • 问题表现:提示 No package metadata was found for torchcodec
Traceback (most recent call last):
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/utils/lazy_import.py", line 80, in __getattr__
    value = self._get_module(name)
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/utils/lazy_import.py", line 108, in _get_module
    raise e
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/utils/lazy_import.py", line 106, in _get_module
    return importlib.import_module(f".{module_name}", self.__name__)
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
  File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
  File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
  File "<frozen importlib._bootstrap_external>", line 883, in exec_module
  File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/cli/launcher.py", line 18, in <module>
    from paddleformers.cli.train.tuner import run_tuner
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/cli/train/tuner.py", line 20, in <module>
    from .auto_parallel import run_auto_parallel
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/cli/train/auto_parallel/__init__.py", line 15, in <module>
    from .workflow import run_auto_parallel
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/cli/train/auto_parallel/workflow.py", line 27, in <module>
    from paddleformers.trainer.trainer import Trainer
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/trainer/trainer.py", line 120, in <module>
    from ..transformers.image_processing_utils import ImageProcessingMixin
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/paddleformers/transformers/image_processing_utils.py", line 29, in <module>
    from transformers.image_processing_utils import (
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/transformers/image_processing_utils.py", line 23, in <module>
    from .processing_utils import ImagesKwargs, Unpack
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/transformers/processing_utils.py", line 35, in <module>
    from .audio_utils import AudioInput, load_audio
  File "/home/aistudio/external-libraries/lib/python3.10/site-packages/transformers/audio_utils.py", line 55, in <module>
    TORCHCODEC_VERSION = version.parse(importlib.metadata.version("torchcodec"))
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/importlib/metadata/__init__.py", line 996, in version
    return distribution(distribution_name).version
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/importlib/metadata/__init__.py", line 969, in distribution
    return Distribution.from_name(distribution_name)
  File "/opt/conda/envs/python35-paddle120-env/lib/python3.10/importlib/metadata/__init__.py", line 548, in from_name
    raise PackageNotFoundError(name)
importlib.metadata.PackageNotFoundError: No package metadata was found for torchcodec
  • 解决方案:这个是因为5.0 以上 transformers接口发生变化导致,请将transformers版本降级至4.x

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions