Skip to content

使用glm-large-chinese微调分类任务 #196

@mechigonft

Description

@mechigonft

报错:Traceback (most recent call last):
File "/ossfs/workspace/vector/model/GLM-main/finetune_glm.py", line 470, in
main(args)
File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/finetune.py", line 119, in main
finetune(args, train_valid_datasets_provider, model_kwargs,
File "/ossfs/workspace/vector/model/GLM-main/finetune_glm.py", line 297, in finetune
train_dataset, valid_dataset = train_valid_datasets_provider(args, tokenizer)
File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/finetune.py", line 56, in train_valid_datasets_provider
train_dataset = SuperGlueDataset(args, task_name, data_dir, args.seq_length, "train", tokenizer,
File "/ossfs/workspace/vector/model/GLM-main/tasks/superglue/dataset.py", line 134, in init
self.processor = PROCESSORStask_name
KeyError: 'multichoice'

dataset.py的字典PROCESSORS并没有multichoice这个key,请问如何解决
PROCESSORS = {
"mnli": MnliProcessor,
"mnli-mm": MnliMismatchedProcessor,
"agnews": AgnewsProcessor,
"yahoo": YahooAnswersProcessor,
"yelp-polarity": YelpPolarityProcessor,
"yelp-full": YelpFullProcessor,
"xstance-de": lambda: XStanceProcessor("de"),
"xstance-fr": lambda: XStanceProcessor("fr"),
"xstance": XStanceProcessor,
"wic": WicProcessor,
"rte": RteProcessor,
"cb": CbProcessor,
"wsc": WscProcessor,
"wsc1": WscProcessor,
"boolq": BoolQProcessor,
"copa": CopaProcessor,
"multirc": MultiRcProcessor,
"record": RecordProcessor,
"ax-g": AxGProcessor,
"ax-b": AxBProcessor,
"sst2": Sst2Processor,
"cola": ColaProcessor,
"mrpc": MrpcProcessor,
"qqp": QqpProcessor,
"qnli": QnliProcessor,
# "squad": SquadProcessor,
"race": RaceProcessor,
"squad": SquadProcessor,
"afqmc": AFQMCProcessor,
"tnews": TNewsProcessor,
'cluewsc': CLUEWSCProcessor,
# 'cmrc': CMRCProcessor
} # type: Dict[str,Callable[[1],DataProcessor]]

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions