Skip to content

Support others LLMs & APIs for the OP generate_qa_from_text_mapper #535

Open
@yxdyc

Description

@yxdyc

Search before continuing 先搜索,再继续

  • I have searched the Data-Juicer issues and found no similar feature requests. 我已经搜索了 Data-Juicer 的 issue 列表但是没有发现类似的功能需求。

Description 描述

Currently (in v1.0.3), the OP generate_qa_from_text_mapper has a fix format assumption binding to PAI models, we can extend it into other use cases depending on general DJ-format, such as using local Qwen models and other APIs.
Refer to many other existing OPs like generate_qa_from_examples_mapper, and calibrate_qa_mapper.py.

Use case 使用场景

No response

Additional 额外信息

No response

Are you willing to submit a PR for this feature? 您是否乐意为此功能提交一个 PR?

  • Yes I'd like to help by submitting a PR! 是的!我愿意提供帮助并提交一个PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    dj:opissues/PRs about some specific OPsenhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions