DPO支持多模态数据训练吗(<image>)?

[Yukinonooo]

Reminder

• I have read the above rules and searched the existing issues.

System Info

DPO支持多模态数据训练吗()?

Reproduction

Put your message here.

Others

No response

[nusshang]

{
"messages": [
{
"role": "system",
"content: "",
},{
"role": "user",
"content": ""
}],"chosen": {
"content": "1",
"role": "assistant"
},
"rejected": {
"content": "2",
"role": "assistant"
},"audios": "xxx.wav"}