[Question] A little doubt about the draft training of VL model

[Arcmoon-Hu]

I noticed that when the draft model gets the input embedding, the commented-out line actually looks correct, using pixel value to get the image embedding. However, the current implementation does not use the image feature. Is there any experimental support that the latter is better?

[icicle4]

see here #102 (comment)