Finetuning PixArtMS_XL_2 Model with Custom Data and Multi-Scale Training #102
-
|
Hi, Initially, my data folder structure was designed to follow the tutorial’s guidance, which works well for models like
However, my goal is to finetune the It would be better to provide a tutorial for fine-tuning Thanks in advance. |
Beta Was this translation helpful? Give feedback.
Replies: 3 comments 3 replies
-
|
I ended up forking the repo to load my data. Also made changes to tie together feature paths between extraction and training. And Changes to speed up T5 feature extraction 20X. Lots of upside for contributions here. Unfortunately my PR never got feedback so I closed it. PixArt team may be busy pushing to release sigma rn. |
Beta Was this translation helpful? Give feedback.
-
|
We release the sigma repo, which reformats the data structure to make it much easier to start your training. You will have totally better feelings. I'm really hoping you can have a try. |
Beta Was this translation helpful? Give feedback.
-
|
No problem. Can hold off review if training will be moving to Sigma. I also
intend to implement validation loss and CMMD measurement for training.
However I may end up simply forking your repos depending on how you want to
develop in the future. I have found that my changes tend to refactor a bit
and change behavior at times. Of course, more than happy to contribute -
let me know.
…On Mon, Apr 1, 2024 at 10:02 AM Junsong Chen ***@***.***> wrote:
I'm sorry for your waiting and thank you for your contribution. I'll
re-open your PR and review it. will never let your effort meaningless.
—
Reply to this email directly, view it on GitHub
<#102 (reply in thread)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/ABF3GFZ4JFRCGVALK2I46BTY3FSFZAVCNFSM6AAAAABEXESOUCVHI2DSMVQWIX3LMV43SRDJONRXK43TNFXW4Q3PNVWWK3TUHM4DSNZTGE4TI>
.
You are receiving this because you were mentioned.Message ID:
***@***.***
com>
|
Beta Was this translation helpful? Give feedback.

We release the sigma repo, which reformats the data structure to make it much easier to start your training. You will have totally better feelings. I'm really hoping you can have a try.