preprocessing details?

[tomyoung903]

Thank you for this effort!

What do create_data.py and split.py do exactly? Why are they interchangeable?

[smartyfh]

Thank you for this effort!

What do create_data.py and split.py do exactly? Why are they interchangeable?

They try to split the whole dataset into train/dev/test parts. They are not interchangeable. One should choose the appropriate one based on the model design. One can also develop his/her own preprocessing strategy.

[tomyoung903]

thank you Cheers, Tom Young PhD Student School of Computer Science and Engineering (SCSE) Nanyang Technological University (NTU) 50 Nanyang Ave, Singapore 639798 tomyoung903.github.io <http://tomyoung.info/>

…

On Mon, Apr 19, 2021 at 1:30 AM Destiny is ALL ***@***.***> wrote: Thank you for this effort! What do create_data.py and split.py do exactly? Why are they interchangeable? They try to split the whole dataset into train/dev/test parts. They are not interchangeable. One should choose the appropriate one based on the model design. One can also develop his/her own preprocessing strategy. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#1 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AKQ3UYCAB4QTUEOLZIKFGIDTJMJLZANCNFSM43EJ42TA> .