JAX port with ByT5 Embeddings #65
Unanswered
contrebande-labs
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi guys!
Sorry for x-posting from Instagram but are you planning on releaseing the pre-training code? How hard would it be to port your training pipeline to JAX and use ByT5 instead of T5? We'd love to make a multilingual, character-aware Deep-Floyd IF! Thanks!
Beta Was this translation helpful? Give feedback.
All reactions