DynamicScale on different platforms #3119
Unanswered
massquantity
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, when browsing the imagenet example, I noticed mixed precision training is available.
The create model code shows we can use
float16
on CPU/GPU andbfloat16
on TPU, but the training code suggests thatDynamicScale
is only used on GPU. Does this mean it is not applicable forbfloat16
on TPU andfloat16
on CPU?Another question is why
DynamicScale
is not documented in API Reference ? Although I finally found its source code.Beta Was this translation helpful? Give feedback.
All reactions