Transformers Notebook does not work on Google Colab

[drewm8080]

Gets stuck on this block of code

`embed_pt = PositionalEmbedding(vocab_size=tokenizers.pt.get_vocab_size(), d_model=512)
embed_en = PositionalEmbedding(vocab_size=tokenizers.en.get_vocab_size(), d_model=512)

pt_emb = embed_pt(pt)
en_emb = embed_en(en`

[drewm8080]

For this code:

https://www.tensorflow.org/text/tutorials/transformer

[MatteoManzari]

Hi,
adding .numpy() after the get_vocab_size() functions will solve your issue!

embed_pt = PositionalEmbedding(vocab_size=tokenizers.pt.get_vocab_size().numpy(), d_model=512)
embed_en = PositionalEmbedding(vocab_size=tokenizers.en.get_vocab_size().numpy(), d_model=512)

[jemmyfebryan]

I got error in the importing parts:

---

AttributeError Traceback (most recent call last)
in <cell line: 26>()
24
25 import tensorflow as tf
---> 26 import tensorflow_hub as hub
27 import tensorflow_text as text
28 import tensorflow_datasets as tfds

13 frames
/usr/local/lib/python3.10/dist-packages/tf_keras/src/saving/legacy/saved_model/load_context.py in
66
67
---> 68 tf.internal.register_load_context_function(in_load_context)
69

AttributeError: module 'tensorflow._api.v2.compat.v2.internal' has no attribute 'register_load_context_function'

[JuanVargas]

I got the same problem on May 1, 2024. I am struggling to understand why these tutorials are not tested before releasing code updates. IMHO these frequent issues create a sense of frustration and loss of faith in the tool.

[garricklw]

Adding .numpy() worked for me, posting in the hopes that the notebook can be corrected and the next person can save themselves the hour I wasted trying to fix myself.