ImportError: cannot import name 'LlamaDynamicNTKScalingRotaryEmbedding' from 'transformers.models.llama.modeling_llama'

[shiwanghua]

Traceback (most recent call last):
File "/home/ubisec/swh/codes/KBLaM/experiments/train.py", line 36, in
from kblam.models.llama3_model import KblamLlamaForCausalLM
File "/home/ubisec/swh/codes/KBLaM/src/kblam/models/llama3_model.py", line 46, in
from transformers.models.llama.modeling_llama import (
ImportError: cannot import name 'LlamaDynamicNTKScalingRotaryEmbedding' from 'transformers.models.llama.modeling_llama' (/home/ubisec/miniconda3/envs/swh-kblam/lib/python3.10/site-packages/transformers/models/llama/modeling_llama.py)

Previously, it could run training successfully, but now it cannot run in the same environment.

[shiwanghua]

In llama3_model.py file:

KBLaM/src/kblam/models/llama3_model.py

Line 122 in 029e2fb

self.rotary_emb = LlamaRotaryEmbedding(

should be replaced by:
self.rotary_emb = LlamaRotaryEmbedding(config=self.config)

And not import the LlamaDynamicNTKScalingRotaryEmbedding and LlamaLinearScalingRotaryEmbedding