Skip to content

Commit d13ac71

Browse files
committed
Update ConfigMap with AutoModel fix
1 parent 2c9d28d commit d13ac71

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

clusters/k3s-stpetersburg/apps/ai/kserve/configmap.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -55,7 +55,7 @@ data:
5555
5656
from PIL import Image as PILImage
5757
import torch as torch_module
58-
from transformers import AutoModelForCausalLM, AutoTokenizer, AutoProcessor
58+
from transformers import AutoModel, AutoTokenizer, AutoProcessor
5959
6060
model_state["Image"] = PILImage
6161
model_state["torch"] = torch_module
@@ -64,7 +64,7 @@ data:
6464
6565
try:
6666
logger.info(f"Loading model from {model_name}...")
67-
model_state["model"] = AutoModelForCausalLM.from_pretrained(
67+
model_state["model"] = AutoModel.from_pretrained(
6868
model_name,
6969
torch_dtype=torch_module.bfloat16,
7070
device_map="auto",

0 commit comments

Comments
 (0)