Skip to content

Commit fa03fb4

Browse files
committed
update
1 parent 9cf8a8a commit fa03fb4

File tree

2 files changed

+10
-8
lines changed

2 files changed

+10
-8
lines changed

modules/ollama_openvino/Dockerfile_genai

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -22,9 +22,9 @@ ARG GOVERSION=1.24.1
2222
RUN curl -fsSL https://golang.org/dl/go${GOVERSION}.linux-$(case $(uname -m) in x86_64) echo amd64 ;; aarch64) echo arm64 ;; esac).tar.gz | tar xz -C /usr/local
2323
ENV PATH=/usr/local/go/bin:$PATH
2424

25-
RUN wget https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/nightly/2025.2.0.0.dev20250320/openvino_genai_ubuntu20_2025.2.0.0.dev20250320_x86_64.tar.gz
26-
RUN tar -xzf openvino_genai_ubuntu20_2025.2.0.0.dev20250320_x86_64.tar.gz
27-
ENV GENAI_DIR=/home/ollama_ov_server/openvino_genai_ubuntu20_2025.2.0.0.dev20250320_x86_64
25+
RUN wget https://storage.openvinotoolkit.org/repositories/openvino_genai/packages/nightly/2025.2.0.0.dev20250513/openvino_genai_ubuntu22_2025.2.0.0.dev20250513_x86_64.tar.gz
26+
RUN tar -xzf openvino_genai_ubuntu20_2025.2.0.0.dev20250513_x86_64.tar.gz
27+
ENV GENAI_DIR=/home/ollama_ov_server/openvino_genai_ubuntu20_2025.2.0.0.dev20250513_x86_64
2828

2929
ENV LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$GENAI_DIR/runtime/3rdparty/tbb/lib:$GENAI_DIR/runtime/lib/intel64
3030

@@ -35,8 +35,8 @@ ENV CGO_LDFLAGS=-L$GENAI_DIR/runtime/lib/intel64
3535
ENV CGO_CFLAGS=-I$GENAI_DIR/runtime/include
3636

3737
WORKDIR /home/ollama_ov_server
38-
RUN git clone https://github.com/zhaohb/ollama_ov.git
39-
WORKDIR /home/ollama_ov_server/ollama_ov
38+
RUN git clone https://github.com/openvinotoolkit/openvino_contrib.git
39+
WORKDIR /home/ollama_ov_server/openvino_contrib/modules/ollama_openvino
4040

4141
RUN go build -o /bin/ollama .
4242

modules/ollama_openvino/README.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -715,7 +715,7 @@ Let's take [deepseek-ai/DeepSeek-R1-Distill-Qwen-7B](https://hf-mirror.com/deeps
715715
```
716716

717717
3. Create a file named `Modelfile`, with a `FROM` instruction with the local filepath to the model you want to import.
718-
For convenience, we have put the model file of DeepSeek-R1-Distill-Qwen-7B-int4-ov model under example dir: [Modelfile for DeepSeek](https://github.com/zhaohb/ollama_ov/blob/main/examples/modelfile/deepseek_r1_distill_qwen/Modelfile), we can use it directly.
718+
For convenience, we have put the model file of DeepSeek-R1-Distill-Qwen-7B-int4-ov model under example dir: [Modelfile for DeepSeek](https://github.com/openvinotoolkit/openvino_contrib/blob/master/modules/ollama_openvino/examples/modelfile/deepseek_r1_distill_qwen/Modelfile), we can use it directly.
719719

720720
Note:
721721

@@ -792,7 +792,8 @@ Then build and run Ollama from the root directory of the repository:
792792
1. clone repo
793793
```shell
794794
git lfs install
795-
git lfs clone https://github.com/zhaohb/ollama_ov.git
795+
git clone https://github.com/openvinotoolkit/openvino_contrib.git
796+
cd openvino_contrib/modules/ollama_openvino
796797
```
797798

798799
2. Enable CGO:
@@ -830,7 +831,8 @@ Then build and run Ollama from the root directory of the repository:
830831
1. clone repo
831832
```shell
832833
git lfs install
833-
git lfs clone https://github.com/zhaohb/ollama_ov.git
834+
git clone https://github.com/openvinotoolkit/openvino_contrib.git
835+
cd openvino_contrib/modules/ollama_openvino
834836
```
835837

836838
2. Enable CGO:

0 commit comments

Comments
 (0)