[WIP] Project#15: GGUF Reader in OpenVINO for direct GGUF Execution#3449
[WIP] Project#15: GGUF Reader in OpenVINO for direct GGUF Execution#3449shahkarnav115-beep wants to merge 7 commits intoopenvinotoolkit:masterfrom
Conversation
|
@ravi9 some of the work for the build is left to be done. Will push the commit shortly. |
|
@shahkarnav115-beep Converting PR to draft as description states it's WIP |
|
This is the complete integration of llama.cpp ("dev_backend_openvino" - branch) in openvino.genai as a submodule (static library). I have implemented the minimal architecture (skeleton) of GGUFReaderV2 in gguf_reader_v2.cpp and its .hpp. To verify that it successfully calls the APIs from the submodule, I have also added a minimal C++ regression test in gguf_reader_v2_test.cpp. Locally, I have built all the required components and tested them, and this minimal scaffold is compiling and working perfectly on my system. As part of my GSoC 2026 preparation, I would be extremely grateful to get your reviews on this initial architectural integration. cc: @ravi9, @cavusmustafa |
|
Link to headers file for submodule's (dev_backend_openvino branch): ravi9/llama.cpp#55 |
Description
gguf_reader_v2.cppandgguf_reader_v2.hpptosrc/cpp/src/gguf_utils/.@ravi9 - Opening this as a WIP to get some feedback on the core C++ implementation and structure. Unit tests (
gguf_reader_v2_test.cpp) are currently being finalized locally and will be pushed in a subsequent commit once the base logic is reviewed.Checklist: