segmentation fault, bus error when importing onnxruntime-node

[amkorousagi]

Describe the issue

env

• arm64
• macOS (Sonoma 14.3)
• npm version : 11.1.0
• node v23.7.0
• onnxruntime-node@1.21.0 (no issue on 1.20.1 version)
• @huggingface/transformers@3.4.0

description

when importing onnxruntime-node and @huggingface/transformers, onnxruntime makes segmentation fault or bus error and prints the following error message

libc++abi: terminating due to uncaught exception of type onnxruntime::OnnxRuntimeException: /Users/runner/work/1/s/onnxruntime/core/session/ort_env.cc:92 static void OrtEnv::Release(OrtEnv *) env_ptr == p_instance_.get() was false. 

zsh: abort      node index.js

screenshots(only import):

screenshots(load model after import):

To reproduce

to reproduce

Urgency

No response

Platform

Mac

OS Version

Sonoma 14.3

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

onnxruntime-node@1.21.0

ONNX Runtime API

JavaScript

Architecture

ARM64

Execution Provider

Default CPU

Execution Provider Library Version

No response

[felixT2K]

Same for onnxruntime-gpu

[fs-eire]

Same for onnxruntime-gpu

Do you mean the python package?

[fs-eire]

I can reproduce this issue. The problem is: you cannot load multiple instances of different versions of onnxruntime dynamic library in one process.

@huggingface/transformers has dependency onnxruntime-node@1.20.1 and your package.json requires onnxruntime-node@1.21.0. There will be 2 dynamic library files:

• /node_modules/onnxruntime-node/bin/napi-v3/darwin/arm64/libonnxruntime.1.21.0.dylib
• /node_modules/@huggingface/transformers/node_modules/onnxruntime-node/bin/napi-v3/darwin/arm64/libonnxruntime.1.20.1.dylib

To fix this problem, you can modify your package.json to add "overrides" to keep the version consistent:

  "dependencies": {
    "@huggingface/transformers": "^3.3.3",
    "onnxruntime-node": "1.21.0"
  },
  "overrides": {
    "@huggingface/transformers": {
      "onnxruntime-node": "1.21.0"
    }
  }

[fs-eire]

@xenova maybe the next transformerjs version can use onnxruntime-node@1.21.0 ?

[xenova]

Absolutely! I'll upgrade to the latest version in the next release.

At the time of v3.4.0, onnxruntime 1.21.0 hadn't been released yet.

[felixT2K]

Same for onnxruntime-gpu

Do you mean the python package?

Yes sry :)

With the prev version 1.20.1 everything runs fine.

[amkorousagi]

I can reproduce this issue. The problem is: you cannot load multiple instances of different versions of onnxruntime dynamic library in one process.

@huggingface/transformers has dependency onnxruntime-node@1.20.1 and your package.json requires onnxruntime-node@1.21.0. There will be 2 dynamic library files:

• /node_modules/onnxruntime-node/bin/napi-v3/darwin/arm64/libonnxruntime.1.21.0.dylib
• /node_modules/@huggingface/transformers/node_modules/onnxruntime-node/bin/napi-v3/darwin/arm64/libonnxruntime.1.20.1.dylib

To fix this problem, you can modify your package.json to add "overrides" to keep the version consistent:

  "dependencies": {
    "@huggingface/transformers": "^3.3.3",
    "onnxruntime-node": "1.21.0"
  },
  "overrides": {
    "@huggingface/transformers": {
      "onnxruntime-node": "1.21.0"
    }
  }

Thank you for letting me know what caused the bug and how to fix it.

It resolved the issue, so I'm closing it now

[fs-eire]

Same for onnxruntime-gpu

Do you mean the python package?

Yes sry :)

With the prev version 1.20.1 everything runs fine.

could you please send a separated issue with details ?