Errors while building MLXChatExample

[valentinptr]

I use MLX for the first time and I wanted to test MLXChatExample. Here are the steps I have done :

1. clone the swift example repo and install dependancies
2. during building the project I had this first issue :
   1. Project/Services/MLXService.swift:32:66 Type 'LLMRegistry' has no member 'acereason_7b_4bit' ==> So I commented this line
   2. Project/ViewModels/ChatViewModel.swift:92:23 Type 'Generation' has no member 'toolCall' ==> I commented the case/brake also
3. I was finally able to build the code but then this error occurred : ViewBridge to RemoteViewService Terminated: Error Domain=com.apple.ViewBridge Code=18 "(null)" UserInfo={com.apple.ViewBridge.error.hint=this process disconnected remote view controller -- benign unless unexpected, com.apple.ViewBridge.error.description=NSViewBridgeErrorCanceled}

On the app window I have this issue :

[davidkoski]

Very curious. For item 2, I see the code here:

• https://github.com/ml-explore/mlx-swift-examples/blob/main/Libraries/MLXLLM/LLMModelFactory.swift#L223

toolCall is also there:

• https://github.com/ml-explore/mlx-swift-examples/blob/main/Libraries/MLXLMCommon/Evaluate.swift#L948

Look in your code and see if those appear. I am not sure how it would happen that you have a stale build or an inconsistent checkout (since these are all in the same repository).

For the screenshot, that looks like entitlement issues where network connections are not allowed:

You can try llm-tool, a command line tool, and see if that works. You can give it a single prompt or it can do a chat session. It is a little simpler and if you have that running you will at least have something working that you can compare to/debug.

[valentinptr]

Thank you for your answer.

I looked at both linked you sent me but although the version librairy is the last one on my Mac (2.25.4) I do not have the same code while looking both at GitHub and Xcode :

and

I will try llm-tool, thanks

[Junyi-99]

same problem here

[Junyi-99]

I'm using a hotspot, so the shouldUseOfflineMode function returned true. When I connect to a normal Wi-Fi, the problem solved.

[davidkoski]

I'm using a hotspot, so the shouldUseOfflineMode function returned true. When I connect to a normal Wi-Fi, the problem solved.

I think this may be a different issue and useOfflineMode is a feature of HubApi (swift-transformers).

[davidkoski]

@valentinptr are you still seeing issues here?

[valentinptr]

Yes