Speech detection not working in VR on Meta Quest 3

[loksangho]

Hi,

I am having trouble with getting speech detected in my scene using the Meta Quest 3's microphone. Do you have a working VR demo, or know of anything I should be aware of? The whole thing (speech detection, ChatGPT, speech synthesiser) works in Editor builds in Unity, just not when deployed on a VR headset. I have tested the mic and it is working on the headset.

Thank you.

[loksangho]

Hi there, looking more into this, I found that the speech was recognised, but it doesn't go to the ChatGPT LLM. Here is the log from the Meta Quest 3.

2026/03/01 09:31:03.623 3063 3098 Info Unity Speech recognized: Hi. Hello.
2026/03/01 09:31:03.623 3063 3098 Info Unity ()
2026/03/01 09:31:03.623 3063 3098 Info Unity UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object)
2026/03/01 09:31:03.623 3063 3098 Info Unity ChatdollKit.SpeechListener.d__49:MoveNext()
2026/03/01 09:31:03.623 3063 3098 Info Unity Cysharp.Threading.Tasks.UniTaskCompletionSourceCore1:TrySetResult(TResult) 2026/03/01 09:31:03.623 3063 3098 Info Unity ChatdollKit.SpeechListener.<ProcessTranscriptionAsync>d__4:MoveNext() 2026/03/01 09:31:03.623 3063 3098 Info Unity Cysharp.Threading.Tasks.UniTaskCompletionSourceCore1:TrySetResult(TResult)
2026/03/01 09:31:03.623 3063 3098 Info Unity Cysharp.Threading.Tasks.UnityWebRequestAsyncOperationConfiguredSource:MoveNext()
2026/03/01 09:31:03.623 3063 3098 Info Unity Cysharp.Threading.Tasks.Internal.PlayerLoopRunner:RunCore()

[uezo]

Hi @loksangho ,

Thank you for reporting this and for the detailed investigation.

Could you provide the following information to help me investigate further?

1. Which SpeechListener are you using? (e.g., OpenAISpeechListener, AzureSpeechListener, etc.)

2. Enable debug logging on your ChatGPT service by setting DebugMode = true on the ChatGPTService component in Unity Inspector, then deploy to Quest 3 again and share the full logs.

3. Full device logs: Could you share the complete log output around the time of the speech recognition? There may be error messages appearing after the "Speech recognized" line that would help identify the issue. You can capture this with adb logcat -s Unity.

[loksangho]

Hi @uezo ,

Thanks for your reply. I'm using OpenAISpeechListener.

There doesn't seem to be any error messages after "Speech recognized", I looked at the code "SpeechListenerBase.cs" and found that the line:
if (OnRecognized != null) equates to false, so it never runs the block, "await OnRecognized(text);"

I'll provide logs once I sort out some issues with space on my development machine.

[loksangho]

Hi there, I have turned debug mode on, here is the log output. The wake words are 'mirror' and 'hello', with 4 prefix and suffix allowances each. 03-01 18:13:18.023 29305 29324 I Unity : Speech recognized: High mirror. 03-01 18:13:18.023 29305 29324 I Unity : () 03-01 18:13:18.023 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:18.023 29305 29324 I Unity : ChatdollKit.SpeechListener.<HandleRecordingCompleteAsync>d__49:MoveNext() 03-01 18:13:18.023 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:18.023 29305 29324 I Unity : ChatdollKit.SpeechListener.<ProcessTranscriptionAsync>d__4:MoveNext() 03-01 18:13:18.023 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:18.023 29305 29324 I Unity : Cysharp.Threading.Tasks.UnityWebRequestAsyncOperationConfiguredSource:MoveNext() 03-01 18:13:18.023 29305 29324 I Unity : Cysharp.Threading.Tasks.Internal.PlayerLoopRunner:RunCore() 03-01 18:13:18.023 29305 29324 I Unity : 03-01 18:13:18.023 29305 29324 I Unity : OnRecognizedFalse 03-01 18:13:18.023 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:18.023 29305 29324 I Unity : ChatdollKit.SpeechListener.<HandleRecordingCompleteAsync>d__49:MoveNext() 03-01 18:13:18.023 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:18.023 29305 29324 I Unity : ChatdollKit.SpeechListener.<ProcessTranscriptionAsync>d__4:MoveNext() 03-01 18:13:18.023 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:18.023 29305 29324 I Unity : Cysharp.Threading.Tasks.UnityWebRequestAsyncOperationConfiguredSource:MoveNext() 03-01 18:13:18.023 29305 29324 I Unity : Cysharp.Threading.Tasks.Internal.PlayerLoopRunner:RunCore() 03-01 18:13:18.023 29305 29324 I Unity : 03-01 18:13:20.376 29305 29324 I Unity : Speech recognized: Hi, Mira. 03-01 18:13:20.376 29305 29324 I Unity : () 03-01 18:13:20.376 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:20.376 29305 29324 I Unity : ChatdollKit.SpeechListener.<HandleRecordingCompleteAsync>d__49:MoveNext() 03-01 18:13:20.376 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:20.376 29305 29324 I Unity : ChatdollKit.SpeechListener.<ProcessTranscriptionAsync>d__4:MoveNext() 03-01 18:13:20.376 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:20.376 29305 29324 I Unity : UnityEngine.AsyncOperation:InvokeCompletionEvent() 03-01 18:13:20.376 29305 29324 I Unity : 03-01 18:13:20.376 29305 29324 I Unity : OnRecognizedFalse 03-01 18:13:20.376 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:20.376 29305 29324 I Unity : ChatdollKit.SpeechListener.<HandleRecordingCompleteAsync>d__49:MoveNext() 03-01 18:13:20.376 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:20.376 29305 29324 I Unity : ChatdollKit.SpeechListener.<ProcessTranscriptionAsync>d__4:MoveNext() 03-01 18:13:20.376 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:20.376 29305 29324 I Unity : UnityEngine.AsyncOperation:InvokeCompletionEvent() 03-01 18:13:20.376 29305 29324 I Unity : 03-01 18:13:23.050 29305 29324 I Unity : [OVRManager] HMDUnmounted event 03-01 18:13:23.050 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:23.050 29305 29324 I Unity : OVRManager:Update() 03-01 18:13:23.050 29305 29324 I Unity : 03-01 18:13:23.562 29305 29324 I Unity : Speech recognized: Hello. Hi. 03-01 18:13:23.562 29305 29324 I Unity : () 03-01 18:13:23.562 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:23.562 29305 29324 I Unity : ChatdollKit.SpeechListener.<HandleRecordingCompleteAsync>d__49:MoveNext() 03-01 18:13:23.562 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:23.562 29305 29324 I Unity : ChatdollKit.SpeechListener.<ProcessTranscriptionAsync>d__4:MoveNext() 03-01 18:13:23.562 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:23.562 29305 29324 I Unity : Cysharp.Threading.Tasks.UnityWebRequestAsyncOperationConfiguredSource:MoveNext() 03-01 18:13:23.562 29305 29324 I Unity : Cysharp.Threading.Tasks.Internal.PlayerLoopRunner:RunCore() 03-01 18:13:23.562 29305 29324 I Unity : 03-01 18:13:23.562 29305 29324 I Unity : OnRecognizedFalse 03-01 18:13:23.562 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:23.562 29305 29324 I Unity : ChatdollKit.SpeechListener.<HandleRecordingCompleteAsync>d__49:MoveNext() 03-01 18:13:23.562 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:23.562 29305 29324 I Unity : ChatdollKit.SpeechListener.<ProcessTranscriptionAsync>d__4:MoveNext() 03-01 18:13:23.562 29305 29324 I Unity : Cysharp.Threading.Tasks.UniTaskCompletionSourceCore`1:TrySetResult(TResult) 03-01 18:13:23.562 29305 29324 I Unity : Cysharp.Threading.Tasks.UnityWebRequestAsyncOperationConfiguredSource:MoveNext() 03-01 18:13:23.562 29305 29324 I Unity : Cysharp.Threading.Tasks.Internal.PlayerLoopRunner:RunCore() 03-01 18:13:23.562 29305 29324 I Unity : 03-01 18:13:38.045 29305 29324 I Unity : Handle cmd APP_CMD_PAUSE(14) 03-01 18:13:38.076 29305 29324 I Unity : [XR] [483009309168] [18:13:38.076][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_FOCUSED->XR_SESSION_STATE_VISIBLE session=81 time=17414950112329 03-01 18:13:38.076 29305 29324 I Unity : [MetaXRFeature] OnSessionStateChange: 5 -> 4 03-01 18:13:38.076 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:38.076 29305 29324 I Unity : Meta.XR.MetaXRFeature:OnSessionStateChange(Int32, Int32) 03-01 18:13:38.076 29305 29324 I Unity : UnityEngine.XR.OpenXR.Features.OpenXRFeature:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.076 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.076 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:Internal_PumpMessageLoop() 03-01 18:13:38.076 29305 29324 I Unity : UnityEngine.BeforeRenderHelper:Invoke() 03-01 18:13:38.076 29305 29324 I Unity : 03-01 18:13:38.076 29305 29324 I Unity : [XR] [483009309168] [18:13:38.076][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_VISIBLE->XR_SESSION_STATE_SYNCHRONIZED session=81 time=17414959952278 03-01 18:13:38.077 29305 29324 I Unity : [MetaXRFeature] OnSessionStateChange: 4 -> 3 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:38.077 29305 29324 I Unity : Meta.XR.MetaXRFeature:OnSessionStateChange(Int32, Int32) 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.XR.OpenXR.Features.OpenXRFeature:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:Internal_PumpMessageLoop() 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.BeforeRenderHelper:Invoke() 03-01 18:13:38.077 29305 29324 I Unity : 03-01 18:13:38.077 29305 29324 I Unity : [XR] [483009309168] [18:13:38.077][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_SYNCHRONIZED->XR_SESSION_STATE_STOPPING session=81 time=17414966867539 03-01 18:13:38.077 29305 29324 I Unity : [MetaXRFeature] OnSessionStateChange: 3 -> 6 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:38.077 29305 29324 I Unity : Meta.XR.MetaXRFeature:OnSessionStateChange(Int32, Int32) 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.XR.OpenXR.Features.OpenXRFeature:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:Internal_PumpMessageLoop() 03-01 18:13:38.077 29305 29324 I Unity : UnityEngine.BeforeRenderHelper:Invoke() 03-01 18:13:38.077 29305 29324 I Unity : 03-01 18:13:38.078 29305 29324 I Unity : [MetaXRFeature] OnSessionEnd: 81 03-01 18:13:38.078 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:38.078 29305 29324 I Unity : Meta.XR.MetaXRFeature:OnSessionEnd(UInt64) 03-01 18:13:38.078 29305 29324 I Unity : UnityEngine.XR.OpenXR.Features.OpenXRFeature:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.078 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.078 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:Internal_EndSession() 03-01 18:13:38.078 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:StopInternal() 03-01 18:13:38.078 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.078 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:Internal_PumpMessageLoop() 03-01 18:13:38.078 29305 29324 I Unity : UnityEngine.BeforeRenderHelper:Invoke() 03-01 18:13:38.078 29305 29324 I Unity : 03-01 18:13:38.095 29305 29324 I Unity : [XR] [483009309168] [18:13:38.095][Info ] OpenXRSession::HandleSessionStateChangedEvent: state XR_SESSION_STATE_STOPPING->XR_SESSION_STATE_IDLE session=81 time=17414987918843 03-01 18:13:38.095 29305 29324 I Unity : [MetaXRFeature] OnSessionStateChange: 6 -> 1 03-01 18:13:38.095 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:38.095 29305 29324 I Unity : Meta.XR.MetaXRFeature:OnSessionStateChange(Int32, Int32) 03-01 18:13:38.095 29305 29324 I Unity : UnityEngine.XR.OpenXR.Features.OpenXRFeature:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.095 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.095 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:Internal_PumpMessageLoop() 03-01 18:13:38.095 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:ReceiveNativeEvent(NativeEvent, UInt64) 03-01 18:13:38.095 29305 29324 I Unity : UnityEngine.XR.OpenXR.OpenXRLoaderBase:Internal_PumpMessageLoop() 03-01 18:13:38.095 29305 29324 I Unity : UnityEngine.BeforeRenderHelper:Invoke() 03-01 18:13:38.095 29305 29324 I Unity : 03-01 18:13:38.114 29305 29324 I Unity : [OVRManager] OnApplicationPause(true) 03-01 18:13:38.114 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:38.114 29305 29324 I Unity : 03-01 18:13:38.127 29305 29324 I Unity : Handle cmd APP_CMD_TERM_WINDOW(2) 03-01 18:13:38.130 29305 29324 I Unity : Handle cmd APP_CMD_LOW_MEMORY(10) 03-01 18:13:38.131 29305 29324 I Unity : Handle cmd APP_CMD_STOP(15) 03-01 18:13:38.131 29305 29324 I Unity : Handle cmd APP_CMD_SAVE_STATE(13) 03-01 18:13:38.133 29305 29324 I Unity : Handle cmd APP_CMD_LOST_FOCUS(8) 03-01 18:13:38.134 29305 29324 I Unity : [OVRManager] OnApplicationFocus(false) 03-01 18:13:38.134 29305 29324 I Unity : UnityEngine.DebugLogHandler:Internal_Log(LogType, LogOption, String, Object) 03-01 18:13:38.134 29305 29324 I Unity :

…

On Sun, Mar 1, 2026 at 11:20 AM uezo ***@***.***> wrote: *uezo* left a comment (uezo/ChatdollKit#496) <#496 (comment)> Hi @loksangho <https://github.com/loksangho> , Thank you for reporting this and for the detailed investigation. Could you provide the following information to help me investigate further? 1. Which SpeechListener are you using? (e.g., OpenAISpeechListener, AzureSpeechListener, etc.) 2. Enable debug logging on your ChatGPT service by setting DebugMode = true on the ChatGPTService component in Unity Inspector, then deploy to Quest 3 again and share the full logs. 3. Full device logs: Could you share the complete log output around the time of the speech recognition? There may be error messages appearing after the "Speech recognized" line that would help identify the issue. You can capture this with adb logcat -s Unity. — Reply to this email directly, view it on GitHub <#496 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AA7VNCBNRLOUX3VBXB2QVVD4ON66NAVCNFSM6AAAAACWCR5YQWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTSNZYGY4TCNRSGU> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[loksangho]

For #495 that was only working with the editor, not for the Meta Quest 3.

[loksangho]

I have identified the problem. The fix is to open up AIAvatar.cs script and move all the statements containing ModelController.SpeechController and ModelController.FaceController from Awake to Start.

The problem was that AIAvatar's Awake was run before ModelController's Awake function on the Quest 3.

[uezo]

Hi @loksangho ,
Good catch. This is a bug. The code was implicitly relying on the execution order, so it happened to work in the editor but broke on Quest.

Thank you very much for investigating this and identifying the root cause. I really appreciate you taking the time to dig into it.

I’ll fix this. 🙏