why gemma 4 model not support pipeline mode ?

[mymmagic]

Will the " pipeline " feature add later?

Describe what you'd like to see added to EXO.

[rltakashige]

The architecture shares KV cache between layers, which is fairly messy to implement. Performance will also take a hit in any implementation, so it's unclear if we plan to add this feature.

I would recommend using TP for now if memory is the concern.

[mymmagic]

The architecture shares KV cache between layers, which is fairly messy to implement. Performance will also take a hit in any implementation, so it's unclear if we plan to add this feature.

I would recommend using TP for now if memory is the concern.

i tried , use mac mini (m4 16g) and mac studio(m1 32g), using tp mode but failed . the log is as follows: 05:37:42.7907AM ù INFO § Waiting for other campaign to finish
libc++abi: terminating due to uncaught exception of type std::runtime_error: °METAL§ Command buffer execution failed: Caused GPU Timeout Error (00000002:kIOGPUCommandBufferCallbackErrorTimeout)
° 05:37:45.7930AM ù INFO § Node 12D3KooWB2B8pMRenqLtPQA1vFSdbAEVVDSpPS7oJhbMZ9nJmu1g elected master
° 05:37:45.7935AM ù INFO § Unpausing API
° 05:37:46.1143AM ù INFO § Checking runner's status
° 05:37:46.1151AM ù INFO § Runner exited with exit code -6
° 05:37:46.1161AM ù ERROR § Runner terminated with signal=6 (Abort trap: 6)
RuntimeError: Runner found to be dead
° 05:37:46.1244AM ù INFO § Runner supervisor shutting down
° 05:37:46.1269AM ù INFO § Runner process succesfully terminated
° 05:37:46.1574AM ù INFO § Worker plan: Shutdown
° 05:37:46.1632AM ù INFO § Starting task Shutdown(task_id='17f6db0b-0172-41de-854d-1293d811eb51' task_status=<TaskStatus.Pending: 'Pending'> instance_id='4def33b2-458c-4af9-acbb-5567d05ae46e' runner_id='261a6c15-f105-425d-948e-e72c50145237')