Skip to content
Integration Quarkus-LangChain4j

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping #48

Sign in to view logs

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping

Add Prefill–Decode Separation with Batched Prompt Ingestion and Logits Skipping #48

Run time

Learn about OS pricing on GitHub Actions
Job Run time
quarkus-integration-test (opencl)
2m 44s
quarkus-integration-test (ptx)
2m 48s
quarkus-integration-test (ptx)
30m 19s
quarkus-integration-test (opencl)
30m 20s
1h 6m 11s