Is --max-workers flag related to CPU core? #156
Answered
by
meizhong986
TinyRick1489
asked this question in
Q&A
|
I have 6 core 12 thread CPU. If I want to use 4 cores, should I keep --max-workers 4 or --max-workers 8? |
Answered by
meizhong986
Feb 25, 2026
Replies: 1 comment
|
The With a single GPU, Setting it higher than your GPU count will not help — the workers would compete for the same GPU memory. |
0 replies
Answer selected by
TinyRick1489
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The
--max-workersflag controls how many GPU worker processes run in parallel, not CPU cores. Each worker loads the model onto a GPU and processes files independently.With a single GPU,
--max-workers 1is usually best (default). With 2 GPUs (like Kaggle dual T4),--max-workers 2lets each GPU process a file simultaneously.Setting it higher than your GPU count will not help — the workers would compete for the same GPU memory.