How to use shared devices exclusively?

[lijinbio]

Hi,

I have a list of GPU devices, e.g., [0, 1, 2], and I have many running tasks (e.g., 30 tasks), which require exclusive access to one device each. I intend to utilize "multiprocess" functions to execute all 30 tasks in parallel, while maintaining a queue of three GPU devices that are employed whenever a GPU device becomes available. Could you recommend any useful resources, such as tutorials or documents, to aid me in achieving this objective? Thank you.