Parellel GPU and CPU use

[bugsyb]

Describe the feature you'd like to request

Recognize to launch preview generation for next batch of GPU based processing at the time of launching GPU processing.

Describe the solution you'd like

CPU used to generate previews whilst GPU processes previews from previous CPU batch.
It would double the speed of processing vs current linear approach of: generate previews (CPU used), once finished, pushed to GPU processing. At the same time, background process could be launched to generate previews required for next run.

Describe alternatives you've considered

Current implementation spends half if not more of the time generating previews using CPU whilst GPU is left unused and vice versa when previews are generated and GPU kicks in, CPU is relatively unused.

[github-actions]

Hello 👋

Thank you for taking the time to open this issue with recognize. I know it's frustrating when software
causes problems. You have made the right choice to come here and open an issue to make sure your problem gets looked at
and if possible solved.
I try to answer all issues and if possible fix all bugs here, but it sometimes takes a while until I get to it.
Until then, please be patient.
Note also that GitHub is a place where people meet to make software better together. Nobody here is under any obligation
to help you, solve your problems or deliver on any expectations or demands you may have, but if enough people come together we can
collaborate to make this software better. For everyone.
Thus, if you can, you could also look at other issues to see whether you can help other people with your knowledge
and experience. If you have coding experience it would also be awesome if you could step up to dive into the code and
try to fix the odd bug yourself. Everyone will be thankful for extra helping hands!
One last word: If you feel, at any point, like you need to vent, this is not the place for it; you can go to the forum,
to twitter or somewhere else. But this is a technical issue tracker, so please make sure to
focus on the tech and keep your opinions to yourself. (Also see our Code of Conduct. Really.)

I look forward to working with you on this issue
Cheers 💙

[marcelklehr]

Ah, that's a good idea! We'll try to take this into account in the revamp

[bugsyb]

Thank you!