I have some hypotheses as to where the bottleneck might be. I'll do some research and submit a PR if I get a sufficient improvement. (Sorry to open an issue on you, but it seemed the most efficient way to get in contact)