Memory access is still a bottleneck.
Consider using a more modern CPU (e.g. Z280) which adds instruction and data cache, plus several other nice features.
See also here:
https://github.com/Konamiman/Z280TechnicalManual/blob/master/A-Z80_Z280_Compatibility.md