Remove grpcio-tools from requirements.txt, it turns out it's not actually needed - only relevant during building and setup.py! Also downgrade grpcio to minimum version which supports Py3.11

Remove grpcio-tools from requirements.txt, it turns out it's not actually needed - only relevant during building and setup.py! Also downgrade grpcio to minimum version which supports Py3.11 #5310