[SPARK-54159][INFRA] Fix pip install commands to use proper quotation marks

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to a few pip install command to use proper quotation marks like the following.

-RUN python3.13 -m pip install --ignore-installed blinker>=1.6.2 # mlflow needs this
+RUN python3.13 -m pip install --ignore-installed 'blinker>=1.6.2' # mlflow needs this

-RUN python3.13 -m pip install numpy>=2.1 pyarrow>=18.0.0 six==1.16.0 pandas==2.3.3 scipy coverage matplotlib openpyxl grpcio==1.67.0 grpcio-status==1.67.0 lxml jinja2 && \
+RUN python3.13 -m pip install 'numpy>=2.1' 'pyarrow>=18.0.0' 'six==1.16.0' 'pandas==2.3.3' scipy coverage matplotlib openpyxl 'grpcio==1.67.0' 'grpcio-status==1.67.0' lxml jinja2 && \

Why are the changes needed?

SHELL handles >= before pip install command receives it.

Does this PR introduce any user-facing change?

No behavior change because this is only changing infra.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

[bjornjorgensen]

ok, but I also think we should have inside the ARG's to like

ARG BASIC_PIP_PKGS="numpy 'pyarrow>=22.0.0' 'six==1.16.0' 'pandas==2.3.3' scipy 'plotly<6.0.0' coverage matplotlib openpyxl 'memory-profiler>=0.61.0' 'scikit-learn>=1.3.2'"
# Python deps for Spark Connect
ARG CONNECT_PIP_PKGS="'grpcio==1.75.1' 'grpcio-status==1.71.2' 'protobuf==5.29.5' 'googleapis-common-protos==1.65.0' 'graphviz==0.20.3'"