"Furthermore, I have some issue with curl when exec post command"
I have the same issue. So basically the example "Run Spark Job" (https://github.com/JahstreetOrg/spark-on-kubernetes-helm#run-spark-job) does not work.

I tried to install curl but I got errors like:

apt update

E: Repository 'https://deb.debian.org/debian buster InRelease' changed its 'Suite' value from 'stable' to 'oldstable'

apt install curl -y

E: Failed to fetch https://deb.debian.org/debian/pool/main/o/openldap/libldap-common_2.4.47+dfsg-3+deb10u2_all.deb  404  Not Found [IP: 151.101.14.132 443]

I already have problems to install curl in the first base image sasnouskikh/spark:3.0.1_2.12-hadoop_3.2.0_cloud somehow apt is locked already:

RUN apt-get update -y

E: Could not open lock file /var/lib/apt/lists/lock - open (13: Permission denied)

#solved by
USER root
#but then same error like above

@jahstreet
What's wrong and how can I fix that? I mean what's the point of giving a curl example if curl is not installed in livy container...

@jahstreet also another question: is that Livy compatible with Spark 3.3.1?

Any hints are welcome :)

exec: "curl": executable file not found in $PATH: unknown #71

Description

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions