Polars in Python | Kernel error : Generic LocalFileSystem error: Unable to Convert URL "file://DeltaLakeRootFolder/DeltaId/delta"

[BiswaKalua]

Hello Coders, I hope you all are doing well.

Recently, I had to implement a Delta-Lake storage for storing a huge amount of data (Hundreds of Millions) for a client, where I was unable to store the Delta Lake in a network address.

I've a boundary to use Polars in Python to do this.

I'm Using
Python - v3.12.2
Polars - v1.32.2
Deltalake - v1.2.1

But the client said that the hosted application and the storage server are different.
So, the storage is hosted on a PC in a different network address, and the storage is nothing but an SSD, which is accessed by just getting access permission to that network address. It's not any object/blob storage. It's just another PC whose file storage is accessible.

Assume something like this -> "\\\\111.22.3.4\\DeltaLakeRootFolder\\DeltaId\\delta"
So, in this folder, I want to store the delta-lake, the delta folder should contain all parquet chunks, and the _delta_log folder.

When I am writing deltalake in the local machine (into the C drive), then it is working properly.
But when I am trying to write it into the network path, then I'm getting this kernel error: Error interacting with object store: Generic LocalFileSystemError: Unable to Convert URL "file:///DeltaLakeRootFolder/DeltaId/delta"

Where is the server IP getting converted into a file prefix?

Try 1: Did some R&D, and I got to know that mapping the network location into the local machine as a drive can solve this problem. So, I mapped the 111.22.3.4 network drive as Z: drive and then used this Z drive path to store deltalake.
Z drive path like this -> "Z:\\DeltaLakeRootFolder\\DeltaId\\delta"

But I got exactly the same error after doing this.

My Queries

• Can someone explain to me why this is happening?
• Why is the server IP getting converted into a file prefix?
• And most importantly, what is the solution for storing Deltalake into a network drive like this?

Thanks :)

Here's the screenshot of the error. Where the server IP and project name are covered by a green mark for the security issue. The first green-marked path variable is the server IP