offline ?

[TomMann]

Hey,
I was wondering if their is a way to utilise the pkl modules such as those for k8 in an offline way, that is to download them locally and reference them somehow. Working behind firewalls etc I would like to make use of this but from an initial try it tries to download from the pkl pantry but maybe I'm holding it wrong.

[StefMa]

I haven't tested it yet, but there is an pkl cache in ~/.pkl.
If I get it right, pkl will check first if there is the requested package already cached and if so, use it from there.
Otherwise it does an http request to download the package.

Doesn't this work for you? 🤔

[StefMa]

So youre talking about pkl project resolve?
I thought we are talking about pkl eval 🙃

I checked this a bit and it seems it behaves indeed differently.
While pkl eval uses the cache pkl project resolve does not.

I'm no sure if this is intended behaviour or an bug?!
cc @bioball

[TomMann]

I'm interested in your response to say pkl eval works for you, could you describe specifically what files exist in your cache because maybe that's my issue. If I run pkl eval **/*.pkl -m .output/

I get
Exception when making request GET https://pkg.pkl-lang.org/pkl-pantry/k8s.contrib.appEnvCluster@1.0.0:
pkg.pkl-lang.org

1 | amends "@appEnvCluster/AppEnvCluster.pkl"
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
at template (file:///mnt/c/Users/someaccount/somePath/PKL_POC/template.pkl, line 1)

that is even with pkl eval for me its not using the cache. I've copied k8s.contrib.appEnvCluster@1.0.0 and k8s.contrib.appEnvCluster@1.0.0.zip as I'm unsure on which it needs and k8s@1.0.1 and k8s@1.0.1.zip for the same reason.
I've also tried specifying the cache directory in case that was somehow an issue with the same result.

I am ultimately just trying to find a way to run pkl with dependency to these two libraries in an offline manner and so far struggling to do so, any way of doing this or pointing me in the direction to read up on it is appreciated :)

[bioball]

I can't reproduce this.

1. Run pkl eval to seed the cache
2. Disable internet
3. Run pkl eval again

This still works for me.

Are you changing the cache dir?

[StefMa]

@bioball eval works with the cache, but project resolve not.

Given this project setup:
Offline.pkl

import "package://pkg.pkl-lang.org/pkl-pantry/pkl.toml@1.0.0#/toml.pkl"

hi = 2

output {
  renderer = new toml.Renderer {}
}

PklProject

amends "pkl:Project"

dependencies {
  ["toml"] { uri = "package://pkg.pkl-lang.org/pkl-pantry/pkl.toml@1.0.0" }
}

Running:

• Online: pkl eval
• Offline: pkl eval

Both works 🎉

Running:

• Online: pkl project resolve
• Offline: pkl project resolve

Second one doesn't work. Report

Exception when making request GET https://pkg.pkl-lang.org/pkl-pantry/pkl.toml@1.0.0:
pkg.pkl-lang.org

The question here is:
Why isn't project resolve using the cache?
pkl.toml should be already cached.
Thats why I asked

I'm no sure if this is intended behaviour?

Maybe for project resolve we can't use the cache because not all information are available there?! 🤷
On the other side, what stops us to save all required information in cache?

I also recorded videos: 🤓

NotWorking.mov

Works.mov

[bioball]

Ah, I see. Looks like the issue is that we do not download packages to the cache dir when resolving.

Root cause here:

pkl/pkl-core/src/main/java/org/pkl/core/packages/PackageResolvers.java

Line 587 in e347b26

public Pair<DependencyMetadata, Checksums> getDependencyMetadataAndComputeChecksum(

It simply defers to super.getDependencyMetadataAndComputeChecksum if the package does not exist in local disk.

Thanks for the helpful videos!