feat: migrate staging to latest spago, package set

and bring compiler up to date with latest Hackage release (0.15.15)

Author: pete-murphy

.github/workflows/ci.yml

@@ -81,7 +81,7 @@ jobs:
           node updateSharedConfigVersions.mjs sharedConfig.out
           diff src/Try/SharedConfig.purs sharedConfig.out || {
             echo 'PureScript and/or package set versions in "client/src/Try/SharedConfig.purs"'
-            echo 'do not match the versions extracted from "stack.yaml" and "staging/packages.dhall".'
+            echo 'do not match the versions extracted from "stack.yaml" and "staging/spago.yaml".'
             echo 'Please run "cd client && npm run updateConfigVersions". CI will fail until then.'
             exit 1
           }

README.md

@@ -47,7 +47,7 @@ Most of these features can be controlled not only from the toolbar, but also usi
 
 ### Which Libraries Are Available?
 
-Try PureScript aims to provide a complete, recent package set from <https://github.com/purescript/package-sets>. The available libraries are those listed in [`staging/spago.dhall`](./staging/spago.dhall), at the versions in the package set mentioned in [`staging/packages.dhall`](./staging/packages.dhall).
+Try PureScript aims to provide a complete, recent package set from <https://github.com/purescript/registry/tree/main/package-sets>. The available libraries are those listed under `package.dependencies` in [`staging/spago.yaml`](./staging/spago.yaml), at the versions in the package set named by `workspace.packageSet.registry` in that same file.
 
 ## Development
 

RELEASE.md

@@ -28,15 +28,17 @@ Update the package set by doing the following. Each step is explained below:
 
 ```sh
 pushd staging
-spago upgrade-set
-cat > spago.dhall << EOF
-{ name = "try-purescript-server"
-, dependencies = [] : List Text
-, packages = ./packages.dhall
-, sources = [ "src/**/*.purs" ]
-}
+cat > spago.yaml << EOF
+package:
+  name: try-purescript-server
+  dependencies: []
+workspace:
+  packageSet:
+    registry: 0.0.1
+  extraPackages: {}
 EOF
-spago ls packages | cut -f 1 -d ' ' | xargs spago install
+spago upgrade
+spago install $(spago ls packages --json --quiet | jq -r 'to_entries[] | select(.value.type == "registry") | .key')
 popd
 pushd client
 npm run updateConfigVersions
@@ -47,27 +49,35 @@ popd
 
 ### Step-by-Step Explanation
 
-1. Update the `upstream` package set in `staging/packages.dhall`:
+1. Overwrite `staging/spago.yaml` with a placeholder config: an empty
+   `dependencies` list and any valid registry package set as a seed (the exact
+   version doesn't matter — the next step overwrites it). Starting from a clean
+   file ensures packages dropped from the new set don't linger.
 
-        ```
-        $ pushd staging && spago upgrade-set && popd
-        ```
+2. Upgrade to the latest package set:
 
-2. Set the `dependencies` key in the `spago.dhall` file to be an empty list. This will require a type annotation of `List Text`:
-
-        ```dhall
-        { name = "try-purescript-server"
-        , dependencies = [] : List Text
-        , packages = ./packages.dhall
-        , sources = [ "src/**/*.purs" ]
-        }
+        ```console
+        $ spago upgrade
         ```
 
-3. For `staging/spago.dhall`, install all packages in the package set by running this command:
+    This rewrites `workspace.packageSet.registry` to the newest available set,
+    replacing the seed version. Each set's JSON at
+    <https://github.com/purescript/registry/tree/main/package-sets> records the
+    `compiler` version it targets, which should line up with the `purescript`
+    version in `stack.yaml` — pin the set explicitly in step 1 instead if the
+    latest set targets a compiler you don't want.
 
+3. Install every package in the new set so they're all available in the
+   playground. This overwrites the empty `dependencies` list in
+   `staging/spago.yaml`, then downloads, compiles, and locks them — so there's
+   no separate `spago fetch`/`spago build` needed:
+
+        ```console
+        $ spago install $(spago ls packages --json --quiet | jq -r 'to_entries[] | select(.value.type == "registry") | .key')
         ```
-        $ spago ls packages | cut -f 1 -d ' ' | xargs spago install
-        ```
+
+    If a package fails to compile, remove it from `package.dependencies` in
+    `staging/spago.yaml` and run `spago install` again.
 
 4. Update the `client/src/Try/SharedConfig.purs` file by running this command in `client`:
 

client/src/Try/SharedConfig.purs

@@ -6,13 +6,14 @@ module Try.SharedConfig where
 import Prelude
 
 pursVersion :: String
-pursVersion = "v0.15.13"
+pursVersion = "v0.15.15"
 
 pursReleaseUrl :: String
 pursReleaseUrl = "https://github.com/purescript/purescript/releases/tag/" <> pursVersion
 
+-- | The registry package set version used by `staging/spago.yaml`.
 packageSetVersion :: String
-packageSetVersion = "0.15.13-20231219"
+packageSetVersion = "77.6.0"
 
 packageSetPackageJsonUrl :: String
-packageSetPackageJsonUrl = "https://github.com/purescript/package-sets/blob/psc-" <> packageSetVersion <> "/packages.json"
+packageSetPackageJsonUrl = "https://github.com/purescript/registry/blob/main/package-sets/" <> packageSetVersion <> ".json"

client/updateSharedConfigVersions.mjs

@@ -3,6 +3,16 @@
 // This script expects the current working directory to be `client`.
 // Call it using:
 //   node updateSharedConfigVersions.mjs src/Try/SharedConfig.purs
+//
+// It keeps `SharedConfig.purs` in sync with the two sources of truth:
+//   - the PureScript compiler version, taken from the server's `stack.yaml`
+//     (the `purescript-X.Y.Z` extra-dep, i.e. the compiler that actually
+//     compiles user snippets);
+//   - the registry package set version, taken from `staging/spago.yaml`
+//     (the `registry:` field). With Spago v1 the package set is a registry
+//     version and no longer encodes a purs version, so the two are read
+//     independently. The footer URLs are derived from these values inside
+//     `SharedConfig.purs`, so only the version strings are written here.
 
 import fs from "fs";
 import path from "path";
@@ -15,9 +25,9 @@ if (process.argv.length <= 2) {
 const sharedConfigPath = process.argv[2];
 
 const stackYamlPath = path.join("..", "stack.yaml");
-const stagingPackagesDhallPath = path.join("..", "staging", "packages.dhall");
+const stagingSpagoYamlPath = path.join("..", "staging", "spago.yaml");
 const stackYamlContent = fs.readFileSync(stackYamlPath, "utf-8");
-const packagesContent = fs.readFileSync(stagingPackagesDhallPath, "utf-8");
+const stagingSpagoYamlContent = fs.readFileSync(stagingSpagoYamlPath, "utf-8");
 
 const pursVersion = stackYamlContent.split("\n")
   .reduce((acc, nextLine) => {
@@ -29,15 +39,15 @@ const pursVersion = stackYamlContent.split("\n")
   }, { found: false })
   .value;
 
-const packageSetVersion = packagesContent
-  .match(/https:\/\/github.com\/purescript\/package-sets\/releases\/download\/psc-([^\/]+)\/packages.dhall/)[1];
+const packageSetVersionMatch = stagingSpagoYamlContent.match(/registry:\s*(\S+)/);
+const packageSetVersion = packageSetVersionMatch ? packageSetVersionMatch[1] : undefined;
 
 if (!pursVersion) {
   throw new Error("Failed to extract the PureScript version from the stack.yaml file. Cannot update SharedConfig.purs file.");
 }
 
 if (!packageSetVersion) {
-  throw new Error("Failed to extract the Package Set version from the staging/packages.dhall file. Cannot update SharedConfig.purs file.");
+  throw new Error("Failed to extract the registry package set version (the 'registry:' field) from the staging/spago.yaml file. Cannot update SharedConfig.purs file.");
 }
 
 const sharedConfigContent = fs.readFileSync(sharedConfigPath, "utf-8");

stack.yaml

@@ -3,7 +3,7 @@ packages:
   - "."
 
 extra-deps:
-  - purescript-0.15.13
+  - purescript-0.15.15
   - language-javascript-0.7.0.0
   - process-1.6.13.1
   # The Cabal library is not in Stackage

stack.yaml.lock

@@ -5,12 +5,12 @@
 
 packages:
 - completed:
-    hackage: purescript-0.15.13@sha256:ed7e4d3561ff6cbc7f950af2450a51f71648c47fece8b9a2b5100f0157a47615,21378
+    hackage: purescript-0.15.15@sha256:8e2a2452b66e29dbfa8269c523487f882c7b94aa71766b06be7e51da4dc85035,21429
     pantry-tree:
-      sha256: f91a02104c2bb596613dca4cf460e8e218488791b8d2f1d0641cd0e73c9eb072
-      size: 159072
+      sha256: c70747a772ab844b7e9b86cfc57a9b22001652ad7bec457eb274df29b7110e17
+      size: 159334
   original:
-    hackage: purescript-0.15.13
+    hackage: purescript-0.15.15
 - completed:
     hackage: language-javascript-0.7.0.0@sha256:3eab0262b8ac5621936a4beab6a0f97d0e00a63455a8b0e3ac1547b4088dae7d,3898
     pantry-tree: