Mainnet Beta Release 1.3.2beta1

[lk86]

The O(1) Labs team is proud to announce that 1.3.1beta1 is ready to test on Mainnet! This release includes a set of minor bugfixes, major testing and CI improvements, and code cleanup as we build towards the final 1.3.2 version.

If you run into any issues, please include Release: 1.3.2beta1 in the name of any issues you create. Please report any issues you encounter here or join the Discussion below!

Bug Fixes:

• Ensure backups always occur at midnight Lk86/change cronjob granularity 10min #10581
• Make sure demo mode nodes stay alive with no peers [Trivial] Fixup demo mode #10657
• Fix a double cache invalidation bug in the catchup code Fix catchup double cache invalidation #10769
• Fix a crash when blocks are applied to the transition frontier twice Fix duplicate block bug #10735
• Fix yojson parsing for Snark_work_recieved logs Allow reversed fields in Fee_excess JSON #10871
• Print "Using password from environment variable" logs when the password is actually used and not always Remove spurious "Using password from environment variable" logs at startup #10865
• Fix the "run local network" script for the latest mina version and add some features Improvements for local network spinning up script #11105 Archive Node support for Local network runner #11221
• Fix generate-keys-and-ledger.sh script Steven ledger gen fix #11157
• Fix long log lines and other logging issues Fix misc error logging issues #10722
• Batch transaction tool fixes Fix for batch_txn_tool #11377

New Features:

• Node status backend RFC Rfc/node status backend #9910
• Log when adding a block Add log when adding block #10310
• Cache the state body hashes for blocks to speed up GetTransitionChainProof Cache state body hashes #10297
• Optimize libp2p/golang message parsing Optimize libp2p IPC reading and parsing #10299
• Estimate the "gap" when the missing block auditor finds a block missing Add gap estimate to missing block log #10481
• New metrics to track the time a node spends validating messages Add execution timing metrics for participation code #10158
• Filter commands when using the replayer Filter command ids in SQL #10312
• New file structure used by the Delegation Program Backend Delegation backend: new storage structure #9712
• Extract wire types into a dedicated library Extract Currency.Amount.t into a separate, compatible library #11256
• Modular graphql serializers with updated graphql_ppx graphql encoders - compatible #11158
• New key and ledger generation tools New gossipqa deployment, compatible #11214

Network Stability Improvements

• Remove validation_callback from blocks type Remove validation_callback out of block type #10684
• Support bitswap block encoding/decoding Add bitswap block encoding/decoding to ocaml #10579
• Improve message pipes using a Sink abstraction Introduce and use Sink abstraction #9962
• Extract validation logic from External_transition Extract validation out of External_transition #10780
• Finalize block header / block body split with new module structure Introduce mina_block package instead of mina_transition #10903
• Pass validation callbacks through the catchup process Pass validation_callback through catchup process #10895

Assorted Testing and CI/CD Improvements:

• CI Fixes Fix libp2p_helper Makefile (ipc building bug) #10320 [cleanup] Small Makefile optimization #10544 Deb s3 atomic upload compatible #10733 Fixup compilation after merge from master #10848 Add .ocamlformat to archive_lib #10846 [Compatible] Use the archive URL for the current branch when running tests #10876 Lint for multiple versioned types in module (compatible) #11122 lk86/fix-rosetta-external-contributors #10958
• CI Structural Improvements Changed CI pod sizing to generic #10338 Retry failed unit tests using dune cache #10441 buildkite: skip git env upload step #10582 archive_lib tests: allow configuring postgres #10572 buildkite: remove "optional" from job names #10680 Use MinaProtcol's repo for deb-s3 #11113 Remove vestiges of coda-archive-processor-test #11155 Add dhall to toolchain #11044 Use exit code 20 for integration test node initialization failures #11264 Feature/retry for all infra errors comp #11375 exit code 6 for failure to create subscription #11397
• New Documentation Feature/9665 spec ouroboros samasika checkpointing #9667 Feature/8407 spec ouroboros samasika consensus - skeleton and min window density #9307 Update links in description.md #10703 Port forwarding docs #10884
• New Tests Delegation test #10325 Documentation: check for invalid references in CI #9902 Test block production under load #10091 Add inline test for signature consistency #10650 replay attack test #10463 Better intg test exit codes #11196
• Nix Support [nix prep] marlin_plonk_bindings changes #10570 [cleanup] Remove bitrotted Bazel support #10543 [nix prep] libp2p: allow disabling MDNS test #10566 [nix prep] trace-tool: use newer cargo version, update Cargo.lock #10568 [nix prep] buildkite: allow passing --privileged to docker #10567 [nix prep] mina_version/gen.sh: make version info generation more reselient and flexible #10569 Nix prep #10942 Nix packaging #10873 flake.lock: Update #11046 Nix: use lld #11050 [Nix] Fix macOS build #11111 Nix related direnv information (compatible) #11386 Fix nix build on macOS Big Sur #11372 Nix: remove unbuildable impure-shell package #11355 Nix CI: skip pointless checkouts #11354 Nix: fix lsp shell after ocaml 4.14 upgrade #11353 Nix: change binary cache key #11337 Nix CI: don't sign or push (since we run a daemon that does that) #11356 Nix: set libp2p helper path in the nix develop #11351 Revert and adapt #11259 #11342 [nix] Correct check for impure switch #11329 Add nix lsp to devShell, improve nix/README.md #11311 Nix-based CI #10898
• Integration Test Fixes Integration test and gating config fixes #10188 Fix snark worker support in integration tests #10279 Bump soft_timeout of Wait_condition.blocks_to_be_produced in integration tests #10326 Integration tests: don't wait 30s before every GraphQL test #10614 Bump graphql_ppx to fix race condition #10630 breadcrumb wait for not working #10702 Try to fix replayer and conenct to mainnet tests #10758 extra genesis accounts for intg test framework #10739 Explicit genesis configs #10785 make slot time configurable in intg tests #10827 Informative structured log error message #10838 Remove some old intgtest #11094
• Dependency Updates Bump ppx_version for annot dummy deriver #10510 Bump graphql_ppx to fix race condition #10630 Use explicit dependencies in dune files #10653 frontend/leaderboard: update yarn.lock #10574 Use LLD as a linker #10762 Temporarily revert LLD linking #10770 Upgrade dune and ocamlformat + reformat files #10896 Detect LLD linker and use it if available #10946 Clean/unpin extlib #10957 Use upgraded rpc_parallel #10983 Remove ocaml-extlib from .gitmodules and nix dependencies #11045 Upgrade Jane Street packages #11011 Bump ppx_version for Jane Street v14 libs #11067 frontend/mina-signer: add 'jest' dev-dependency to run tests in CI #11175 Use upstream graphql_ppx, upgrade ppxlib #11114 dune: add (sandbox none) to mina_version, ocaml-rocksdb #11173 Upgrade OCaml to 4.14 #11257 Update ocaml-graphql-server - compatible #11383 Upgrade dune to 3.3.1, factorize graph-ppx configuration #11347

Complete Changelog since 1.3.0:

1.3.1...1.3.2beta1

Upgrading & Connecting to Mainnet

Debian Packages:

Debian Repository:
First, set up and update the beta Debian Repository for your platform with the following commands:

sudo rm /etc/apt/sources.list.d/mina*.list
echo "deb [trusted=yes] http://packages.o1test.net $(lsb_release -cs) beta" | sudo tee /etc/apt/sources.list.d/mina-beta.list
sudo apt-get update

Then, install the package(s) that you need:
Mina Daemon: sudo apt-get install -y mina-mainnet=1.3.2beta1-985b1b2
Mina Archive: sudo apt-get install -y mina-archive=1.3.2beta1-985b1b2
New Mina Archive Schema: create_schema.sql

Docker Images:

Every docker image is built for each of the supported platforms, replace CODENAME in the images below with your choice of bionic, focal, stretch, buster, or bullseye to select the base docker image.

Mina Daemon: minaprotocol/mina-daemon:1.3.2beta1-985b1b2-CODENAME-mainnet
Mina Archive: minaprotocol/mina-archive:1.3.2beta1-985b1b2-CODENAME
New Mina Archive Schema: create_schema.sql
Mina Rosetta: minaprotocol/mina-rosetta:1.3.2beta1-985b1b2-CODENAME

Sandbox Node: For testing in an isolated, single-node network without snarks

As of 1.2.0, the demo functionality is built into the standard daemon container, via the environment variable RUN_DEMO=true.
Just docker run -it --name mina-demo -e RUN_DEMO=true minaprotocol/mina-daemon:1.3.2beta1-985b1b2-CODENAME-devnet and go!

Step by Step Guide:

Check out our documentation for complete instructions on using this version to connect to Mainnet.
Docker only Make sure to run with --peer-list-url https://storage.googleapis.com/mina-seed-lists/mainnet_seeds.txt or add PEER_LIST_URL=https://storage.googleapis.com/mina-seed-lists/mainnet_seeds.txt to your .mina-env.

If you are running the correct version on the correct network MAINNET, mina client status will show:

Chain id:     5f704cc0c82e0ed70e873f0893d7e06f148524e3f0bdae2afb02e7819a0c24d1
Git SHA-1:    985b1b2b0204d97eaffd093b0f55962ff576a5fb

---

This discussion was created from the release Mainnet Beta Release 1.3.2beta1.