gemini-3h-2024-jun-18

Main change

This is a bug fix release of Gemini 3h.

A few notable improvements:

• workaround for farming stopping on some farms in large setups when replotting starts
• fix for some RPC timeout reasons
• auditing and proving benchmarks are now more accurate and use the same number of threads as normal farmer operation
• scrubbing command now supports more targeted and faster scrubbing (metadata-only, metadata+plot, cache-only)
• better farming cluster performance when handling incoming requests

The rest of the changes are internal.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-jun-11

Main change

This is a relatively large release of Gemini 3h.

Node improvements:

• New experimental very fast sync mode "Snap sync" that you can opt-in with --sync snap (will become the default after more testing and some remaining work around domains, only works for the initial sync)
• Fixes and workarounds to prevent node from getting stuck in DSN sync state (please share feedback whether it helps)
• --state-pruning archive-canonical default changed to --state-pruning 140000 to decrease node disk usage (only affects new databases, works great in combination with Snap sync)
• Fix node getting stuck and unable to make progress if farmer did not acknowledge newly created segment header (timeout is applied)

Farmer improvements:

• Improved farming cluster and plotting logging
• Default sector encoding concurrency for farming cluster increased from 8 to 50
• Workaround for high memory usage on Windows
• Reduced bandwidth usage by farming cluster through more direct communication between plotters and cache instances
• Make more farmer errors non-fatal

Shared improvements:

• Fix for yamux errors
• Farster network initialization on restart for both node and farmr using knowledge of previously connected peers
• Reduce peak memory usage for node and farmer on all platforms by optimizing piece data structure internals

The rest of the changes are internal.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-may-24

Main change

This is a bug fix release of Gemini 3h.

A few notable improvements:

• Same as gemini-3h-2024-may-23, but with farming fixed
• Initial farming cluster support (MVP, expect more things around metrics and performance improvements in the future)
• Improved plotting performance (and better CPU utilization)

The rest of the changes are internal.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-may-23

⚠️ This release is problematic, please downgrade to gemini-3h-2024-may-15 or upgrade to the next release once it is out ⚠️

Main change

This is a bug fix release of Gemini 3h.

A few notable improvements:

• Initial farming cluster support (MVP, expect more things around metrics and performance improvements in the future)
• Improved plotting performance (and better CPU utilization)

The rest of the changes are internal.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-may-15

Main change

This is a bug fix release of Gemini 3h.

A few notable improvements:

• Improved piece cache performance
• Plotting errors are now retried instead of erroring the whole farm

The rest of the changes are internal.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-may-06

Main change

This is a bug fix release of Gemini 3h.

A few notable improvements:

• Reduced idle farmer memory usage
• Increased RPC timeout that should help a bit with pathological cases (though it doesn't really fix the root of the issue)
• Ability to specify sector record chunks reading mode, for example path=/path/to/farm,size=100G,record-chunks-mode=ConcurrentChunks
• Ability to prevent farmer from creating new farms with --create false, helpful in case disk failed to mount properly

The rest of the changes are internal.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-may-01

Main change

This is a bug fix release of Gemini 3h.

This release fixes a security vulnerability from CVE-2024-32984 and update should be done ASAP.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-apr-26-2

Main change

This is a bug fix release of Gemini 3h.

Hotfix for gemini-3h-2024-apr-26 release that couldn't create new farms.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-apr-26

Main change

This is a bug fix release of Gemini 3h.

A few notable improvements:

• --farm-during-initial-plotting removed from farmer as unnecessary (always enabled now)
• Faster node startup
• Fix farmer errors after resizing

The rest of the changes are internal.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only

gemini-3h-2024-apr-24

Main change

This is a bug fix release of Gemini 3h.

A few notable improvements:

• Higher peak DSN download speed with libp2p upgrade
• Exact CPU cores used for plotting/replotting are not printed in logs on farmer startup (helpful as a baseline for customization)
• L3 cache groups now properly respected when --sector-encoding-concurrency is used without --[re|]plotting-thread-pool-size, improving performance for those using it
• Single farm can now encode any number of sectors concurrently (regrouping of CPU cores no longer happens)

The rest of the changes are internal.

Ubuntu and Windows x86-64 builds

There are two versions:

• skylake: for Intel Skylake/AMD Ryzen processors and newer
• x86-64-v2: for older processors since ~2009 and some old VMs
• older processors/VMs are no longer supported by official releases, but can still be compiled manually if desired
• x86-64 container images are built for Skylake/AMD Ryzen processors and newer only