Skip to content
This repository was archived by the owner on Apr 18, 2024. It is now read-only.

Adaptive Pool - #116

Open
willscott wants to merge 7 commits into
mainfrom
feat/adaptive
Open

Adaptive Pool#116
willscott wants to merge 7 commits into
mainfrom
feat/adaptive

Conversation

@willscott

@willscott willscott commented Jul 8, 2023

Copy link
Copy Markdown
Contributor

Working on reflecting the design described in "Caboose Adaptive Pool"

  • This moves tracking / statistics updates within a Node object, rather than spread across the code as it exists now.
  • Refactors code for some clearer division of responsibilities
  • Uses the FetchResourceWith code path for all requests - blocks are redirected to a standard car request, which the block is then read out of.

willscott and others added 7 commits July 8, 2023 13:59
* feat: modify pool tests

* fix: top n node selection from heap

* feat: add more comprehensive tests

* enhancement: add refresh no to tests

* go fmt

* remove unused metrics

* put back trace

* response size does not include header

* reset retry counter only if progress is made

* update go-car

* dont drain response body

* send verification errors to Saturn

* pool tier promotion

* otel and send trace id to Saturn

* stabilize dynamics tests

* mirroring parallel

* pool-target-size through config to better test dynamics

* down to flakiness

* add substitution (rough)

* use new orchestrator API

* fix: top N selection

* enhancement: increase test size

* feat: Add tests for affinity

* test cache affinity

* test cache affinity

* remove assert

* fix test

* address review

* feat: port compliance cids

* fix: remove unused code

* modify harness

* feat: add core attr to trace span

* fix CI

* improve error classification (#165)

---------

Co-authored-by: Aarsh Shah <aarshkshah1992@gmail.com>
Co-authored-by: Will Scott <will.scott@protocol.ai>
@willscott
willscott marked this pull request as ready for review October 10, 2023 09:18
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants