Code

async release channel#1512

Code

Draft

technillogue wants to merge 55 commits intomainreplicate/cog:mainfrom

asyncreplicate/cog:asyncCopy head branch name to clipboard

Commits

Commits on Jan 22, 2024

• run CI for this branch the same way as for main

  Show description for 0df9b82
  technillogue

  committed
  0df9b82

  Copy full SHA for 0df9b82

Commits on Feb 21, 2024

• async runner (#1352)

  Show description for 2eb3b48
  technillogue

  committed
  2eb3b48

  Copy full SHA for 2eb3b48

• support async predict functions (#1350)

  Show description for d5e6f73
  technillogue

  committed
  d5e6f73

  Copy full SHA for d5e6f73

• create event loop before predictor setup (#1366)

  Show description for 8f3fe08
  technillogue

  committed
  8f3fe08

  Copy full SHA for 8f3fe08

• lints

  Show description for ff754f3
  technillogue

  committed
  ff754f3

  Copy full SHA for ff754f3

• minimal async worker (#1410)

  Show description for 3112380
  

  technillogue

  and

  nickstenning

  committed
  3112380

  Copy full SHA for 3112380

• format

  Show description for 3792202
  technillogue

  committed
  3792202

  Copy full SHA for 3792202

• Mux prediction events (#1405)

  Show description for ce18964
  technillogue

  committed
  ce18964

  Copy full SHA for ce18964

• Scary temporary commit for a hemorrhaging-edge release

  Show description for 335f67b
  technillogue

  committed
  335f67b

  Copy full SHA for 335f67b

• Revert "Scary temporary commit for a hemorrhaging-edge release"

  Show description for 1af5eda
  technillogue

  committed
  1af5eda

  Copy full SHA for 1af5eda

Commits on Mar 29, 2024

• replace requests with httpx and factor out clients (#1574)

  Show description for 7ee96ba
  

  technillogue

  and

  mattt

  authored
  7ee96ba

  Copy full SHA for 7ee96ba

Commits on Mar 30, 2024

• format

  Show description for 9538673
  technillogue

  committed
  9538673

  Copy full SHA for 9538673

Commits on May 7, 2024

• implement mp.Connection with async streams (#1640)

  Show description for bb01c85
  technillogue

  authored
  bb01c85

  Copy full SHA for bb01c85

Commits on May 8, 2024

• AsyncConcatenateIterator

  Show description for 12b0abe
  technillogue

  committed
  12b0abe

  Copy full SHA for 12b0abe

• optimize webhook serialization and logging (#1651)

  Show description for 08f3780
  technillogue

  committed
  08f3780

  Copy full SHA for 08f3780

• tweak names and style

  Show description for c62cf67
  technillogue

  committed
  c62cf67

  Copy full SHA for c62cf67

Commits on May 16, 2024

• omnibus actual concurrency and major refactor (#1530)

  Show description for 0ebfc54
  technillogue

  authored
  0ebfc54

  Copy full SHA for 0ebfc54

Commits on May 17, 2024

• fix test (#1669)

  Show description for fb498be
  technillogue

  authored
  fb498be

  Copy full SHA for fb498be

• predict_time_share metric (#1643)

  Show description for f44b67f
  

  technillogue

  and

  zeke

  authored
  f44b67f

  Copy full SHA for f44b67f

• function to emit metrics (#1649)

  Show description for b35d1f7
  technillogue

  authored
  b35d1f7

  Copy full SHA for b35d1f7

• allow setting both max and target concurrency in cog.yaml (#1672)

  Show description for e32f5cc
  technillogue

  authored
  e32f5cc

  Copy full SHA for e32f5cc

Commits on May 22, 2024

• predict_time_share needs to be set before sending the completed webhook (#1683)

  Show description for 1728da7
  technillogue

  authored
  1728da7

  Copy full SHA for 1728da7

• allow disabling time share metric with COG_DISABLE_TIME_SHARE_METRIC

  Show description for 07eabfd
  technillogue

  committed
  07eabfd

  Copy full SHA for 07eabfd

• drop default_target (#1685)

  Show description for 0731446
  technillogue

  authored
  0731446

  Copy full SHA for 0731446

Commits on May 23, 2024

• Set VSCode default formatter to charliermarsh.ruff (#1547)

  Show description for 4e48c28
  mattt

  committed
  4e48c28

  Copy full SHA for 4e48c28

• Update VSCode workspace settings (#1545)

  Show description for fe0d2db
  mattt

  committed
  fe0d2db

  Copy full SHA for fe0d2db

Commits on May 25, 2024

• fix config schema

  technillogue

  committed
  e07dc07

  Copy full SHA for e07dc07

Commits on May 31, 2024

• Backport `Secret` type to async branch (#1706)

  Show description for 8dc4890
  mattt

  authored
  8dc4890

  Copy full SHA for 8dc4890

• stick a %s on line 190 clients.py (#1707)

  Show description for c5ad13b
  mattt

  authored
  c5ad13b

  Copy full SHA for c5ad13b

Commits on Jun 4, 2024

• local upload server can be called cluster.local in addition to .internal (#1714)

  Show description for 6b6ac5f
  technillogue

  authored
  6b6ac5f

  Copy full SHA for 6b6ac5f

Commits on Jun 12, 2024

• log traceback properly (#1734)

  Show description for 42c6617
  technillogue

  authored
  42c6617

  Copy full SHA for 42c6617

Commits on Jun 18, 2024

• add batch size metric (#1750)

  Show description for adf8894
  technillogue

  authored
  adf8894

  Copy full SHA for adf8894

Commits on Jul 2, 2024

• Revert "should_exit is not actually used by http". It was being used by uvicorn and I hadn't noticed

  Show description for b93f233
  technillogue

  committed
  b93f233

  Copy full SHA for b93f233

• fix ruff check

  technillogue

  committed
  81187f4

  Copy full SHA for 81187f4

Commits on Jul 3, 2024

• Poison model healthcheck on shutdown

  Show description for a4b86cd
  nickstenning

  committed
  a4b86cd

  Copy full SHA for a4b86cd

Commits on Jul 11, 2024

• Fix broken `make go-test` command

  Show description for 99a26d4
  aron

  committed
  99a26d4

  Copy full SHA for 99a26d4

Commits on Jul 12, 2024

• Add fixes for ruff issues (#1799)

  aron

  authored
  8d834f0

  Copy full SHA for 8d834f0

• Propagate trace context to webhook and upload requests

  Show description for 5d38ae7
  

  aron

  authored and

  technillogue

  committed
  5d38ae7

  Copy full SHA for 5d38ae7

Commits on Jul 17, 2024

• [async] Include prediction id upload request (#1788)

  Show description for b9df82a
  

  aron

  and

  mattt

  authored
  b9df82a

  Copy full SHA for b9df82a

Commits on Jul 22, 2024

• patch cancel bug: immediately mark predictions as cancelled (#1798)

  Show description for 5464c43
  technillogue

  authored
  5464c43

  Copy full SHA for 5464c43

Commits on Jul 23, 2024

• syl/fix setup shutdown bug (#1819)

  Show description for 9f49b29
  technillogue

  authored
  9f49b29

  Copy full SHA for 9f49b29

Commits on Jul 26, 2024

• fix incorrect strutlog usage throwing an error when setup fails

  technillogue

  committed
  acbb283

  Copy full SHA for acbb283

Commits on Aug 2, 2024

• move runner.terminate into runner.shutdown after waiting for predictions to complete (#1843)

  Show description for 0976a05
  technillogue

  authored
  0976a05

  Copy full SHA for 0976a05

Commits on Oct 16, 2024

• [async] Support URLFile in the upload_file function (#1987)

  Show description for b29c93c
  aron

  authored
  b29c93c

  Copy full SHA for b29c93c

• Fix type annotations in Input

  aron

  committed
  3edefe4

  Copy full SHA for 3edefe4

• Validate url passed to URLFile conforms to HTTP protocol

  aron

  committed
  05a13bf

  Copy full SHA for 05a13bf

Commits on Oct 17, 2024

• Support custom filename to be provided to URLFile (#1997)

  Show description for 3805e2e
  aron

  authored
  3805e2e

  Copy full SHA for 3805e2e

Commits on Oct 18, 2024

• Add support for image/webp to mimetypes package (#2002)

  Show description for 12d5a4c
  aron

  authored
  12d5a4c

  Copy full SHA for 12d5a4c

• Add .envrc for asdf

  Show description for a60d151
  nickstenning

  committed
  a60d151

  Copy full SHA for a60d151

• direnv: use `layout python` to automatically use venv (#1970)

  

  philandstuff

  authored and

  nickstenning

  committed
  b710b33

  Copy full SHA for b710b33

• Add dotenv_if_exists to .envrc

  Show description for 2dcdf64
  nickstenning

  committed
  2dcdf64

  Copy full SHA for 2dcdf64

• Propagate the `name` attribute of URLFile across serializers (#2000)

  Show description for 9cb5f35
  aron

  authored
  9cb5f35

  Copy full SHA for 9cb5f35

Commits on Oct 21, 2024

• Provide User-Agent and Accept headers in URLFile requests (#2011)

  Show description for 426b112
  aron

  authored
  426b112

  Copy full SHA for 426b112

Commits on Dec 3, 2024

• pin httpx to <0.28.0 (#2075)

  Show description for 9b75c82
  philandstuff

  authored
  9b75c82

  Copy full SHA for 9b75c82

Commits on Dec 4, 2024

• fix GHA

  philandstuff

  committed
  32c7408

  Copy full SHA for 32c7408