Code

initial runner api#1732

Code

Merged

savingoyal merged 55 commits intoNetflix:masterNetflix/metaflow:masterfrom madhur-ob:runner-apimadhur-ob/metaflow:runner-apiCopy head branch name to clipboardMay 23, 2024

Commits

Commits on May 21, 2024

• initial runner map api

  madhur-ob

  committed
  90e1aea

  Copy full SHA for 90e1aea

• return Run objects

  madhur-ob

  committed
  a8cd6ab

  Copy full SHA for a8cd6ab

• WIP: click to method mapping

  madhur-ob

  committed
  89cb6eb

  Copy full SHA for 89cb6eb

• WIP: click to method, adding groups

  madhur-ob

  committed
  723e835

  Copy full SHA for 723e835

• remove comment

  madhur-ob

  committed
  1d429de

  Copy full SHA for 1d429de

• pass in args and opts correctly

  madhur-ob

  committed
  ef279d1

  Copy full SHA for ef279d1

• fix validation for top level params

  madhur-ob

  committed
  682f6a0

  Copy full SHA for 682f6a0

• restore metaflow_runner.py

  madhur-ob

  committed
  37ba90d

  Copy full SHA for 37ba90d

• handle list in options

  madhur-ob

  committed
  d6fe8ac

  Copy full SHA for d6fe8ac

• fix nargs

  madhur-ob

  committed
  37bb394

  Copy full SHA for 37bb394

• fix issue with validating missing args

  madhur-ob

  committed
  5c255ef

  Copy full SHA for 5c255ef

• inject flow parameters as well

  madhur-ob

  committed
  d47cd75

  Copy full SHA for d47cd75

• handle include file

  madhur-ob

  committed
  7812e58

  Copy full SHA for 7812e58

• internal click to chaining methods functionality

  madhur-ob

  committed
  f958c68

  Copy full SHA for f958c68

• subprocess manager

  madhur-ob

  committed
  86968e6

  Copy full SHA for 86968e6

• simpler subprocess manager

  madhur-ob

  committed
  1c3c5bd

  Copy full SHA for 1c3c5bd

• handle SIGINT

  madhur-ob

  committed
  61623cd

  Copy full SHA for 61623cd

• wait() handles timeout + logs both

  madhur-ob

  committed
  216c366

  Copy full SHA for 216c366

• improved log streaming with ability to resume + stream multiple times

  madhur-ob

  committed
  847822d

  Copy full SHA for 847822d

• cleanup in context manager, otherwise user is responsible

  madhur-ob

  committed
  be5512e

  Copy full SHA for be5512e

• remove aiofiles

  madhur-ob

  committed
  4158db0

  Copy full SHA for 4158db0

• split into CommandManager and SubprocessManager

  madhur-ob

  committed
  b7d1083

  Copy full SHA for b7d1083

• return components array instead

  madhur-ob

  committed
  bf04383

  Copy full SHA for bf04383

• remove assert

  madhur-ob

  committed
  efa8750

  Copy full SHA for efa8750

• add type hints

  madhur-ob

  committed
  cc6d602

  Copy full SHA for cc6d602

• return ExecutingRun encapsulating CommandManager and metaflow.Run

  madhur-ob

  committed
  9766d0f

  Copy full SHA for 9766d0f

• print as string

  madhur-ob

  committed
  080fbb2

  Copy full SHA for 080fbb2

• suggested improvements

  madhur-ob

  committed
  8a5a14f

  Copy full SHA for 8a5a14f

• use correct variable name

  madhur-ob

  committed
  04b8811

  Copy full SHA for 04b8811

• update usage of subprocess manager

  madhur-ob

  committed
  0cfc979

  Copy full SHA for 0cfc979

• fix flags such as --pylint/--no-pylint

  madhur-ob

  committed
  b8ed331

  Copy full SHA for b8ed331

• cache loaded modules

  madhur-ob

  committed
  73935b1

  Copy full SHA for 73935b1

• fix boolean flags

  madhur-ob

  committed
  d3f53aa

  Copy full SHA for d3f53aa

• remove aiofiles

  madhur-ob

  committed
  79aeb4e

  Copy full SHA for 79aeb4e

• no f-strings

  madhur-ob

  committed
  b8a47ac

  Copy full SHA for b8a47ac

• get run object explicitly

  madhur-ob

  committed
  25f8ace

  Copy full SHA for 25f8ace

• new higher level UX

  madhur-ob

  committed
  33c08c3

  Copy full SHA for 33c08c3

• typeguard warning for 3.5/3.6 + add profile argument

  madhur-ob

  committed
  bafd29b

  Copy full SHA for bafd29b

• default None for profile

  madhur-ob

  committed
  2128a22

  Copy full SHA for 2128a22

• detect early issues

  madhur-ob

  committed
  95e7076

  Copy full SHA for 95e7076

• fix user defined params not being recognised

  madhur-ob

  committed
  1f20019

  Copy full SHA for 1f20019

• kill all descendants

  madhur-ob

  committed
  6b67548

  Copy full SHA for 6b67548

• do not use f-strings

  madhur-ob

  committed
  a77ba01

  Copy full SHA for a77ba01

• suggested changes

  madhur-ob

  committed
  5c8a9aa

  Copy full SHA for 5c8a9aa

• use pkill instead of psutil

  madhur-ob

  committed
  9a43517

  Copy full SHA for 9a43517

• minor fix

  madhur-ob

  committed
  93dcd5c

  Copy full SHA for 93dcd5c

• vendor typeguard

  madhur-ob

  committed
  fc0ee63

  Copy full SHA for fc0ee63

• update error message

  madhur-ob

  committed
  471c335

  Copy full SHA for 471c335

• remove comma and check in init

  madhur-ob

  committed
  706c00c

  Copy full SHA for 706c00c

Commits on May 23, 2024

• Added docstrings; fixed stubs; moved stuff around

  romain-intel

  committed
  c387d84

  Copy full SHA for c387d84

• change dir name to runner

  madhur-ob

  committed
  737d2da

  Copy full SHA for 737d2da

• fix import in test

  madhur-ob

  committed
  4363d8f

  Copy full SHA for 4363d8f

• fix import

  madhur-ob

  committed
  fc1d92e

  Copy full SHA for fc1d92e

• add status property to ExecutingRun

  madhur-ob

  committed
  790e270

  Copy full SHA for 790e270

• add docstring for status property

  madhur-ob

  committed
  d661bbc

  Copy full SHA for d661bbc