Using lambda step functions for sub-minute triggering of the scaler

[pmenglund]

I'm running the buildkite-agent-scaler lambda on my own due to the way we run our infrastructure, and instead of letting the lambda run for 50 seconds, I'm going to implement sub-minute lambda triggering using a step function.

Is thing something you'd like me to create a PR for?

[pda]

I would love to see it, if you got around to it. If a PR is an easy way to show it, that'd be great. I'm not sure we'd merge it, but maybe! Lower latency does sound tempting.

[pmenglund]

I've got a generic implementation here:
https://github.com/rockset/high-frequency-lambda

You just give it the lambda you want to invoke. Let me know if you want a PR for the changes I made to the buildkite-agent-scaler so it runs just once.

[keithduncan]

You just give it the lambda you want to invoke. Let me know if you want a PR for the changes I made to the buildkite-agent-scaler so it runs just once.

I think a one-shot argument for the Lambda makes sense for this if someone wants to orchestrate a timer like this or use EventBridge to drive the Lambda.

If you get to this I’d be happy to merge it! 🙇