Provide an API to register a webhook which will be called when something is pushed into a list and indicates the potential consumers that there are things to pop in the list.
I wouldn't implement a pub-sub system, as I wouldn't want to get my webhook called ~500 times a second, but something which notifies that "hey the list is not empty" from time to time if the list is not empty.
Maybe send the webhook immediately when something is pushed to the list, and then continue sending to the webhook some delay until the queue is empty.
This would allow you to deploy a lambda or a web server http endpoint to create consumers for your service, which could run for N seconds processing list entries and then die, expecting the webhook to spin an another consumer.
Provide an API to register a webhook which will be called when something is pushed into a list and indicates the potential consumers that there are things to pop in the list.
I wouldn't implement a pub-sub system, as I wouldn't want to get my webhook called ~500 times a second, but something which notifies that "hey the list is not empty" from time to time if the list is not empty.
Maybe send the webhook immediately when something is pushed to the list, and then continue sending to the webhook some delay until the queue is empty.
This would allow you to deploy a lambda or a web server http endpoint to create consumers for your service, which could run for N seconds processing list entries and then die, expecting the webhook to spin an another consumer.