Skip to content

Task creation fails with coordinator on VPS, worker local, and RabbitMQ on separate server #579

@shitaanshus27

Description

@shitaanshus27

When running tork.run in a distributed setup with multiple components across different servers, task creation fails.

Setup:
Coordinator is deployed on a VPS cloud instance.
Worker is running on a local machine.
RabbitMQ is hosted on a separate server.
The coordinator is exposed via an endpoint, and tasks are triggered through a backend service.

Steps to reproduce:
Start RabbitMQ on a remote server.
Deploy the coordinator on a VPS cloud instance.
Run a worker on a local machine.
From the backend, push a job/task to the coordinator endpoint.
Observe that task creation fails.

Expected behavior:
The coordinator should accept the job, use RabbitMQ for message passing, and assign it to the available worker.

Actual behavior:
Task creation fails, and the worker does not receive the job.

Environment details:
tork.run version: 0.1.136 on coordinator and on worker 0.1.122
Coordinator environment: VPS (cloud)
Worker environment: Local machine
Message broker: RabbitMQ on a separate server
Communication: Backend service → exposed coordinator endpoint
Logs/Error messages:

2025-09-30 03:56:53 INF starting Coordinator
2025-09-30 03:56:54 INF Coordinator listening on http://localhost:8000
2025-09-30 03:56:54 ERR failed to deserialize message error="unknown message type: " body="Hi\r\n" queue=logs type=
2025-09-30 03:56:54 INF received first heartbeat hostname=srv1034414 node-id=34YWFcojL9pQHHeXum4UJw
2025-09-30 03:57:50 ERR Request error="code=404, message=Not Found" URI=/ method=GET remote-ip=180.151.90.24 status=404
2025-09-30 03:57:50 ERR Request error="code=404, message=Not Found" URI=/favicon.ico method=GET remote-ip=180.151.90.24 status=404
2025-09-30 04:01:28 ERR Request error="code=404, message=Not Found" URI=/robots.txt method=GET remote-ip=171.244.43.14 status=404
2025-09-30 04:01:28 ERR Request error="code=404, message=Not Found" URI=/ method=GET remote-ip=171.244.43.14 status=404
2025-09-30 04:16:39 ERR Request error="code=404, message=Not Found" URI=/ method=GET remote-ip=178.33.107.250 status=404
2025-09-30 04:21:11 INF received first heartbeat hostname=Sellcos-MacBook-Air.local node-id=KHKv9cvHiDk4o6Ht4z2vVp
2025-09-30 04:26:54 INF logs channel closed. reconnecting
2025-09-30 04:26:54 ERR failed to deserialize message error="unknown message type: " body="Hi\r\n" queue=logs type=
2025-09-30 04:29:26 ERR job b7a0eccbfde44adeba8d48391841e8f6 failed:
2025-09-30 04:29:26 ERR job 8f1b920c2bef44beaf45377adb56ba3f failed:
2025-09-30 04:29:26 ERR job 681f02c00d6d498487b56f4d3080dda7 failed:
2025-09-30 04:29:26 ERR job 76d95549eeba4bf6a76f46029174bafd failed:
2025-09-30 04:29:26 ERR job 28754da384a5418296737df160a2e7a4 failed:

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions