feat(deployment): improve nginx config, update docker/k8s manifests, and enhance API serialization

[kikkomep]

This pull request introduces several improvements and updates across the application’s deployment, configuration, and codebase. The most significant changes include:

• Enhancements to the Nginx configuration for better proxying and timeout handling.
• Updates to Docker and Kubernetes deployment files for improved resource management and compatibility.
• Optimizations to the GitHub Workflows fetching/caching mechanism for better performance.
• Improvements to API controllers for more robust workflow serialization.

Nginx and Proxy Configuration Improvements

• Enhanced both docker/nginx.conf and docker/nginx.dev.conf with:
  • New /api/ proxy rules.
  • Increased timeout settings.
  • Dynamic port handling in redirects.
  • Improved header management for proxied requests and WebSocket connections. [1] [2]
• Updated proxy headers to use $host:$server_port instead of hardcoded values, ensuring compatibility in different environments. [1] [2]

Deployment and Resource Management Updates

• Upgraded Nginx and Redis images in Docker Compose files to newer versions for improved security and performance. [1] [2] [3]
• Improved Gunicorn worker configuration in docker/lm_entrypoint.sh by:
  • Dynamically calculating recommended worker count based on CPU cores.
  • Adjusting default thread and keepalive settings.
• Updated Kubernetes manifests to:
  • Support per-queue resource and replica configuration.
  • Improve autoscaling (HPA) compatibility with autoscaling/v2.
  • Include new job-related environment variables. [1] [2] [3] [4] [5] [6]
• Made minor Kubernetes secret and deployment manifest cleanups for TLS and worker pods. [1] [2] [3]

GitHub Workflow Fetching and Caching Improvements

• Revised the mechanism for fetching and caching GitHub Workflows to improve overall system performance.
• The update leverages the GitHub GraphQL API to:
  • Minimize the number of requests.
  • Reduce update times, ensuring faster and more efficient synchronization.

API and Serialization Improvements

• Improved workflow serialization in API controllers [1] [2]