Skip to content

feat: setup script, evaluation walkthrough, portals, and batch retry#33

Merged
RajjjAryan merged 1 commit into
mainfrom
feat/improvements-batch
Apr 10, 2026
Merged

feat: setup script, evaluation walkthrough, portals, and batch retry#33
RajjjAryan merged 1 commit into
mainfrom
feat/improvements-batch

Conversation

@RajjjAryan

Copy link
Copy Markdown
Owner

Summary

Addresses 4 open issues in one PR:

1. Setup script — replaces #25 (Docker)

  • setup.sh — one command installs Node deps, Playwright Chromium, copies config templates, runs doctor
  • Docker was overkill; a bash script is simpler and more appropriate for a CLI tool
  • README updated with bash setup.sh option

2. Evaluation walkthrough — closes #7

  • docs/evaluation-walkthrough.md — full A-F scoring example with realistic data
  • Shows each block's output, scoring logic, and final verdict
  • Helps new users understand what career-copilot produces

3. 10 more company portals — closes #2

Added to templates/portals.example.yml:
Stripe, Datadog, Cloudflare, Figma, Notion, Databricks, Scale AI, Supabase, Dagger, Modal

4. Rate limiting & retry logic — closes #26

Updated modes/batch.md with:

  • 2s delay between worker batches
  • 10s backoff on 429 (rate limit) responses
  • 3s spacing for same-domain requests
  • Max 3 attempts per URL (1 initial + 2 retries)
  • Non-retryable errors: login walls, 404s, removed listings

Testing

All 58 tests pass, 0 failures.

… logic

- Add setup.sh one-liner that installs all dependencies (#25 replacement)
- Add docs/evaluation-walkthrough.md with full A-F scoring example (#7)
- Add 10 company portals: Stripe, Datadog, Cloudflare, Figma, Notion,
  Databricks, Scale AI, Supabase, Dagger, Modal (#2)
- Add rate limiting and retry logic to batch mode: 2s between batches,
  10s backoff on 429, max 3 attempts per URL, non-retryable errors (#26)
- Update README with setup.sh option

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@RajjjAryan RajjjAryan added the feature New feature or request label Apr 10, 2026
@RajjjAryan RajjjAryan merged commit c006389 into main Apr 10, 2026
8 checks passed
@RajjjAryan RajjjAryan deleted the feat/improvements-batch branch April 10, 2026 09:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

feature New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add rate limiting and retry logic to batch processing Add sample evaluation walkthrough to docs/ Add 10 more company portals to portals.example.yml

1 participant