Skip to content

junsier9/quant-alpha-research-skill

Repository files navigation

quant-alpha-research

skill-validate License: Apache-2.0

A fail-closed Codex / Claude Code skill for crypto quant alpha research. It turns "find me an alpha" into a falsifiable Stage 0 contract instead of an optimistic Sharpe story: repo-native, governance-aware, and unwilling to call a candidate promotable without falsification evidence.

This skill is for the moment when a strategy idea sounds exciting and you want the agent to slow down, read the evidence, and try to kill the idea before it starts decorating itself with backtest glow.

Who this is for: quant researchers using Codex or Claude Code on a repo with docs/quant_research/ or artifacts/quant_research/ style evidence.

Research Stance

$quant-alpha-research turns crypto quant ideas, roadmaps, provider-data questions, and market commentary into repo-native research work with a hard bias toward:

  • current artifacts over memory
  • Stage 0 evidence before optimization
  • provider concordance before alpha reruns
  • falsification before promotion language
  • explicit go, no-go, blocked, watch, or research-only decisions

It is not an alpha generator, a trading bot, or a promotion shortcut. The core promise is narrower and more useful: make the research assistant harder to fool.

What It Changes

Recorded evals compare fresh-agent baseline answers against the same prompts with $quant-alpha-research loaded.

Prompt Without the skill With the skill
Provider coverage passed. Can we rerun alpha now? "Coverage passed + quality/concordance passed = rerun alpha allowed. Coverage passed but quality/concordance not passed = do not rerun yet." "Decision: blocked. Provider coverage passing is not enough to rerun alpha. Coverage only says the provider surface is populated; it does not prove the data is trustworthy for research reruns."

The baseline is friendly and mostly sensible. The skill adds the release-grade shape: decision label, separate trust gates, Stage 0 state, falsification state, promotion state, and the next repo-native action.

What It Does

Use $quant-alpha-research when Codex needs to:

  • find or validate a crypto alpha candidate against the current parent
  • execute a quant research roadmap instead of summarizing it
  • convert market articles or threads into testable repo-native hypotheses
  • separate provider coverage from provider trust/concordance
  • design Stage 0 or Stage 0.5 falsification checks
  • audit whether a candidate is blocked, research-only, or promotable

The skill lives at:

skills/quant-alpha-research/

What It Refuses

The skill intentionally pushes back when the evidence is not there:

  • no "coverage passed, so rerun alpha"
  • no "Sharpe improved, so alpha exists"
  • no "Stage 0 passed, so it is promotable"
  • no hidden live-trading or manifest changes
  • no private project profiles bundled into the public package
  • no hand-authored evals presented as release evidence

If the repo lacks current artifacts, the correct answer is usually blocked until Codex reads the relevant roadmap, parent definition, candidate report, provider-trust status, and falsification output.

Package Contents

skills/quant-alpha-research/
  SKILL.md
  agents/openai.yaml
  references/
    output_templates.md
    patterns.md
    stage0_and_falsification.md
  scripts/
    score_eval_cases.py
    validate_skill_package.py

Repo-level files provide release hygiene:

  • recorded_eval_cases.json: recorded fresh-agent release gate
  • sample_eval_cases.json: illustrative smoke cases only
  • scripts/quick_validate.py: repo-local metadata validator
  • .github/workflows/skill-validate.yml: CI validation
  • dev_docs/eval_design.md: eval design notes outside the skill folder

Install

Copy the skill directory into a Codex-discoverable skills path:

Copy-Item -Recurse .\skills\quant-alpha-research "$env:CODEX_HOME\skills\quant-alpha-research"
cp -R ./skills/quant-alpha-research "$CODEX_HOME/skills/quant-alpha-research"

The bundled scripts require Python and use only the standard library.

Use It

Example prompts:

Use $quant-alpha-research to find a new alpha and validate it against the current canonical parent.
Use $quant-alpha-research to read this roadmap and execute the next Stage 0 slice.
Use $quant-alpha-research to decide whether provider coverage is enough to rerun alpha.

For a target quant repo, the validator can run a read-only evidence probe:

python .\skills\quant-alpha-research\scripts\validate_skill_package.py --evidence-root <path-to-quant-repo>
python ./skills/quant-alpha-research/scripts/validate_skill_package.py --evidence-root <path-to-quant-repo>

Project-specific required documents should live in local profile JSON outside the public repo, or in an ignored profile directory:

python .\skills\quant-alpha-research\scripts\validate_skill_package.py --evidence-root <path-to-quant-repo> --profile-dir <path-to-local-profiles> --evidence-profile <profile-name>
python ./skills/quant-alpha-research/scripts/validate_skill_package.py --evidence-root <path-to-quant-repo> --profile-dir <path-to-local-profiles> --evidence-profile <profile-name>

Validate

Windows:

python .\scripts\quick_validate.py .\skills\quant-alpha-research
python .\skills\quant-alpha-research\scripts\validate_skill_package.py
python .\skills\quant-alpha-research\scripts\score_eval_cases.py .\recorded_eval_cases.json
python .\skills\quant-alpha-research\scripts\score_eval_cases.py .\sample_eval_cases.json --allow-illustrative

Unix:

python ./scripts/quick_validate.py ./skills/quant-alpha-research
python ./skills/quant-alpha-research/scripts/validate_skill_package.py
python ./skills/quant-alpha-research/scripts/score_eval_cases.py ./recorded_eval_cases.json
python ./skills/quant-alpha-research/scripts/score_eval_cases.py ./sample_eval_cases.json --allow-illustrative

recorded_eval_cases.json is the release gate and must pass without --allow-illustrative. sample_eval_cases.json is smoke coverage and intentionally requires --allow-illustrative.

To scan the full package repo rather than only the installed skill directory:

python .\skills\quant-alpha-research\scripts\validate_skill_package.py --repo-root .
python ./skills/quant-alpha-research/scripts/validate_skill_package.py --repo-root .

For release-grade secret scanning, install gitleaks and run:

python .\skills\quant-alpha-research\scripts\validate_skill_package.py --require-external-secret-scan
python ./skills/quant-alpha-research/scripts/validate_skill_package.py --require-external-secret-scan

Release Bar

CI enforces:

  • skill metadata validation
  • Python syntax checks
  • package validation with external secret scanning
  • recorded transcript scoring without --allow-illustrative
  • illustrative smoke scoring with explicit warnings

The release gate is designed to make inflated eval scores harder to sneak in: hand-authored transcripts must be labeled hand_authored, and the scorer refuses them unless --allow-illustrative is passed.

Limits And Known Gaps

  • Recorded release coverage is currently 3 must-trigger prompts, not the full trigger matrix.
  • The public recorded evals are generic-repo tests; a second independent quant repo forward-test is still future work.
  • The scorer still supports illustrative fixtures, but only when they are explicitly marked hand_authored and run with --allow-illustrative.
  • The skill cannot enforce read-only behavior by itself; it gives Codex a contract and validators, but runtime discipline still matters.

Chinese search terms: 量化研究, 加密货币, alpha 研究, Codex skill, Claude Code skill.

Public Boundary

Before publishing, verify that no API keys, private artifact dumps, raw backtest outputs, machine-local paths, private project names, or personal identifiers are present outside ignored local state. This package is meant to ship reusable research discipline, not private research residue.

About

Fail-closed Codex/Claude Code skill for crypto quant alpha research - Stage 0, falsification, provider concordance, promotion gates

Topics

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

 
 
 

Contributors

Languages