Skip to content
This repository was archived by the owner on Sep 14, 2025. It is now read-only.

feat: Hello AI AVS with a minimal interface - #159

Open
sotoJ24 wants to merge 1 commit into
Layr-Labs:masterfrom
sotoJ24:eigen_bootcamp_2
Open

feat: Hello AI AVS with a minimal interface#159
sotoJ24 wants to merge 1 commit into
Layr-Labs:masterfrom
sotoJ24:eigen_bootcamp_2

Conversation

@sotoJ24

@sotoJ24 sotoJ24 commented Jul 6, 2025

Copy link
Copy Markdown

🧠 Add Inference Step Using LLM API in AVS Handler

✨ Summary

This PR enhances the AVS by including an inference step during the request validation process using a language model API (Groq/OpenAI-compatible).

🔍 What was done

  • Added environment variable support for GROQ_API_KEY
  • Integrated an LLM call inside the AVS handler (handler.ts)
  • The handler now performs a basic inference based on the user input
  • Fallback to a mock or placeholder if no key is provided

📚 Motivation

This aligns with the AVS requirement to:

"perform some inference: either locally via small local LLM like Gemma or remotely via calls to an LLM API"

Result

Screenshot from 2025-07-05 08-35-37
Screenshot from 2025-07-05 08-21-47
Screenshot from 2025-07-05 07-37-35
Screenshot from 2025-07-05 19-00-22

🧪 How to test

Run:

npx tsx scripts/avs/index.ts

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant