Add prompt engineering tutorial blueprint with Ministral-8B on vLLM#242
Open
tugglep wants to merge 1 commit intoawslabs:mainfrom
Open
Add prompt engineering tutorial blueprint with Ministral-8B on vLLM#242tugglep wants to merge 1 commit intoawslabs:mainfrom
tugglep wants to merge 1 commit intoawslabs:mainfrom
Conversation
Contributor
|
Hi @tugglep, thank you for opening this PR, this looks very thorough! Rather than add another deployment for vLLM, can you take a look at awslabs/ai-on-eks-charts. We have a simple way to deploy many inference servers using this helm chart. Additionally, rather than a set of notebooks, does it make sense to convert this to |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Adds a new prompt engineering tutorial blueprint that deploys Ministral-8B on vLLM with an OpenAI-compatible API. Includes 10 Jupyter notebooks covering prompt engineering fundamentals from basic prompt structure to reducing hallucinations.
Motivation
Created for the EKS Startups Program to provide hands-on prompt engineering education using self-hosted LLMs on EKS. This enables developers to learn prompt engineering techniques using infrastructure they control, with no external API dependencies.
More
Additional Notes
Test Evidence:
Blueprint contents:
Note: Website docs update pending - happy to add if maintainers confirm desired location.