-
Notifications
You must be signed in to change notification settings - Fork 941
Port PXI documentation eval to Python #12969
Copy link
Copy link
Open
Labels
c/agentsrelated to the in-browser or terminal agent for phoenix datarelated to the in-browser or terminal agent for phoenix datac/evalsc/serverServer implementationServer implementationenhancementNew feature or requestNew feature or requestpythonPull requests that update Python codePull requests that update Python code
Description
Metadata
Metadata
Assignees
Labels
c/agentsrelated to the in-browser or terminal agent for phoenix datarelated to the in-browser or terminal agent for phoenix datac/evalsc/serverServer implementationServer implementationenhancementNew feature or requestNew feature or requestpythonPull requests that update Python codePull requests that update Python code
Type
Fields
Give feedbackNo fields configured for issues without a type.
Projects
StatusShow more project fields
📘 Todo
Parent: #11598
Background
PXI's model-facing system prompt is now owned by the Phoenix server. The existing TypeScript documentation eval still lives in the frontend app evals and imports the frontend prompt artifact, which is being removed as part of the server-authoritative prompt work.
Current eval on
origin/main, before removal: app/evals/documentation.eval.tsWork
Port the documentation-link eval from TypeScript to Python so it evaluates the server-owned PXI prompt path instead of depending on frontend prompt state.
Acceptance Criteria
app/evals/documentation.eval.tsbehavior.