-
Notifications
You must be signed in to change notification settings - Fork 0
Add a generate feedback button to the Submission View #93
Description
Add the button at the top of the page on the aps_sis\views\aps_resource_submission_views.xml
The button will send the model_answer and the student answer to an AI agent with the following prompt (or one that you can improve).
"A question, out of marks and answer are supplied. Analyse the answer according to the question and generate a score and written feedback for the justifying the score. The feedback should be focused on providing students with guidance on how they can improve. Provide a summary at the top of the feedback and more detail below. Format the feedback nicely using headings, bullet points, bolding etc."
The feedback gets stored in the feedback field. Score written to the score field.
Please set this up initially with whatever free system we can easily access. We want to be able to use muliple providers so we can chose or switch between them. We want to track usage so we know when we are going to run out of credits and can switch to other LLMs automatically. Add a form and model to manage the LLMs, see how many requests have been made by them, show the remaining credits etc. It would be good to record an entry for every request made showing user, cost, and model it was made on and perhaps an identifying string provided when called. The LLM stuff should be addon agnostic - it imght be used by other addons.