forked from pesc101/exp-template
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathtest.txt
More file actions
2 lines (2 loc) · 2.84 KB
/
test.txt
File metadata and controls
2 lines (2 loc) · 2.84 KB
1
2
['<|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\n## Instruction\nClassify the given response as either an answer or a non-answer.\n\nNon-answers are responses that indicate a lack of information or inability to provide an answer. They typically include phrases such as:\n- "I don\'t know..."\n- "I can\'t provide information about..."\n- "It is not stated..."\n- "There is no answer"\n- "There is no information..."\n- Or other synonymous expressions indicating uncertainty or lack of information\n\nAny response that provides concrete information or a direct answer, even if brief, should be classified as an answer.\nUse 0 for answers and 1 for non-answers in the \'non_answer\' field.\n\nFor each response, provide a classification in the following JSON format:\n\n{\'description\': \'Classify if the answer is a non-answer.\', \'properties\': {\'rationale\': {\'title\': \'Rationale\', \'type\': \'string\'}, \'non_answer\': {\'enum\': [0, 1], \'title\': \'Non Answer\', \'type\': \'integer\'}}, \'required\': [\'rationale\', \'non_answer\'], \'title\': \'ClassifiedAnswer\', \'type\': \'object\'}\n\n## Examples\n\nResponse: The information provided does not mention anything about compulsory elective modules or the number of free modules a student can choose from in the M.Sc. Data Science program at Marburg University.\nClassification: {\'rationale\': \'The response indicates a lack of information, which is characteristic of a non-answer.\', \'non_answer\': 1}\n\n\nResponse: The question is not clear because there is no specific module mentioned. The text only talks about enrollment as a doctoral student and provides information about the required documents and the enrollment process. It does not mention a specific module.\nClassification: {\'rationale\': \'The response states that specific information is not provided, making it a non-answer.\', \'non_answer\': 1}\n\n\nResponse: Master of Science (M.Sc.)\nClassification: {\'rationale\': \'The response provides a specific piece of information, making it a valid answer.\', \'non_answer\': 0}\n\n\n\n<|start_header_id|>user<|end_header_id|>\n\n## Task\nNow, classify the following response:\nResponse: \n\nBased on the story, Cotton was white.\nClassification:\n\n<|eot_id|>\n<|start_header_id|>assistant<|end_header_id|>']
SamplingParams(n=1, presence_penalty=0.0, frequency_penalty=0.0, repetition_penalty=1.0, temperature=0, top_p=1.0, top_k=-1, min_p=0.0, seed=None, stop=[], stop_token_ids=[], bad_words=[], include_stop_str_in_output=False, ignore_eos=False, max_tokens=1000, min_tokens=0, logprobs=None, prompt_logprobs=None, skip_special_tokens=True, spaces_between_special_tokens=True, truncate_prompt_tokens=None, guided_decoding=GuidedDecodingParams(json=<class 'encourage.metrics.non_answer_critic.ClassifiedAnswer'>, regex=None, choice=None, grammar=None, json_object=None, backend=None, whitespace_pattern=None))