fzzhang/svd-code main
References an answer or ground-truth pathAverage identifier length >= 22 chars
SHA-2569687da6c5a8199edaf0e7a42abda2ed547b857c53eb26783e7fbd97240336b78
MaleculeO(As)H(Db)
Evidence
1"""
2Prompt templates for question generation from CHIMERA subjects/topics.
3
4Prompts are copied verbatim from the CHIMERA paper (subject expansion, problem
5generation, and problem validation).
6"""
7
8# =================================================================== …
13:72… "Physics").
14SUBJECT_EXPANSION_PROMPT = (
15 "I have a broad subject. Generate a list of more specific topics that fall under this "
16 "subject. Each topic should be unique and different from the other topics. The topics "
17 …
49:42… and unambiguous.
50- There is exactly one objectively verifiable answer.
51Your answer must strictly follow the format and criteria below, without any markdown formatting:
52Verdict: VALID or INVALID
53Reas …
1"""
2Prompt templates for question generation from CHIMERA subjects/topics.
3
4Prompts are copied verbatim from the CHIMERA paper (subject expansion, problem
5generation, and problem validation).
6"""
7
8# =================================================================== …
13:72… "Physics").
14SUBJECT_EXPANSION_PROMPT = (
15 "I have a broad subject. Generate a list of more specific topics that fall under this "
16 "subject. Each topic should be unique and different from the other topics. The topics "
17 …
49:42… and unambiguous.
50- There is exactly one objectively verifiable answer.
51Your answer must strictly follow the format and criteria below, without any markdown formatting:
52Verdict: VALID or INVALID
53Reas …