01
Relevance to the research question
Deep research
STEM Research QA
Research question-answer data across biology, earth sciences, mathematics and physics.
Benchmark / task domain
STEM Research QA
The work
Reason from research materials to a structured scientific answer.
Questions require literature analysis, experimental interpretation and scientific derivations. Each item connects a research question with supporting materials, a reference answer and assessment criteria.
Delivery can include
- 01
- JSON research questions with paper PDFs and numerical XLSX attachments
- 02
- Reference answers and explanations
- 03
- Itemized scoring criteria
How we evaluate the task
Define how to evaluate the result.
02
Scientific reasoning and calculations
03
Completeness of the answer
WORK WITH ASTRAFLUX
What should your
model be able to do?
Share the capability, task types and delivery requirements. We’ll discuss the right program and representative tasks.
Contact us norman383@astraflux.spaceBenchmark names indicate reference directions. Task scope and delivery specifications are agreed for each project.