01
Security task objectives
Cybersecurity
ExploitGym
CVE security tasks for vulnerability analysis and remediation assessment.
Benchmark / task domain
ExploitGym
The work
Evaluate agents on security analysis and remediation.
Agents investigate security issues, analyze their impact and assess remediation behavior in task environments. Task coverage and expected outcomes are defined for the selected evaluation goals.
Delivery can include
- 01
- Security task briefs and task metadata
- 02
- Dockerfile environment definitions and task binaries
- 03
- Task evaluation code
How we evaluate the task
Define how to evaluate the result.
02
Analysis quality and task outputs
03
Behavior within the evaluation scope
WORK WITH ASTRAFLUX
What should your
model be able to do?
Share the capability, task types and delivery requirements. We’ll discuss the right program and representative tasks.
Contact us norman383@astraflux.spaceBenchmark names indicate reference directions. Task scope and delivery specifications are agreed for each project.