Package-local evidence
Discover the relevant files inside an isolated event package and retain package-relative evidence references.
Scientific agents for a dynamic Earth
EarthVerse
EarthVerse puts research agents to work on real geoscience and natural-hazard investigations.
Each of its 405 expert tasks starts with one of 199 event packages. The model has to find the right local files, do the required calculations, reconstruct the physical process, and give an answer that can be checked.
405Expert tasks
199Event packages
19Hazard families
6,709Evidence files
19 hazard families / official observations
Earth systems in motion
Select a scene to inspect the corresponding EarthVerse tasks.
Why EarthVerse
From files to defensible earth-system reasoning
Multi-step computation
Run transparent calculations, retain units and intermediate values, and test sensitivity across sources.
Physical process reasoning
Reconstruct timing and mechanism, compare competing explanations, and connect observed responses causally.
Verifiable outcomes
Return a structured conclusion whose fields, values, evidence, and reasoning can be independently scored.
405Expert tasks
199Event packages
10,879Atomic answer units
19Hazard families
Inside the dataset / CSX-055
One event, many evidence streams
Every task begins inside an isolated event package. The agent must find the useful sources, connect measurements across formats, and leave a trace from evidence to conclusion.
Seven capability lenses
What the questions demand
Physical mechanism 340
Quantitative calculation 286
Causal chain 214
Spatiotemporal process 158
Multi-source evidence 101
Ranking & decision 67
Remote sensing & geospatial 44
Across the release6,709
deduplicated package-local evidence files spanning reports, tables, archives, rasters, imagery, and catalogs.
EarthVerse, end to end
Built to test investigation, not recall
EarthVerse evaluates the complete path from an unfamiliar event package to a defensible scientific conclusion. Evidence choice, calculations, mechanism reasoning, and the final answer remain inspectable.
Isolated context
Package-scoped investigation
Each task starts from a bounded local event package rather than an answer-bearing prompt.
Prevents web recall and hidden cross-task leakageEvidence selection
Autonomous evidence discovery
The model lists, searches, reads, and prioritizes files before it can form a conclusion.
Measures retrieval quality and exploration disciplineScientific work
Transparent computation
Formulas, units, windows, intermediate values, and source differences remain in the trace.
Separates numerical reasoning from plausible proseEarth-system inference
Competing mechanism analysis
Tasks require temporal reconstruction, causal links, and rejection of weaker explanations.
Tests whether evidence supports the claimed processScoring contract
Traceable answer units
Structured fields and task-specific rubrics score both conclusions and their reasoning paths.
Supports reproducible task-level error analysisScientific breadth
EarthVerse across a changing Earth
The release connects 19 hazard families with 7 capability lenses across 6,709 evidence files and 10,879 answer units, grounded in documented events rather than synthetic scenarios.
Water cycleExtreme rainfall · river and coastal flood · tropical cyclone · atmospheric river
AtmosphereSevere storm · heat · cold · drought · dust · air quality · climate modes
Solid EarthEarthquake and tsunami · volcano · landslide · cascading hazards
Land, ice & oceanWildfire · cryosphere · marine heatwave · agricultural stress
Why the tasks are difficult
Research questions with inspectable paths
Representative tasks require more than extracting a reported number. The model must decide what to inspect, construct intermediate quantities, and defend a process-level interpretation.
Observe / measure / explain
Observing a dynamic Earth
EarthVerse connects orbital measurements, rapid-response imagery, and instrumented field observations into one traceable reasoning process.
Published results
Leading systems
Strict score is the percentage of tasks where at least 95% of required answer units are correct.
Published EarthVerse results
Leaderboard
Compare answer accuracy, rubric quality, capability dimensions, and research-process costs.
Exacting task success
Strict@95 ranking
All published systems, ordered by tasks where at least 95% of required answer units are correct.
Published evaluation
Model performance
Comparable scoreMean core by model
0-100
Ranked by published EarthVerse resultsSelect any system to inspect its task-level outputs.
| Rank | Model | Answer | Rubric | Mean core | Strict@95 | Rounds | Files | Latency | Tokens | Results |
|---|
System result archive
Model results
Inspect EarthVerse scores, research-process diagnostics, and task-level outputs.
Highest-scoring investigations
Featured task results
Task record sample
10 task outputs
Research process archive
Exploration
Inspect how selected systems discovered files, calculated intermediate values, fused evidence, and reached a final answer for the same task.
5Select a task
Inspect five preserved exploration trajectories.
405 expert investigations
Task Gallery
Explore each question together with its complete event package, hidden solution, computed ground truth, review, and source-level evidence.
Task
405Select an EarthVerse task
Inspect the question, answer materials, and every file inside its event package.