The authors report a more autonomous research agent and say one of three fully AI-generated workshop submissions was accepted after peer review.
Discovery systemAutomated machine-learning researchreviewed 2026-07-16
The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search
Certiv evidence level
Artifact inventoriedcentral claim independently reproduced?
No.
That answer stays “no” even when a selected check passed.
claim boundary
Three statements that must not be collapsed.
The exact v1 PDF and official repository revision were pinned. The paper documents a workshop acceptance event, which is a process outcome rather than a reproduction of the paper's scientific conclusions.
Acceptance does not establish that the generated research is true, novel, reproducible, or representative of general automated-science performance. The system was not replayed here.
source identity
The paper is versioned bytes.
A mutable title or unversioned link is not enough to reproduce what was reviewed.
- arXiv version
- 2504.08066v1
- Submitted
- 2025-04-10
- Version date
- 2025-04-10
- Size
- 8,923,691 bytes · 69 pages
- PDF SHA-256
- 53bafd3028e3f8829a3d85220e84dcf0d18934f9b75c092a60de303ff3644bd2
Observed parser properties
- Recognized as a PDF and not encrypted.
- pdfinfo reported JavaScript: no.
- pdfdetach reported no embedded files.
- pdftotext completed successfully.
These probes reduce ambiguity and obvious PDF attack surface. They are not a comprehensive malware analysis.
Certiv T0 exercise: this exact PDF was hash-pinned without executing its declared command. The unchanged input remained explicitly unverifiable; a one-byte tamper produced a failed input_hash_drift finding.
test record
Checks, failures, and blockers.
Status is always paired with text. A pass applies only to the check and boundary shown in the same row.
Observed
Exact PDF identity
Observed
The downloaded v1 PDF matched the recorded SHA-256, byte count, and page count.
Boundary
This establishes file identity only.
Observed
Public code inventory
Observed
The official v2 repository was pinned at commit 96bd51617cfdbb494a9fc283af00fe090edfae48.
Boundary
Open code is not a completed run and still relies on mutable models and services.
Not run
End-to-end tree-search run
Observed
No GPU- and API-backed autonomous research campaign was executed.
Boundary
Autonomy, cost, output quality, and acceptance rate were not reproduced.
external artifacts
Pinned, not trusted by default.
Official AI Scientist-v2 repository
Observed revision96bd51617cfdbb494a9fc283af00fe090edfae48
The workflow depends on external model APIs, GPU workloads, and changing service behavior.
red-team findings
Where a confident summary can outrun the evidence.
- One workshop acceptance cannot establish a general success rate for autonomous scientific discovery.
- Peer-review acceptance is meaningful process evidence but is not itself a truth or reproducibility certificate.
- Externally hosted models and services weaken long-term replay unless their behavior and outputs are separately captured.
primary sources
Follow the evidence outward.
Dossier certiv-ai-discovery-2026-07-16/ai-scientist-v2. Certiv produced this test record; the paper authors did not issue or endorse it.