2026-10-13T06:56:22Z https://api.figshare.com/v2/oai

oai:figshare.com:article/34002279 2026-09-26T05:38:37Z category_29194 item_type_3 month_year_09_2026

ADAPT-SELECT: Historical Correction for Multi-Evidence Regression Test Selection Anonymous Author (24311699) Software architecture Test selection ADAPT-SELECT reproducibility packageThis package accompanies ADAPT-SELECT: Historical Correction for Multi-Evidence Regression Test Selection. It includes the complete application and selector source code, experiment drivers, frozen inputs, archived expected outputs, individual oracle/output records where available, validators, paper source/PDF, and instructions for all three studies. No parent repository, API key, external model, or running service is needed. Internet access is needed only to install Python dependencies.<h2 dir="ltr">Reproduce every primary result</h2>Extract the ZIP to a short local path and open a terminal in the extracted <code>ADAPT_SELECT</code> directory. Python 3.13.13 with the supplied pinned dependencies on Windows is the verified reference environment. Other Python/platform combinations are not claimed to yield identical scientific records.Windows PowerShell:<pre>python -m venv .venv .\.venv\Scripts\python.exe -m pip install -r requirements.txt .\.venv\Scripts\python.exe -I -B reproduce.py --output-dir results/full </pre>Linux/macOS equivalent commands (not independently validated on those platforms):<pre>python3 -m venv .venv .venv/bin/python -m pip install -r requirements.txt .venv/bin/python -I -B reproduce.py --output-dir results/full </pre>The full run verifies all packaged file hashes; independently regenerates Study A at K=15/30/45; reruns all Study B analyses, tests, and primary application observations; executes both Study C output panels from frozen inputs; and checks the numerical paper tables and budget-curve coordinates. It typically takes about 3–4 minutes in the reference environment, excluding installation. The uncompressed inputs occupy about 385 MB; allow additional space for the virtual environment and fresh generated results.Success means exit status zero and <code>results/full/verification.json</code> containing <code>"passed": true</code> and <code>"mode": "full"</code>. <code>results/full/commands.json</code> lists completed stages and durations; the adjacent logs explain any failure. The runner refuses to overwrite an existing result directory. For another run, choose <code>--output-dir results/full-2</code>.<h2 dir="ltr">Faster checks with narrower scope</h2><pre>.\.venv\Scripts\python.exe -I -B reproduce.py --verify-only .\.venv\Scripts\python.exe -I -B reproduce.py --replay-only --output-dir results/replay </pre><code>--verify-only</code> checks package integrity. <code>--replay-only</code> recalculates A/B analyses and compares the paper with retained C evidence, but does not execute the application to regenerate observations. It therefore does not establish fresh execution reproducibility. Full execution is the default. See <code>REPRODUCIBILITY.md</code> for per-study commands, outputs, and failure interpretation.<h2 dir="ltr">Studies and expected results</h2><table><tr><th>Study</th><th>Design</th><th>Principal reproducibility checks</th></tr><tr><td>A: foundation</td><td>510 tests; 8 snapshots; 3 repetitions; separate K=15/30/45 histories</td><td>Each budget matches 4,080 profiles, 3,570 label records and 420 prediction artifacts. Independent analysis checks native and equal-count results separately.</td></tr><tr><td>B: exploratory</td><td>220 tests; 5 snapshots; 2 repetitions; K=15/30/45 replay</td><td>Fresh primary records match 1,100 profiles, 880 labels, 168 prediction artifacts and 2,200 individual execution traces. At K30, base/guided find 232/236 proxy impacts; the semantic component finds 238.</td></tr><tr><td>C: controlled</td><td>108 requirements; 27 crossed evaluation cells per output panel; 2 panels; K=9</td><td>Per panel, base=110, route+stage=110, route-only=116, development-selected component=117. Fresh execution matches 540 checked cell files and 6 summaries.</td></tr></table>The negative C finding is retained: stage conditioning does not improve the base policy in this design. The panels are not pooled as independent changes. These workloads share one local application backend; they are not independent software projects. B's outcome is a proxy-impact label, while C uses versioned factual requirements. The older differing B archive is historical provenance and is not the paper's primary evidence.<h2 dir="ltr">Package map</h2><ul><li><code>study_a/source/</code>, <code>study_b/source/</code>: complete Python application, evidence, selection, scheduling, test generation and analysis implementation used by the studies, with catalogs and corpus inputs.</li><li><code>study_a/scripts/</code>, <code>study_b/scripts/</code>, <code>study_b/validation_scripts/</code>: regeneration, policy/control/sensitivity analysis, recovered-case evidence and validation code. <code>study_b/tests/</code> contains the executable checks invoked by the runner.</li><li><code>study_a/inputs/</code>, <code>study_b/raw/</code>: archived primary scientific records; <code>study_a/expected/</code>, <code>study_b/expected/</code> and <code>study_b/expected_reported/</code> retain expected analytical results.</li><li><code>study_c/run_controlled_experiment.py</code>, <code>study_c/frozen/</code>: controlled-experiment source and frozen catalogs, schedules, fault allocations, selector masks and source hashes. <code>study_c/expected_execution/</code> contains raw cell-level materializations, selection commits, fitted retrieval state, answers and oracle records.</li><li><code>study_b/historical_case_dossiers/</code>, <code>study_b/historical_archive_diagnostic/</code>, <code>regeneration_investigation/</code>: explicitly historical case/context and environmental diagnostics, separated from refreshed primary results.</li><li><code>paper/</code>: current manuscript source, references, compiled PDF and implementation supplement. Numerical checks consume the source directly; compiling the PDF is not needed to run experiments.</li><li><code>SHA256.json</code>: current per-file SHA-256 manifest. <code>ANONYMIZATION.md</code> explains retained scientific identifiers and the limits of identity removal; <code>RIGHTS.md</code> preserves third-party attribution and licensing status.</li></ul>Missing original producing environments and Study A's original per-replicate associations cannot be reconstructed retroactively. Current primary A/B/C records regenerate in the reference environment; refreshed B and C include complete current oracle/output associations. Preserved historical fingerprints describe the original records, while <code>SHA256.json</code> describes the bytes of this review package.Repository history, direct author/workstation metadata and private revision identifiers are excluded. Necessary original benchmark identifiers and corpus text remain unchanged so that exact computation is preserved; this is not a guarantee that scientific content cannot be linked to prior work. See <code>ANONYMIZATION.md</code> before public deposition. No upload or DOI registration is performed by this package. Manuscript URL placeholders are intentionally unfilled. 2026-09-26T05:38:37Z Dataset Dataset 10.6084/m9.figshare.34002279.v1 https://figshare.com/articles/dataset/ADAPT-SELECT_Historical_Correction_for_Multi-Evidence_Regression_Test_Selection/34002279 CC BY 4.0