1# fastandaccurate-results
3Benchmark results for
4[fastandaccurate](https://github.com/concept-collection/fastandaccurate),
5viewed at https://concept-collection.github.io/fastandaccurate/.
7This repository is the database: each file under `results/` is one
8work-precision sweep (one problem instance, one solver, one environment)
9in the JSON format defined by the main repository's
10`src/harness/resultSchema.ts`. The site fetches `index.json` and the
11files it lists, statically; there is no server. Provenance travels
12inside each file: instance spec and hash, solver id and version,
13protocol, runtime, numbl version, and machine. The submitter is recorded
14by the pull request itself.
16## Submitting results
181. Produce result files with the command line (or download them from a
19 run made in the browser on the site):
21 ```
22 npx https://concept-collection.github.io/fastandaccurate/cli.tgz run --label "my workstation"
23 ```
252. Copy them under `results/<problem>/`, naming files
26 `<problem>.<instance>.<solver>.<something-distinguishing>.json` so
27 that results from different machines can coexist.
293. Regenerate the index and open a pull request:
31 ```
32 node scripts/build-index.mjs
33 ```
35Results from solvers not in the main repository are welcome; the file
36records the solver's source, and such results display on the site marked
37as not reproducible in the browser. Review is by inspection of the
38provenance fields and, for in-browser solvers, by rerunning; a result
39that cannot be reproduced within reason will be questioned in the PR.
41## License
43Apache-2.0