/ concept-collection / fastandaccurate-results
Sign in
concept-collection / fastandaccurate-results
fastandaccurate-results / README.md
42 lines · 1.5 KBCodeBlameHistory
3Benchmark results for
4[fastandaccurate](https://github.com/concept-collection/fastandaccurate),
5viewed at https://concept-collection.github.io/fastandaccurate/.
2e344a7Tighten README wordingJeremy Magland 7Each file under `results/` is one work-precision sweep (one problem
8instance, one solver, one environment) in the JSON format defined by the
9main repository's `src/harness/resultSchema.ts`. The site fetches
10`index.json` and the files it lists, statically. Provenance travels
dc3d05fInitial results: laplace-dirichlet-2d, mfs and nystrom-dlp on one machineJeremy Magland 11inside each file: instance spec and hash, solver id and version,
12protocol, runtime, numbl version, and machine. The submitter is recorded
13by the pull request itself.
15## Submitting results
171. Produce result files with the command line (or download them from a
18 run made in the browser on the site):
20 ```
21 npx https://concept-collection.github.io/fastandaccurate/cli.tgz run --label "my workstation"
22 ```
242. Copy them under `results/<problem>/`, naming files
25 `<problem>.<instance>.<solver>.<something-distinguishing>.json` so
26 that results from different machines can coexist.
283. Regenerate the index and open a pull request:
30 ```
31 node scripts/build-index.mjs
32 ```
34Results from solvers not in the main repository are welcome; the file
35records the solver's source, and such results display on the site marked
36as not reproducible in the browser. Review is by inspection of the
37provenance fields and, for in-browser solvers, by rerunning; a result
38that cannot be reproduced within reason will be questioned in the PR.
40## License
42Apache-2.0
moveopenescclose