berkus
/
ANE
mirror of https://github.com/maderix/ANE.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
ANE/benchmarks
History
Nabbil Khan 35152a3490
Merge 7fceb99988 into 7d61ee4d25 		2026-03-08 00:20:08 +08:00
..
submissions/m3-ultra-mac-studio-2026-03-03 Add reproducible M3 Ultra benchmark submission package 2026-03-03 18:39:34 +00:00
ANE_BENCHMARK_REPORT.md Add model config to benchmark report, update README with current results 2026-03-04 06:13:21 -08:00
README.md Add reproducible M3 Ultra benchmark submission package 2026-03-03 18:39:34 +00:00
community_results.json Add NE core counts, clarify FP16 vs rated TOPS methodology 2026-03-04 06:11:29 -08:00

README.md

Community Benchmark Submissions

This folder is for reproducible hardware benchmark submissions from the community.

Goals

  • Make cross-chip results easy to compare.
  • Keep raw logs attached so numbers are auditable.
  • Keep submissions lightweight and low-maintenance.

Submission Layout

Use one directory per machine/date:

benchmarks/submissions/<chip>-<machine>-<YYYY-MM-DD>/

Required files:

  • README.md — short summary of machine, commands, and key results
  • metrics.json — machine-readable summary of key metrics
  • raw/ — raw command outputs (*.log, system_info.txt, upstream_commit.txt)

Privacy

Please redact machine serial numbers, UUIDs, and other unique identifiers before committing logs.

Minimal Repro Guidance

Each submission should include:

  • exact upstream commit hash tested
  • exact commands run
  • fixed step counts for training comparisons (for example, --steps 20)
  • clear pass/fail status for each benchmark