berkus
/
ANE
mirror of https://github.com/maderix/ANE.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
26 Commits 3 Branches 0 Tags 1.1 MiB
Commit Graph

8 Commits

Author SHA1 Message Date
Manjeet Singh 032f866f2d
Merge pull request #29 from nabbilkhan/contrib/fix-training-data-paths 
Fix hardcoded TinyStories data path in train_large/train_large_ane
 2026-03-04 17:48:43 +05:30
Manjeet Singh 3efa27d7a3
Merge pull request #17 from TastyHeadphones/tastyheadphones/short-dataset-underflow-fix 
Fix token sampling underflow for short token datasets
 2026-03-04 17:48:22 +05:30
nabbilkhan c04168ee17 Add --data path support for static training pipelines 2026-03-03 19:19:49 +00:00
maderix 4c14ed0e25 CLI fixes + --no-ane-extras flag + README benchmark table 
- Fix positional arg parsing (model_path, steps, lr were silently ignored)
- Add --model, --ckpt flags; forward ckpt_path across exec() restarts
- Add --no-ane-extras to disable ANE classifier/softmax/rmsnorm_bwd
- CPU fallback for softmax/classifier/rmsnorm_bwd when extras disabled
- Update README with 4-way benchmark comparison table (20 steps)
 2026-03-03 04:34:55 -08:00
tastyheadphones 2b3b7ae5cc Fix token sampling underflow on short datasets 2026-03-03 11:42:42 +09:00
m0at 40d3f45631 Add ANE probe tests and training telemetry for M5 optimization 
Four standalone probe tests to characterize the M5 ANE:
- test_weight_reload: Can weights be hot-swapped via unload+load without recompilation?
- test_perf_stats: Enumerate _ANEPerformanceStats methods/properties and hardware counters
- test_qos_sweep: Measure compile/load/eval latency across QoS 0-63
- test_ane_advanced: Probe SharedEvents, weightsBuffer IOSurface, procedureIndex, VirtualClient

Training telemetry (train_large.m):
- JSON lines to stderr with per-step timing breakdown and per-batch TFLOPS metrics
- Enables external monitoring tools to visualize ANE utilization in real-time

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-01 22:54:58 -08:00
maderix 4d67db1bdb stories110M: 12-layer ANE training with dashboard, 107ms/step 
- Scale to full stories110M (109M params, 12 layers) with real TinyStories data
- vDSP-vectorized cross-entropy (110ms→14ms), NEON fp16 IO, async dW
- TUI dashboard: loss curve, ANE/CPU power, CPU/memory graphs, text generation
- Split into modular headers: config, io, mil, cpu_ops
 2026-03-01 03:14:39 -08:00
maderix f213c8db68 Initial release 2026-02-28 00:22:06 -08:00