70 KiB
Changelog
All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
Unreleased
Security
-
ESP32 OTA upload now fails closed when no PSK is provisioned (#596 audit finding — critical, breaking change for unprovisioned nodes).
ota_check_auth()previously returnedtruewhens_ota_psk[0] == '\0', so a freshly-flashed node would accept attacker-controlled firmware over plain HTTP on port 8032 from any host on the WiFi. No Secure Boot V2, no signed-image verification — a single LAN call could brick or backdoor a node. The fix rejects every OTA upload until a PSK is written to NVS (the OTA HTTP server still starts so operators can runprovision.py --ota-psk <hex>over USB-CDC without reflashing). Operators affected: any deployment that relied on the unauthenticated OTA endpoint working out of the box now needs to provision a PSK before subsequent OTA pushes will succeed. Boot-timeESP_LOGWmakes the new posture visible. -
Path-traversal vulnerabilities patched in five sensing-server endpoints (closes #615 — critical). New
wifi_densepose_sensing_server::path_safety::safe_id()enforces[A-Za-z0-9._-]only (no leading., max 64 chars) before any user-controlled identifier reaches aformat!()building a filesystem path. Applied at:POST /api/v1/recording/start(recording.rs—session_name)GET /api/v1/recording/download/:id(recording.rs—id)DELETE /api/v1/recording/delete/:id(recording.rs—id)POST /api/v1/models/load(model_manager.rs—model_id)training_api.rsload_recording_frames(dataset_ids)
Pre-fix, unauthenticated callers could read
../../etc/passwd-style paths, write arbitrary JSONL files, load attacker-controlled.rvfmodel files, or delete arbitrary files the server process could touch. 9 unit tests inpath_safety::testsexercise the rejection envelope (empty, too-long, path separators, parent-dir traversal, null byte, whitespace/specials, non-ASCII).
Fixed
-
WebSocket
/ws/sensingnow reportsesp32:offlinewhen ESP32 hardware goes stale (closes #618).broadcast_tick_taskwas re-emitting the cachedlatest_updatewith a frozensource: "esp32"field forever after the hardware lost power or network. The REST/healthendpoint already calledeffective_source()(which returns"esp32:offline"afterESP32_OFFLINE_TIMEOUT= 5 s with no UDP frames), but the WS broadcast path was the one consumer that didn't. Result: the UI's "LIVE — ESP32 HARDWARE Connected" banner stayed green long after the hardware went away, andvital_signs/features/classificationre-broadcasted the last-seen values indefinitely. Fix: clone the cachedlatest_updateper tick, overwritesourcewiths.effective_source(), then serialize and broadcast. UI can now switch to an offline state on the same 5-second budget the REST surface uses. -
Proof replay (
archive/v1/data/proof/verify.py) is now cross-platform deterministic (closes #560). Three changes together: (1)features_to_bytes()nownp.round(.., HASH_QUANTIZATION_DECIMALS=6)s each feature array before packing as little-endian f64, collapsing ULP-level drift from scipy.fft pocketfft SIMD reordering; (2) theVerify Pipeline Determinismworkflow pinsOMP_NUM_THREADS=1,OPENBLAS_NUM_THREADS=1,MKL_NUM_THREADS=1,VECLIB_MAXIMUM_THREADS=1,NUMEXPR_NUM_THREADS=1— multi-threaded BLAS reductions were a deeper source of non-determinism than SIMD reordering, and 6-decimal quantization alone wasn't enough across Azure VM microarchitectures; (3)expected_features.sha256regenerated under the new conditions. CI now passes the determinism check (same hash across consecutive runs on canonical Linux x86_64 CI runner:667eb054c44ac510342665bf9c93d608868a8ead948ae8774b2796ebce6f8fe7).scripts/probe-fft-platform.pyupdated to mirrorHASH_QUANTIZATION_DECIMALS=6for cross-machine spot-checks. -
archive/v1/src/services/pose_service.py:223calls the right method onPhaseSanitizer(closes #612). The call wasself.phase_sanitizer.sanitize(phase_data), butPhaseSanitizer's full-pipeline entry point is namedsanitize_phase()(unwrap_phase+remove_outliers+smooth_phasechained, seearchive/v1/src/core/phase_sanitizer.py:266). The shortersanitizename doesn't exist on the class, so any path that reached this branch raisedAttributeErrorand crashed the pose service mid-frame. -
adaptive_classifier.rs:94no longer panics on NaN feature values (closes #611).sorted.sort_by(|a, b| a.partial_cmp(b).unwrap())returnedNoneand panicked whenever a singleNaNreached the classifier from real ESP32 hardware (silent DSP div-by-zero, empty buffer). One bad frame killed the entire sensing-server process. Swapped forunwrap_or(Ordering::Equal), matching the pattern the same file already used at lines 149-150 and 155. Per-frame hot path; this was a real production crash vector. -
Completed the #611 NaN-panic audit across the sensing-server crate (follow-up to #613). The original audit grepped for the literal
partial_cmp(b).unwrap()and missed seven additional production sites that use comparator variants (partial_cmp(b.1).unwrap(),partial_cmp(&variances[b]).unwrap()). All share the same crash class — a singleNaNin CSI-derived state panics the whole sensing-server. Fixed:adaptive_classifier.rs:205—AdaptiveModel::classify()argmax over softmax probs. Same per-frame hot path as #611; NaN flows through normalise → logits → softmax and still reaches this site even after the #613 IQR fix.adaptive_classifier.rs:480, 500— training-loop argmax intrain()(training/per-class accuracy reporting).main.rs:2446, 2449andcsi.rs:602, 605— variance-based source/sink selection incount_persons_mincut. The outerunwrap_or((0, &0))only catches an empty iterator; it cannot rescue a comparator panic.
Remaining
partial_cmp(...).unwrap()sites in the workspace are all inside#[cfg(test)]/#[test]blocks (spectrogram.rs:269,depth.rs:234,connectivity.rs:477,vital_signs.rs:737) where inputs are controlled. -
ui/utils/pose-renderer.jsno longer divides by zero when two render frames land in the sameperformance.now()tick (issue #519 Bug 2).deltaTimeis nowMath.max(currentTime - lastFrameTime, 1)before the1000 / deltaTimedivision, capping displayed FPS at 1000 — far above any real render rate, but finite so the EMAaverageFps = averageFps * 0.9 + fps * 0.1no longer poisons itself toInfinityon a single zero-dt tick.
Removed
- Stub crates
wifi-densepose-api,wifi-densepose-db,wifi-densepose-config(closes #578). Each was a single-line doc-comment placeholder with an empty[dependencies]section and zero references from any source file orCargo.toml. The names were reserved early for an envisioned REST/database/config split that never materialised; the functionality they would provide is covered today bywifi-densepose-sensing-server(Axum REST/WS), per-crate config + CLI args, and the project's real-time-only (no-persistent-state) posture. Removing them from the workspace preventscargofrom listing dead crates and shipping empty published artifacts. If any of these names is needed in the future, they can be reintroduced with a real implementation.
Added
-
Home Assistant + Matter integration (ADR-115). New
--mqttand--matterflags onwifi-densepose-sensing-serverexpose the full sensing capability set to any Home Assistant install via MQTT auto-discovery (HA-DISCO) and to any Matter controller (Apple Home / Google Home / Alexa / SmartThings) via a built-in Matter Bridge (HA-FABRIC). Includes 21 entity kinds — 11 raw signals + 10 semantic primitives (someone-sleeping, possible-distress, room-active, elderly-inactivity-anomaly, meeting, bathroom, fall-risk, bed-exit, no-movement, multi-room-transition). The semantic primitives run server-side so--privacy-modestrips HR/BR/pose values from the wire while still publishing the inferred states — the architectural win for healthcare and AAL deployments. Three starter HA Blueprints (distress notify, hallway dim on sleeping, wake routine on bed exit), Lovelace dashboard examples, mTLS support, 32 KB payload-size cap, MQTT-wildcard topic-injection rejection. 372 tests cover the implementation. Seedocs/integrations/home-assistant.md,docs/integrations/semantic-primitives-metrics.md,docs/adr/ADR-115-home-assistant-integration.md, and tracking issue #776. Matter SDK spike (P7) and CSA-certification path (P10) deferred to v0.7.1+ per ADR §9.10. Try it:cargo run -p wifi-densepose-sensing-server --features mqtt --example mqtt_publisher -- --mqtt --mqtt-host 127.0.0.1. -
Real-time CSI introspection / low-latency tap on
wifi-densepose-sensing-server(ADR-099). Newwifi_densepose_sensing_server::introspectionmodule wires midstream'stemporal-attractor(Lyapunov + regime classification) andtemporal-compare(DTW pattern matching) as a parallel tap alongside RuView's existing event pipeline — no replacement, no behaviour change to the existing/ws/sensingfan-out orwifi-densepose-signalDSP. Two new endpoints (off by default, enabled via--introspection):GET /ws/introspection— newline-delimited JSON snapshots streamed at the CSI frame rate. Each snapshot carriesframe_count,regime(Idle / Periodic / Transient / Chaotic / Unknown),lyapunov_exponent,attractor_dim,attractor_confidence,regime_changed(boolean — flips on the first frame after a regime transition), andtop_k_similarity[](highest-scoring signature matches against a per-deployment library).GET /api/v1/introspection/snapshot— single-shot JSON snapshot, auth-gated whenRUVIEW_API_TOKENis set. Per-frameupdate()budget measured at 0.041 ms p99 on the I5 bench (~24× under ADR-099 D4's 1 ms target). Shape-match latency on a 1-D mean-amplitude L1 stand-in: 5 frames (3.20× ratio vs the 16-frame event-path floor). ADR-099 D8 honestly amended — the aspirational 10× bar is contingent on ADR-208 Phase 2 multi-dim NPU embeddings; this release ships the tap off-by-default while the foundation lands. 8 lib tests + 5 latency/regression tests (tests/introspection_latency.rs, including a 200-frame noise warm-up → 10-frame motion-ramp signature benchmark).
-
Opt-in bearer-token auth on
wifi-densepose-sensing-server's/api/v1/*HTTP surface (closes #443). Newwifi_densepose_sensing_server::bearer_authmodule: when theRUVIEW_API_TOKENenv var is set, every request whose path begins with/api/v1/must carry anAuthorization: Bearer <token>header (constant-time compared) or the server responds401 Unauthorized. When the variable is unset or empty the middleware is a no-op — the long-standing LAN-only deployment posture is preserved, so this is a binary deployment-time switch with no default behaviour change./health*,/ws/sensing, and the/ui/*static mount are intentionally never gated (orchestrator probes + local browsers). Startup logs which mode is active and warns when auth is on with a0.0.0.0bind. 8 unit tests on the middleware (lib test count 191 → 199). Resolves the security audit raised in #443.
Changed
- Docker image: build-time guard for the UI assets, plus a CI workflow that
rebuilds and pushes on every change (closes #520, #514).
docker/Dockerfile.rustnowRUNs a guard afterCOPY ui/that fails the build if any ofindex.html/observatory.html/pose-fusion.html/viz.html/ theobservatory//pose-fusion//components//services/directories are missing, so a stale image can never be silently produced again. New.github/workflows/sensing-server-docker.ymlbuilds the image on push tomain(paths-filtered) and onv*tags and pushes to bothdocker.io/ruvnet/wifi-denseposeandghcr.io/ruvnet/wifi-denseposewithlatest+vX.Y.Z+sha-<short>tags, then smoke-tests the published artifact:/health,/api/v1/info, the observatory + pose-fusion UI assets, and theRUVIEW_API_TOKENauth path (no token → 401, wrong → 401, correct → 200). UsesDOCKERHUB_USERNAME/DOCKERHUB_TOKENrepo secrets for the Docker Hub push; ghcr.io uses the workflow'sGITHUB_TOKEN. - rvCSI moved to its own repo and is now vendored as a submodule. The 9
rvcsi-*crates (rvcsi-core/-dsp/-events/-adapter-file/-adapter-nexmon/-ruvector/-runtime/-node/-cli— added inline in #542) now live ingithub.com/ruvnet/rvcsi: published to crates.io asrvcsi-* 0.3.x, to npm as@ruv/rvcsi, with a Claude Code plugin marketplace and a RuView-style README. RuView vendors it undervendor/rvcsi(alongsidevendor/ruvector/vendor/midstream/vendor/sublinear-time-solver) and no longer carries inline copies inv2/crates/; consumers depend on the published crates (or the submodule'scrates/rvcsi-*paths).v2/Cargo.toml,CLAUDE.md, and the README docs table updated accordingly. The ADRs (ADR-095, ADR-096), PRD, and DDD model stay indocs/here as the design record of the incubation.
Fixed
- README: corrected the camera-supervised pose-accuracy claim. The README stated
"92.9% PCK@20" for camera-supervised training; that figure does not appear in
ADR-079 and is ~2.6× the ADR's own success target (>35% PCK@20). ADR-079 phases
P7 (data collection), P8 (training + evaluation on real paired data) and P9
(cross-room LoRA) are still
Pending, so no measured camera-supervised PCK@20 has been published. README now states the proxy-supervised baseline (≈2.5%) and the ADR-079 target (35%+), and notes the eval phases are pending. Surfaced by the PowerPlatePulse training-pipeline audit (2026-05-11); 6 remaining audit findings tracked in the PR. - rvCSI
BaselineDriftDetector: drift thresholds are now scale-relative, not absolute. The detector comparedmean_amplitudeagainst its EWMA baseline with absolute thresholds (anomaly_threshold = 1.0,drift_threshold = 0.15) — fine for the synthetic unit tests (amplitudes ≈ 1.0), but raw ESP32 CSI isint8I/Q with amplitudes up to ~128, so the window-to-window RMS distance is routinely 5–50 ≫ 1.0 andAnomalyDetectedfired on ~96 % of windows (319/331 on a real node-1 capture). Drift is now‖current − baseline‖₂ / ‖baseline‖₂(a fraction, with anepsfloor for a degenerate near-zero baseline), so one tuning works across raw-int8ESP32,int16-scaled Nexmon, and baseline-subtracted streams alike —AnomalyDetecteddrops to 40/331 on the same data, the existing detector tests still pass, and abaseline_drift_is_scale_invariant_no_anomaly_stormregression test was added. ADR-095 D13 / ADR-096 §2.1, §5 updated. Surfaced by an end-to-end test against real ESP32 CSI (a 7,000-frame node-1 capture; transcoder atscripts/esp32_jsonl_to_rvcsi.py).
Added
- rvCSI — edge RF sensing runtime (design + first implementation). New subsystem rvCSI: a Rust-first / TypeScript-accessible / hardware-abstracted edge RF sensing runtime that normalizes WiFi CSI from Nexmon, ESP32, Intel, Atheros, file and replay sources into one validated
CsiFrameschema, runs reusable DSP, emits typed confidence-scored events, and bridges to RuVector RF memory, an MCP tool server and a TS SDK.- Design docs:
docs/prd/rvcsi-platform-prd.md(purpose, users, success criteria, FR1–FR10, NFRs, system architecture, data model);docs/adr/ADR-095-rvcsi-edge-rf-sensing-platform.md(the 15 architectural decisions: Rust core, C-at-the-boundary, TS SDK via napi-rs, normalized schema, validate-before-FFI, CSI-as-temporal-delta, RuVector as RF memory, replayability, detection≠decision, local-first, read-first/write-gated MCP, mandatory quality scoring, versioned calibration, plugin adapters);docs/adr/ADR-096-rvcsi-ffi-crate-layout.md(crate topology, the napi-c shim record format & contract, the napi-rs Node surface, build/test invariants);docs/ddd/rvcsi-domain-model.md(7 bounded contexts: Capture, Validation, Signal, Calibration, Event, Memory, Agent — with aggregates, invariants, context map and domain services). Indexed indocs/adr/README.mdanddocs/ddd/README.md. - Crates (9 new
v2/crates/rvcsi-*workspace members):rvcsi-core(normalizedCsiFrame/CsiWindow/CsiEventschema,AdapterProfile,CsiSourceplugin trait, id newtypes +IdGenerator,RvcsiError, thevalidate_framepipeline + quality scoring;forbid(unsafe_code));rvcsi-adapter-nexmon— the napi-c seam:native/rvcsi_nexmon_shim.{c,h}(the only C in the runtime — allocation-free, bounds-checked, ABI1.1), compiled viabuild.rs+cc, handling two byte formats — the compact self-describing "rvCSI Nexmon record", and the real nexmon_csi UDP payload (the 18-bytemagic 0x1111 · rssi · fctl · src_mac · seq · core/stream · chanspec · chip_verheader +nsubint16 I/Q samples, the modern BCM43455c0/4358/4366c0 export read by CSIKit/csireader.py), with a Broadcom d11ac chanspec decoder (channel/bandwidth/band) — plus a pure-Rust libpcap reader (classic.pcap, all byte-order/timestamp-resolution magics, Ethernet/raw-IPv4/Linux-SLL link types) and a Nexmon-chip / Raspberry-Pi-model registry (NexmonChip/RaspberryPiModel— including the Raspberry Pi 5 (CYW43455/BCM43455c0, same wireless as the Pi 4 — 20/40/80 MHz, 2.4+5 GHz, 64/128/256 subcarriers), the Pi 3B+/4/400, and the Pi Zero 2 W (BCM43436b0);nexmon_adapter_profile/raspberry_pi_profilebuild the per-chipAdapterProfile;chip_verwords auto-resolve to a chip). Wrapped by a documentedffimodule and twoCsiSources:NexmonAdapter(record buffers) andNexmonPcapAdapter(real nexmon_csi UDP inside atcpdump -i wlan0 dst port 5500 -w csi.pcapcapture — the pcap timestamp stamps each frame; the chip is auto-detected fromchip_ver, overridable via.with_pi_model(Pi5)/.with_chip(...)).rvcsi-dsp(DC removal, phase unwrap, smoothing, Hampel/MAD filter, sliding variance, baseline subtraction, motion-energy/presence/confidence features, heuristic breathing-band estimate, non-destructiveSignalPipeline);rvcsi-events(WindowBuffer, theEventDetectortrait + presence/motion/quality/baseline-drift state machines,EventPipeline; the baseline-drift detector uses scale-relative thresholds — drift as a fraction of the baseline's RMS magnitude — so one tuning works across raw-int8ESP32,int16-scaled Nexmon, and baseline-subtracted streams alike);rvcsi-adapter-file(the.rvcsiJSONL capture format,FileRecorder,FileReplayAdapterdeterministic replay);rvcsi-ruvector(deterministic window/event embeddings,cosine_similarity, theRfMemoryStoretrait,InMemoryRfMemory+JsonlRfMemory— a standin until the production RuVector binding);rvcsi-runtime(the no-FFI composition layer:CaptureRuntime=CsiSource+validate_frame+SignalPipeline+EventPipeline, plus one-shot helperssummarize_capture/decode_nexmon_records/decode_nexmon_pcap/summarize_nexmon_pcap/events_from_capture/export_capture_to_rf_memory);rvcsi-node— the napi-rs seam (a["cdylib","rlib"]Node addon,build.rsrunsnapi_build::setup(); thin#[napi]wrappers overrvcsi-runtime—nexmonDecodeRecords/nexmonDecodePcap(with optionalchip)/inspectNexmonPcap/decodeChanspec/nexmonChipName/nexmonProfile/nexmonChips/inspectCaptureFile/eventsFromCaptureFile/exportCaptureToRfMemory+ anRvcsiRuntimestreaming class; everything that crosses to JS is a validated/normalized struct serialized to JSON);rvcsi-cli(thervcsibinary:record(Nexmon-dump or--source nexmon-pcap [--chip pi5]→.rvcsi),inspect,inspect-nexmon,nexmon-chips,decode-chanspec,replay,stream,events,health,calibratev0-baseline,export ruvector). Plus the@ruv/rvcsinpm package (package.json/index.js/index.d.ts/README/__test__) alongsidervcsi-node— a curated JS surface that parses the addon's JSON into plainCsiFrame/CsiWindow/CsiEvent/SourceHealth/CaptureSummary/NexmonPcapSummary/DecodedChanspecobjects, with a lazy native-addon load. - Tests: 169 across the rvcsi crates (core 29, dsp 28, events 19 — incl. a baseline-drift scale-invariance regression, adapter-file 20 + 1 doctest, adapter-nexmon 28 — round-tripping through the C shim and synthetic libpcap files, incl. Pi 5 / chip-detection, ruvector 20 + 1 doctest, runtime 13, cli 10), 0 failures; all rvcsi crates build together and are clippy-clean (
rvcsi-nodeunderdeny(clippy::all));forbid(unsafe_code)everywhere exceptrvcsi-adapter-nexmon(FFI, everyunsafeblock documented). Also exercised end-to-end against a real 7,000-frame ESP32 node-1 capture (transcoded withscripts/esp32_jsonl_to_rvcsi.py— the stand-in for the not-yet-shippedrecord --source esp32-jsonl):rvcsi inspect/replay/calibrate/eventsall run on real hardware data. Not yet wired in: live radio capture,rvcsi-adapter-esp32(live serial/UDP ESP32 source), the WebSocket daemon (rvcsi-daemon), the MCP tool server (rvcsi-mcp), and the legacy nexmon packed-float CSI export — follow-ups on top of these crates.
- Design docs:
wifi-densepose-train:signal_featuresmodule — wireswifi-densepose-signalinto the training pipeline.wifi-densepose-signalwas previously a phantom dependency ofwifi-densepose-train(listed inCargo.toml, never imported). Newwifi_densepose_train::signal_features::extract_signal_features(andCsiSample::signal_features()) run a windowed CSI observation's centre frame throughwifi_densepose_signal::features::FeatureExtractor, producing a fixed-length (FEATURE_LEN = 12) amplitude/phase/PSD feature vector — the hook for a future vitals / multi-task supervision head (breathing- and heart-rate-band power are read off the PSD summary). The vector is produced on demand and not yet fed back into the loss. Surfaced by the 2026-05-11 training-pipeline audit (findings #1 "vitals features absent from training" and #2 "wifi-densepose-signalghost dep").wifi-densepose-train:TrainingConfigsubcarrier-layout presets + a real-loader integration test. NewTrainingConfig::for_subcarriers(native, target)plus named presetsht40_192()(≈192-sc ESP32 HT40 → 56) andmultiband_168()(168-sc ADR-078 multi-band mesh → 56), so non-MM-Fi CSI shapes are first-class instead of requiring manualnative_subcarriers/num_subcarriersoverrides; field docs now list the supported source counts and the multi-NIC mapping. Newtests/test_real_loader.rsround-trips synthetic CSI through.npyfiles →MmFiDataset::discover/get(including the subcarrier-interpolation branch and the empty-root case) — exercising the on-disk loader path the deterministicverify-trainingproof intentionally bypasses. Addresses training-pipeline audit findings #6 (56-sc/1-NIC config default) and #7 (multi-band mesh not in config); the #4 concern ("proof uses synthetic data") is reframed — the proof should use a reproducible source, and this test covers the real loader it skips.
Fixed
- HuggingFace
MODEL_CARD.md: marked the PIR/BME280 environmental-sensor ground-truth path as planned, not implemented (training-pipeline audit finding #3) — the card presented PIR/BME280 weak-label fine-tuning as a current capability; there is no env-sensor ingestion in the training pipeline today. - README: corrected the camera-supervised pose-accuracy claim (audit finding #5; see PR #535) — "92.9% PCK@20" → the ADR-079 target (35%+; proxy baseline 35.3%), noting P7/P8/P9 are pending.
Added
-
RollingP95adaptive feature normalizer (v2/crates/wifi-densepose-sensing-server) — Streaming P95 estimator (600-sample / ~30 s sliding window) that self-calibrates feature normalization to whatever distribution the deployment produces. Replaces fixed-scale denominators (variance/300,motion/250,spectral/500) which saturated when live ESP32 values exceeded those limits, collapsing dynamic range to zero. Cold-start (<60 samples) falls back to the legacy denominators so day-0 behaviour is preserved. Deployment-neutral: no hardcoded values. (ADR-044 §5.2) -
dedup_factorruntime configuration API (v2/crates/wifi-densepose-sensing-server) — Exposes the multi-node person-count deduplication divisor at runtime via REST:GET /api/v1/config/dedup-factor— read current value.POST /api/v1/config/dedup-factor— set value (clamped 1.0–10.0, persisted).POST /api/v1/config/ground-truth— auto-tunesdedup_factorfrom a known person count ({"count": N}); derives optimal divisor from current node-sum. Config is persisted todata/config.jsonand reloaded on restart. (ADR-044 §5.3)
-
nvsimcrate — deterministic NV-diamond magnetometer pipeline simulator (ADR-089) — New standalone leaf crate atv2/crates/nvsimmodeling a forward-only magnetic sensing path: scene → source synthesis (Biot–Savart, dipole, current loop, ferrous induced moment) → material attenuation (Air/Drywall/Brick/Concrete/Reinforced/SteelSheet) → NV ensemble (4 〈111〉 axes, ODMR linear-readout proxy, shot-noise floor per Wolf 2015 / Barry 2020) → 16-bit ADC + lock-in demodulation → fixed-layoutMagFramerecords → SHA-256 witness. Six-pass build perdocs/research/quantum-sensing/15-nvsim-implementation-plan.md. 50 tests, ~4.5 M samples/s on x86_64 (4500× the Cortex-A53 1 kHz acceptance gate), pinned reference witnesscc8de9b01b0ff5bd97a6c17848a3f156c174ea7589d0888164a441584ec593b4for byte-equivalence regression. WASM-ready by construction (zerostd::time/fs/env/process/thread); builds cleanly forwasm32-unknown-unknown. ADR-090 (Proposed, conditional) tracks the optional Lindblad/Hamiltonian extension if AC magnetometry, MW power saturation, hyperfine spectroscopy, or pulsed protocols become required.
Fixed
- WebSocket broadcast handler now handles Lagged events gracefully and sends periodic ping keepalives to prevent dashboard disconnects —
handle_ws_clientandhandle_ws_pose_clientinwifi-densepose-sensing-serverwere treatingRecvError::Laggedas a fatal error, causing instant disconnect when clients fell behind the 256-frame broadcast buffer at 10 Hz ingest. Clients would reconnect, immediately lag again, and rapid-cycle every 2–4 s.Laggednow continues (drops missed frames, logs debug) rather than breaking. Added 30 s ping keepalive on the sensing handler to prevent proxy idle timeouts. - Ghost skeletons in live UI with multi-node ESP32 setups (#420, ADR-082) —
tracker_bridge::tracker_to_person_detectionsdocumented itself as filtering tois_alive()tracks but in fact passed every non-Terminated track to the WebSocket stream.Losttracks — kept insidereid_windowfor re-identification but not currently observed — were rendering as phantom skeletons, accumulating to 22-24 with 3 nodes × 10 Hz CSI whileestimated_personscorrectly reported 1. AddedPoseTracker::confirmed_tracks()(Tentative + Active only) and rewired the bridge to use it. Lost tracks remain in the tracker for re-ID; they just no longer ship to the UI. Regression test:test_lost_tracks_excluded_from_bridge_output. - Rust workspace build with
--no-default-featureson Windows (#366, #415) —wifi-densepose-mat,wifi-densepose-sensing-server, andwifi-densepose-trainall depended onwifi-densepose-signalwith default features enabled, which pulledndarray-linalg→openblas-src→ vcpkg/system-BLAS through the entire workspace.--no-default-featuresat the workspace root then could not opt out of BLAS, breakingcargo build/cargo teston Windows without vcpkg. All three consumers now declarewifi-densepose-signal = { ..., default-features = false }, socargo test --workspace --no-default-featuresbuilds cleanly without vcpkg/openblas. Validated: 1,538 tests pass, 0 fail, 8 ignored. signaltesttest_estimate_occupancy_noise_onlyfailed withouteigenvalue— The test unwrapped theNotCalibratedstub returned when the BLAS-backedestimate_occupancyis compiled out. Gated with#[cfg(feature = "eigenvalue")]so it only runs when the real implementation is available.
[v0.6.2-esp32] — 2026-04-20
Firmware release cutting ADR-081 and the Timer Svc stack fix discovered during
on-hardware validation. Cut from main at commit pointing to this entry.
Tested on ESP32-S3 (QFN56 rev v0.2, MAC 3c:0f:02:e9:b5:f8), 30 s continuous
run: no crashes, 149 rv_feature_state_t emissions (~5 Hz), medium/slow ticks
firing cleanly, HEALTH mesh packets sent.
Fixed
- Firmware: Timer Svc stack overflow on ADR-081 fast loop —
emit_feature_state()runs inside the FreeRTOS Timer Svc task via the fast-loop callback; it callsstream_sendernetwork I/O which pushes past the ESP-IDF 2 KiB default timer stack and panics ~1 s after boot. BumpedCONFIG_FREERTOS_TIMER_TASK_STACK_DEPTHto 8 KiB insdkconfig.defaults,sdkconfig.defaults.template, andsdkconfig.defaults.4mb. Follow-up (tracked separately): move heavy work out of the timer daemon into a dedicated worker task. - Firmware:
adaptive_controller.cimplicit declaration (#404) —fast_loop_cbcalledemit_feature_state()before its static definition, triggering-Werror=implicit-function-declaration. Added a forward declaration above the first use.
Changed
- CI: firmware build matrix (8MB + 4MB) —
firmware-ci.ymlnow matrix-builds both the default 8MB (sdkconfig.defaults) and 4MB SuperMini (sdkconfig.defaults.4mb) variants, uploading distinct artifacts and producing variant-named release binaries (esp32-csi-node.bin/esp32-csi-node-4mb.bin,partition-table.bin/partition-table-4mb.bin).
Added
- ADR-081: Adaptive CSI Mesh Firmware Kernel — New 5-layer architecture
(Radio Abstraction Layer / Adaptive Controller / Mesh Sensing Plane /
On-device Feature Extraction / Rust handoff) that reframes the existing
ESP32 firmware modules as components of a chipset-agnostic kernel. ADR
in
docs/adr/ADR-081-adaptive-csi-mesh-firmware-kernel.md. Goal: swap one radio family for another without changing the Rust signal / ruvector / train / mat crates. - Firmware: radio abstraction vtable (
rv_radio_ops_t) — Newfirmware/esp32-csi-node/main/rv_radio_ops.{h}defines the chipset-agnostic ops (init, set_channel, set_mode, set_csi_enabled, set_capture_profile, get_health), profile enum (RV_PROFILE_PASSIVE_LOW_RATE/ACTIVE_PROBE/RESP_HIGH_SENS/FAST_MOTION/CALIBRATION), and health snapshot struct.rv_radio_ops_esp32.cprovides the ESP32 binding wrappingcsi_collector+esp_wifi_*. A second binding (mock or alternate chipset) is the portability acceptance test for ADR-081. - Firmware:
rv_feature_state_tpacket (magic0xC5110006) — New 60-byte compact per-node sensing state (packed, verified by_Static_assert) infirmware/esp32-csi-node/main/rv_feature_state.h: motion, presence, respiration BPM/conf, heartbeat BPM/conf, anomaly score, env-shift score, node coherence, quality flags, IEEE CRC32. Replaces raw ADR-018 CSI as the default upstream stream (~99.7% bandwidth reduction: 300 B/s at 5 Hz vs. ~100 KB/s raw). - Firmware: mock radio ops binding for QEMU — New
firmware/esp32-csi-node/main/rv_radio_ops_mock.c, compiled only whenCONFIG_CSI_MOCK_ENABLED. Satisfies ADR-081's portability acceptance test: a secondrv_radio_ops_tbinding compiles and runs against the same controller + mesh-plane code as the ESP32 binding. - Firmware: feature-state emitter wired into controller fast loop —
adaptive_controller.cnow emits one 60-byterv_feature_state_tper fast tick (default 200 ms → 5 Hz), pulling from the latest edge vitals and controller observation. This is the first end-to-end Layer 4/5 path for ADR-081. - Firmware:
csi_collector_get_pkt_yield_per_sec()/_get_send_fail_count()accessors — Expose the CSI callback rate and UDP send-failure counter so the ESP32 radio ops binding can populaterv_radio_health_t.pkt_yield_per_secand.send_fail_count, closing the adaptive controller's observation loop. - Firmware: host-side unit test suite for ADR-081 pure logic — New
firmware/esp32-csi-node/tests/host/(Makefile + 2 test files + shimesp_err.h). Exercisesadaptive_controller_decide()(9 test cases: degraded gate on pkt-yield collapse + coherence loss, anomaly > motion, motion → SENSE_ACTIVE, aggressive cadence, stable presence → RESP_HIGH_SENS, empty-room default, hysteresis, NULL safety) andrv_feature_state_*helpers (size assertion, IEEE CRC32 known vectors, determinism, receiver-side verification). 33/33 assertions pass. Benchmarks: decide() 3.2 ns/call, CRC32(56 B) 614 ns/pkt (87 MB/s), full finalize() 616 ns/call. Pure functionadaptive_controller_decide()extracted toadaptive_controller_decide.cso the firmware build and the host tests share a single source-of-truth implementation. - Scripts:
validate_qemu_output.pyADR-081 checks — Validator (invoked by ADR-061scripts/qemu-esp32s3-test.shin CI) gains three checks for adaptive controller boot line, mock radio ops registration, and slow-loop heartbeat, so QEMU runs regression-gate Layer 1/2 presence. - Firmware: ADR-081 Layer 3 mesh sensing plane — New
firmware/esp32-csi-node/main/rv_mesh.{h,c}defines 4 node roles (Anchor / Observer / Fusion relay / Coordinator), 7 on-wire message types (TIME_SYNC, ROLE_ASSIGN, CHANNEL_PLAN, CALIBRATION_START, FEATURE_DELTA, HEALTH, ANOMALY_ALERT), 3 authorization classes (None / HMAC-SHA256-session / Ed25519-batch),rv_node_status_t(28 B),rv_anomaly_alert_t(28 B),rv_time_sync_t,rv_role_assign_t,rv_channel_plan_t,rv_calibration_start_t. Pure-C encoder/decoder (rv_mesh_encode()/rv_mesh_decode()) with 16-byte envelope + payload + IEEE CRC32 trailer; convenience encoders for each message type. Controller now emitsHEALTHevery slow-loop tick (30 s default) andANOMALY_ALERTon state transitions to ALERT or DEGRADED. Host tests:test_rv_meshexercises 27 assertions covering roundtrip, bad magic, truncation, CRC flipping, oversize payload rejection, and encode+decode throughput (1.0 μs/roundtrip on host). - Rust: ADR-081 Layer 1/3 mirror module — New
crates/wifi-densepose-hardware/src/radio_ops.rsmirrors the firmware-siderv_radio_ops_tvtable as the RustRadioOpstrait (init, set_channel, set_mode, set_csi_enabled, set_capture_profile, get_health) and providesMockRadiofor offline testing. Also mirrors therv_mesh.htypes (MeshHeader,NodeStatus,AnomalyAlert,MeshRole,MeshMsgType,AuthClass) and ships byte-identicalcrc32_ieee(),decode_mesh(),decode_node_status(),decode_anomaly_alert(), andencode_health(). Exported fromlib.rs. 8 unit tests pass;crc32_matches_firmware_vectorsverifies parity with the firmware-side test vectors (0xCBF43926for"123456789",0xD202EF8Dfor single-byte zero), andmesh_constants_match_firmwareassertsMESH_MAGIC,MESH_VERSION,MESH_HEADER_SIZE, andMESH_MAX_PAYLOADmatchrv_mesh.hbyte-for-byte. Satisfies ADR-081's portability acceptance test: signal/ruvector/train/mat crates are untouched. - Firmware: adaptive controller — New
firmware/esp32-csi-node/main/adaptive_controller.{c,h}implements the three-loop closed-loop control specified by ADR-081: fast (~200 ms) for cadence and active probing, medium (~1 s) for channel selection and role transitions, slow (~30 s) for baseline recalibration. Pureadaptive_controller_decide()policy function is exposed in the header for offline unit testing. Default policy is conservative (enable_channel_switchandenable_role_changeoff); Kconfig surface added under "Adaptive Controller (ADR-081)".
Fixed
- Firmware: SPI flash cache crash under high CSI callback pressure (RuView#396, #397) — ESP32-S3 nodes crashed in
cache_ll_l1_resume_icache/wDev_ProcessFiqafter ~2400 callbacks when the promiscuous filter admitted DATA frames at 100–500 Hz. Fixed by narrowing the filter mask toWIFI_PROMIS_FILTER_MASK_MGMT(~10 Hz beacons), adding a 50 Hz early callback rate gate (CSI_MIN_PROCESS_INTERVAL_US) that drops excess callbacks before any processing work, and enablingCONFIG_ESP_WIFI_EXTRA_IRAM_OPT=yas defense-in-depth. Stability validated with a 4-min-per-node soak. - Firmware:
filter_mac/node_idclobber by WiFi driver init (#232, #375, #385, #386, #390, #397) —g_nvs_configcan be corrupted duringwifi_init_sta()on some devices (confirmed on80:b5:4e:c1:be:b8), revertingnode_idto the Kconfig default and producing garbage MAC-filter reads in the CSI callback (100–500 Hz). Newcsi_collector_set_node_id()API called fromapp_main()beforewifi_init_sta()captures both fields into module-local statics (s_node_id,s_filter_mac,s_filter_mac_set).csi_collector_init()now runs a canary that distinguishes "early≠g_nvs_config" (corruption confirmed) from a no-op match. All CSI runtime paths use the defensive copies exclusively. - Firmware:
edge_processingsample rate mismatch (#397) —estimate_bpm_zero_crossing()was called with a hard-codedsample_rate = 20.0f, but MGMT-only promiscuous delivers ~10 Hz. Breathing and heart-rate reports were 2× too high. Corrected to10.0fwith an explicit comment tying it to the callback rate. provision.pyesptool command form (#391, #397) — ESP-IDF v5.4 bundlesesptool 4.10.0, which only acceptswrite_flash(underscore). Standalonepip install esptoolv5.x accepts both forms but preferswrite-flash. #391 switched towrite-flashwhich broke the documented ESP-IDF Python venv flow; #397 reverts towrite_flash(works with both esptool 4.x and 5.x) with an inline comment warning future maintainers not to "re-fix" it.provision.pyesptool v5 dry-run hint (#391) — Stalewrite_flash(underscore) syntax in the dry-run manual-flash hint now useswrite-flash(hyphenated) for esptool >= 5.x. The primary flash command was already correct.provision.pysilent NVS wipe (#391) — The script replaces the entirecsi_cfgNVS namespace on every run, so partial invocations were silently erasing WiFi credentials and causingRetrying WiFi connection (10/10)in the field. Now refuses to run without--ssid,--password, and--target-ipunless--force-partialis passed.--force-partialprints a warning listing which keys will be wiped.- Firmware: defensive
node_idcapture (#232, #375, #385, #386, #390) — Users on multi-node deployments reportednode_idreverting to the Kconfig default (1) in UDP frames and in thecsi_collectorinit log, despite NVS loading the correct value. The root cause (memory corruption ofg_nvs_config) has not been definitively isolated, but the UDP frame header is now tamper-proof:csi_collector_init()capturesg_nvs_config.node_idinto a module-locals_node_idonce, andcsi_serialize_frame()plus all other consumers (edge_processing.c,wasm_runtime.c,display_ui.c,swarm_bridge_init) read it via the newcsi_collector_get_node_id()accessor. A canary logsWARNifg_nvs_config.node_iddiverges froms_node_idat end-of-init, helping isolate the upstream corruption path. Validated on attached ESP32-S3 (COM8): NVSnode_id=2propagates through boot log, capture log, init log, and byte[4] of every UDP frame.
Docs
- CHANGELOG catch-up (#367) — Added missing entries for v0.5.5, v0.6.0, and v0.7.0 releases.
[v0.7.0] — 2026-04-06
Model release (no new firmware binary). Firmware remains at v0.6.0-esp32.
Added
- Camera ground-truth training pipeline (ADR-079) — End-to-end supervised WiFlow pose training using MediaPipe + real ESP32 CSI.
scripts/collect-ground-truth.py— MediaPipe PoseLandmarker webcam capture (17 COCO keypoints, 30fps), synchronized with CSI recording over nanosecond timestamps.scripts/align-ground-truth.js— Time-aligns camera keypoints with 20-frame CSI windows by binary search, confidence-weighted averaging.scripts/train-wiflow-supervised.js— 3-phase curriculum training (contrastive → supervised SmoothL1 → bone/temporal refinement) with 4 scale presets (lite/small/medium/full).scripts/eval-wiflow.js— PCK@10/20/50, MPJPE, per-joint breakdown, baseline proxy mode.scripts/record-csi-udp.py— Lightweight ESP32 CSI UDP recorder (no Rust build required).
- ruvector optimizations (O6-O10) — Subcarrier selection (70→35, 50% reduction), attention-weighted subcarriers, Stoer-Wagner min-cut person separation, multi-SPSA gradient estimation, Mac M4 Pro training via Tailscale.
- Scalable WiFlow presets —
lite(189K params, ~19 min) throughfull(7.7M params, ~8 hrs) to match dataset size. - Pre-trained WiFlow v1 model — 92.9% PCK@20, 974 KB, 186,946 params. Published to HuggingFace under
wiflow-v1/.
Validated
- 92.9% PCK@20 pose accuracy from a 5-minute data collection session with one $9 ESP32-S3 and one laptop webcam.
- Training pipeline validated on real paired data: 345 samples, 19 min training, eval loss 0.082, bone constraint 0.008.
[v0.6.0-esp32] — 2026-04-03
Added
- Pre-trained CSI sensing weights published — First official pre-trained models on HuggingFace.
model.safetensors(48 KB),model-q4.bin(8 KB 4-bit),model-q2.bin(4 KB),presence-head.json, per-node LoRA adapters. - 17 sensing applications — Sleep monitor, apnea detector, stress monitor, gait analyzer, RF tomography, passive radar, material classifier, through-wall detector, device fingerprint, and more. Each as a standalone
scripts/*.js. - ADRs 069-078 — 10 new architecture decisions covering Cognitum Seed integration, self-supervised pretraining, ruvllm pipeline, WiFlow architecture, channel hopping, SNN, MinCut person separation, CNN spectrograms, novel RF applications, multi-frequency mesh.
- Kalman tracker (PR #341 by @taylorjdawson) — temporal smoothing of pose keypoints.
Fixed
- Security fix merged via PR #310.
Performance
- Presence detection: 100% accuracy on 60,630 overnight samples.
- Inference: 0.008 ms per sample, 164K embeddings/sec.
- Contrastive self-supervised training: 51.6% improvement over baseline.
[v0.5.5-esp32] — 2026-04-03
Added
- WiFlow SOTA architecture (ADR-072) — TCN + axial attention pose decoder, 1.8M params, 881 KB at 4-bit. 17 COCO keypoints from CSI amplitude only (no phase).
- Multi-frequency mesh scanning (ADR-073) — ESP32 nodes hop across channels 1/3/5/6/9/11 at 200ms dwell. Neighbor WiFi networks used as passive radar illuminators. Null subcarriers reduced from 19% to 16%.
- Spiking neural network (ADR-074) — STDP online learning, adapts to new rooms in <30s with no labels, 16-160x less compute than batch training.
- MinCut person counting (ADR-075) — Stoer-Wagner min-cut on subcarrier correlation graph. Fixes #348 (was always reporting 4 people).
- CNN spectrogram embeddings (ADR-076) — Treat 64×20 CSI as an image, produce 128-dim environment fingerprints (0.95+ same-room similarity).
- Graph transformer fusion — Multi-node CSI fusion via GATv2 attention (replaces naive averaging).
- Camera-free pose training pipeline — Trains 17-keypoint model from 10 sensor signals with no camera required.
Fixed
- #348 person counting — MinCut correctly counts 1-4 people (24/24 validation windows).
[v0.5.4-esp32] — 2026-04-02
Added
- ADR-069: ESP32 CSI → Cognitum Seed RVF ingest pipeline — Live-validated pipeline connecting ESP32-S3 CSI sensing to Cognitum Seed (Pi Zero 2 W) edge intelligence appliance. 339 vectors ingested, 100% kNN validation, SHA-256 witness chain verified.
- Feature vector packet (magic 0xC5110003) — New 48-byte packet with 8 normalized dimensions (presence, motion, breathing, heart rate, phase variance, person count, fall, RSSI) sent at 1 Hz alongside vitals.
scripts/seed_csi_bridge.py— Python bridge: UDP listener → HTTPS ingest with bearer token auth,--validate(kNN + PIR ground truth),--stats,--compactmodes, hash-based vector IDs, NaN/inf rejection, source IP filtering, retry logic.- Arena Physica research — 26 research documents in
docs/research/covering Maxwell's equations in WiFi sensing, Arena Physica Studio analysis, SOTA WiFi sensing 2025-2026, GOAP implementation plan for ESP32 + Pi Zero. - Cognitum Seed MCP integration — 114-tool MCP proxy enables AI assistants to query sensing state, vectors, witness chain, and device status directly.
Fixed
- Compressed frame magic collision — Reassigned compressed frame magic from
0xC5110003to0xC5110005to free0xC5110003for feature vectors. - Uninitialized
s_top_k[0]read — Guarded variance computation againsts_top_k_count == 0insend_feature_vector(). - Presence score normalization — Bridge now divides by 15.0 instead of clamping, preserving dynamic range for raw values 1.41-14.92.
- Stale magic references — Updated ADR-039, DDD model to reflect
0xC5110005for compressed frames.
Security
- Credential exposure remediation — Removed hardcoded WiFi passwords and bearer tokens from source files. Added NVS binary/CSV patterns to
.gitignore. Environment variable fallback for bearer token. - NaN/Inf injection prevention — Bridge validates all feature dimensions are finite before Seed ingest.
- UDP source filtering —
--allowed-sourcesargument restricts packet acceptance to known ESP32 IPs.
Changed
- Wire format table now includes 6 magic numbers:
0xC5110001(raw),0xC5110002(vitals),0xC5110003(features),0xC5110004(WASM events),0xC5110005(compressed),0xC5110006(fused vitals).
[v0.5.3-esp32] — 2026-03-30
Added
- Cross-node RSSI-weighted feature fusion — Multiple ESP32 nodes fuse CSI features using RSSI-based weighting. Closer node gets higher weight. Reduces variance noise by 29%, keypoint jitter by 72%.
- DynamicMinCut person separation — Uses
ruvector_mincut::DynamicMinCuton the subcarrier temporal correlation graph to detect independent motion clusters. Replaces variance-based heuristic for multi-person counting. - RSSI-based position tracking — Skeleton position driven by RSSI differential between nodes. Walk between ESP32s and the skeleton follows you.
- Per-node state pipeline (ADR-068) — Each ESP32 node gets independent
HashMap<u8, NodeState>with frame history, classification, vitals, and person count. Fixes #249 (the #1 user-reported issue). - RuVector Phase 1-3 integration — Subcarrier importance weighting, temporal keypoint smoothing (EMA), coherence gating, skeleton kinematic constraints (Jakobsen relaxation), compressed pose history.
- Client-side lerp smoothing — UI keypoints interpolate between frames (alpha=0.15) for fluid skeleton movement.
- Multi-node mesh tests — 8 integration tests covering 1-255 node configurations.
wifi_denseposePython package —from wifi_densepose import WiFiDensePosenow works (#314).
Fixed
- Watchdog crash on busy LANs (#321) — Batch-limited edge_dsp to 4 frames before 20ms yield. Fixed idle-path busy-spin (
pdMS_TO_TICKS(5)==0). - No detection from edge vitals (#323) — Server now generates
sensing_updatefrom Tier 2+ vitals packets. - RSSI byte offset mismatch (#332) — Server parsed RSSI from wrong byte (was reading sequence counter).
- Stack overflow risk — Moved 4KB of BPM scratch buffers from stack to static storage.
- Stale node memory leak —
node_statesHashMap evicts nodes inactive >60s. - Unsafe raw pointer removed — Replaced with safe
.clone()for adaptive model borrow. - Firmware CI — Upgraded to IDF v5.4, replaced
xxdwithod(#327). - Person count double-counting — Multi-node aggregation changed from
sumtomax. - Skeleton jitter — Removed tick-based noise, dampened procedural animation, recalibrated feature scaling for real ESP32 data.
Changed
- Motion-responsive skeleton: arm swing (0-80px) driven by CSI variance, leg kick (0-50px) by motion_band_power, vertical bob when walking.
- Person count thresholds recalibrated for real ESP32 hardware (1→2 at 0.70, EMA alpha 0.04).
- Vital sign filtering: larger median window (31), faster EMA (0.05), looser HR jump filter (15 BPM).
- Vendored ruvector updated to v2.1.0-40 (316 commits ahead).
Benchmarks (2-node mesh, COM6 + COM9, 30s)
| Metric | Baseline | v0.5.3 | Improvement |
|---|---|---|---|
| Variance noise | 109.4 | 77.6 | -29% |
| Feature stability | std=154.1 | std=105.4 | -32% |
| Keypoint jitter | std=4.5px | std=1.3px | -72% |
| Confidence | 0.643 | 0.686 | +7% |
| Presence accuracy | 93.4% | 94.6% | +1.3pp |
Verified
- Real hardware: COM6 (node 1) + COM9 (node 2) on ruv.net WiFi
- All 284 Rust tests pass, 352 signal crate tests pass
- Firmware builds clean at 843 KB
- QEMU CI: 11/11 jobs green
[v0.5.2-esp32] — 2026-03-28
Fixed
- RSSI byte offset in frame parser (#332)
- Per-node state pipeline for multi-node sensing (#249)
- Firmware CI upgraded to IDF v5.4 (#327)
[v0.5.1-esp32] — 2026-03-27
Fixed
- Watchdog crash on busy LANs (#321)
- No detection from edge vitals (#323)
wifi_denseposePython package import (#314)- Pre-compiled firmware binaries added to release
[v0.5.0-esp32] — 2026-03-15
Added
- 60 GHz mmWave sensor fusion (ADR-063) — Auto-detects Seeed MR60BHA2 (60 GHz, HR/BR/presence) and HLK-LD2410 (24 GHz, presence/distance) on UART at boot. Probes 115200 then 256000 baud, registers device capabilities, starts background parser.
- 48-byte fused vitals packet (magic
0xC5110004) — Kalman-style fusion: mmWave 80% + CSI 20% when both available. Automatic fallback to standard 32-byte CSI-only packet. - Server-side fusion bridge (
scripts/mmwave_fusion_bridge.py) — Reads two serial ports simultaneously for dual-sensor setups where mmWave runs on a separate ESP32. - Multimodal ambient intelligence roadmap (ADR-064) — 25+ applications from fall detection to sleep monitoring to RF tomography.
Verified
- Real hardware: ESP32-S3 (COM7) WiFi CSI + ESP32-C6/MR60BHA2 (COM4) 60 GHz mmWave running concurrently. HR=75 bpm, BR=25/min at 52 cm range. All 11 QEMU CI jobs green.
[v0.4.3-esp32] — 2026-03-15
Fixed
- Fall detection false positives (#263) — Default threshold raised from 2.0 to 15.0 rad/s²; normal walking (2-5 rad/s²) no longer triggers alerts. Added 3-consecutive-frame debounce and 5-second cooldown between alerts. Verified on real ESP32-S3 hardware: 0 false alerts in 60s / 1,300+ live WiFi CSI frames.
- Kconfig default mismatch —
CONFIG_EDGE_FALL_THRESHKconfig default was still 2000 (=2.0) whilenvs_config.cfallback was updated to 15.0. Fixed Kconfig to 15000. Caught by real hardware testing — mock data did not reproduce. - provision.py NVS generator API change —
esp_idf_nvs_partition_genpackage changed itsgenerate()signature; switched to subprocess-first invocation for cross-version compatibility. - QEMU CI pipeline (11 jobs) — Fixed all failures: fuzz test
esp_timerstubs, QEMUlibgcryptdependency, NVS matrix generator, IDF containerpippath, flash image padding, validation WARN handling, swarmip/cargomissing.
Added
- 4MB flash support (#265) —
partitions_4mb.csvandsdkconfig.defaults.4mbfor ESP32-S3 boards with 4MB flash (e.g. SuperMini). Dual OTA slots, 1.856 MB each. Thanks to @sebbu for the community workaround that confirmed feasibility. --strictflag forvalidate_qemu_output.py— WARNs now pass by default in CI (no real WiFi in QEMU); use--strictto fail on warnings.
Unreleased
Added
- QEMU ESP32-S3 testing platform (ADR-061) — 9-layer firmware testing without hardware
- Mock CSI generator with 10 physics-based scenarios (empty room, walking, fall, multi-person, etc.)
- Single-node QEMU runner with 16-check UART validation
- Multi-node TDM mesh simulation (TAP networking, 2-6 nodes)
- GDB remote debugging with VS Code integration
- Code coverage via gcov/lcov + apptrace
- Fuzz testing (3 libFuzzer targets + ASAN/UBSAN)
- NVS provisioning matrix (14 configs)
- Snapshot-based regression testing (sub-second VM restore)
- Chaos testing with fault injection + health monitoring
- QEMU Swarm Configurator (ADR-062) — YAML-driven multi-ESP32 test orchestration
- 4 topologies: star, mesh, line, ring
- 3 node roles: sensor, coordinator, gateway
- 9 swarm-level assertions (boot, crashes, TDM, frame rate, fall detection, etc.)
- 7 presets: smoke (2n/15s), standard (3n/60s), ci-matrix, large-mesh, line-relay, ring-fault, heterogeneous
- Health oracle with cross-node validation
- QEMU installer (
install-qemu.sh) — auto-detects OS, installs deps, builds Espressif QEMU fork - Unified QEMU CLI (
qemu-cli.sh) — single entry point for all 11 QEMU test commands - CI:
firmware-qemu.ymlworkflow with QEMU test matrix, fuzz testing, NVS validation, and swarm test jobs - User guide: QEMU testing and swarm configurator section with plain-language walkthrough
Fixed
-
Firmware now boots in QEMU: WiFi/UDP/OTA/display guards for mock CSI mode
-
9 bugs in mock_csi.c (LFSR bias, MAC filter init, scenario loop, overflow burst timing)
-
23 bugs from ADR-061 deep review (inject_fault.py writes, CI cache, snapshot log corruption, etc.)
-
16 bugs from ADR-062 deep review (log filename mismatch, SLIRP port collision, heap false positives, etc.)
-
All scripts:
--helpflags, prerequisite checks with install hints, standardized exit codes -
Sensing server UI API completion (ADR-043) — 14 fully-functional REST endpoints for model management, CSI recording, and training control
- Model CRUD:
GET /api/v1/models,GET /api/v1/models/active,POST /api/v1/models/load,POST /api/v1/models/unload,DELETE /api/v1/models/:id,GET /api/v1/models/lora/profiles,POST /api/v1/models/lora/activate - CSI recording:
GET /api/v1/recording/list,POST /api/v1/recording/start,POST /api/v1/recording/stop,DELETE /api/v1/recording/:id - Training control:
GET /api/v1/train/status,POST /api/v1/train/start,POST /api/v1/train/stop - Recording writes CSI frames to
.jsonlfiles via tokio background task - Model/recording directories scanned at startup, state managed via
Arc<RwLock<AppStateInner>>
- Model CRUD:
-
ADR-044: Provisioning tool enhancements — 5-phase plan for complete NVS coverage (7 missing keys), JSON config files, mesh presets, read-back/verify, and auto-detect
-
25 real mobile tests replacing
it.todo()placeholders — 205 assertions covering components, services, stores, hooks, screens, and utils -
Project MERIDIAN (ADR-027) — Cross-environment domain generalization for WiFi pose estimation (1,858 lines, 72 tests)
HardwareNormalizer— Catmull-Rom cubic interpolation resamples any hardware CSI to canonical 56 subcarriers; z-score + phase sanitizationDomainFactorizer+GradientReversalLayer— adversarial disentanglement of pose-relevant vs environment-specific featuresGeometryEncoder+FilmLayer— Fourier positional encoding + DeepSets + FiLM for zero-shot deployment given AP positionsVirtualDomainAugmentor— synthetic environment diversity (room scale, wall material, scatterers, noise) for 4x training augmentationRapidAdaptation— 10-second unsupervised calibration via contrastive test-time training + LoRA adaptersCrossDomainEvaluator— 6-metric evaluation protocol (MPJPE in-domain/cross-domain/few-shot/cross-hardware, domain gap ratio, adaptation speedup)
-
ADR-027: Cross-Environment Domain Generalization — 10 SOTA citations (PerceptAlign, X-Fi ICLR 2025, AM-FM, DGSense, CVPR 2024)
-
Cross-platform RSSI adapters — macOS CoreWLAN (
MacosCoreWlanScanner) and Linuxiw(LinuxIwScanner) Rust adapters with#[cfg(target_os)]gating -
macOS CoreWLAN Python sensing adapter with Swift helper (
mac_wifi.swift) -
macOS synthetic BSSID generation (FNV-1a hash) for Sonoma 14.4+ BSSID redaction
-
Linux
iw dev <iface> scanparser with freq-to-channel conversion andscan dump(no-root) mode -
ADR-025: macOS CoreWLAN WiFi Sensing (ORCA)
Fixed
- sendto ENOMEM crash (Issue #127) — CSI callbacks in promiscuous mode exhaust lwIP pbuf pool causing guru meditation crash. Fixed with 50 Hz rate limiter in
csi_collector.cand 100 ms ENOMEM backoff instream_sender.c. Hardware-verified on ESP32-S3 (200+ callbacks, zero crashes) - Provisioning script missing TDM/edge flags (Issue #130) — Added
--tdm-slot,--tdm-total,--edge-tier,--pres-thresh,--fall-thresh,--vital-win,--vital-int,--subk-counttoprovision.py - WebSocket "RECONNECTING" on Dashboard/Live Demo —
sensingService.start()now called on app init inapp.jsso WebSocket connects immediately instead of waiting for Sensing tab visit - Mobile WebSocket port —
ws.service.tsbuildWsUrl()uses same-origin port instead of hardcoded port 3001 - Mobile Jest config —
testPathIgnorePatternsno longer silently ignores the entire test directory - Removed synthetic byte counters from Python
MacosWifiCollector— now reportstx_bytes=0, rx_bytes=0instead of fake incrementing values
3.0.0 - 2026-03-01
Major release: AETHER contrastive embedding model, Docker Hub images, and comprehensive UI overhaul.
Added — AETHER Contrastive Embedding Model (ADR-024)
- Project AETHER — self-supervised contrastive learning for WiFi CSI fingerprinting, similarity search, and anomaly detection (
9bbe956) embedding.rsmodule:ProjectionHead,InfoNceLoss,CsiAugmenter,FingerprintIndex,PoseEncoder,EmbeddingExtractor(909 lines, zero external ML dependencies)- SimCLR-style pretraining with 5 physically-motivated augmentations (temporal jitter, subcarrier masking, Gaussian noise, phase rotation, amplitude scaling)
- CLI flags:
--pretrain,--pretrain-epochs,--embed,--build-index <type> - Four HNSW-compatible fingerprint index types:
env_fingerprint,activity_pattern,temporal_baseline,person_track - Cross-modal
PoseEncoderfor WiFi-to-camera embedding alignment - VICReg regularization for embedding collapse prevention
- 53K total parameters (55 KB at INT8) — fits on ESP32
Added — Docker & Deployment
- Published Docker Hub images:
ruvnet/wifi-densepose:latest(132 MB Rust) andruvnet/wifi-densepose:python(569 MB) (add9f19) - Multi-stage Dockerfile for Rust sensing server with RuVector crates
docker-compose.ymlorchestrating both Rust and Python services- RVF model export via
--export-rvfand load via--load-rvfCLI flags
Added — Documentation
- 33 use cases across 4 vertical tiers: Everyday, Specialized, Robotics & Industrial, Extreme (
0afd9c5) - "Why WiFi Wins" comparison table (WiFi vs camera vs LIDAR vs wearable vs PIR)
- Mermaid architecture diagrams: end-to-end pipeline, signal processing detail, deployment topology (
50f0fc9) - Models & Training section with RuVector crate links (GitHub + crates.io), SONA component table (
965a1cc) - RVF container section with deployment targets table (ESP32 0.7 MB to server 50+ MB)
- Collapsible README sections for improved navigation (
478d964,99ec980,0ebd6be) - Installation and Quick Start moved above Table of Contents (
50acbf7) - CSI hardware requirement notice (
528b394)
Fixed
- UI auto-detects server port from page origin — no more hardcoded
localhost:8080; works on any port (Docker :3000, native :8080, custom) (3b72f35, closes #55) - Docker port mismatch — server now binds 3000/3001 inside container as documented (
44b9c30) - Added
/ws/sensingWebSocket route to the HTTP server so UI only needs one port - Fixed README API endpoint references:
/api/v1/health→/health,/api/v1/sensing→/api/v1/sensing/latest - Multi-person tracking limit corrected: configurable default 10, no hard software cap (
e2ce250)
2.0.0 - 2026-02-28
Major release: complete Rust sensing server, full DensePose training pipeline, RuVector v2.0.4 integration, ESP32-S3 firmware, and 6 security hardening patches.
Added — Rust Sensing Server
- Full DensePose-compatible REST API served by Axum (
d956c30)GET /health— server healthGET /api/v1/sensing/latest— live CSI sensing dataGET /api/v1/vital-signs— breathing rate (6-30 BPM) and heartbeat (40-120 BPM)GET /api/v1/pose/current— 17 COCO keypoints derived from WiFi signal fieldGET /api/v1/info— server build and feature infoGET /api/v1/model/info— RVF model container metadataws://host/ws/sensing— real-time WebSocket stream
- Three data sources:
--source esp32(UDP CSI),--source windows(netsh RSSI),--source simulated(deterministic reference) - Auto-detection: server probes ESP32 UDP and Windows WiFi, falls back to simulated
- Three.js visualization UI with 3D body skeleton, signal heatmap, phase plot, Doppler bars, vital signs panel
- Static UI serving via
--ui-pathflag - Throughput: 9,520–11,665 frames/sec (release build)
Added — ADR-021: Vital Sign Detection
VitalSignDetectorwith breathing (6-30 BPM) and heartbeat (40-120 BPM) extraction from CSI fluctuations (1192de9)- FFT-based spectral analysis with configurable band-pass filters
- Confidence scoring based on spectral peak prominence
- REST endpoint
/api/v1/vital-signswith real-time JSON output
Added — ADR-023: DensePose Training Pipeline (Phases 1-8)
wifi-densepose-traincrate with complete 8-phase pipeline (fc409df,ec98e40,fce1271)- Phase 1:
DataPipelinewith MM-Fi and Wi-Pose dataset loaders - Phase 2:
CsiToPoseTransformer— 4-head cross-attention + 2-layer GCN on COCO skeleton - Phase 3: 6-term composite loss (MSE, bone length, symmetry, joint angle, temporal, confidence)
- Phase 4:
DynamicPersonMatchervia ruvector-mincut (O(n^1.5 log n) Hungarian assignment) - Phase 5:
SonaAdapter— MicroLoRA rank-4 with EWC++ memory preservation - Phase 6:
SparseInference— progressive 3-layer model loading (A: essential, B: refinement, C: full) - Phase 7:
RvfContainer— single-file model packaging with segment-based binary format - Phase 8: End-to-end training with cosine-annealing LR, early stopping, checkpoint saving
- Phase 1:
- CLI:
--train,--dataset,--epochs,--save-rvf,--load-rvf,--export-rvf - Benchmark: ~11,665 fps inference, 229 tests passing
Added — ADR-016: RuVector Training Integration (all 5 crates)
ruvector-mincut→DynamicPersonMatcherinmetrics.rs+ subcarrier selection (81ad09d,a7dd31c)ruvector-attn-mincut→ antenna attention inmodel.rs+ noise-gated spectrogramruvector-temporal-tensor→CompressedCsiBufferindataset.rs+ compressed breathing/heartbeatruvector-solver→ sparse subcarrier interpolation (114→56) + Fresnel triangulationruvector-attention→ spatial attention inmodel.rs+ attention-weighted BVP- Vendored all 11 RuVector crates under
vendor/ruvector/(d803bfe)
Added — ADR-017: RuVector Signal & MAT Integration (7 integration points)
gate_spectrogram()— attention-gated noise suppression (18170d7)attention_weighted_bvp()— sensitivity-weighted velocity profilesmincut_subcarrier_partition()— dynamic sensitive/insensitive subcarrier splitsolve_fresnel_geometry()— TX-body-RX distance estimationCompressedBreathingBuffer+CompressedHeartbeatSpectrogramBreathingDetector+HeartbeatDetector(MAT crate, real FFT + micro-Doppler)- Feature-gated behind
cfg(feature = "ruvector")(ab2453e)
Added — ADR-018: ESP32-S3 Firmware & Live CSI Pipeline
- ESP32-S3 firmware with FreeRTOS CSI extraction (
92a5182) - ADR-018 binary frame format:
[0xAD, 0x18, len_hi, len_lo, payload] - Rust
Esp32Aggregatorreceiving UDP frames on port 5005 bridge.rsconverting I/Q pairs to amplitude/phase vectors- NVS provisioning for WiFi credentials
- Pre-built binary quick start documentation (
696a726)
Added — ADR-014: SOTA Signal Processing
- 6 algorithms, 83 tests (
fcb93cc)- Hampel filter (median + MAD, resistant to 50% contamination)
- Conjugate multiplication (reference-antenna ratio, cancels common-mode noise)
- Phase sanitization (unwrap + linear detrend, removes CFO/SFO)
- Fresnel zone geometry (TX-body-RX distance from first-principles physics)
- Body Velocity Profile (micro-Doppler extraction, 5.7x speedup)
- Attention-gated spectrogram (learned noise suppression)
Added — ADR-015: Public Dataset Training Strategy
- MM-Fi and Wi-Pose dataset specifications with download links (
4babb32,5dc2f66) - Verified dataset dimensions, sampling rates, and annotation formats
- Cross-dataset evaluation protocol
Added — WiFi-Mat Disaster Detection Module
- Multi-AP triangulation for through-wall survivor detection (
a17b630,6b20ff0) - Triage classification (breathing, heartbeat, motion)
- Domain events:
survivor_detected,survivor_updated,alert_created - WebSocket broadcast at
/ws/mat/stream
Added — Infrastructure
- Guided 7-step interactive installer with 8 hardware profiles (
8583f3e) - Comprehensive build guide for Linux, macOS, Windows, Docker, ESP32 (
45f8a0d) - 12 Architecture Decision Records (ADR-001 through ADR-012) (
337dd96)
Added — UI & Visualization
- Sensing-only UI mode with Gaussian splat visualization (
b7e0f07) - Three.js 3D body model (17 joints, 16 limbs) with signal-viz components
- Tabs: Dashboard, Hardware, Live Demo, Sensing, Architecture, Performance, Applications
- WebSocket client with automatic reconnection and exponential backoff
Added — Rust Signal Processing Crate
- Complete Rust port of WiFi-DensePose with modular workspace (
6ed69a3)wifi-densepose-signal— CSI processing, phase sanitization, feature extractionwifi-densepose-core— shared types and configurationwifi-densepose-nn— neural network inference (DensePose head, RCNN)wifi-densepose-hardware— ESP32 aggregator, hardware interfaceswifi-densepose-config— configuration management
- Comprehensive benchmarks and validation tests (
3ccb301)
Added — Python Sensing Pipeline
WindowsWifiCollector— RSSI collection vianetsh wlan show networksRssiFeatureExtractor— variance, spectral bands (motion 0.5-4 Hz, breathing 0.1-0.5 Hz), change pointsPresenceClassifier— rule-based 3-state classification (ABSENT / PRESENT_STILL / ACTIVE)- Cross-receiver agreement scoring for multi-AP confidence boosting
- WebSocket sensing server (
ws_server.py) broadcasting JSON at 2 Hz - Deterministic CSI proof bundles for reproducible verification (
archive/v1/data/proof/) - Commodity sensing unit tests (
b391638)
Changed
- Rust hardware adapters now return explicit errors instead of silent empty data (
6e0e539)
Fixed
- Review fixes for end-to-end training pipeline (
45f0304) - Dockerfile paths updated from
src/toarchive/v1/src/(7872987) - IoT profile installer instructions updated for aggregator CLI (
f460097) process.envreference removed from browser ES module (e320bc9)
Performance
- 5.7x Doppler extraction speedup via optimized FFT windowing (
32c75c8) - Single 2.1 MB static binary, zero Python dependencies for Rust server
Security
- Fix SQL injection in status command and migrations (
f9d125d) - Fix XSS vulnerabilities in UI components (
5db55fd) - Fix command injection in statusline.cjs (
4cb01fd) - Fix path traversal vulnerabilities (
896c4fc) - Fix insecure WebSocket connections — enforce wss:// on non-localhost (
ac094d4) - Fix GitHub Actions shell injection (
ab2e7b4) - Fix 10 additional vulnerabilities, remove 12 dead code instances (
7afdad0)
1.1.0 - 2025-06-07
Added
- Complete Python WiFi-DensePose system with CSI data extraction and router interface
- CSI processing and phase sanitization modules
- Batch processing for CSI data in
CSIProcessorandPhaseSanitizer - Hardware, pose, and stream services for WiFi-DensePose API
- Comprehensive CSS styles for UI components and dark mode support
- API and Deployment documentation
Fixed
- Badge links for PyPI and Docker in README
- Async engine creation poolclass specification
1.0.0 - 2024-12-01
Added
- Initial release of WiFi-DensePose
- Real-time WiFi-based human pose estimation using Channel State Information (CSI)
- DensePose neural network integration for body surface mapping
- RESTful API with comprehensive endpoint coverage
- WebSocket streaming for real-time pose data
- Multi-person tracking with configurable capacity (default 10, up to 50+)
- Fall detection and activity recognition
- Domain configurations: healthcare, fitness, smart home, security
- CLI interface for server management and configuration
- Hardware abstraction layer for multiple WiFi chipsets
- Phase sanitization and signal processing pipeline
- Authentication and rate limiting
- Background task management
- Cross-platform support (Linux, macOS, Windows)
Documentation
- User guide and API reference
- Deployment and troubleshooting guides
- Hardware setup and calibration instructions
- Performance benchmarks
- Contributing guidelines