History

ruv 60d2c8eb82 feat(examples/three.js): cinematic skinned realtime pose demo + ESP32 CSI bridge Five-stage example progression exploring three.js helpers (ADR-097 surface) as a viewer for live RuView sensor data: 1. helpers-demo.html — clean ADR-097 helper reference (GridHelper, PolarGridHelper, BoxHelper, AxesHelper), file://-safe, no backend 2. helpers-cinematic.html — same scene + UnrealBloomPass + pseudo-CSI sonar pings + tomography sweep + procedural cyber floor + ambient drift particles 3. helpers-skinned.html — replaces sphere skeleton with Mixamo X Bot via GLTFLoader from threejs.org CDN, plays bundled animations with additive blending 4. helpers-skinned-fbx.html — same but loads a local Mixamo FBX (needs serve-demo.py — file:// can't fetch local siblings). Drop X Bot.fbx alongside. 5. helpers-skinned-realtime.html — webcam → MediaPipe Pose Heavy → poseWorldLandmarks → direct quaternion retargeting onto the Mixamo skeleton. Real ESP32-S3 CSI streamed over WebSocket from ruvultra (Tailscale, port 8766). Supporting: - serve-demo.py threaded HTTP server with no-cache headers (fixes net::ERR_EMPTY_RESPONSE on the FBX path) - ruvultra-csi-bridge.py ESP32 RuView firmware tick → WebSocket bridge, runs as systemd-run unit on ruvultra Bugs found + fixed along the way (all documented in code comments): - FBX exports yield TWO parallel Bone trees with identical names; only the SkinnedMesh.skeleton.bones one drives visible deformation. model.traverse finds orphans. - Mixamo FBX nests a zero-length wrapper bone above the real bone, same name. bone.children[0].getWorldPosition == bone.getWorldPosition → restDir is (0,0,0) → setFromUnitVectors collapses to identity. Walk past same-named same-position wrappers when computing tail. - AnimationMixer.update() with a "stopped" action still mutates bones unless enabled=false is set. Retargeting layer in helpers-skinned-realtime.html: - 12 bones direct quaternion retarget (arms × 2, legs × 2, spine × 3, neck) - Hips root rotation from shoulder/hip line basis (torso twist + lean) - Neck aims at ear-midpoint (kp 7+8), not nose (kp 0), to remove the forward bias of the protruding-nose anchor - One Euro Filter per landmark per axis (Casiez 2012) — adaptive low-pass - Visibility-weighted per-bone slerp gain — occluded limbs relax to rest - URL toggles: ?mirror= ?yflip= ?zflip= ?cnn=0/1/2 ?csi=ws://... Live CSI integration: - Bridge parses adaptive_ctrl tick lines (motion/presence/rssi/yield) - Browser fans single ESP32 reading across 4 UI nodes with phase-shifted wobble (0.88–1.00 × sin(t·0.55 + offsetᵢ)) - EMA α=0.06 (~3 sec time constant), HUD update throttled 3 Hz Co-Authored-By: claude-flow <ruv@ruv.net>		2026-05-15 22:22:41 -04:00
..
environment	feat: 4 sensing examples — sleep apnea, stress, room environment	2026-03-15 16:50:04 -04:00
happiness-vector	chore(repo): rename rust-port/wifi-densepose-rs → v2/ (flatten to one level) (#427 )	2026-04-25 21:28:13 -04:00
medical	feat: 10-in-1 medical vitals suite from single mmWave sensor	2026-03-15 18:05:42 -04:00
sleep	feat: 4 sensing examples — sleep apnea, stress, room environment	2026-03-15 16:50:04 -04:00
stress	feat: 4 sensing examples — sleep apnea, stress, room environment	2026-03-15 16:50:04 -04:00
three.js	feat(examples/three.js): cinematic skinned realtime pose demo + ESP32 CSI bridge	2026-05-15 22:22:41 -04:00
README.md	feat: 10-in-1 medical vitals suite from single mmWave sensor	2026-03-15 18:05:42 -04:00
ruview_live.py	feat: happiness scoring pipeline + ESP32 swarm with Cognitum Seed (#285 )	2026-03-20 18:46:34 -04:00

README.md

Examples

Real-time sensing applications built on the RuView platform.

Unified Dashboard (start here)

pip install pyserial numpy
python examples/ruview_live.py --csi COM7 --mmwave COM4

The live dashboard auto-detects available sensors and displays fused vitals, environment data, and events in real-time. Works with any combination of sensors.

Individual Examples

Example	Sensors	What It Does
ruview_live.py	CSI + mmWave + Light	Unified dashboard: HR, BR, BP, stress, presence, light, RSSI
Medical: Blood Pressure	mmWave	Contactless BP estimation from HRV
Medical: Vitals Suite	mmWave	10-in-1: HR, BR, BP, HRV, sleep stages, apnea, cough, snoring, activity, meditation
Sleep: Apnea Screener	mmWave	Detects breathing cessation events, computes AHI
Stress: HRV Monitor	mmWave	Real-time stress level from heart rate variability
Environment: Room Monitor	CSI + mmWave	Occupancy, light, RF fingerprint, activity events

Hardware

Port	Device	Cost	What It Provides
COM7	ESP32-S3 (WiFi CSI)	~$9	Presence, motion, breathing, heart rate (through walls)
COM4	ESP32-C6 + Seeed MR60BHA2	~$15	Precise HR/BR, presence, distance, ambient light

Either sensor works alone. Both together enable fusion (mmWave 80% + CSI 20%).

Quick Start

pip install pyserial numpy

# Unified dashboard (recommended)
python examples/ruview_live.py --csi COM7 --mmwave COM4

# Blood pressure estimation
python examples/medical/bp_estimator.py --port COM4

# Sleep apnea screening (run overnight)
python examples/sleep/apnea_screener.py --port COM4 --duration 28800

# Stress monitoring (workday session)
python examples/stress/hrv_stress_monitor.py --port COM4 --duration 3600

# Room environment monitor
python examples/environment/room_monitor.py --csi-port COM7 --mmwave-port COM4

# CSI only (no mmWave)
python examples/ruview_live.py --csi COM7 --mmwave none