Overview
DeviceSense is an interactive kinetic sandbox engineered to acquire, display, and analyze real-time biomechanical telemetry from mobile devices. Incorporating specialized hooks for the browser's DeviceOrientation and DeviceMotion application programming interfaces, the dashboard constructs live continuous signals mapped straight to the device's internal micro-electro-mechanical systems (MEMS).
This dynamic playground serves as a testbed for clinicians, gait researchers, and designers to audit posture patterns, spatial rotation angles, and translational movement acceleration. A simulated hardware environment acts as a robust surrogate layer when physical sensor telemetry is blocked or absent.
How to Use
- Hardware Connect: Select the "Request Hardware Access" button. If running on iOS or specific modern Android distributions, follow browser prompts to authorize motion sensors.
- Spatial Calibration: Hold your device flat to center your initial physical equilibrium baseline relative to gravity.
- Audit Dashboard: View the live 3D phone visualizer rotate, mapping shifts across Pitch (Beta), Roll (Gamma), and Yaw (Alpha). View continuous acceleration spikes dynamically.
- Interactive Audio: Activate "Sound OFF" to engage a dynamic frequency feedback loop. Pitch and attenuation adjust based on movement magnitude.
- Interactive Sandbox: Enable "Force Sandbox Sliders" on desktop to manually construct and feed simulated signal pathways into the workspace.
Technical Details
This single-page laboratory executes completely on the client side, avoiding remote database storage and maintaining extreme processing responsiveness to satisfy low Interaction to Next Paint (INP) targets below 200ms. Visual renders and signal waveforms utilize optimized canvas frames managed directly by the hardware-synchronized requestAnimationFrame() cycle.
Web Audio API synthesis translates spatial parameters directly to dynamic audio frequencies. For security reasons, browsers restrict hardware sensor access to secure contexts (HTTPS). Modern iOS environments additionally request developer compliance via explicit User Gesture activation permissions before initializing raw DeviceMotionEvent.requestPermission() triggers.
Future Directions
The system roadmap targets advanced filter layers—namely double-integration algorithms, high-pass gravity separation filters, and Kalman sensor fusion matrices to filter high-frequency sensor noise. Dynamic step-detection, gait speed estimators, and automated postural tremor analyses are slated for future releases.
We are additionally optimizing local storage pipelines to handle extensive diagnostic sessions and plan to support direct exports to industry-standard biological data visualization profiles (such as BiosignalsPLUX and OpenSignals structures).