List All Projects   List Graduate Projects   List Senior Design Projects   List REU Projects   Other Undergraduate Projects

Project # 71
ASRAD: Uncovering Privacy Risks in Mixed Reality via Spatial Audio Inference

Team Lead: Bardan Dhakal
Other Team Members:
Faculty Advisor(s): Prof Faysal Hossain Shezan
Department: CSE
Project Type: REU
Title: ASRAD: Uncovering Privacy Risks in Mixed Reality via Spatial Audio Inference
Abstract: We investigated the privacy implications of spatial audio in MR environments and propose ASRAD (Audiobased Scene Recognition and Activity Detection), an attack framework that leverages 3D audio cues to infer a user's environment and activities. ASRAD utilizes advanced audio processing techniques, including Mel-Spectrogram and MelFrequency Cepstral Coefficient feature extraction, which are transformed into visual representations and classified using a Convolutional Neural Network model. The system effectively distinguishes between various indoor and outdoor environments by capturing unique acoustic properties influenced by surrounding objects and surfaces.
Poster: View Poster #71 (PDF)
Judges Scoring: Submit Evaluation (judges only)