PhD Proposal: Human-centric Acoustics: The interplay of opportunities and security

Acoustic signals play a fundamental role in human life, serving as a unique medium for communication, interaction, and perception. Beyond speech, our bodies generate various sounds that carry valuable information, from health indicators to environmental cues. These signals not only shape our daily interactions but also offer unprecedented opportunities to enhance user experiences in diverse contexts, whether by improving communication, monitoring health, or safeguarding privacy. This dissertation delves into the intricate interplay of these opportunities and the security challenges inherent in human- centric acoustics, advancing the field toward innovative and user-focused solutions.The contributions of this dissertation span three key areas: improving communication, enabling continuous ear health monitoring, and ensuring the integrity of live speeches. To enhance communication, this work introduces a novel spatial filtering algorithm that leverages the harmonic structure of human speech to isolate the user’s voice, significantly improving audio call quality in noisy environments using commodity headphones. For health monitoring, it presents an innovative approach to trigger distortion product otoacoustic emissions (DPOAEs)—a critical marker for ear health assessment—using commer- cial earbuds equipped with single-speaker elements. This approach enables continuous, medical-grade ear health assessment without requiring specialized equipment. To ensure speech integrity, this research proposes a robust verification system for tamper-proofing live recordings, effectively safeguarding against manipulation and ensuring the authenticity of spoken content.These advancements are built on a strong foundation of theoretical principles in signal processing, spatial sensing, human speech production and perception, and machine learning. By seamlessly integrating these disciplines, this work demonstrates the potential for acoustic technologies to address real-world challenges. By addressing the dual challenges of opportunity and security, this research bridges the gap between technological innovation and user-centric needs. It lays a foundation for future acoustic systems that enhance the quality of life while maintaining trust, privacy, and security in an increasingly interconnected world.