CMSC 491/691 (Fall 2024): Special Topics on Mobile and Wireless Sensing
Time: Tuesday & Thursday 09:00 AM – 10:15 AM
Location: Interdisciplinary Life Sciences Building (ILSB) 237
Office Hours: Tuesdays from 2:30 PM to 3:30 PM at ITE 355 or by appointment via email
Course Overview
The rapid expansion of mobile and wireless technologies, alongside breakthroughs in deep learning, has led to the emergence of the “Artificial Intelligence of Things” (AIoT). In this cutting-edge paradigm, wireless signals do more than just facilitate communication between devices—they also enable interaction with people and the physical environment. This course provides an in-depth exploration of key concepts in mobile and wireless sensing, including the fundamentals of wireless signals, signal processing techniques, and machine learning algorithms. The course is structured into six comprehensive modules, each focused on a specific application domain, such as localization and tracking, gesture and activity recognition, health sensing, material and environmental sensing, multi-modal sensing, and privacy-preserving sensing. Throughout the course, students will engage with recent research papers that highlight innovative designs, algorithms, and applications within the field of mobile and wireless sensing. A significant component of the course involves a semester-long, research-oriented project where students will gain hands-on experience by designing and building their own AIoT systems. This project will allow students to apply theoretical knowledge to practical challenges, fostering a deeper understanding of the AIoT landscape.
Grading Policy
- Paper Review: 16%
- Paper Presentation: 24%
- Research Project: 60%
- 10% for project proposal presentation & report
- 10% for project milestone presentation & report
- 20% for final presentation & demonstration
- 20% for final report
Course Schedule and Materials
Note: the schedule below is tentative and subject to change. Please check it regularly.
| # | Date | Topic | Assigned Paper |
|---|---|---|---|
| 1 | Thu, Aug 29, 2024 | Course Introduction and Overview | |
| Module 1: Localization and Tracking | |||
| 2 | Tue, Sep 03, 2024 | Localization and Tracking: WiFi | Experience: Pushing Indoor Localization from Laboratory to the Wild |
| 3 | Thu, Sep 05, 2024 | Localization and Tracking: RFID | Drone Relays for Battery-Free Networks |
| 4 | Tue, Sep 10, 2024 | Localization and Tracking: Acoustics | FM-Track: Pushing the Limits of Contactless Multi-target Tracking using Acoustic Signals |
| 5 | Thu, Sep 12, 2024 | Student Presentation | TBD |
| Module 2: Gesture and Activity Recognition | |||
| 6 | Tue, Sep 17, 2024 | Gesture and Activity Recognition: mmWave | Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar |
| 7 | Thu, Sep 19, 2024 | Gesture and Activity Recognition: LTE | Robust Dynamic Hand Gesture Interaction using LTE Terminals |
| 8 | Tue, Sep 24, 2024 | Gesture and Activity Recognition: Ambient Light | Self-Powered Gesture Recognition with Ambient Light |
| 9 | Thu, Sep 26, 2024 | Student Presentation | TBD |
| Module 3: Health Sensing | |||
| 10 | Tue, Oct 01, 2024 | Health Sensing: Vital Sign Monitoring | Your Smart Speaker Can “Hear” Your Heartbeat! |
| 11 | Thu, Oct 03, 2024 | Project Proposal Presentation and Discussion | |
| 12 | Tue, Oct 08, 2024 | Health Sensing: Sleep Stage Monitoring | WiFi-Sleep: sleep stage monitoring using commodity Wi-Fi devices |
| 13 | Thu, Oct 10, 2024 | Student Presentation | TBD |
| Module 4: Material and Environment Sensing | |||
| 14 | Tue, Oct 15, 2024 | Material and Environment Sensing: Food and Liquids | Liquid Testing with Your Smartphone |
| 15 | Thu, Oct 17, 2024 | Material and Environment Sensing: Soil | SoilCares: Towards Low-cost Soil Macronutrient and Moisture Monitoring Using RF-VNIR Sensing |
| 16 | Tue, Oct 22, 2024 | Material and Environment Sensing: Temperature | VECTOR: Velocity Based Temperature-field Monitoring with Distributed Acoustic Devices |
| 17 | Thu, Oct 24, 2024 | Student Presentation | TBD |
| Module 5: Multi-modal Sensing | |||
| 18 | Tue, Oct 29, 2024 | Multi-modal Sensing: WiFi + Camera | Through-Wall Human Pose Estimation Using Radio Signals |
| 19 | Thu, Oct 31, 2024 | Multi-modal Sensing: Audio + Ultrasound | Sensing to Hear: Speech Enhancement for Mobile Devices Using Acoustic Signals |
| 20 | Tue, Nov 05, 2024 | Project Milestone Presentation and Discussion | |
| 21 | Thu, Nov 07, 2024 | Multi-modal Sensing: mmWave + Depth Camera + IMU | Cosmo: Contrastive Fusion Learning with Small Data for Multimodal Human Activity Recognition |
| 22 | Tue, Nov 12, 2024 | Student Presentation | TBD |
| Module 6: Privacy-preserving Sensing | |||
| 23 | Thu, Nov 14, 2024 | Privacy-preserving Sensing: Signal-level Methods | You Can Hear But You Cannot Record: Privacy Protection by Jamming Audio Recording |
| 24 | Tue, Nov 19, 2024 | Privacy-preserving Sensing: Algorithm-level Methods | ClusterFL: a similarity-aware federated learning system for human activity recognition |
| 25 | Thu, Nov 21, 2024 | Student Presentation | TBD |
| Project Presentation and Demonstration | |||
| 26 | Tue, Nov 26, 2024 | Project Presentation and Demonstration I | |
| Thu, Nov 28, 2024 | No Class - Thanksgiving | ||
| 27 | Tue, Dec 03, 2024 | Project Presentation and Demonstration II | |
| 28 | Thu, Dec 05, 2024 | Project Presentation and Demonstration III | |
| 29 | Thu, Dec 10, 2024 | Project Presentation and Demonstration IV | |
More Information
Check the course syllabus for more information.