IEEE ANTS 2026 · IIT Roorkee · 17–20 Dec 2026Accepted
LightDep: Knowledge-Distilled Multimodal Depression Screening for Mobile and Edge Devices
Devansh Pandey*, Prateek Goyal*, Dr. Amit Vishwakarma1, Dr. Arijit Roy2, Dr. Om Jee Pandey3
1IIITDM Jabalpur·2IIT Patna·3IIT BHU
IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS)
- The paper
- A small model that screens for depression from face and voice features and runs on the device, even inside a browser tab. It learns from bigger teacher models (knowledge distillation) and is then quantized to 3.96 MB.
- My part
- Joint first author with Prateek Goyal. I built and trained the model, ran the distillation experiments and the significance tests, and did the INT8 ONNX export.From my summer research internship at IIT BHU.
- Results
- Distillation only helps when the teacher is a stronger, well-calibrated screener: +10.4 recall on D-Vlog (p = 0.045), confirmed over 10 seeds on a second GPU. No significant gain on LMVD.
- 3.96 MB INT8 model, 28× smaller than its teacher, 96 ms per inference on one CPU thread, 75.9 binary F1 on D-Vlog.