AegisLens: Edge-Native Multimodal Copilot

Private by design. Useful in real time. Optimized for Snapdragon®-powered HP PCs (HP OmniBook X).
Built by Siddharth Goyal for the Snapdragon® AI Lab Build & Present Challenge.

---

📌 Project Overview

AegisLens is an on-device multimodal meeting assistant designed to keep sensitive screen shares, audio, and meeting context strictly within the local hardware boundary. By offloading speech recognition, visual credential redaction, and semantic recall to the **45 TOPS Hexagon NPU** on **Snapdragon X Series HP PCs (HP OmniBook X)**, it maintains low latency and preserves battery life without streaming unredacted data to cloud APIs.

🛠️ Architecture & Dataflow

[ WASAPI Audio Loopback ] ──> [ Whisper-Small W8A16 ] ────┐
                                                         ├──> [ Llama 3.2 1B W4 ] ──> [ WinUI 3 UI / Tasks ]
[ DXGI Screen Capture  ] ──> [ YOLOv8 W8A8 Vision Guard] ┘             │
                                                                       ▼
                                                       [ MiniLM-v2 (384-D) + SQLite Index ]
                                                                       │
                                                       (100% On-Device / Zero Cloud Egress)