Note for Mobile Devices: When operating this application on mobile, a separate, dedicated compute server must be built and configured in order to successfully run the AI model.

GDG Hackathon 2026 Project

E2C Platform Intelligent Video Analytics

Autonomous zero-latency threat triage converting standard optical & thermal feeds into actionable intelligence.

FastAPI React 18 CUDA 12.1 LocateAnything-3B

The Mission

Purpose & Improvements

Bridging the gap between legacy security infrastructure and next-generation artificial intelligence.

The Purpose

The core purpose of the E2C platform is to transform existing "dumb" optical and thermal surveillance networks into proactive, intelligent defense systems.

Currently, security relies heavily on human operators monitoring multiple screens, leading to fatigue and delayed responses. Our goal is to provide an automated, zero-latency threat triage system that uses state-of-the-art Vision-Language Models to detect anomalies instantly, requiring zero hardware upgrades to the edge cameras themselves.

Existing Limitations vs. Our Improvements

Fixed Object Detection Classes
Zero-Shot Natural Language Query
Manual Screen Monitoring
Autonomous Geofence Alerts
High Latency AI Inference
Parallel Box Decoding (<100ms)
Requires Expensive Edge Chips
100% Hardware-Agnostic Retrofit

Live Demonstration

How E2C Works

Watch the system ingest live feeds, apply zero-shot VLM object detection, and trigger spatial alerts in real time.

Full Walkthrough

Live stream ingestion, dynamic zero-shot detection, and drawing real-time geofences.

Accelerated Pipeline

Under-the-hood look at the LocateAnything-3B inference pipeline executing Parallel Box Decoding.

System Highlight 1

Hardware-Agnostic C2 Dashboard

System Highlight 2

AI Threat Evaluation Overlays

Technical Pipeline

System Architecture

A fully decoupled, modular system pipeline spanning edge video ingestion to browser-based C2 tactical views.

1

Data Ingestion

Ingests feeds from Legacy IP cameras, Thermal/IR Optronics, PTZ Masts, or Drones. Frames are buffered asynchronously via OpenCV to prevent blocking.

Input: RTSP / MJPEG / MP4
2

Processing Core

NVIDIA LocateAnything-3B performs zero-shot detection. Kalman filters apply persistent tracking IDs, and spatial rules calculate point-in-polygon overlaps.

Engine: CUDA / PyTorch
3

Tactical Interface

React C2 dashboard receives WebSocket broadcasts with base64 video frames + threat metadata. Users draw interactive geofence polygons directly on the canvas.

Transport: ws:// JSON

Project Highlights

System Capabilities

Zero-Shot VLM Engine

Powered by NVIDIA LocateAnything-3B, dynamically detect unseen threats—like "armed individual" or "unattended baggage"—without requiring expensive dataset retraining.

Parallel Box Decoding

Shattered the autoregressive bottleneck. Extracts dozens of dense bounding boxes simultaneously, delivering critical real-time processing at sub-100ms latency.

Dynamic Geofencing

Draw interactive exclusion zones directly in the browser. Calculates continuous ray-casting algorithms for point-in-polygon checks, triggering instantaneous WebSocket alerts.

Persistent Tracking

A highly optimized ByteTrack-style association model using Constant Velocity matrices + IoU. Maintains unique entity IDs across visual occlusions and crowds.

Hardware-Agnostic Edge

Seamlessly taps into existing infrastructure—analog cameras, RTSP streams, ONVIF IP systems—infusing legacy security networks with state-of-the-art AI.

Automated Forensics

Every detected threat is immortalized. Extracts high-resolution snapshots, calculates hashes for tamper evidence, and logs rich JSON metadata for audit trails.

Performance Benchmarks

FPS limiters have been completely removed for maximum throughput.

Profile Latency Resolution VRAM
Fast ~14-18 ms 640×640 7.8 GB
Hybrid ~22-32 ms 1024×1024 11.7 GB
Slow ~60-85 ms Native 4K 18.2 GB

How to Use

Getting started with the E2C platform is simple. Clone the repository, download the VLM weights, and launch the servers.

System Requirements

  • Python 3.10+
  • Node.js 18+
  • NVIDIA GPU (RTX 3080+)
  • CUDA 12.1+
Terminal
# 1. Clone repository and initialize Git LFS
git clone https://github.com/lenluarun/E2C-CCTV.git
cd E2C-CCTV
git lfs install
# 2. Acquire LocateAnything-3B weights
huggingface-cli download nvidia/LocateAnything-3B --local-dir LocateAnything-3B
# 3. Setup Python Backend
cd backend
python -m venv venv
# Windows: .\venv\Scripts\activate
pip install -r requirements.txt
uvicorn main:app --host 0.0.0.0 --port 8000
# 4. Setup React Frontend
cd ../frontend
npm install
npm run dev