🎙️ Vani Setu

Voice Access to Government Services for Rural India

---

✨ Features

🎤 Multilingual Voice Advanced speech-to-text with auto-language detection (Hindi/English)	📸 Smart Document Scan AI-powered OCR to extract and verify identity details instantly
📊 Application Tracking Real-time dashboard to monitor your government service requests	🤖 Adaptive AI Guide Intelligent intent analysis to match citizens with the right schemes
🎙️ Neural TTS High-quality voice guidance in Hindi (Kajal) and English (Aditi)	⚡ Low-Bandwidth Ready Engineered for 2G/3G speeds common in remote rural areas

---

🏗️ Tech Stack

Category	Technologies
Frontend
Backend
AI & Voice
Cloud

---

📁 Project Structure

📦 Vani Setu
├── 📂 src/
│   ├── 📂 app/
│   │   ├── 📂 api/
│   │   │   ├── 🎙️ transcribe/        # Audio streaming to AWS
│   │   │   ├── 🗣️ tts/               # Neural speech generation
│   │   │   ├── 🤖 ai/analyze-intent   # Intent analysis (Nova-2)
│   │   │   └── 💾 db/list & save      # Submission management
│   │   ├── 📊 track/              # Application tracking dashboard
│   │   ├── 📸 scan/               # Document capture & success flow
│   │   └── 🏠 page.tsx            # Interactive landing page
│   ├── 🧩 components/             # Reusable UI modules
│   ├── 🎨 context/                # Bilingual state management
│   └── 🛠️ lib/                    # AWS SDK configurations
└── 📋 scripts/                    # Resource setup & diagnostics

---

🚀 Quick Start

📋 Prerequisites

✓ Node.js 18+
✓ AWS IAM User with (Transcribe, Polly, Bedrock, Textract, S3, DynamoDB) permissions

💻 Installation

# 1️⃣ Clone the repository
git clone https://github.com/MK-codes365/vanisetu.git
cd vanisetu

# 2️⃣ Install dependencies
npm install

# 3️⃣ Configure environment variables
cp .env.example .env.local
# Edit .env.local with your AWS credentials

⚙️ AWS Resources Setup

# Initialize S3 and DynamoDB resources
npx tsx scripts/setup-aws-resources.ts

# Start development server
npm run dev

---

📚 API Endpoints

Method	Endpoint	Description
🎙️	POST /api/transcribe	Real-time bilingual streaming transcription
🗣️	POST /api/tts	Generate neural speech (Kajal/Aditi)
🤖	POST /api/ai/analyze-intent	Nova-2 Powered Intent Understanding
📄	POST /api/ocr/extract-text	AWS Textract Document Analysis
📊	GET /api/db/list	Fetch user application status

---

🎨 Core Experience

🎤 Intelligent Voice

Just speak naturally. The system identifies your needs and guides you in your language.

📸 Zero-Form Scanning

Skip the paperwork. Vani Setu extracts your details directly from your identity documents.

📊 Real-Time Tracking

Clarity and trust. See exactly where your application sits in the government pipeline.

---

Built for Rural India with ❤️ by CodeX5

⬆ back to top