Document Q&A - Python Version

A Streamlit application for asking questions about PDF documents using local AI models via Ollama.

Setup

1. Install Ollama:

   • Download from https://ollama.ai/download
   • Install and run Ollama

2. Pull a model (in terminal):

   ollama pull llama3.2

   Or try other models: mistral, llama3, phi3, etc.

3. Start Ollama server (if not auto-started):

   ollama serve

4. Set up Python environment:

   python -m venv .venv
   .venv\Scripts\activate  # Windows
   pip install -r requirements.txt

5. Optional: Configure model: Create a .env file with:

   OLLAMA_MODEL=llama3.2  # or your preferred model
   

6. Run the app:

   streamlit run main.py

Features

• Upload PDF files
• Extract text from PDFs
• Ask questions about the document content
• AI-powered answers using local Ollama models (no API key required)
• Document storage with automatic expiration (1 hour)

Notes

• Only PDF files are supported
• Documents are stored in memory and expire after 1 hour
• Answers are based only on the extracted text from the PDF
• Requires Ollama to be running locally
• No internet connection needed for AI inference (after model download)