rag-llm/README.md

Local RAG System for Markdown Files

Requirements

1. Install Ollama
2. Pull required models:

ollama pull qwen2.5:7b-instruct-q8_0
ollama pull mxbai-embed-large:latest

You can use any model but update model names in .env

Run

cp .env.example .env
uv sync
uv run main.py