Blog

RAG Chatbot 1: Project structure

A term one must come across when aiming to deploy a chatbot for the internal use within a company is RAG, translating to Retrieval Augmented Generation. What is it about? RAG combines a generator model with a retriever model to produce high-quality text. The generator produces an initial draft, while the retriever retrieves relevant existing texts and incorporates them into the output. This hybrid approach can improve coherence, variety, and factual accuracy in generated text. (Meta-Llama-3-8B-Instruct.Q4_0.gguf “What is RAG in context of chatbots?”)

Read more →

July 28, 2025