Tag: On-Device RAG

Retrieval-Augmented Generation (RAG) is a powerful technique for enhancing large language models (LLMs), but running it on-device has always been a challenge. Enter Google’s new Embedding Gemma model, a lightweight embedding model designed to make on-device RAG not only possible, but also easy and efficient.