Skip to main content
Milvus is an open-source vector database designed for building Retrieval-Augmented Generation (RAG) applications. By combining Milvus with SambaNova LLMs, you can create scalable, high-performance RAG pipelines.

​
Prerequisites

​
Installation and setup

1

Create a virtual environment

macOS/Linux:
Windows:
2

Install dependencies

3

Set your SambaNova API key

​
Example use cases

  • Build Retrieval-Augmented Generation (RAG) systems
  • Store and query embeddings efficiently
  • Combine SambaNova LLMs with Milvus for scalable knowledge retrieval

​
Example notebooks

You can explore example notebooks to learn how to build RAG systems with SambaCloud and Milvus: These guides walk you through setting up and integrating the systems to create a functional RAG application.

​
Troubleshooting

Install dependencies with the virtual environment active: pip install pymilvus.
Verify your API key is exported correctly. Get a new key from the SambaNova API dashboard.
Ensure Milvus is running and accessible. See the Milvus quickstart guide for setup instructions.