{"id":132,"date":"2024-12-16T09:39:22","date_gmt":"2024-12-16T09:39:22","guid":{"rendered":"https:\/\/innohub.powerweave.com\/?p=132"},"modified":"2024-12-16T09:39:22","modified_gmt":"2024-12-16T09:39:22","slug":"self-hosted-ai-starter-kit-setting-up-your-ai-env-in-local","status":"publish","type":"post","link":"https:\/\/innohub.powerweave.com\/?p=132","title":{"rendered":"Self-Hosted AI Starter Kit:  Setting Up Your AI Env in Local"},"content":{"rendered":"\n<p><\/p>\n\n\n\n<p>This guide will help you set up an incredible Self-Hosted AI Starter Kit in just a few minutes, integrating everything you need for efficient local AI workflows. Whether you&#8217;re a developer or an enthusiast, this setup is designed to be user-friendly and powerful.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Run ALL Your AI Locally in Minutes! LLMs, AI Agents, RAG, and More! (Opensource)\" width=\"500\" height=\"281\" src=\"https:\/\/www.youtube.com\/embed\/MqzEnwP0s60?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">What You Will Need<\/h2>\n\n\n\n<p>Before diving into the setup, ensure you have the following:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Docker Desktop<\/strong>: Download and install Docker Desktop from\u00a0<a href=\"https:\/\/dockr.ly\/3OA9AbB\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a>.<\/li>\n\n\n\n<li><strong>Git<\/strong>: Install Git from\u00a0<a href=\"https:\/\/git-scm.com\/downloads\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a>.<\/li>\n\n\n\n<li><strong>Python<\/strong>: Download Python from\u00a0<a href=\"https:\/\/www.python.org\/downloads\/\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a>.<\/li>\n\n\n\n<li><strong>PostgreSQL<\/strong>: Get PostgreSQL from\u00a0<a href=\"https:\/\/www.postgresql.org\/download\/windows\/\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a>.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Key Components of the Setup<\/h2>\n\n\n\n<p>This self-hosted AI starter kit includes several essential components:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Ollama<\/strong>: A tool that allows you to use open-source LLMs effortlessly.<\/li>\n\n\n\n<li><strong>Postgres<\/strong>: A reliable SQL database for data management.<\/li>\n\n\n\n<li><strong>Quadrant<\/strong>: A robust vector database for advanced AI applications.<\/li>\n\n\n\n<li><strong>n8n<\/strong>: A workflow automation tool that ties all components together seamlessly.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Step-by-Step Setup<\/h2>\n\n\n\n<p>         <strong>Clone the Repository<\/strong>: Start by cloning the original GitHub repository for the self-hosted AI starter kit<\/p>\n\n\n\n<ol class=\"wp-block-list\"><\/ol>\n\n\n\n<div class=\"wp-block-codesue-terminal-block\" title=\"bash\" style=\"--wp--default--terminal--block--color--background:#252a33;--wp--default--terminal--block--color--text:#eee;--wp--default--terminal--block--color--accent:#a2a2a2\">\n<p class=\"wp-block-codesue-terminal-command-block display-prompt\" prompt=\"$\"><code>git clone https:\/\/github.com\/n8n-io\/self-hosted-ai-starter-kit<\/code><\/p>\n<\/div>\n\n\n\n<p>         <strong>Configure Environment Variables<\/strong>: Navigate to the cloned directory and set up your environment variables as needed.<\/p>\n\n\n\n<p>         <strong>Run Docker Compose<\/strong>: Use Docker Compose to start your services with a single command:<\/p>\n\n\n\n<div class=\"wp-block-codesue-terminal-block\" title=\"bash\" style=\"--wp--default--terminal--block--color--background:#252a33;--wp--default--terminal--block--color--text:#eee;--wp--default--terminal--block--color--accent:#a2a2a2\">\n<p class=\"wp-block-codesue-terminal-command-block display-prompt\" prompt=\"$\"><code>docker-compose up -d<\/code><\/p>\n<\/div>\n\n\n\n<p>        <strong>Access the Open WebUI<\/strong>: Once everything is running, you can access the built-in Open WebUI to chat with your AI agents and manage workflows easily.<\/p>\n\n\n\n<p>        <strong>Explore Cloud Integration<\/strong>: For those looking to expand their capabilities, consider using Docker Build Cloud for parallel builds and shared caching, enhancing your project&#8217;s scalability.<\/p>\n\n\n\n<ol class=\"wp-block-list\"><\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">Advantages of This Setup<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Simplified Configuration<\/strong>: The setup requires only two files\u2014environment variables and Docker Compose\u2014making it straightforward even for beginners.<\/li>\n\n\n\n<li><strong>Open Source<\/strong>: Being fully open-source ensures maximum control and privacy over your AI projects.<\/li>\n\n\n\n<li><strong>Scalability<\/strong>: With Docker Build Cloud, you can scale your projects effortlessly, achieving unmatched performance.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Conclusion<\/h2>\n\n\n\n<p>Setting up a self-hosted AI starter kit using Docker Compose is a game-changer for local AI development. This setup not only simplifies your workflow but also provides robust tools to manage and automate your AI processes efficiently.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This guide will help you set up an incredible Self-Hosted AI Starter Kit in just a few minutes, integrating everything you need for efficient local AI workflows. Whether you&#8217;re a developer or an enthusiast, this setup is designed to be user-friendly and powerful. What You Will Need Before diving into the setup, ensure you have [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":133,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[33,34,73],"tags":[26,94,76,85,95,96,93],"class_list":["post-132","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-artificial-intelligence","category-cloud-computing","category-devops-tools","tag-ai","tag-aiagent","tag-devops","tag-docker","tag-n8n","tag-quadrant","tag-rag"],"jetpack_featured_media_url":"https:\/\/innohub.powerweave.com\/wp-content\/uploads\/2024\/12\/sddefault-4.jpg","_links":{"self":[{"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=\/wp\/v2\/posts\/132","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=132"}],"version-history":[{"count":1,"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=\/wp\/v2\/posts\/132\/revisions"}],"predecessor-version":[{"id":135,"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=\/wp\/v2\/posts\/132\/revisions\/135"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=\/wp\/v2\/media\/133"}],"wp:attachment":[{"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=132"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=132"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/innohub.powerweave.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=132"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}