OMX Helsinki — S&P 500 — DAX — NASDAQ 100 — STOXX 600 — EUR/USD — EUR/SEK — BTC/USD — ETH/USD — Euribor 3M — Euribor 12M —
Cole Medin

Cole Medin

Technology and AI 229,000 subscribers

Create Your Own Private Local AI Cloud Stack in Under 20 Minutes

12.03.2025
Published: 12.03.2025 Category: Technology and AI

Episode details

Episode description

I've gotten a LOT of requests for this video so I'm really excited for this one! I’ve covered the Local AI Package a lot on my channel. It’s the easiest way to get all your local AI up and running in a single stack - your LLMs (Ollama), database (Supabase and Qdrant), automation tools (n8n + Flowise), local web search (SearXNG), and user interface (Open WebUI). But even with local AI, we don’t always want to run it on our own computer! Sometimes you want others (like your internal team) using your local AI setup, you want it running 24/7, you don’t want the stack hogging resources on your machine, you want access to hardware you don’t have, or all of the above. In this video, I’ll show you step by step how to deploy the local AI package to a private cloud instance so you can have all the benefits of local AI without having to run it on your machine. This even includes setting up subdomains for all the services like n8n and Open WebUI and the entire process could NOT be easier with some new additions to the package! ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Local AI Package (100% free and open source): https://github.com/coleam00/local-ai-packaged Video showing how to deploy and use the local AI package on your own computer (similar process, but I also show a simple n8n agent): https://youtu.be/pOsO40HSbOo Video where I cover using this package to build a local AI agent with n8n: https://youtu.be/T2QWhXpnT5I ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 00:00 - Why Deploy Your Local AI Stack 01:38 - Local AI Package Overview 03:16 - Cloud Hosting Platform Options 04:59 - Creating our Linux Cloud Instance 06:44 - Configuring Firewalls 08:18 - DNS Setup for Subdomains 09:30 - Installing the Local AI Package 14:31 - Showcasing the End Result! 16:17 - Outro ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Join me as I push the limits of what is possible with AI. I'll be uploading videos at least two times a week - Sundays and Wednesdays at 7:00 PM CDT!

Open the AI assistant chat. The chat loads only when you open it.