Self-Hosted AI Stack

Self-Hosted AI Stack

New
5|0 reviews|0 favorites
Visit website
Introduction
An open-source Docker Compose project for running local models, chat, documents, voice, and AI tools on your own infrastructure.
Listed on
October 2, 2026
FreeWebsiteAI FrameworksAI DevOps ToolsAI LLM APIAI Model DeploymentAI Model ManagementAI Open Source LLMAI RAG Open SourceAI RAG PlatformAI Vector DatabaseAI Workflow Orchestration
Self-Hosted AI Stack product preview
Visit website

What is Self-Hosted AI Stack?

Self-Hosted AI Stack is an open-source Docker Compose project for building a private, local-first AI platform on infrastructure you control. It bundles local model serving and chat, document embeddings and retrieval, speech, tools, and AI gateways, with optional HTTPS and NVIDIA GPU acceleration. It supports CPU, NVIDIA GPU, and cloud deployment options, and is designed to be composable so you can start small and add services as needed.

How to use Self-Hosted AI Stack?

  • 1. Review the architecture, included services, lightweight configurations, security defaults, and deployment instructions on the GitHub repository. 2. Deploy the open-source Docker Compose stack on your own machine, server, or cloud instance. 3. Optionally enable HTTPS and NVIDIA GPU acceleration. 4. Start with the services you need and add more as your requirements grow. 5. If you are still deciding, download the free Local AI Readiness Guide to assess your hardware, try a small local model with Ollama, and compare local, cloud, managed, and hybrid approaches before spending.

Core features of Self-Hosted AI Stack

  • Local model serving and chat
  • Documents, embeddings, and retrieval (RAG)
  • Speech and voice capabilities
  • AI tools and gateways
  • CPU, NVIDIA GPU, and cloud deployment options
  • Optional HTTPS and security defaults
  • Composable, modular Docker Compose architecture
  • Open-source and local-first / private by default

User reviews

5.0

/ 5

0 reviews

5 stars
0
4 stars
0
3 stars
0
2 stars
0
1 stars
0

No reviews yet. Be the first to write one.

Similar products

Self-Hosted AI Stack Embed

Add a website badge to show your product on Hootool—help others find the right AI tool for their problem. Easy to place on your homepage or footer.

Featured on

Hootool.ai