πŸš€ Ash Server v1.2.0 Released

Forge Your AI.
Your Way.

A sovereign, lightweight, and security-hardened open-source AI ecosystem. Run high-performance private intelligence locally, coordinate multi-node P2P compute, and secure connections through any VPN.

ash-server --daemon
ash$ dotnet run --project ash-server
[startup] Loaded config.json overlay [startup] Verified JWT cryptographic secret (48-bytes generated) [PipeServer] Starting Named Pipe: \\.\pipe\AshLoaderPipe [WebAPI] Starting Web Server on http://localhost:18799 [startup] Tailscale VPN binding active: 100.75.12.80 [PipeServer] Satisfactory DLL connected! [grid-master] Listening for worker connections... [grid-master] Node 'Worker-Office' joined (AMD Ryzen 9, RTX 4090, 64GB)

The Ash AI Ecosystem

Four interconnected open-source pillars designed for total developer sovereignty and local execution.

🌸

Ash Server

The secure, lightweight C# orchestrator. Implements JWT/RBAC, sliding rate limiters, automated model updates, and a native MCP App Store.

Core Engine ASP.NET Core SQLite
πŸ¦™

gemma4-turbo

Optimized non-linear IQ4_XS quantizations of Google's Gemma 4. Features full vision/multimodal support. One of the most popular and downloaded community quants of Gemma 4.

Model Ollama Hub 33K+ Downloads
πŸ“±

Pocket-Ash

The sovereign mobile gateway. Talk to your personal AI system anywhere in the world, with direct access to custom tools and speech encoders.

Mobile UI iOS/Android Offline-First
πŸ•ΈοΈ

P2P Compute Grid

A built-in hub-and-spoke worker network. Link multiple local machines in a click to pool CPU/GPU inference tasks securely over WebSockets.

P2P Cluster WebSockets Zero-Config
Clustering

Decentralized P2P Compute

Distribute local LLM workloads seamlessly without complex cloud infrastructure. Convert any running instance into a worker node using simple CLI arguments.

  • WebSocket-driven real-time worker registration
  • Automated hardware profiling (VRAM, RAM, Threads)
  • Smart request routing based on worker hardware capability
  • Self-healing worker reconnect loops with exponential backoff
ash-server --worker
ash$ ash-server --worker --master http://100.75.12.80:18799 --token A8B7F1D0
[grid-worker] Connecting to Master: ws://100.75.12.80:18799/api/grid/ws... [grid-worker] Connection authorized. Node registered as 'Worker-Office'. [grid-worker] Reporting hardware profile: [RTX 4090 | 24GB VRAM] [grid-worker] Heartbeat loop started (30s interval).
Networking

Zero-Trust Adapter Binding

Secure your system from external exposures. Ash Server scans your operating system for all active VPNs and private overlays, letting you lock the server to secure virtual networks.

  • Supports NetBird, Tailscale, Proton VPN, WireGuard, and OpenVPN
  • Exposes active network adapters directly in the Admin Panel
  • Dynamic Kestrel binding to target interface IP at startup
  • Localhost fallback safety prevents exposure if the VPN drops
Admin API: GET /api/admin/network/interfaces
[ { "name": "wt0", "description": "NetBird VPN Adapter", "ip": "100.110.15.5", "is_vpn": true }, { "name": "tailscale0", "description": "Tailscale Tunnel", "ip": "100.75.12.80", "is_vpn": true }, { "name": "eth0", "description": "Intel(R) Ethernet Connection", "ip": "192.168.1.15", "is_vpn": false } ]