Omarchy Homelab
Infrastructure
A five-node Kubernetes cluster with GPU compute, GitOps delivery, and centralized observability.
Mining Infrastructure Meets Cloud Native
The Challenge
The Solution
Infrastructure Innovation
Git-Sourced Fleet
Just-Driven Ops
GitOps for Kubernetes
Cluster Status
Kubernetes
AI Stack
Observability
Operations & Automation
Automated Deployments
Service Mesh
Observability
Cluster Capabilities
Hardware Infrastructure
AI/ML Services
Observability Stack
Logs: journald + pod logs
Alerting: vmalert rule evaluation
Dashboards: GPU utilization, cluster health, service SLOs
Infrastructure Timeline
The Journey
Windows + Proxmox
Dual-boot setup with Proxmox servers for testing, Windows as daily driver
Killed Windows
Full commitment to Linux. Started distro hopping journey.
OS Evolution
Omarchy (Arch-based) → CachyOS (optimized Arch) → NixOS (declarative + reproducible)
NixOS Initial Commit
First NixOS configuration. Single host (zephyr) with basic desktop + gaming.
AI Gateway v1.0
OpenAI-compatible API, mining infrastructure, multi-GPU support
Gateway v2.0
Middleware architecture with circuit breaker, rate limiting, Redis caching
Cluster Expansion
Added nexus, forge, sentry. Implemented NFS config sync, profile system, 50+ Justfile commands
K8s Phase 1-3: Foundation
Control plane, Flannel CNI, CoreDNS, stateful services (GlitchTip PostgreSQL)
K8s Phase 4-5: Services & GPU
Stateless services (GlitchTip web/worker, SearXNG, n8n), GPU workloads (llama.cpp)
K8s Phase 6-7: Monitoring Stack Complete
Prometheus + Grafana monitoring deployed for cluster-wide observability.
Production Cluster Live
60+ pods running across 4 hosts. AI inference, mining, and monitoring workloads in production.
Blog Content Collections
Migrated blog to Astro Content Collections. Type-safe content management with automated OG image generation.
Infrastructure Extraction
Extracted MCP Registry, Knowledge Fabric, and AI gateway into standalone declarative projects with reproducible config and CI pipelines.
Gateway V2.1
Connection pooling, response caching, K8s embed-server integration, and OCI container image builds for the AI inference gateway.
Code Quality Automation
Standardized pre-commit hooks (statix, deadnix, lint) across all infrastructure projects. Automated code quality enforcement.
Portfolio Design V2
16-theme retro gaming design system with Base24-compliant semantic tokens, theme-aware components across the entire portfolio.
Semantic Token Redesign
Theme architecture streamlined. Removed theme preview system, migrated to pure semantic tokens for maintainability.
Integration Roadmap Complete
Cross-codebase integration roadmap covering MCP ecosystem, knowledge pipeline, GPU federation, and unified auth across 12 repositories.
ReverbOS / Omarchy Pivot
Full-stack migration off NixOS to an owned Omarchy-based OS across all hosts. Home-manager layer, declarative profiles, AI-first tooling. Sovereign infra future-proofing.
Migration Complete
Every host migrated off NixOS to Arch-based Omarchy — K3s, AI inference, mining, and monitoring carried over without breakage.
Fleet Telemetry Desk
Infomarchy desk deployed to every host (fix merged upstream) — live AI sessions, mining, and system health across the fleet.
GitOps Everywhere
Every cluster stack moved under ArgoCD app-of-apps management — media, Quill/MapleSpike, Haven, and trading deploy from git. No kubectl, no drift.
Mining Joins the Cluster
All five GPU rigs migrated from native systemd services to K3s pods managed by ArgoCD (mining-helm). Zephyr joined as an agent to serve its two GPUs — rollback is one git revert.
Self-Hosted, Full Stack
Community server (Haven) live at haven.reverb256.dev with a full Discord mirror; an autonomous agent fleet runs daily operations.
Code Explorer
Code Patterns
# NixOS Configuration Pattern
{
# Declarative system configuration
boot.loader.systemd-boot.enable = true;
# Network setup
networking.networkmanager.enable = true;
# User management
users.users.jkro = {
isNormalUser = true;
extraGroups = [ "wheel" "networkmanager" ];
};
# System packages
environment.systemPackages = with pkgs; [
vim git curl wget
];
}# Module Composition Pattern
{ config, pkgs, ... }:
{
imports = [
./hardware-configuration.nix
./modules/gpu.nix
./modules/networking.nix
];
# Service configuration with options
services.nginx = {
enable = true;
virtualHosts."example.com" = {
forceSSL = true;
enableACME = true;
root = "/var/www/example";
};
};
# GPU passthrough for ML workloads
hardware.nvidia.package = config.boot.kernelPackages.nvidiaPackages.beta;
}# Advanced NixOS Patterns
{ config, pkgs, lib, ... }:
{
# Service configuration with systemd
systemd.services.myservice = {
description = "Custom Service";
wantedBy = [ "multi-user.target" ];
serviceConfig = {
ExecStart = "/usr/bin/myservice";
Restart = "on-failure";
};
};
# System activation scripts
system.activationScripts.setup-dirs.text = ''
mkdir -p /var/lib/myservice
chown myservice:myservice /var/lib/myservice
'';
}