7.9 KiB
Homelab Monitor — Project Memory
Unified health dashboard for the homelab (infra docs: jhodgkin/homelab repo, docs/infrastructure.md).
One login instead of logging into Proxmox, Zabbix, OMV, and every service separately.
How to resume work in a new session
- List open issues:
GET /api/v1/repos/jhodgkin/homelab-monitor/issues?state=open&limit=30ongit.jerodrigged.com(same pattern as the main homelab backlog, see global~/.claude/CLAUDE.md). Milestonev1-dashboardis the current focus; everything else is backlog. - Pick an issue, comment that you're starting it, do the work, comment what you did, close it.
- Commit and push after every meaningful step — don't let work sit uncommitted.
Architecture
apps/api— Fastify + TypeScript. Polls collectors on an interval (POLL_INTERVAL_SECONDS, default 30s), writes snapshots to SQLite (apps/api/src/db), serves/api/*.apps/web— React + Vite + TypeScript. Polls/api/hostsevery 15s, renders host/container cards.config/hosts.yaml— declares what to monitor (no secrets, committed). Credentials live in.env(gitignored) — see.env.examplefor the full list.- Collectors implement the
Collectorinterface (apps/api/src/collectors/types.ts) and are registered inapps/api/src/index.ts. Adding a new data source = new collector + config entry, no other wiring.ProxmoxCollector(done): one API call topvereturns CPU/mem/disk and PSI pressure (pressurecpusome,pressurememoryfull) for the host + every LXC. Covers ~22 of ~24 machines.SshHostCollector(done): covers.180(omv) and.171(ripper), the bare-metal boxes Proxmox can't see. Dedicated SSH key with a forcedcommand=in the remoteauthorized_keys— the server always runs a fixed read-only script regardless of what's exec'd, so a leaked key is still contained. Seedocs/ssh-collector-key-setup.md, including the gotcha thatdiskPathsinhosts.yamlmust be kept in sync by hand with the remote script'sDISK_<label>=lines.- No Zabbix collector — see "Zabbix: intentionally skipped" below.
- Historical sparklines (done):
/api/hostsembeds the last ~40 samples per host (one windowed query,ROW_NUMBER() OVER (PARTITION BY host_id ...)), rendered as small hand-rolled SVG sparklines in each card — no charting library. Fixed a real bug while building this: the Proxmox host node's own mem/disk had beennullthe whole time (/nodes/{node}/statusnestsmemory/rootfsobjects; code assumed the flat shape the LXC listing endpoint uses). LXC entries were never affected. - Hot-reload (done):
sshHosts/knownDevicesinconfig/hosts.yamlare re-read on the next poll cycle (mtime check) — no container restart needed. Proxmox hosts already needed no config (auto- discovered every poll). Seedocs/hot-reload.md— includes a real single-file-bind-mount inode bug that silently broke this on first deploy, fixed by mounting./configas a directory. - Auth: local (bcrypt + signed session cookie) is always available — it's not an exclusive mode
switch. OIDC via Authentik is an additional sign-in button, live when
OIDC_ENABLED=true. Seedocs/oidc-setup.md. Deliberately additive so OIDC config problems can never lock out the admin login. - Device discovery (done, separate from the collector system above — it's inventory, not per-host
metrics):
scripts/discover-devices.shruns via systemd timer on the CT122 host, not in Docker (real ARP entries live in the host's network namespace, not Docker's bridge network). API reads the resulting JSON each poll cycle. Full reasoning indocs/device-discovery.md.
Infrastructure this project owns
- Gitea repo:
jhodgkin/homelab-monitor - Proxmox API token:
monitor@pve!dashboard, rolePVEAuditor(read-only), created viapveumonpve. Secret lives only in CT122's.env. - Deployment: CT122 (
homelab-monitor, 192.168.1.103), unprivileged LXC onpve, Docker + Compose. SSH aliashomelab-monitorin~/.ssh/config(root, key-based). ⚠️ CT122 ID conflict: the main homelab repo'sjhodgkin/homelab#15(Grafana/Loki/Prometheus migration) also planned to use CT122. That issue predates this dashboard's CT122 but wasn't checked before provisioning. Flagged in a comment on that issue — when #15 is picked up, it needs a different CT ID (123 or next free). - SSH collector key:
monitor_ed25519keypair lives only at/opt/homelab-monitor/ssh/on CT122 (gitignored, not in the repo). Public key installed onomvandripperwith a forced command — seedocs/ssh-collector-key-setup.md. - Authentik OIDC provider: set up via an Authentik blueprint on CT121 (not a manual UI step) — see
docs/oidc-setup.md. Purely additive, didn't touch any existing Authentik user/credential. - Public exposure (done, issue #13 closed):
https://monitor.jerodrigged.comis live. Chain is Cloudflare Tunnel (existing tunnelac3a4440-..., added a Public Hostname pointing at NPM, not directly at the dashboard) → NPM proxy host id 14 (192.168.1.185:80→192.168.1.103:8090) → app. NPM cert is Let's Encrypt (id 18).ssl_forcedmust stayfalseon this proxy host — Cloudflare is in Flexible SSL mode (terminates TLS at the edge, talks plain HTTP to the tunnel origin), sossl_forced: truecauses an infinite redirect loop. Hit this exact bug once already; don't re-enable it.COOKIE_SECUREalso staysfalsefor the same underlying reason — the Fastify process never sees an HTTPS connection even when the browser is on HTTPS, since TLS terminates before it. - Authentik redirect URIs: both the public (
https://monitor.jerodrigged.com/..., now primary in.env) and LAN (http://192.168.1.103:8090/...) callback URLs are registered in the blueprint, so OIDC login still works if the tunnel/DNS is ever down. - Vaultwarden: dashboard admin credentials saved as "Homelab Monitor (dashboard admin)". OIDC client
credentials not yet saved there (pending a
BW_SESSIONfrom the user). - Not yet verified: nobody has actually clicked "Sign in with Authentik" through a real browser — the redirect chain and params are confirmed correct via curl, but the final interactive consent/login step needs a human.
Zabbix: intentionally skipped, not blocked
Investigated CT109 while working issue #11 and found Zabbix was never actually finished being set up
(frontend not wired into Apache, setup wizard never run, no real hosts monitored, likely still on
default Admin/zabbix credentials). Turned out this is expected: jhodgkin/homelab#15 already plans
to decommission Zabbix entirely in favor of Prometheus+Loki+Grafana. User's call: skip Zabbix
integration entirely rather than finish configuring a service that's being replaced. homelab-monitor
issue #11 is closed as won't-do — if a metrics-alerting panel is wanted later, it should target
Grafana/Prometheus once homelab#15 lands, as a new issue, not a reopening of #11.
Status: original backlog complete
All 14 issues filed at project start are closed (10 shipped, #11/Zabbix closed as won't-do, no others
skipped). GET .../issues?state=open on this repo should return empty. If picking this up again with
no specific ask from the user, there's no queued work — check in with them for what's next rather than
inventing scope. Remaining known gaps, none blocking:
- Nobody has clicked "Sign in with Authentik" through an actual browser yet (see note above) — worth confirming next time a human is at the dashboard.
- OIDC client credentials aren't in Vaultwarden yet (Proxmox token and admin password are) — needs a
BW_SESSIONfrom the user, see prior session's request in the conversation history if resuming soon. diskPathsinhosts.yamlvs. the remote forced-command scripts on omv/ripper is a manual-sync point (documented, not automated — only 2 hosts, hasn't been worth it).