KNEL/PFVCluster
5
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

docs(audit): revised fleet audit with corrected placements + Friday plan

Browse Source 
User has fixed the HA pair storage redundancy issue:
- netinfra-01 moved to S2 (tsys5), netinfra-02 stays on D2 (tsys4)
- ucs-02 moved to S2 (tsys5), ucs-01 stays on D2 (tsys4)
Both pairs now survive any single storage server failure. Marked as
FIXED in Known Issues.

Revised audit includes:
- Corrected VM placements from fresh qm config data
- Host capacity analysis: tsys1 (118% RAM), tsys5 (135% RAM), tsys9
  (131% RAM) are overcommitted; tsys6 (38%) and tsys7 (30%) have room
- Wnode storage rebalancing plan: move wnode-tsys6 → S4, wnode-tsys7 →
  S1, giving every wnode its own physical disk
- Friday maintenance plan: tsys2 Proxmox install as primary deliverable,
  VM migrations to relieve overloaded hosts, USB-passthrough VMs relocate
  from tsys1 to tsys9
- Cnode quorum: documented as fundamental constraint (3 cnodes, 2 NFS
  servers), accepted for now, revisit post-Friday when local-SSD boot
  becomes available

💘 Generated with Crush

Assisted-by: Crush:glm-5.2
This commit is contained in:
mrcharles
2026-07-28 21:09:56 -05:00
parent b6f94483e5
commit b860cb116d
2 changed files with 239 additions and 223 deletions
Download Patch File Download Diff File Expand all files Collapse all files
STATUS.md
+13 -14
View File
@@ -78,28 +78,27 @@ infrastructure, Proxmox cluster ops, and k8s control plane.
| Issue | Impact | Status |
|-------|--------|--------|
| **UCS + netinfra HA pairs both on tsys4** | tsys4 failure = DNS/DHCP/NTP + LDAP/AD fully dark | **CRITICAL — needs PDM migration** |
| **2 of 3 k3s cnodes on tsys4** | tsys4 failure = etcd quorum lost | **CRITICAL — needs PDM migration** |
| **2 of 3 k3s cnodes on tsys4** | tsys4 failure = etcd quorum lost (1 of 3) | Accepted — fundamental constraint with 3 cnodes + 2 NFS servers. Revisit after Friday (local-SSD boot for one cnode) |
| **tsys1/5/9 RAM-overcommitted** | 118%/135%/131% respectively | Friday: migrate NFS-backed VMs to tsys6/tsys7 (77+132 GB free) |
| Technitium AXFR uses port 53 (occupied by Pi-hole) | Zone transfer via rsync instead of native AXFR | Workaround in place |
| `download.proxmox.com` unreachable from sandbox VM | 2 validation tests warn (environmental) | Not a code issue |
| tsys4/5 hardware pending | Perf tuning incomplete on 2 hosts | Waiting on physical install |
| tsys4/5 hardware pending | Perf tuning incomplete on 2 hosts | Friday physical install |
## Pending (next session priorities)
1. **CRITICAL: Migrate HA pairs to separate storage** (PDM, 10 min):
- netinfra-02 (VMID 904): D2 → S3 (tsys4 → tsys5)
- ucs-02 (VMID 902): D5 → S2 (tsys4 → tsys5)
2. **CRITICAL: Fix k3s cnode quorum risk** (PDM, 5 min):
- Move cnode1 (VMID 906) or cnode2 (VMID 705) from tsys4 to tsys5 storage
3. **k8s workers:** Join wnodes to the k3s cluster (agents, not servers)
1. **Wnode storage rebalancing** (2 PDM storage migrations):
- wnode-tsys6 (100): D5 → S4 (tsys4 → tsys5)
- wnode-tsys7 (701): D5 → S1 (tsys4 → tsys5)
- Gives every wnode its own physical disk, balances 3/3 across servers
2. **Friday maintenance:** physical hardware + VM migrations (see
[`docs/proxmox/AUDIT-2026-07-28.md`](docs/proxmox/AUDIT-2026-07-28.md) §5)
3. **k8s workers:** Join wnodes to the k3s cluster (after rebalancing)
4. **PDU:** Rename outlets in powerman.conf to match physical devices (Friday)
5. Perf: complete tsys4/5 tuning after hardware install (Friday)
6. tsys2: rebuild from Win10 to Proxmox (k8s-dedicated host)
7. **k8s deferred topics:** ETL tooling, HPC scheduler, vcluster policy,
5. **k8s deferred topics:** ETL tooling, HPC scheduler, vcluster policy,
solar-aware scale-out
> **See [`docs/proxmox/AUDIT-2026-07-28.md`](docs/proxmox/AUDIT-2026-07-28.md)
> for the full fresh audit with VM inventory and action items.**
> for the full fresh audit with VM inventory, capacity analysis, and
> Friday migration plan.**
## Infrastructure Summary