mrcharles
422999bf3c
Performance optimization engagement for a 7-host Proxmox R&D cluster.
Captures the accumulated work across host tuning, network analysis,
fleet assessment, and kubernetes architecture planning.
Contents:
- Host-side tunings (scripts/): CPU governor, swappiness, BBR, NFS
nconnect, tuned profiles -- complete on 5 of 7 hosts
- Validation + benchmarking scripts: iperf matrix, bond/NFS fixes
- Collected host data (returned-logs/): check.sh output from all 7
hosts + iperf results, including newly-validated pfv-tsys9
- AGENTS.md: operating context for AI agents
- PROJECT.md: board-ready fleet assessment with VM placement and
storage redundancy analysis (40 VMs across 7 hosts)
- K8S.md: kubernetes architecture deep-dive covering cnode/wnode
distribution, StorageClass design, and ETL/HPC workload planning
💘 Generated with Crush
Assisted-by: Crush:glm-5.2
123 lines
7.4 KiB
Plaintext
123 lines
7.4 KiB
Plaintext
[14:58:04] pre-flight: shellcheck on check.sh
|
|
[14:58:05] pre-flight: shellcheck clean
|
|
[14:58:05] ============================================================
|
|
[14:58:05] [pfv-tsys1] begin
|
|
[14:58:05] ============================================================
|
|
[14:58:05] [pfv-tsys1] probing SSH connectivity (8s timeout)...
|
|
[14:58:06] [pfv-tsys1] SSH reachable
|
|
[14:58:06] [pfv-tsys1] uploading check.sh → /root/check.sh
|
|
[14:58:06] [pfv-tsys1] upload verified (50741 bytes)
|
|
[14:58:06] [pfv-tsys1] executing: chmod +x && bash /root/check.sh (may take 30-90s)
|
|
[15:03:03] [pfv-tsys1] check.sh exit code: 0
|
|
[pfv-tsys1] Size: 1.1M (21078 lines)
|
|
[pfv-tsys1] Elapsed: 296s
|
|
[pfv-tsys1] Please copy /root/pfv-tsys1.log back for analysis.
|
|
[pfv-tsys1] ================================================================
|
|
[15:03:03] [pfv-tsys1] expecting remote log: /root/pfv-tsys1.log
|
|
[15:03:03] [pfv-tsys1] pulling /root/pfv-tsys1.log → /home/reachableceo/projects/perfopt/returned-logs/
|
|
[15:03:03] [pfv-tsys1] SUCCESS: /home/reachableceo/projects/perfopt/returned-logs/pfv-tsys1.log (1077443 bytes, 21085 lines)
|
|
[15:03:03] ============================================================
|
|
[15:03:03] [pfv-tsys3] begin
|
|
[15:03:03] ============================================================
|
|
[15:03:03] [pfv-tsys3] probing SSH connectivity (8s timeout)...
|
|
[15:03:04] [pfv-tsys3] SSH reachable
|
|
[15:03:04] [pfv-tsys3] uploading check.sh → /root/check.sh
|
|
[15:03:04] [pfv-tsys3] upload verified (50741 bytes)
|
|
[15:03:04] [pfv-tsys3] executing: chmod +x && bash /root/check.sh (may take 30-90s)
|
|
[15:07:18] [pfv-tsys3] check.sh exit code: 0
|
|
[pfv-tsys3] Size: 708K (10060 lines)
|
|
[pfv-tsys3] Elapsed: 253s
|
|
[pfv-tsys3] Please copy /root/pfv-tsys3.log back for analysis.
|
|
[pfv-tsys3] ================================================================
|
|
[15:07:18] [pfv-tsys3] expecting remote log: /root/pfv-tsys3.log
|
|
[15:07:18] [pfv-tsys3] pulling /root/pfv-tsys3.log → /home/reachableceo/projects/perfopt/returned-logs/
|
|
[15:07:19] [pfv-tsys3] SUCCESS: /home/reachableceo/projects/perfopt/returned-logs/pfv-tsys3.log (724633 bytes, 10067 lines)
|
|
[15:07:19] ============================================================
|
|
[15:07:19] [pfv-tsys4] begin
|
|
[15:07:19] ============================================================
|
|
[15:07:19] [pfv-tsys4] probing SSH connectivity (8s timeout)...
|
|
[15:07:19] [pfv-tsys4] SSH reachable
|
|
[15:07:19] [pfv-tsys4] uploading check.sh → /root/check.sh
|
|
[15:07:19] [pfv-tsys4] upload verified (50741 bytes)
|
|
[15:07:19] [pfv-tsys4] executing: chmod +x && bash /root/check.sh (may take 30-90s)
|
|
[15:12:06] [pfv-tsys4] check.sh exit code: 0
|
|
[pfv-tsys4] Size: 588K (11010 lines)
|
|
[pfv-tsys4] Elapsed: 286s
|
|
[pfv-tsys4] Please copy /root/pfv-tsys4.log back for analysis.
|
|
[pfv-tsys4] ================================================================
|
|
[15:12:06] [pfv-tsys4] expecting remote log: /root/pfv-tsys4.log
|
|
[15:12:06] [pfv-tsys4] pulling /root/pfv-tsys4.log → /home/reachableceo/projects/perfopt/returned-logs/
|
|
[15:12:06] [pfv-tsys4] SUCCESS: /home/reachableceo/projects/perfopt/returned-logs/pfv-tsys4.log (600147 bytes, 11017 lines)
|
|
[15:12:06] ============================================================
|
|
[15:12:06] [pfv-tsys5] begin
|
|
[15:12:06] ============================================================
|
|
[15:12:06] [pfv-tsys5] probing SSH connectivity (8s timeout)...
|
|
[15:12:06] [pfv-tsys5] SSH reachable
|
|
[15:12:06] [pfv-tsys5] uploading check.sh → /root/check.sh
|
|
[15:12:07] [pfv-tsys5] upload verified (50741 bytes)
|
|
[15:12:07] [pfv-tsys5] executing: chmod +x && bash /root/check.sh (may take 30-90s)
|
|
[15:19:13] [pfv-tsys5] check.sh exit code: 0
|
|
[pfv-tsys5] Size: 1020K (17508 lines)
|
|
[pfv-tsys5] Elapsed: 426s
|
|
[pfv-tsys5] Please copy /root/pfv-tsys5.log back for analysis.
|
|
[pfv-tsys5] ================================================================
|
|
[15:19:13] [pfv-tsys5] expecting remote log: /root/pfv-tsys5.log
|
|
[15:19:13] [pfv-tsys5] pulling /root/pfv-tsys5.log → /home/reachableceo/projects/perfopt/returned-logs/
|
|
[15:19:14] [pfv-tsys5] SUCCESS: /home/reachableceo/projects/perfopt/returned-logs/pfv-tsys5.log (1041632 bytes, 17515 lines)
|
|
[15:19:14] ============================================================
|
|
[15:19:14] [pfv-tsys6] begin
|
|
[15:19:14] ============================================================
|
|
[15:19:14] [pfv-tsys6] probing SSH connectivity (8s timeout)...
|
|
[15:19:14] [pfv-tsys6] SSH reachable
|
|
[15:19:14] [pfv-tsys6] uploading check.sh → /root/check.sh
|
|
[15:19:15] [pfv-tsys6] upload verified (50741 bytes)
|
|
[15:19:15] [pfv-tsys6] executing: chmod +x && bash /root/check.sh (may take 30-90s)
|
|
[15:25:10] [pfv-tsys6] check.sh exit code: 0
|
|
[pfv-tsys6] Size: 932K (18526 lines)
|
|
[pfv-tsys6] Elapsed: 355s
|
|
[pfv-tsys6] Please copy /root/pfv-tsys6.log back for analysis.
|
|
[pfv-tsys6] ================================================================
|
|
[15:25:10] [pfv-tsys6] expecting remote log: /root/pfv-tsys6.log
|
|
[15:25:10] [pfv-tsys6] pulling /root/pfv-tsys6.log → /home/reachableceo/projects/perfopt/returned-logs/
|
|
[15:25:11] [pfv-tsys6] SUCCESS: /home/reachableceo/projects/perfopt/returned-logs/pfv-tsys6.log (954023 bytes, 18533 lines)
|
|
[15:25:11] ============================================================
|
|
[15:25:11] [pfv-tsys7] begin
|
|
[15:25:11] ============================================================
|
|
[15:25:11] [pfv-tsys7] probing SSH connectivity (8s timeout)...
|
|
[15:25:12] [pfv-tsys7] SSH reachable
|
|
[15:25:12] [pfv-tsys7] uploading check.sh → /root/check.sh
|
|
[15:25:13] [pfv-tsys7] upload verified (50741 bytes)
|
|
[15:25:13] [pfv-tsys7] executing: chmod +x && bash /root/check.sh (may take 30-90s)
|
|
[15:26:57] [pfv-tsys7] check.sh exit code: 0
|
|
[pfv-tsys7] Size: 1.3M (17600 lines)
|
|
[pfv-tsys7] Elapsed: 104s
|
|
[pfv-tsys7] Please copy /root/pfv-tsys7.log back for analysis.
|
|
[pfv-tsys7] ================================================================
|
|
[15:26:57] [pfv-tsys7] expecting remote log: /root/pfv-tsys7.log
|
|
[15:26:57] [pfv-tsys7] pulling /root/pfv-tsys7.log → /home/reachableceo/projects/perfopt/returned-logs/
|
|
[15:26:58] [pfv-tsys7] SUCCESS: /home/reachableceo/projects/perfopt/returned-logs/pfv-tsys7.log (1288070 bytes, 17607 lines)
|
|
[15:26:58] ============================================================
|
|
[15:26:58] DEPLOY SUMMARY
|
|
[15:26:58] ============================================================
|
|
[15:26:58] Passed (6):
|
|
[15:26:58] ✓ pfv-tsys1:pfv-tsys1.log
|
|
[15:26:58] ✓ pfv-tsys3:pfv-tsys3.log
|
|
[15:26:58] ✓ pfv-tsys4:pfv-tsys4.log
|
|
[15:26:58] ✓ pfv-tsys5:pfv-tsys5.log
|
|
[15:26:58] ✓ pfv-tsys6:pfv-tsys6.log
|
|
[15:26:58] ✓ pfv-tsys7:pfv-tsys7.log
|
|
[15:26:58] Failed (0):
|
|
[15:26:58]
|
|
[15:26:58] Contents of /home/reachableceo/projects/perfopt/returned-logs:
|
|
total 5580
|
|
drwxrwxr-x 2 reachableceo reachableceo 4096 Jul 26 15:26 .
|
|
drwxrwxr-x 6 reachableceo reachableceo 4096 Jul 26 14:55 ..
|
|
-rw-rw-r-- 1 reachableceo reachableceo 6824 Jul 26 15:26 _deploy.log
|
|
-rw------- 1 reachableceo reachableceo 1077443 Jul 26 15:03 pfv-tsys1.log
|
|
-rw------- 1 reachableceo reachableceo 724633 Jul 26 15:07 pfv-tsys3.log
|
|
-rw------- 1 reachableceo reachableceo 600147 Jul 26 15:12 pfv-tsys4.log
|
|
-rw------- 1 reachableceo reachableceo 1041632 Jul 26 15:19 pfv-tsys5.log
|
|
-rw------- 1 reachableceo reachableceo 954023 Jul 26 15:25 pfv-tsys6.log
|
|
-rw------- 1 reachableceo reachableceo 1288070 Jul 26 15:26 pfv-tsys7.log
|
|
-rw-rw-r-- 1 reachableceo reachableceo 0 Jul 26 14:58 _shellcheck.preflight.txt
|