Repo tidy: logs consolidated, 15/16 scripts tracked, docs synced (#615/#611/#603)

Run outputs moved to logs/ (incl. sda partition-table backup). New from
the 15:57-16:03 parallel session: 16-grow-root-online.sh (RAN: / = 431G
online, swap removed by design — GROW-ROOT-RUNBOOK superseded) and
15-docker-to-data2.sh (staged, not run). README/NEXT/RUNBOOK/REBUILD
reflect current reality. Moot rdp-testprep timer removed from the VM.

Details: https://projects.knownelement.com/issues/615
This commit is contained in:
2026-09-01 17:17:10 -05:00
parent 30e4d502a6
commit f815149472
18 changed files with 286 additions and 12 deletions
+22
View File
@@ -0,0 +1,22 @@
== day flip 05:00 -> 07:00 2026-09-01T07:29:27-05:00 ==
-- live timer now --
[Unit]
Description=UKRRS: day profile at 07:00
[Timer]
OnCalendar=*-*-* 07:00:00
Persistent=true
[Install]
WantedBy=timers.target
-- armed timers --
NEXT LEFT LAST PASSED UNIT ACTIVATES
Tue 2026-09-01 22:00:00 CDT 14h Mon 2026-08-31 22:00:06 CDT - ukrrs-nightprofile.timer ukrrs-nightprofile.service
Wed 2026-09-02 07:00:00 CDT 23h Tue 2026-09-01 07:29:28 CDT 122ms ago ukrrs-dayprofile.timer ukrrs-dayprofile.service
2 timers listed.
Pass --all to see loaded but inactive timers, too.
-- current profile markers --
vm.dirty_bytes = 1073741824
vm.dirty_background_bytes = 268435456
== done 2026-09-01T07:29:28-05:00 ==
+97
View File
@@ -0,0 +1,97 @@
== grow / online 2026-09-01T16:03:32-05:00 ==
-- gates
-- backup partition table (rollback artifact)
label: dos
label-id: 0x2d03b9dd
device: /dev/sda
unit: sectors
sector-size: 512
/dev/sda1 : start= 2048, size= 585547776, type=83, bootable
/dev/sda2 : start= 585551870, size= 18425858, type=f
/dev/sda5 : start= 585551872, size= 18425856, type=82
-- swapoff + comment fstab swap line
13:# swap was on /dev/sda5 during installation
14:#UUID=611d6da8-3fd6-40f0-9239-d8825a6d256c none swap sw 0 0
-- delete sda5 (swap) and sda2 (extended container)
The partition table has been altered.
Calling ioctl() to re-read partition table.
Re-reading the partition table failed.: Device or resource busy
The kernel still uses the old table. The new table will be used at the next reboot or after you run partprobe(8) or partx(8).
Syncing disks.
The partition table has been altered.
Calling ioctl() to re-read partition table.
Re-reading the partition table failed.: Device or resource busy
The kernel still uses the old table. The new table will be used at the next reboot or after you run partprobe(8) or partx(8).
Syncing disks.
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINTS
sda 8:0 0 438G 0 disk
└─sda1 8:1 0 279.2G 0 part /
-- rewrite table: sda1 fills the disk (start 2048 unchanged)
disk sectors: 918552576, new sda1 size: 918550528
label: dos
label-id: 0x2d03b9dd
device: /dev/sda
unit: sectors
sector-size: 512
/dev/sda1 : start= 2048, size=918550528, type=83, bootable
Checking that no-one is using this disk right now ... FAILED
This disk is currently in use - repartitioning is probably a bad idea.
Umount all file systems, and swapoff all swap partitions on this disk.
Use the --no-reread flag to suppress this check.
Disk /dev/sda: 438 GiB, 470298918912 bytes, 918552576 sectors
Disk model: QEMU HARDDISK
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x2d03b9dd
Old situation:
Device Boot Start End Sectors Size Id Type
/dev/sda1 * 2048 585549823 585547776 279.2G 83 Linux
>>> Script header accepted.
>>> Script header accepted.
>>> Script header accepted.
>>> Script header accepted.
>>> Script header accepted.
>>> Created a new DOS (MBR) disklabel with disk identifier 0x2d03b9dd.
/dev/sda1: Created a new partition 1 of type 'Linux' and of size 438 GiB.
Partition #1 contains a ext4 signature.
/dev/sda2: Done.
New situation:
Disklabel type: dos
Disk identifier: 0x2d03b9dd
Device Boot Start End Sectors Size Id Type
/dev/sda1 * 2048 918552575 918550528 438G 83 Linux
The partition table has been altered.
Calling ioctl() to re-read partition table.
Re-reading the partition table failed.: Device or resource busy
The kernel still uses the old table. The new table will be used at the next reboot or after you run partprobe(8) or partx(8).
Syncing disks.
-- online ext4 grow
resize2fs 1.47.2 (1-Jan-2025)
Filesystem at /dev/sda1 is mounted on /; on-line resizing required
old_desc_blocks = 35, new_desc_blocks = 55
The filesystem on /dev/sda1 is now 114818816 (4k) blocks long.
-- verify
918550528
NAME SIZE FSTYPE MOUNTPOINT
sda 438G
└─sda1 438G ext4 /
Filesystem Size Used Avail Use% Mounted on
/dev/sda1 431G 87G 324G 22% /
Filename Type Size Used Priority
== done 2026-09-01T16:03:34-05:00 — no reboot needed; swap is gone by design
(rollback BEFORE resize2fs only: sfdisk /dev/sda < /root/sda-table.backup-20260901-160332)
+19
View File
@@ -0,0 +1,19 @@
== remove agent stacks 2026-08-31T21:58:26-05:00 ==
Removed '/etc/systemd/system/timers.target.wants/tsg-supervisor.timer'.
Removed '/etc/systemd/system/multi-user.target.wants/reachableceo-agent-stack.service'.
removed unit: tsg-supervisor.timer
removed unit: tsg-supervisor.service
removed unit: tsg-agent-stacks.service
removed unit: reachableceo-agent-stack.service
moved launcher: /usr/local/sbin/launch-rceo-stack.sh
moved launcher: /usr/local/sbin/setup-rceo-stack.sh
No screen session found.
root screen ukrrs-gateway-final: not present
-- cron cross-check (expect clean) --
root crontab: clean
cron dirs: clean
-- verify: units gone, timer list, remaining screens --
no stack/supervisor units remain
No Sockets found in /run/screen/S-root.
== done 2026-08-31T21:58:29-05:00 — rollback: restore /home/reachableceo/projects/ultix/removed-agent-stacks + re-enable units ==
+82
View File
@@ -0,0 +1,82 @@
== open-terminal install 2026-08-31T22:04:33-05:00 ==
Downloading cpython-3.12.14-linux-x86_64-gnu (download) (32.5MiB)
Downloaded cpython-3.12.14-linux-x86_64-gnu (download)
Ignoring existing environment for `open-terminal`: the requested Python interpreter does not match the environment interpreter
Resolved 71 packages in 25ms
Installed 71 packages in 228ms
+ aiofiles==25.1.0
+ annotated-doc==0.0.5
+ annotated-types==0.8.0
+ anyio==4.14.2
+ asttokens==3.0.2
+ attrs==26.1.0
+ certifi==2026.7.22
+ click==8.5.0
+ comm==0.2.3
+ debugpy==1.8.21
+ et-xmlfile==2.0.0
+ executing==2.2.1
+ fastapi==0.141.1
+ fastjsonschema==2.22.2
+ h11==0.16.0
+ httpcore==1.0.9
+ httptools==0.8.0
+ httpx==0.28.1
+ idna==3.19
+ ipykernel==7.3.0
+ ipython==9.17.0
+ ipython-pygments-lexers==1.1.1
+ jedi==0.20.0
+ jsonschema==4.26.0
+ jsonschema-specifications==2025.9.1
+ jupyter-client==8.10.0
+ jupyter-core==5.9.1
+ lxml==6.1.2
+ matplotlib-inline==0.2.2
+ nbclient==0.11.0
+ nbformat==5.11.1
+ nest-asyncio2==1.7.2
+ open-terminal==0.11.34
+ openpyxl==3.1.5
+ packaging==26.3
+ parso==0.8.7
+ pexpect==4.9.0
+ pillow==12.3.0
+ platformdirs==4.11.5
+ prompt-toolkit==3.0.53
+ psutil==7.2.2
+ ptyprocess==0.7.0
+ pure-eval==0.2.3
+ pydantic==2.13.5
+ pydantic-core==2.46.5
+ pygments==2.21.0
+ pypdf==6.16.2
+ python-dateutil==2.9.0.post0
+ python-docx==1.2.0
+ python-dotenv==1.2.3
+ python-multipart==0.0.32
+ python-pptx==1.0.2
+ pyyaml==6.0.3
+ pyzmq==27.2.0
+ referencing==0.37.0
+ rpds-py==2026.6.3
+ six==1.17.0
+ stack-data==0.6.3
+ starlette==1.6.0
+ striprtf==0.0.33
+ tornado==6.5.8
+ traitlets==5.16.1
+ typing-extensions==4.16.0
+ typing-inspection==0.4.4
+ uvicorn==0.52.4
+ uvloop==0.22.1
+ watchfiles==1.2.0
+ wcwidth==0.8.3
+ websockets==17.1
+ xlrd==2.0.2
+ xlsxwriter==3.2.9
Installed 1 executable: open-terminal
open-terminal 0.11.34 ok
-- verify --
unit: active
== done 2026-08-31T22:04:42-05:00 ==
+18
View File
@@ -0,0 +1,18 @@
== open-terminal per-user install 2026-08-31T22:05:03-05:00 ==
Created symlink '/etc/systemd/system/multi-user.target.wants/open-terminal@TSGCOO.service' → '/etc/systemd/system/open-terminal@.service'.
TSGCOO port 30001 cwd /home/TSGCOO/projects active unreachable
Created symlink '/etc/systemd/system/multi-user.target.wants/open-terminal@TSGCCO.service' → '/etc/systemd/system/open-terminal@.service'.
TSGCCO port 30002 cwd /home/TSGCCO active unreachable
Created symlink '/etc/systemd/system/multi-user.target.wants/open-terminal@TSGCTO.service' → '/etc/systemd/system/open-terminal@.service'.
TSGCTO port 30003 cwd /home/TSGCTO/projects active unreachable
Created symlink '/etc/systemd/system/multi-user.target.wants/open-terminal@TSGBOD.service' → '/etc/systemd/system/open-terminal@.service'.
TSGBOD port 30004 cwd /home/TSGBOD active unreachable
Created symlink '/etc/systemd/system/multi-user.target.wants/open-terminal@COS-RCEO.service' → '/etc/systemd/system/open-terminal@.service'.
COS-RCEO port 30005 cwd /home/COS-RCEO active unreachable
Created symlink '/etc/systemd/system/multi-user.target.wants/open-terminal@COS-WFO.service' → '/etc/systemd/system/open-terminal@.service'.
COS-WFO port 30006 cwd /home/COS-WFO active unreachable
Created symlink '/etc/systemd/system/multi-user.target.wants/open-terminal@COS-TSG.service' → '/etc/systemd/system/open-terminal@.service'.
COS-TSG port 30007 cwd /home/COS-TSG active unreachable
Created symlink '/etc/systemd/system/multi-user.target.wants/open-terminal@reachableceo-offstage.service' → '/etc/systemd/system/open-terminal@.service'.
reachableceo-offstage port 30008 cwd /home/reachableceo-offstage/projects active unreachable
== done 2026-08-31T22:05:18-05:00 ==
+50
View File
@@ -0,0 +1,50 @@
[22:47:32] P0 uat/.env written (beta gateway http://127.0.0.1:4002/v1, model glm-4.7)
Container ukrrs-openwebui-uat Stopping
Container ukrrs-openwebui-uat Stopped
Container ukrrs-openwebui-uat Removing
Container ukrrs-openwebui-uat Removed
Volume openwebui-uat_openwebui-uat Removing
Volume openwebui-uat_openwebui-uat Removed
Volume openwebui-uat_openwebui-uat Creating
Volume openwebui-uat_openwebui-uat Creating
Volume openwebui-uat_openwebui-uat Created
Volume openwebui-uat_openwebui-uat Created
Container ukrrs-openwebui-uat Creating
Container ukrrs-openwebui-uat Created
Container ukrrs-openwebui-uat Starting
Container ukrrs-openwebui-uat Started
[22:48:29] P1 PASS: openwebui v0.11.1 healthy on 127.0.0.1:8081
[22:48:29] P1 PASS: glm-4.7 reachable via beta gateway
[22:48:30] P2 PASS: admin signup (role admin)
[22:48:30] P3 verify: {"status":true,"type":"terminal"}
[22:48:30] P3 PASS: terminal server verified (terminal)
[22:48:30] P3 set connections: {"TERMINAL_SERVER_CONNECTIONS":[{"id":"ultix-rceo","name":"ultix-rceo","enabled":true,"url":"http://100.101.187.119:30000","path":"/openapi.json","key":"***","auth_type":"bearer","config":null,"server_type":null,"policy_id":null}]}
[22:48:30] P3 user terminal list: [{"id":"ultix-rceo","url":"http://100.101.187.119:30000","name":"ultix-rceo","contexts":{},"config":{"chat_uploads":"default"}}]
[22:48:30] P3 PASS: connection ultix-rceo visible to users
[22:48:30] P4 exec result: {"id":"20260831-224830-489a48","command":"id && ls -1 /home/reachableceo/projects","status":"done","exit_code":0,"output":[{"type":"output","data":"uid=1001(reachableceo) gid=1001(reachableceo) groups=1001(reachableceo),100(users),118(libvirt),988(docker)\r\n"},{"type":"output","data":"dotfiles\r\nKNEL\r\nPFVCluster\r\nreference\r\nSITER-Solar\r\nTSYSDevStack-SupportStack-LocalWorkstation\r\nukrrs\r\nultix\r\nWorkstationStack\r\n"}],"truncated":false,"next_offset":2,"log_path":"/home/reachableceo/.local/state/open-terminal/logs/processes/20260831-224830-489a48.jsonl"}
[22:48:30] P4 PASS: ran as reachableceo
[22:48:30] P4 PASS: sees ~/projects/ultix
[22:48:33] P5 turn1: model emitted 1 tool call(s): [{"id":"call_-7296378025417892855","name":"run_command"}]
[22:48:33] P5 executing via openwebui terminal proxy: ls -1 /home/reachableceo/projects
[22:48:33] P5 proxy exec: {"id":"20260831-224833-94630c","command":"ls -1 /home/reachableceo/projects\n","status":"done","exit_code":0,"output":[{"type":"output","data":"dotfiles\r\nKNEL\r\nPFVCluster\r\nreference\r\nSITER-Solar\r\nTSYSDevStack-SupportStack-LocalWorkstation\r\nukrrs\r\nultix\r\nWorkstationStack\r\n"}],"truncated":false,"next_offset":1,"log_path":"/home/reachableceo/.local/state/open-terminal/logs/processes/20260831-224833-94630c.jsonl"}
[22:48:33] P5 PASS: proxy-executed command returned real ~/projects content
[22:48:33] P5 turn2 body: valid JSON
[22:49:01] P5 turn2 raw (first 400): {"id":"2026090111483398401ef2c2a6440b","object":"chat.completion","created":1788234541,"model":"glm-4.7","choices":[{"index":0,"message":{"role":"assistant","content":"dotfiles\nKNEL\nPFVCluster\nreference\nSITER-Solar\nTSYSDevStack-SupportStack-LocalWorkstation\nukrrs\nultix\nWorkstationStack","reasoning_content":"The user wants me to run a specific command in a terminal-like environment (simulat
[22:49:01] P5 final answer: dotfiles
KNEL
PFVCluster
reference
SITER-Solar
TSYSDevStack-SupportStack-LocalWorkstation
ukrrs
ultix
WorkstationStack
[22:49:01] P5 PASS: final model answer contains 9/9 real directory names (full round trip: tool_call -> proxy exec on terminal -> real output -> answer)
Container ukrrs-openwebui-uat Stopping
Container ukrrs-openwebui-uat Stopped
Container ukrrs-openwebui-uat Removing
Container ukrrs-openwebui-uat Removed
Volume openwebui-uat_openwebui-uat Removing
Volume openwebui-uat_openwebui-uat Removed
[22:49:05] teardown complete (project+volume removed)
[22:49:05] EXIT=0 ALL PHASES PASSED
+1221
View File
File diff suppressed because it is too large Load Diff
+45
View File
@@ -0,0 +1,45 @@
== qm config 5111 (relevant lines) ==
cores: 4
cpuunits: 9000
memory: 50000
net0: virtio=BC:24:11:1A:8F:6F,bridge=vmbr0,queues=4
net1: virtio=BC:24:11:E3:32:D9,bridge=datanet,queues=2
onboot: 1
scsi0: NVME:5111/vm-5111-disk-0.qcow2,discard=on,iothread=1,size=438G,ssd=1
scsi1: ssd2:5111/vm-5111-disk-0.qcow2,discard=on,iothread=1,size=400G,ssd=1
scsi2: SSD:5111/vm-5111-disk-0.qcow2,discard=on,iothread=1,size=200G,ssd=1
scsihw: virtio-scsi-single
sockets: 2
startup: order=10,up=180
== qm pending 5111 (unapplied staged changes) ==
cur agent: 1
cur balloon: 0
cur boot: order=scsi0;net0
cur cores: 4
cur cpu: host,flags=+nested-virt
cur cpuunits: 9000
cur memory: 50000
cur meta: creation-qemu=10.1.2,ctime=1784819584
cur name: ultix-streaming
cur net0: virtio=BC:24:11:1A:8F:6F,bridge=vmbr0,queues=4
cur net1: virtio=BC:24:11:E3:32:D9,bridge=datanet,queues=2
cur numa: 0
cur onboot: 1
cur ostype: l26
cur scsi0: NVME:5111/vm-5111-disk-0.qcow2,discard=on,iothread=1,size=438G,ssd=1
cur scsi1: ssd2:5111/vm-5111-disk-0.qcow2,discard=on,iothread=1,size=400G,ssd=1
cur scsi2: SSD:5111/vm-5111-disk-0.qcow2,discard=on,iothread=1,size=200G,ssd=1
cur scsihw: virtio-scsi-single
cur smbios1: uuid=bc74eb91-b156-46e2-b946-808da9b4f037
cur sockets: 2
cur startup: order=10,up=180
cur vmgenid: 06fc08de-c644-497a-a1e9-72304fefd32f
== last bounce log (/var/log/ukrrs-vm5111-bounce.log) ==
bounce-start 2026-08-31T22:51:32-05:00
CPU flag 'nested-virt' resolved to 'vmx'
bounce-done 2026-08-31T22:53:16-05:00
== pve version ==
pve-manager/9.2.5/20242970da7fbcef (running kernel: 7.0.14-6-pve)
+13
View File
@@ -0,0 +1,13 @@
== pre-flip baseline 2026-08-31 21:44 CDT ==
dirty_bytes=1073741824 dirty_bg=268435456 sdb_ra_kb=128 sdc_ra_kb=128
ukrrs cgroup dirs: NONE (batch/gateway slices enabled but never started)
== sample 1: 2026-08-31T22:00:20-05:00 ==
dirty_bytes=2147483648 dirty_bg=536870912
sdb_ra_kb=1024 sdc_ra_kb=128
/sys/fs/cgroup/ukrrs.slice
== sample 2: 2026-08-31T22:01:05-05:00 ==
dirty_bytes=2147483648 dirty_bg=536870912
sdb_ra_kb=1024 sdc_ra_kb=128
/sys/fs/cgroup/ukrrs.slice
+9
View File
@@ -0,0 +1,9 @@
label: dos
label-id: 0x2d03b9dd
device: /dev/sda
unit: sectors
sector-size: 512
/dev/sda1 : start= 2048, size= 585547776, type=83, bootable
/dev/sda2 : start= 585551870, size= 18425858, type=f
/dev/sda5 : start= 585551872, size= 18425856, type=82
+6
View File
@@ -0,0 +1,6 @@
data: {"choices":[{"delta":{"content":"","reasoning_content":"The user wants me to run a specific command and return only the directory names, one per line. The command is: `ls -1 /home/reachableceo/projects`\n\nLet me run this command and see what it returns.","role":"assistant","tool_calls":[{"index":0,"id":"call_-7296376513589405675","type":"function","function":{"name":"run_command","arguments":"{\"command\":\"ls -1 /home/reachableceo/projects\"}"}}]},"finish_reason":null,"index":0}],"created":1788233502,"id":"20260901113140eae7bb7a7ca94820","model":"glm-4.7","object":"chat.completion.chunk"}
data: {"choices":[{"delta":{},"finish_reason":"tool_calls","index":0}],"created":1788233502,"id":"20260901113140eae7bb7a7ca94820","model":"glm-4.7","object":"chat.completion.chunk","usage":{"prompt_tokens":2487,"completion_tokens":66,"total_tokens":2553}}
data: [DONE]