docs: prepend 2026-03-01 upload pipeline + filesystem consolidation session entry

This commit is contained in:
jester 2026-03-01 23:17:30 +00:00
parent 969e49d971
commit 93eadcb855

View File

@ -1,20 +1,108 @@
# Session Log ZeroLagHub (Execution Ledger) # Session Log ZeroLagHub (Execution Ledger)
Chronological ledger of notable execution work. Keep this high signal; link to code PRs/commits in upstream repos when available. Chronological ledger of notable execution work. Keep this high signal.
--- ---
## 2026-02-07 → 2026-02-08 — Console stabilization ## 2026-03-01 Upload Pipeline + Filesystem Consolidation
- Migrated console from log tailing to **PTY-backed interactive console** over WebSockets.
- Hardened WS stability: ### Completed
- moved to a single-writer pattern
- ensured exactly one PTY read loop per `{vmid, container_type}` - Implemented direct runtime upload model
- Fixed "it works but not on prod" issues caused by stale binaries still running. - Removed staging and symlink exploration
- Confirmed systemd points to `/opt/zlh-agent/current/zlh-agent` with `current -> releases/<ver>` layout. - Added `.zlh_metadata.json` provenance tracking
- Extended `stat` response with `source`
- Implemented raw `http.request` streaming in API
- Confirmed agent upload via direct curl
- Identified API upload proxy transport timing issue
- Switched from `fetch()` to native piping
- Consolidated filesystem architecture docs (`filesystem-and-file-browser.md`, `mod-deployment-safety.md`)
- Full grind repo consolidation pass (README, CONSTRAINTS, OPEN_THREADS, SESSION_START, ANTI_DRIFT, UPSTREAMS)
### System State
- Read: Stable
- Write: Stable with shadow backup
- Delete: Constrained and safe
- Upload: Implemented, transport tuning in progress
- Console: Stable
### Remaining Focus
- Improve upload transport diagnostics
- Increase upload timeout
- Dev server filesystem model planning
--- ---
## 2026-02-21 → 2026-02-22 — Game telemetry routing + agent Phase 1 feature set ## 2026-02-23 Mod System Now Operational
Full mod lifecycle implemented and confirmed end-to-end.
### What shipped
- Modrinth search integrated (`GET /api/game/mods/search`)
- Full install/list/enable/disable/delete routes live behind auth + ownership
- Agent host allowlist expanded to include `cdn.modrinth.com`
- Filename validation updated to allow `+` (required for Modrinth filenames like `sodium-neoforge-0.6.13+mc1.21.4.jar`)
- Engine metadata bug fixed: `engineType="neoforge"`, `engineVersion="1.21.4"` (was `"minecraft"` / `"neoforge-1.21.4"`)
- API → Agent payload contract corrected (field names and `source` field)
- Frontend: mod search drawer, installed panel, enable/disable/delete, toast notifications
### System state
- Full lifecycle via API: ✅
- Frontend search + install: ✅
- Enable/disable/delete: ✅
- Installed flag displayed: ✅
- Soft delete to `/mods-removed`: ✅
- No retention automation: intentional
- No install queue: intentional
- Filesystem authoritative: confirmed
### Known tradeoffs locked in
- No deterministic Modrinth project ID persistence (installed detection is heuristic)
- No DB tracking of mod state
- Soft delete is permanent until file browser enables manual restore
### Pending
- Response corruption investigation (one early curl output appeared malformed)
- API error mapping: `"mod already exists"``409` (currently `502`)
- Portal UI wiring for install flow
---
## 2026-02-22 Architecture strategy session (Claude)
### Artifact server strategy decided
- Moved away from self-hosting all mod artifacts.
- `zlh-artifactd` Phase 1 scope: **mod resolver only** (Modrinth API + NeoForge maven).
- No local mod storage in Phase 1; agent fetches from upstream, verifies hash.
- Local caching added in Phase 2 based on real usage patterns.
- Full artifact orchestrator (game jars, runtimes, mods unified) is the Phase 3 vision.
- Rationale: single-operator sustainability; learn ingestion patterns from mods before automating game jars.
### Mod platform decision
- **Modrinth** as primary source (open API, no key required, hash provided, NeoForge/Fabric/Forge/Quilt filter support).
- **CurseForge**: manual SFTP upload by user (their friction, not ours).
- Modrinth API base: `api.modrinth.com/v2`, rate limit 300 req/min, requires User-Agent header.
### NeoForge versions for artifact server
- **1.21.1** highest mod ecosystem density (16,000+ mods)
- **1.21.4** next significant stable adoption
- **1.21.11** current latest
- 1.20.x NOT needed for NeoForge; existing Forge covers that ecosystem.
### Vanilla MC versions to add
- Currently at 1.21.7; need to add 1.21.8 through 1.21.11.
- Source: Mojang version manifest at `piston-meta.mojang.com/mc/game/version_manifest_v2.json`.
### Confirmed loader coverage at launch
- Vanilla, Paper, Purpur, Forge, Quilt (covers Fabric mods too) already in place.
- NeoForge added (3 versions above).
- No Fabric standalone needed; Quilt provides compatibility.
---
## 2026-02-21 → 2026-02-22 Game telemetry routing + agent Phase 1 feature set
### API (control plane) ### API (control plane)
- Added `src/routes/game.js`, mounted at `/api/game`. - Added `src/routes/game.js`, mounted at `/api/game`.
@ -55,74 +143,10 @@ Chronological ledger of notable execution work. Keep this high signal; link to c
--- ---
## 2026-02-22 — Architecture strategy session (Claude) ## 2026-02-07 → 2026-02-08 Console stabilization
- Migrated console from log tailing to **PTY-backed interactive console** over WebSockets.
### Artifact server strategy decided - Hardened WS stability:
- Moved away from self-hosting all mod artifacts. - moved to a single-writer pattern
- `zlh-artifactd` Phase 1 scope: **mod resolver only** (Modrinth API + NeoForge maven). - ensured exactly one PTY read loop per `{vmid, container_type}`
- No local mod storage in Phase 1; agent fetches from upstream, verifies hash. - Fixed "it works but not on prod" issues caused by stale binaries still running.
- Local caching added in Phase 2 based on real usage patterns. - Confirmed systemd points to `/opt/zlh-agent/current/zlh-agent` with `current -> releases/<ver>` layout.
- Full artifact orchestrator (game jars, runtimes, mods unified) is the Phase 3 vision.
- Rationale: single-operator sustainability; learn ingestion patterns from mods before automating game jars.
### Mod platform decision
- **Modrinth** as primary source (open API, no key required, hash provided, NeoForge/Fabric/Forge/Quilt filter support).
- **CurseForge**: manual SFTP upload by user (their friction, not ours).
- Modrinth API base: `api.modrinth.com/v2`, rate limit 300 req/min, requires User-Agent header.
### NeoForge versions for artifact server
- **1.21.1** — highest mod ecosystem density (16,000+ mods)
- **1.21.4** — next significant stable adoption
- **1.21.11** — current latest
- 1.20.x NOT needed for NeoForge; existing Forge covers that ecosystem.
### Vanilla MC versions to add
- Currently at 1.21.7; need to add 1.21.8 through 1.21.11.
- Source: Mojang version manifest at `piston-meta.mojang.com/mc/game/version_manifest_v2.json`.
### Confirmed loader coverage at launch
- Vanilla, Paper, Purpur, Forge, Quilt (covers Fabric mods too) — already in place.
- NeoForge added (3 versions above).
- No Fabric standalone needed; Quilt provides compatibility.
---
## 2026-02-23 — Mod System Now Operational
Full mod lifecycle implemented and confirmed end-to-end.
### What shipped
- Modrinth search integrated (`GET /api/game/mods/search`)
- Full install/list/enable/disable/delete routes live behind auth + ownership
- Agent host allowlist expanded to include `cdn.modrinth.com`
- Filename validation updated to allow `+` (required for Modrinth filenames like `sodium-neoforge-0.6.13+mc1.21.4.jar`)
- Engine metadata bug fixed: `engineType="neoforge"`, `engineVersion="1.21.4"` (was `"minecraft"` / `"neoforge-1.21.4"`)
- API → Agent payload contract corrected (field names and `source` field)
- Frontend: mod search drawer, installed panel, enable/disable/delete, toast notifications
### System state
- Full lifecycle via API: ✅
- Frontend search + install: ✅
- Enable/disable/delete: ✅
- Installed flag displayed: ✅
- Soft delete to `/mods-removed`: ✅
- No retention automation: intentional
- No install queue: intentional
- Filesystem authoritative: confirmed
### Known tradeoffs locked in
- No deterministic Modrinth project ID persistence (installed detection is heuristic)
- No DB tracking of mod state
- Soft delete is permanent until file browser enables manual restore
### Pending
- Response corruption investigation (one early curl output appeared malformed)
- API error mapping: `"mod already exists"``409` (currently `502`)
- Portal UI wiring for install flow
---
## Next session targets
- Reproduce and resolve response corruption with clean curl test
- Tighten API error mapping
- Begin file browser (agent + API + frontend) — see `OPEN_THREADS.md`