josh 901db02a6b Replace decorative overload policy with real serving pipeline and dedicated Serving page ...

The old overload policy had dead controls (maxQueueDepth, rateLimitPerCustomer never read)
and trivial flat penalties. This replaces it with a full serving pipeline where deployed
models form a fleet, requests route through priority/degradation logic, and policy choices
create meaningful strategic tradeoffs.

New serving pipeline: fleet building from deployed models (size/quant/MoE multipliers),
demand categorization by 5 priority tiers, enterprise capacity reservation, priority-ordered
serving with overflow behaviors (queue/reject/degrade), auto-degradation to faster models
under load, and Batch API to fill idle capacity at discounted rates.

4 new research nodes gate features progressively: Intelligent Request Routing, Priority
Queue System, Request Batching, and Auto-Scaling. New dedicated Serving page with pipeline
metrics, model fleet utilization, and research-gated policy controls.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

2026-04-25 12:42:09 -04:00

..

src

Replace decorative overload policy with real serving pipeline and dedicated Serving page

2026-04-25 12:42:09 -04:00

package.json

Add Docker and Gitea Actions CI/CD pipeline

2026-04-24 18:27:07 -04:00

tsconfig.json

Initial scaffold: AI Tycoon monorepo with core game loop

2026-04-24 16:53:46 -04:00