-
Self-Hosting a 70B Model Breaks Even at 2,131 Tokens per Second, Not 5.6 Billion per Month
The break-even volume is fixed at 5.60 billion billed tokens per month regardless of workload, which is exactly why that number is useless. The real test is your overnight trough throughput, and once you add a latency target and a standby node, self-hosting stops winning at any volume.