System Overview
Model Details
| Model | Type | Params(B) | Active(B) | FLOPs/tkn | TPS | TPM | RPM | p95(ms) | Provider | Status |
|---|
21 Models Consolidated | Real-time Metrics | Azure Quotas Integrated
| Model | Type | Params(B) | Active(B) | FLOPs/tkn | TPS | TPM | RPM | p95(ms) | Provider | Status |
|---|