Inference Providers
·
Metrics for top trending models
 | together cheapest | $2.50 | $6.25 | 1,010,000 | 1.95 | 60 | Yes | No |
| | fireworks-ai fastest | - | - | 262,144 | 0.93 | 90 | Yes | Yes |
 | novita cheapest | $1.32 | $3.96 | 1,048,576 | 4.62 | 27 | Yes | No |
| | $1.32 | $3.96 | 1,048,576 | 0.84 | 67 | Yes | No | |
| | - | - | 1,048,576 | 0.97 | 62 | Yes | Yes | |
| | baseten fastest | $1.32 | $3.96 | 1,048,576 | 0.64 | 76 | Yes | Yes |
 | together cheapest fastest | $0.35 | $1.50 | 131,072 | 0.24 | 99 | Yes | No |
| | - | - | 131,072 | 0.22 | 57 | Yes | No | |
| | $0.14 | $0.28 | 1,048,576 | 0.55 | 69 | Yes | No | |
| | $0.14 | $0.28 | 1,048,576 | 0.70 | 26 | Yes | Yes | |
| | - | - | 1,048,576 | 0.48 | 91 | Yes | Yes | |
| | baseten fastest | $0.13 | $0.26 | 1,048,576 | 0.57 | 114 | Yes | Yes |
| | deepinfra cheapest | $0.08 | $0.18 | 1,048,576 | 0.84 | 41 | Yes | Yes |
 | together cheapest | $3.00 | $15.00 | 1,000,000 | 3.29 | 44 | Yes | No |
| | $3.00 | $15.00 | 1,048,576 | 1.49 | 50 | Yes | Yes | |
| | baseten fastest | $3.00 | $15.00 | 1,048,576 | 0.65 | 77 | Yes | Yes |
| | - | - | - | - | - | - | - | |
 | - | - | 262,144 | 0.62 | 283 | Yes | Yes | |
 | $1.40 | $4.40 | 1,048,576 | 1.18 | 53 | Yes | Yes | |
| | $1.40 | $4.40 | 512,000 | 0.21 | 55 | Yes | Yes | |
| | $1.40 | $4.40 | 1,048,576 | 2.34 | 46 | Yes | Yes | |
| | - | - | - | 3.59 | 44 | Yes | No | |
| | scaleway fastest | $2.05 | $6.27 | - | 0.46 | 88 | Yes | No |
| | $1.40 | $4.40 | 1,048,576 | 1.59 | 70 | Yes | Yes | |
| | deepinfra cheapest | $0.75 | $2.40 | 1,048,576 | 0.45 | 63 | Yes | Yes |
 | $0.14 | $0.40 | 262,144 | 1.80 | 51 | Yes | No | |
| | cerebras fastest | $0.99 | $1.49 | 131,072 | 0.26 | 778 | Yes | Yes |
| | $0.39 | $0.97 | 262,144 | 0.20 | 86 | Yes | No | |
| | deepinfra cheapest | $0.13 | $0.38 | 262,144 | 0.26 | 88 | Yes | Yes |
| | - | - | - | - | - | - | - | |
| | $1.74 | $3.48 | 512,000 | 0.50 | 63 | Yes | Yes | |
| | $1.74 | $3.48 | 1,048,576 | 1.60 | 55 | Yes | Yes | |
| | baseten fastest | $1.74 | $3.48 | 1,048,576 | 0.53 | 118 | Yes | No |
| | deepinfra cheapest | $1.30 | $2.60 | 1,048,576 | 0.41 | 31 | Yes | Yes |
| | scaleway fastest | $0.29 | $1.71 | - | 0.36 | 173 | Yes | Yes |
| | deepinfra cheapest | $0.10 | $0.95 | 262,144 | 0.89 | 28 | Yes | No |
| | ovhcloud cheapest | $0.47 | $3.19 | 262,144 | 0.34 | 65 | Yes | Yes |
| | deepinfra fastest | $0.32 | $3.20 | 262,144 | 0.56 | 76 | Yes | Yes |
| | novita fastest | $0.14 | $0.28 | 1,048,576 | 0.87 | 94 | Yes | No |
| | deepinfra cheapest | $0.09 | $0.18 | 1,048,576 | 0.47 | 33 | Yes | Yes |
| | $0.13 | $0.40 | 262,144 | 1.10 | 47 | Yes | No | |
| | scaleway fastest | $0.29 | $0.57 | - | 0.34 | 165 | Yes | No |
| | deepinfra cheapest | $0.07 | $0.34 | 262,144 | 0.31 | 24 | Yes | Yes |
 | $0.30 | $1.20 | 1,000,000 | 0.88 | 92 | Yes | No | |
| | $0.30 | $1.20 | 524,288 | 0.34 | 96 | Yes | No | |
| | fireworks-ai fastest | $0.30 | $1.20 | 512,000 | 0.77 | 100 | Yes | Yes |
| | deepinfra cheapest | $0.28 | $1.10 | 524,288 | 1.32 | 28 | Yes | Yes |
| | $0.17 | $0.25 | 262,144 | 0.74 | 37 | Yes | Yes | |
| | $0.12 | $0.18 | 262,144 | 0.33 | 39 | Yes | Yes | |
| | deepinfra cheapest fastest | $0.10 | $0.15 | 262,144 | 0.51 | 69 | Yes | Yes |
 | $0.00 | $0.00 | 262,144 | 0.41 | 62 | Yes | No | |
 | novita cheapest fastest | $0.02 | $0.05 | 16,384 | 0.46 | 178 | No | No |
| | $0.06 | $0.06 | 131,072 | 0.64 | 145 | No | Yes | |
| | $0.02 | $0.05 | 131,072 | 0.36 | 34 | Yes | No | |
| | $0.20 | $1.50 | 262,144 | 0.97 | 126 | Yes | No | |
| | $0.70 | $2.50 | 64,000 | 0.87 | 64 | Yes | No | |
 | groq fastest | $0.10 | $0.50 | 131,072 | 0.23 | 757 | Yes | Yes |
| | $0.04 | $0.15 | 131,072 | 0.48 | 150 | No | No | |
| | $0.05 | $0.20 | 131,072 | 0.58 | 147 | Yes | Yes | |
| | $0.05 | $0.20 | 131,072 | 0.31 | 108 | Yes | No | |
| | $0.07 | $0.30 | 131,072 | 0.31 | 161 | Yes | Yes | |
| | $0.05 | $0.18 | 131,072 | 0.34 | 85 | Yes | Yes | |
| | deepinfra cheapest | $0.03 | $0.14 | 131,072 | 0.38 | 125 | Yes | Yes |
 | together cheapest | $1.00 | $4.05 | 524,288 | 0.18 | 105 | Yes | Yes |
| | - | - | 1,048,576 | 0.52 | 90 | Yes | Yes | |
| | baseten fastest | $1.00 | $4.05 | 1,048,576 | 0.19 | 135 | Yes | Yes |
| | $0.95 | $4.05 | 524,288 | 0.53 | 24 | Yes | No | |
| | $1.00 | $5.00 | 262,144 | 0.98 | 100 | Yes | Yes | |
| | together cheapest | $0.50 | $1.20 | 524,288 | 0.18 | 163 | Yes | No |
| | baseten fastest | $0.50 | $1.20 | 1,048,576 | 0.18 | 180 | Yes | Yes |
| | $0.45 | $1.20 | 524,288 | 1.08 | 124 | Yes | Yes | |
| | novita cheapest | $0.07 | $0.40 | 200,000 | 0.92 | 70 | Yes | No |
| | - | - | - | 2.32 | 53 | Yes | No | |
| | deepinfra fastest | $0.06 | $0.40 | 202,752 | 0.44 | 106 | Yes | No |
 | $0.14 | $0.58 | 262,144 | 0.35 | 53 | Yes | Yes | |
| | $0.23 | $0.91 | - | 0.34 | 147 | Yes | Yes | |
| | $0.07 | $0.18 | 40,960 | 0.58 | 133 | Yes | No | |
| | $0.15 | $0.75 | 131,072 | 0.39 | 401 | Yes | Yes | |
| | $0.05 | $0.25 | 131,072 | 0.51 | 130 | Yes | Yes | |
| | cerebras fastest | $0.35 | $0.75 | 131,072 | 0.23 | 1,027 | Yes | Yes |
| | $0.10 | $0.40 | 131,072 | 0.56 | 115 | Yes | Yes | |
| | $0.15 | $0.60 | 131,072 | 0.83 | 76 | Yes | Yes | |
| | $0.15 | $0.60 | 131,072 | 0.55 | 133 | Yes | Yes | |
| | $0.17 | $0.68 | - | 0.48 | 154 | Yes | Yes | |
| | $0.10 | $0.50 | 128,072 | 0.35 | 263 | Yes | Yes | |
| | $0.09 | $0.47 | 131,072 | 0.32 | 67 | Yes | Yes | |
| | deepinfra cheapest | $0.04 | $0.17 | 131,072 | 0.27 | 73 | Yes | Yes |
| | $0.01 | $0.03 | 262,144 | 0.60 | 129 | Yes | Yes | |
 | $0.40 | $2.00 | 262,144 | 0.50 | 21 | Yes | Yes | |
| | - | - | - | 3.02 | 54 | Yes | No | |
| | together fastest | $0.60 | $3.60 | 512,288 | 0.39 | 105 | Yes | Yes |
| | fireworks-ai cheapest | $0.60 | $2.40 | 262,144 | 1.78 | 82 | Yes | Yes |
| | $1.00 | $3.00 | 1,048,576 | 0.36 | 80 | Yes | Yes | |
| | $0.95 | $4.00 | 262,144 | 1.40 | 34 | Yes | Yes | |
| | $0.95 | $4.00 | 262,144 | 0.32 | 42 | Yes | Yes | |
| | $0.95 | $4.00 | 262,144 | 0.38 | 92 | Yes | Yes | |
| | baseten fastest | $0.95 | $4.00 | 262,000 | 0.32 | 143 | Yes | Yes |
| | deepinfra cheapest | $0.68 | $3.40 | 262,144 | 1.09 | 29 | Yes | No |
| | $0.03 | $0.03 | 8,192 | 1.15 | 208 | No | No | |
 | $0.20 | $1.15 | 262,144 | 0.41 | 101 | Yes | No | |
| | $0.01 | $0.03 | 131,072 | 0.58 | 148 | No | Yes | |
| | $0.40 | $3.20 | 262,144 | 0.87 | 80 | Yes | No | |
| | deepinfra cheapest fastest | $0.29 | $2.40 | 262,144 | 0.38 | 132 | Yes | Yes |
| | $0.30 | $1.20 | 204,800 | 1.72 | 31 | Yes | No | |
| | fireworks-ai fastest | $0.30 | $1.20 | 196,608 | 0.54 | 155 | Yes | Yes |
| | deepinfra cheapest | $0.25 | $1.00 | 196,608 | 0.69 | 45 | Yes | No |
| | nscale cheapest fastest | $0.07 | $0.20 | 40,960 | 0.62 | 87 | Yes | Yes |
| | $0.12 | $0.24 | 40,960 | 0.52 | 59 | Yes | No | |
| | $0.30 | $0.30 | 32,768 | 0.21 | 144 | Yes | Yes | |
| | $0.08 | $0.16 | 131,072 | 0.23 | 38 | Yes | Yes | |
| | $0.05 | $0.15 | 131,072 | 0.30 | 48 | Yes | Yes | |
 | $0.82 | $2.92 | - | 0.76 | 63 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | - | - | - | - | - | - | - | |
| | nscale cheapest | $0.08 | $0.25 | 40,960 | 0.57 | 48 | Yes | Yes |
| | deepinfra fastest | $0.08 | $0.28 | 40,960 | 0.23 | 57 | Yes | No |
| | novita cheapest fastest | $0.13 | $0.85 | 131,072 | 0.64 | 80 | Yes | No |
| | - | - | - | 1.76 | 67 | Yes | No | |
| | novita cheapest | $0.80 | $3.40 | 262,144 | 1.27 | 34 | Yes | Yes |
| | together fastest | $1.20 | $4.50 | 262,144 | 0.44 | 142 | Yes | Yes |
| | $0.95 | $4.00 | 262,144 | 0.70 | 57 | Yes | Yes | |
| | $0.95 | $4.00 | 262,000 | 0.53 | 139 | Yes | Yes | |
| | $0.75 | $3.50 | 262,144 | 0.91 | 27 | Yes | Yes | |
| | $0.20 | $0.20 | 131,072 | 0.58 | 93 | No | Yes | |
| | novita fastest | $1.00 | $3.20 | 202,800 | 0.90 | 53 | Yes | No |
| | - | - | - | 3.29 | 38 | Yes | No | |
| | deepinfra cheapest | $0.60 | $2.08 | 202,752 | 0.66 | 48 | Yes | Yes |
| | $0.10 | $0.30 | 262,144 | 0.56 | 102 | Yes | No | |
| | $0.05 | $0.10 | 131,072 | 0.37 | 25 | Yes | Yes | |
| | $0.06 | $0.20 | 131,072 | 0.54 | 45 | No | Yes | |
 | $0.40 | $0.40 | - | 1.01 | 55 | Yes | Yes | |
| | $0.60 | $2.20 | 204,800 | 1.83 | 37 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | - | - | - | 2.72 | 39 | Yes | No | |
| | baseten fastest | $0.60 | $2.20 | 200,000 | 0.41 | 99 | Yes | Yes |
| | deepinfra cheapest | $0.40 | $1.75 | 202,752 | 1.06 | 22 | Yes | No |
| | novita fastest | $0.27 | $1.00 | 131,072 | 1.82 | 26 | Yes | Yes |
| | deepinfra cheapest | $0.25 | $0.95 | 163,840 | 0.72 | 13 | Yes | Yes |
| | novita fastest | $0.30 | $1.50 | 131,072 | 0.86 | 30 | Yes | Yes |
| | deepinfra cheapest | $0.20 | $0.88 | 262,144 | 0.96 | 12 | Yes | Yes |
| | $0.30 | $1.20 | 204,800 | 1.30 | 58 | Yes | No | |
| | novita fastest | $0.27 | $0.40 | 163,840 | 1.65 | 32 | Yes | Yes |
| | deepinfra cheapest | $0.26 | $0.38 | 163,840 | 0.54 | 11 | Yes | No |
| | $0.05 | $0.05 | 131,072 | 0.58 | 131 | No | Yes | |
| | novita fastest | $0.25 | $2.00 | 262,144 | 1.16 | 91 | Yes | No |
| | deepinfra cheapest | $0.14 | $1.00 | 262,144 | 0.33 | 56 | Yes | Yes |
 | $0.30 | $2.50 | 262,144 | 1.07 | 85 | Yes | Yes | |
| | $0.38 | $1.55 | 262,144 | 1.49 | 47 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | $0.12 | $0.50 | 40,960 | 0.37 | 93 | Yes | Yes | |
| | - | - | 131,072 | 0.22 | 777 | Yes | Yes | |
| | together fastest | $0.20 | $0.20 | 1,048,576 | 0.12 | 16 | No | No |
| | deepinfra cheapest | $0.18 | $0.18 | 163,840 | 0.38 | 8 | No | No |
| | $0.27 | $0.41 | 163,840 | 1.25 | 28 | Yes | Yes | |
 | $1.20 | $1.20 | 65,536 | 0.69 | 51 | No | Yes | |
| | $0.15 | $0.15 | 131,072 | 0.73 | 160 | No | No | |
| | $0.15 | $1.50 | 131,072 | 0.60 | 146 | Yes | No | |
| | deepinfra cheapest fastest | $0.09 | $1.10 | 262,144 | 0.40 | 161 | Yes | Yes |
| | - | - | - | - | - | - | - | |
| | $1.05 | $3.50 | 202,752 | 4.87 | 10 | Yes | Yes | |
| | $0.60 | $3.60 | 262,144 | 0.97 | 59 | Yes | No | |
| | $0.68 | $4.10 | - | 0.52 | 51 | Yes | Yes | |
| | ovhcloud fastest | $0.71 | $4.25 | 262,144 | 0.42 | 73 | Yes | Yes |
| | deepinfra cheapest | $0.45 | $3.00 | 262,144 | 0.59 | 41 | Yes | Yes |
| | - | - | - | - | - | - | - | |
| | novita cheapest | $0.14 | $0.40 | 12,288 | 0.61 | 47 | Yes | No |
| | $1.04 | $1.04 | 131,072 | 0.78 | 60 | Yes | Yes | |
| | scaleway fastest | $1.03 | $1.03 | - | 0.39 | 85 | Yes | Yes |
| | $0.74 | $0.74 | 131,072 | 0.28 | 31 | Yes | Yes | |
| | novita fastest | $0.20 | $0.70 | 131,072 | 0.73 | 90 | Yes | Yes |
| | deepinfra cheapest | $0.15 | $0.60 | 262,144 | 0.40 | 33 | Yes | Yes |
| | $1.01 | $1.01 | 32,768 | 0.47 | 34 | No | Yes | |
| | $0.55 | $2.20 | 204,800 | 0.96 | 44 | Yes | No | |
| | - | - | - | 4.04 | 28 | Yes | No | |
| | deepinfra cheapest fastest | $0.50 | $2.00 | 202,752 | 0.41 | 61 | Yes | Yes |
| | $0.27 | $1.12 | 163,840 | 1.04 | 34 | Yes | No | |
| | deepinfra cheapest fastest | $0.24 | $0.90 | 163,840 | 1.04 | 92 | Yes | Yes |
| | novita cheapest fastest | $0.60 | $1.80 | 65,536 | 0.99 | 69 | Yes | No |
| | - | - | - | 2.69 | 39 | Yes | No | |
| | novita cheapest | $0.30 | $2.40 | 262,144 | 0.88 | 70 | Yes | No |
| | deepinfra fastest | $0.26 | $2.60 | 262,144 | 0.28 | 82 | Yes | Yes |
| | $0.40 | $1.30 | 64,000 | 1.16 | 33 | Yes | No | |
| | deepinfra cheapest fastest | $0.32 | $0.89 | 163,840 | 0.77 | 74 | Yes | Yes |
| | - | - | - | 2.41 | 53 | Yes | No | |
| | $0.30 | $1.20 | 204,800 | 1.33 | 58 | Yes | No | |
| | $0.30 | $1.20 | 204,800 | 1.78 | 50 | Yes | No | |
 | $0.05 | $0.05 | 8,192 | 0.56 | 92 | No | No | |
| | $0.80 | $0.80 | 8,192 | 0.66 | 38 | No | No | |
 | - | - | - | 0.32 | 77 | Yes | Yes | |
| | $0.09 | $0.58 | 131,072 | 0.78 | 44 | Yes | No | |
| | $0.20 | $0.60 | 32,768 | 0.78 | 18 | Yes | Yes | |
| | scaleway fastest | $0.86 | $2.57 | - | 0.33 | 100 | Yes | Yes |
| | deepinfra cheapest | $0.09 | $0.55 | 262,144 | 0.41 | 24 | Yes | Yes |
| | - | - | - | 2.78 | 52 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | $0.18 | $0.59 | 131,072 | 0.57 | 51 | No | No | |
| | nscale cheapest | $0.09 | $0.29 | 890,000 | 0.61 | 61 | Yes | Yes |
| | deepinfra fastest | $0.10 | $0.30 | 327,680 | 0.83 | 79 | Yes | Yes |
| | - | - | - | 0.19 | 54 | Yes | Yes | |
| | - | - | - | 2.03 | 59 | Yes | No | |
| | $0.06 | $0.12 | 32,768 | 0.20 | 58 | No | Yes | |
 | $1.25 | $1.25 | 163,840 | 0.27 | 81 | No | No | |
| | - | - | - | - | - | - | - | |
| | - | - | - | 2.66 | 44 | Yes | No | |
| | $1.25 | $1.25 | 163,840 | 0.29 | 74 | No | No | |
| | $0.60 | $2.50 | 262,144 | 0.55 | 40 | Yes | Yes | |
| | novita fastest | $0.60 | $3.00 | 262,144 | 0.76 | 40 | Yes | Yes |
| | deepinfra cheapest | $0.45 | $2.25 | 262,144 | 0.81 | 18 | Yes | Yes |
| | novita fastest | $0.30 | $3.00 | 131,072 | 0.86 | 70 | Yes | No |
| | deepinfra cheapest | $0.23 | $2.30 | 262,144 | 0.22 | 52 | Yes | No |
| | - | - | - | 0.35 | 30 | Yes | Yes | |
| | novita cheapest | $0.30 | $0.90 | 131,072 | 0.81 | 46 | Yes | No |
| | zai-org fastest | - | - | - | 1.82 | 69 | Yes | No |
| | - | - | - | 1.76 | 72 | Yes | No | |
| | - | - | - | 0.25 | 45 | No | No | |
| | - | - | - | 0.32 | 42 | No | No | |
 | $0.28 | $0.86 | 262,144 | 0.34 | 44 | Yes | No | |
| | - | - | - | 0.28 | 126 | Yes | Yes | |
| | - | - | - | 0.24 | 47 | No | Yes | |
| | - | - | - | 2.44 | 46 | Yes | No | |
| | - | - | - | 0.17 | 134 | No | No | |
| | - | - | - | 0.34 | 132 | No | No | |
| | - | - | - | 0.34 | 134 | No | No | |
| | - | - | - | 0.17 | 106 | Yes | Yes | |
| | $0.00 | $0.00 | 262,144 | 0.48 | 61 | Yes | No | |
| | - | - | - | 0.22 | 132 | No | No | |
| | - | - | - | 0.24 | 67 | Yes | Yes | |
| | $0.05 | $0.05 | 8,192 | 0.34 | 79 | No | No | |
| | novita cheapest fastest | $0.38 | $0.40 | 32,000 | 1.81 | 25 | Yes | No |
| | $0.36 | $0.40 | 32,768 | 0.28 | 25 | Yes | Yes | |
 | $0.62 | $0.62 | 65,535 | 0.52 | 13 | No | No | |
| | $0.01 | $0.03 | 32,768 | 0.59 | 168 | No | Yes | |
| | $0.27 | $0.85 | 1,048,576 | 0.50 | 70 | No | Yes | |
| | $0.55 | $1.66 | 32,000 | 0.78 | 48 | No | No | |
| | $0.04 | $0.14 | 65,536 | 0.49 | 95 | No | No | |
| | novita fastest | $0.20 | $0.80 | 40,960 | 1.69 | 21 | No | No |
| | nscale cheapest | $0.20 | $0.60 | 32,000 | 0.69 | 16 | Yes | No |
| | novita fastest | $0.70 | $2.50 | 163,840 | 0.97 | 19 | Yes | Yes |
| | deepinfra cheapest | $0.50 | $2.15 | 163,840 | 0.97 | 15 | Yes | No |
| | $0.55 | $2.20 | 1,000,000 | 1.58 | 55 | Yes | No | |
 | $0.42 | $1.25 | 123,000 | 1.29 | 36 | No | No | |
 | $0.07 | $0.14 | 16,384 | 0.45 | 72 | No | Yes | |
 | $0.25 | $0.50 | - | 2.88 | 41 | Yes | Yes | |
| | $0.20 | $0.40 | - | 1.33 | 52 | No | Yes | |
| | $0.82 | $2.92 | - | 0.85 | 62 | Yes | Yes | |
| | $0.27 | $1.00 | 131,072 | 1.47 | 29 | Yes | Yes | |
| | deepinfra cheapest fastest | $0.27 | $0.95 | 163,840 | 0.71 | 52 | Yes | Yes |
| | $0.57 | $2.30 | 131,072 | 0.74 | 39 | Yes | No | |
| | $0.01 | $0.03 | 262,144 | 0.56 | 156 | Yes | Yes | |
 | $0.70 | $0.70 | 131,072 | 0.23 | 38 | No | Yes | |
| | $0.98 | $3.95 | 131,072 | 0.93 | 54 | Yes | No |