Inference Providers
·
Metrics for top trending models
 | together cheapest | $2.50 | $6.25 | 1,010,000 | 0.73 | 77 | Yes | No |
| | fireworks-ai fastest | - | - | 262,144 | 1.04 | 100 | Yes | Yes |
 | together cheapest fastest | $0.35 | $1.50 | 131,072 | 0.21 | 84 | Yes | No |
| | - | - | 131,072 | 0.16 | 58 | Yes | No | |
 | novita cheapest | $1.32 | $3.96 | 1,048,576 | 0.77 | 36 | Yes | No |
| | $1.32 | $3.96 | 1,048,576 | 0.85 | 54 | Yes | No | |
| | - | - | 1,048,576 | 0.69 | 41 | Yes | Yes | |
| | baseten fastest | $1.32 | $3.96 | 1,048,576 | 0.55 | 111 | Yes | Yes |
| | $0.14 | $0.28 | 1,048,576 | 0.66 | 67 | Yes | No | |
| | $0.14 | $0.28 | 1,048,576 | 1.05 | 83 | Yes | Yes | |
| | - | - | 1,048,576 | 0.61 | 85 | Yes | Yes | |
| | baseten fastest | $0.13 | $0.26 | 1,048,576 | 0.45 | 144 | Yes | Yes |
| | deepinfra cheapest | $0.08 | $0.18 | 1,048,576 | 1.22 | 21 | Yes | Yes |
 | $3.00 | $15.00 | 1,000,000 | 0.86 | 46 | Yes | No | |
| | $3.00 | $15.00 | 1,048,576 | 1.11 | 57 | Yes | Yes | |
| | baseten fastest | $3.00 | $15.00 | 1,048,576 | 0.66 | 87 | Yes | Yes |
| | deepinfra cheapest | $2.85 | $14.25 | 1,048,576 | 1.10 | 15 | Yes | Yes |
 | - | - | 262,144 | 0.46 | 270 | Yes | Yes | |
 | $1.40 | $4.40 | 1,048,576 | 1.53 | 55 | Yes | No | |
| | $1.40 | $4.40 | 512,000 | 1.63 | 8 | Yes | Yes | |
| | $1.40 | $4.40 | 1,048,576 | 1.46 | 50 | Yes | Yes | |
| | - | - | - | 4.13 | 33 | Yes | No | |
| | scaleway fastest | $2.05 | $6.27 | - | 0.69 | 87 | Yes | No |
| | $1.40 | $4.40 | 1,048,576 | 0.82 | 86 | Yes | Yes | |
| | deepinfra cheapest | $0.75 | $2.40 | 1,048,576 | 0.97 | 64 | Yes | Yes |
 | $0.14 | $0.40 | 262,144 | 2.34 | 56 | Yes | No | |
| | cerebras fastest | $0.99 | $1.49 | 131,072 | 0.18 | 774 | Yes | Yes |
| | $0.39 | $0.97 | 262,144 | 0.20 | 80 | Yes | Yes | |
| | deepinfra cheapest | $0.13 | $0.38 | 262,144 | 0.65 | 32 | Yes | Yes |
| | - | - | - | - | - | - | - | |
| | $1.74 | $3.48 | 512,000 | 0.51 | 65 | Yes | Yes | |
| | $1.74 | $3.48 | 1,048,576 | 0.64 | 54 | Yes | Yes | |
| | baseten fastest | $1.74 | $3.48 | 1,048,576 | 0.55 | 109 | Yes | No |
| | deepinfra cheapest | $1.30 | $2.60 | 1,048,576 | 0.54 | 34 | Yes | No |
| | scaleway fastest | $0.29 | $1.71 | - | 0.40 | 186 | Yes | Yes |
| | deepinfra cheapest | $0.10 | $0.95 | 262,144 | 0.32 | 29 | Yes | Yes |
| | ovhcloud cheapest fastest | $0.47 | $3.19 | 262,144 | 0.36 | 76 | Yes | Yes |
| | $0.32 | $3.20 | 262,144 | 0.30 | 56 | Yes | Yes | |
| | novita fastest | $0.14 | $0.28 | 1,048,576 | 0.83 | 95 | Yes | No |
| | deepinfra cheapest | $0.09 | $0.18 | 1,048,576 | 0.76 | 35 | Yes | Yes |
 | $0.00 | $0.00 | 262,144 | 0.39 | 90 | Yes | No | |
| | $0.13 | $0.40 | 262,144 | 0.54 | 24 | Yes | No | |
| | scaleway fastest | $0.29 | $0.57 | - | 0.39 | 170 | Yes | No |
| | deepinfra cheapest | $0.07 | $0.34 | 262,144 | 0.40 | 26 | Yes | Yes |
 | $0.30 | $1.20 | 1,000,000 | 0.94 | 87 | Yes | No | |
| | $0.30 | $1.20 | 524,288 | 0.33 | 95 | Yes | No | |
| | fireworks-ai fastest | $0.30 | $1.20 | 512,000 | 0.67 | 108 | Yes | Yes |
| | deepinfra cheapest | $0.28 | $1.10 | 524,288 | 0.70 | 39 | Yes | Yes |
 | novita cheapest fastest | $0.02 | $0.05 | 16,384 | 0.48 | 157 | No | No |
| | $0.06 | $0.06 | 131,072 | 0.65 | 148 | No | Yes | |
| | $0.02 | $0.05 | 131,072 | 0.52 | 22 | Yes | No | |
| | together fastest | $0.17 | $0.25 | 262,144 | 0.33 | 82 | Yes | Yes |
| | $0.12 | $0.18 | 262,144 | 0.39 | 36 | Yes | Yes | |
| | deepinfra cheapest | $0.10 | $0.15 | 262,144 | 0.37 | 36 | Yes | Yes |
| | $0.20 | $1.50 | 262,144 | 0.98 | 123 | Yes | No | |
 | together cheapest | $1.00 | $4.05 | 524,288 | 1.04 | 44 | Yes | Yes |
| | - | - | 1,048,576 | 0.46 | 88 | Yes | Yes | |
| | baseten fastest | $1.00 | $4.05 | 1,048,576 | 0.21 | 105 | Yes | Yes |
| | $0.95 | $4.05 | 524,288 | 0.85 | 17 | Yes | No | |
| | $0.70 | $2.50 | 64,000 | 0.91 | 16 | No | Yes | |
 | groq fastest | $0.10 | $0.50 | 131,072 | 0.13 | 805 | Yes | Yes |
| | $0.04 | $0.15 | 131,072 | 0.35 | 108 | No | Yes | |
| | $0.05 | $0.20 | 131,072 | 0.54 | 162 | Yes | Yes | |
| | $0.05 | $0.20 | 131,072 | 0.29 | 107 | Yes | Yes | |
| | $0.07 | $0.30 | 131,072 | 0.56 | 95 | Yes | Yes | |
| | $0.05 | $0.18 | 131,072 | 0.31 | 80 | Yes | Yes | |
| | deepinfra cheapest | $0.03 | $0.14 | 131,072 | 0.28 | 87 | Yes | Yes |
| | novita cheapest | $0.07 | $0.40 | 200,000 | 0.61 | 53 | Yes | No |
| | - | - | - | 1.93 | 75 | Yes | No | |
| | deepinfra fastest | $0.06 | $0.40 | 202,752 | 0.50 | 126 | Yes | No |
| | together cheapest fastest | $0.50 | $1.20 | 524,288 | 0.21 | 190 | Yes | No |
| | $0.50 | $1.20 | 1,048,576 | 0.21 | 178 | Yes | Yes | |
| | $0.45 | $1.20 | 524,288 | 0.38 | 138 | Yes | Yes | |
| | $0.23 | $0.91 | - | 0.40 | 147 | Yes | Yes | |
| | $1.00 | $5.00 | 262,144 | 1.02 | 123 | Yes | Yes | |
| | $0.15 | $0.75 | 131,072 | 0.18 | 442 | Yes | Yes | |
| | $0.05 | $0.25 | 131,072 | 0.43 | 76 | Yes | Yes | |
| | cerebras fastest | $0.35 | $0.75 | 131,072 | 0.29 | 855 | Yes | Yes |
| | $0.10 | $0.40 | 131,072 | 0.55 | 112 | Yes | Yes | |
| | $0.15 | $0.60 | 131,072 | 0.23 | 167 | Yes | Yes | |
| | $0.15 | $0.60 | 131,072 | 0.47 | 79 | Yes | Yes | |
| | $0.17 | $0.68 | - | 0.46 | 140 | Yes | Yes | |
| | $0.10 | $0.50 | 128,072 | 0.19 | 315 | Yes | Yes | |
| | $0.09 | $0.47 | 131,072 | 0.26 | 144 | Yes | Yes | |
| | deepinfra cheapest | $0.04 | $0.17 | 131,072 | 0.35 | 11 | Yes | Yes |
| | $0.95 | $4.00 | 262,144 | 1.04 | 62 | Yes | Yes | |
| | $0.95 | $4.00 | 262,144 | 0.25 | 121 | Yes | Yes | |
| | $0.95 | $4.00 | 262,144 | 0.37 | 95 | Yes | Yes | |
| | baseten fastest | $0.95 | $4.00 | 262,000 | 0.40 | 147 | Yes | Yes |
| | deepinfra cheapest | $0.68 | $3.40 | 262,144 | 0.69 | 87 | Yes | No |
| | $0.07 | $0.18 | 40,960 | 0.58 | 134 | Yes | No | |
| | $0.60 | $3.60 | 512,288 | 0.23 | 105 | Yes | Yes | |
| | fireworks-ai cheapest fastest | $0.60 | $2.40 | 262,144 | 0.51 | 115 | Yes | Yes |
 | $0.14 | $0.58 | 262,144 | 0.24 | 59 | Yes | Yes | |
| | $0.01 | $0.03 | 262,144 | 0.63 | 61 | Yes | Yes | |
 | $1.00 | $3.00 | 1,048,576 | 0.33 | 86 | Yes | Yes | |
| | $0.03 | $0.03 | 8,192 | 1.04 | 192 | No | No | |
| | $0.25 | $2.00 | 262,144 | 0.74 | 98 | Yes | No | |
| | deepinfra cheapest fastest | $0.14 | $1.00 | 262,144 | 0.20 | 139 | Yes | Yes |
| | $0.01 | $0.03 | 131,072 | 0.58 | 149 | No | Yes | |
| | $0.30 | $1.20 | 204,800 | 1.58 | 39 | Yes | No | |
| | fireworks-ai fastest | $0.30 | $1.20 | 196,608 | 0.74 | 128 | Yes | Yes |
| | deepinfra cheapest | $0.25 | $1.00 | 196,608 | 0.83 | 58 | Yes | No |
| | $0.40 | $2.00 | 262,144 | 0.28 | 64 | Yes | Yes | |
| | $0.06 | $0.20 | 131,072 | 0.57 | 46 | No | Yes | |
| | $0.40 | $3.20 | 262,144 | 1.08 | 82 | Yes | No | |
| | deepinfra cheapest fastest | $0.29 | $2.40 | 262,144 | 0.33 | 122 | Yes | No |
 | $0.20 | $1.15 | 262,144 | 0.32 | 92 | Yes | No | |
| | - | - | - | 3.43 | 43 | Yes | No | |
| | $0.05 | $0.15 | 131,072 | 0.84 | 23 | Yes | Yes | |
| | novita cheapest | $0.80 | $3.40 | 262,144 | 1.13 | 58 | Yes | Yes |
| | together fastest | $1.20 | $4.50 | 262,144 | 0.36 | 189 | Yes | Yes |
| | $0.95 | $4.00 | 262,144 | 2.60 | 73 | Yes | Yes | |
| | $0.95 | $4.00 | 262,000 | 0.38 | 148 | Yes | Yes | |
| | $0.75 | $3.50 | 262,144 | 0.54 | 45 | Yes | Yes | |
| | $0.10 | $0.30 | 262,144 | 0.42 | 93 | Yes | No | |
| | novita cheapest | $0.13 | $0.85 | 131,072 | 0.62 | 61 | Yes | No |
| | zai-org fastest | - | - | - | 1.90 | 76 | Yes | No |
| | $1.00 | $3.20 | 202,800 | 1.12 | 36 | Yes | No | |
| | zai-org fastest | - | - | - | 3.29 | 38 | Yes | No |
| | deepinfra cheapest | $0.60 | $2.08 | 202,752 | 0.78 | 37 | Yes | Yes |
| | $0.20 | $0.20 | 131,072 | 0.71 | 90 | No | Yes | |
| | - | - | - | - | - | - | - | |
| | $0.12 | $0.50 | 40,960 | 0.25 | 73 | Yes | Yes | |
 | $0.40 | $0.40 | - | 0.99 | 56 | Yes | Yes | |
| | $0.30 | $0.30 | 32,768 | 0.23 | 133 | Yes | No | |
| | $0.08 | $0.16 | 131,072 | 1.06 | 19 | Yes | Yes | |
| | novita fastest | $0.27 | $0.40 | 163,840 | 1.54 | 28 | Yes | Yes |
| | deepinfra cheapest | $0.26 | $0.38 | 163,840 | 0.74 | 10 | Yes | Yes |
| | $0.60 | $2.20 | 204,800 | 1.28 | 50 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | - | - | - | - | - | - | - | |
| | baseten fastest | $0.60 | $2.20 | 200,000 | 0.47 | 129 | Yes | Yes |
| | deepinfra cheapest | $0.40 | $1.75 | 202,752 | 0.96 | 18 | Yes | No |
| | novita cheapest | $0.30 | $0.90 | 131,072 | 0.59 | 59 | Yes | No |
| | zai-org fastest | - | - | - | 1.64 | 77 | Yes | No |
| | $0.30 | $1.20 | 204,800 | 1.39 | 57 | Yes | No | |
| | novita fastest | $0.30 | $1.50 | 131,072 | 0.54 | 35 | Yes | Yes |
| | deepinfra cheapest | $0.20 | $0.88 | 262,144 | 0.80 | 22 | Yes | Yes |
| | $0.05 | $0.05 | 131,072 | 0.81 | 127 | No | Yes | |
| | $0.60 | $3.60 | 262,144 | 0.99 | 58 | Yes | No | |
| | scaleway fastest | $0.68 | $4.10 | - | 0.41 | 115 | Yes | Yes |
| | $0.71 | $4.25 | 262,144 | 0.35 | 106 | Yes | No | |
| | deepinfra cheapest | $0.45 | $3.00 | 262,144 | 0.66 | 10 | Yes | Yes |
 | $0.30 | $2.50 | 262,144 | 0.98 | 42 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | - | - | - | - | - | - | - | |
| | nscale cheapest | $0.08 | $0.25 | 40,960 | 0.67 | 47 | Yes | Yes |
| | deepinfra fastest | $0.08 | $0.28 | 40,960 | 0.32 | 89 | Yes | No |
| | nscale cheapest fastest | $0.07 | $0.20 | 40,960 | 0.53 | 96 | Yes | No |
| | $0.12 | $0.24 | 40,960 | 0.41 | 43 | Yes | No | |
 | $0.82 | $2.92 | - | 0.80 | 64 | Yes | Yes | |
| | $0.10 | $0.20 | - | 0.72 | 147 | Yes | Yes | |
| | $1.01 | $1.01 | 32,768 | 0.34 | 34 | No | Yes | |
| | - | - | 131,072 | 0.30 | 654 | Yes | Yes | |
| | novita fastest | $0.27 | $1.00 | 131,072 | 1.56 | 27 | Yes | Yes |
| | deepinfra cheapest | $0.25 | $0.95 | 163,840 | 0.78 | 7 | Yes | Yes |
 | $0.07 | $0.14 | 16,384 | 0.29 | 4 | No | Yes | |
| | $0.05 | $0.10 | 131,072 | 1.58 | 24 | Yes | Yes | |
| | $0.38 | $1.55 | 262,144 | 0.73 | 58 | Yes | No | |
 | - | - | - | 0.14 | 126 | Yes | Yes | |
 | $1.20 | $1.20 | 65,536 | 0.52 | 55 | No | Yes | |
| | $0.15 | $0.15 | 131,072 | 0.70 | 161 | No | No | |
| | novita fastest | $0.15 | $1.50 | 131,072 | 0.92 | 114 | Yes | No |
| | deepinfra cheapest | $0.09 | $1.10 | 262,144 | 0.62 | 53 | Yes | Yes |
| | zai-org fastest | - | - | - | 4.11 | 41 | Yes | No |
| | deepinfra cheapest | $1.05 | $3.50 | 202,752 | 4.41 | 9 | Yes | No |
| | novita fastest | $0.20 | $0.80 | 40,960 | 0.90 | 32 | No | No |
| | nscale cheapest | $0.20 | $0.60 | 32,000 | 0.80 | 16 | Yes | Yes |
| | $0.09 | $0.58 | 131,072 | 0.83 | 29 | Yes | Yes | |
| | $0.20 | $0.60 | 32,768 | 0.72 | 14 | Yes | Yes | |
| | scaleway fastest | $0.86 | $2.57 | - | 0.48 | 93 | Yes | Yes |
| | deepinfra cheapest | $0.09 | $0.55 | 262,144 | 0.43 | 32 | Yes | Yes |
| | - | - | - | 2.13 | 59 | Yes | No | |
| | $0.01 | $0.03 | 262,144 | 0.68 | 157 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | novita cheapest | $0.14 | $0.40 | 12,288 | 0.53 | 45 | Yes | No |
| | $1.04 | $1.04 | 131,072 | 0.44 | 83 | Yes | Yes | |
| | scaleway fastest | $1.03 | $1.03 | - | 0.38 | 86 | Yes | Yes |
| | $0.74 | $0.74 | 131,072 | 0.28 | 29 | Yes | Yes | |
| | $0.55 | $2.20 | 204,800 | 1.54 | 38 | Yes | No | |
| | - | - | - | 4.85 | 16 | Yes | No | |
| | deepinfra cheapest fastest | $0.50 | $2.00 | 202,752 | 0.51 | 61 | Yes | Yes |
| | together fastest | $0.20 | $0.20 | 1,048,576 | 0.12 | 15 | No | No |
| | deepinfra cheapest | $0.18 | $0.18 | 163,840 | 0.45 | 7 | No | No |
| | novita cheapest | $0.60 | $1.80 | 65,536 | 1.03 | 81 | Yes | No |
| | zai-org fastest | - | - | - | 1.55 | 94 | Yes | No |
| | novita cheapest fastest | $0.38 | $0.40 | 32,000 | 0.38 | 39 | Yes | No |
| | $0.36 | $0.40 | 32,768 | 1.82 | 4 | Yes | Yes | |
| | - | - | - | 2.41 | 53 | Yes | No | |
| | novita cheapest | $0.30 | $2.40 | 262,144 | 1.26 | 36 | Yes | No |
| | deepinfra fastest | $0.26 | $2.60 | 262,144 | 0.24 | 78 | Yes | Yes |
| | $0.30 | $1.20 | 204,800 | 1.75 | 54 | Yes | No | |
| | $0.30 | $1.20 | 204,800 | 0.97 | 57 | Yes | No | |
| | $0.27 | $0.41 | 163,840 | 1.07 | 30 | Yes | Yes | |
 | $0.05 | $0.05 | 8,192 | 0.43 | 89 | No | No | |
| | $0.80 | $0.80 | 8,192 | 0.74 | 18 | No | No | |
| | $0.40 | $1.30 | 64,000 | 1.73 | 30 | Yes | No | |
| | deepinfra cheapest fastest | $0.32 | $0.89 | 163,840 | 0.40 | 33 | Yes | Yes |
| | $0.04 | $0.14 | 65,536 | 0.59 | 82 | No | No | |
| | - | - | - | 0.19 | 133 | No | No | |
| | - | - | - | 0.35 | 132 | No | No | |
| | - | - | - | 0.14 | 154 | Yes | Yes | |
| | - | - | - | 0.24 | 47 | No | Yes | |
| | $0.00 | $0.00 | 262,144 | 0.33 | 93 | Yes | No | |
 | $0.42 | $1.25 | 123,000 | 1.51 | 34 | No | No | |
| | - | - | - | - | - | - | - | |
| | $0.18 | $0.59 | 131,072 | 0.60 | 38 | No | No | |
| | nscale cheapest fastest | $0.09 | $0.29 | 890,000 | 0.60 | 73 | Yes | No |
| | $0.10 | $0.30 | 327,680 | 0.30 | 63 | Yes | Yes | |
 | $0.28 | $0.86 | 262,144 | 0.29 | 42 | Yes | No | |
| | $0.57 | $2.30 | 131,072 | 0.83 | 39 | Yes | No | |
| | novita fastest | $0.30 | $3.00 | 131,072 | 0.76 | 47 | Yes | No |
| | deepinfra cheapest | $0.23 | $2.30 | 262,144 | 0.40 | 40 | Yes | No |
| | novita fastest | $0.20 | $0.70 | 131,072 | 0.56 | 69 | Yes | Yes |
| | deepinfra cheapest | $0.15 | $0.60 | 262,144 | 0.38 | 34 | Yes | Yes |
| | - | - | - | 0.13 | 143 | Yes | Yes | |
| | - | - | - | 1.73 | 82 | Yes | No | |
| | $0.60 | $2.50 | 262,144 | 0.73 | 39 | Yes | Yes | |
| | - | - | - | 0.24 | 53 | Yes | Yes | |
| | novita fastest | $0.27 | $1.00 | 131,072 | 1.64 | 27 | Yes | Yes |
| | deepinfra cheapest | $0.27 | $0.95 | 163,840 | 0.72 | 22 | Yes | Yes |
| | - | - | - | 0.22 | 82 | Yes | Yes | |
| | - | - | - | 0.20 | 39 | Yes | Yes | |
| | - | - | - | 2.34 | 53 | Yes | No | |
| | - | - | - | 3.33 | 52 | Yes | No | |
| | - | - | - | 0.27 | 44 | No | No | |
| | $0.98 | $3.95 | 131,072 | 0.91 | 47 | Yes | No | |
| | - | - | - | 0.18 | 134 | No | No | |
| | - | - | - | 4.26 | 26 | Yes | No | |
| | - | - | - | 0.20 | 42 | No | No | |
| | - | - | - | 0.24 | 39 | Yes | No | |
| | $0.55 | $2.20 | 1,000,000 | 1.57 | 47 | Yes | No | |
| | - | - | - | 0.18 | 103 | Yes | Yes | |
| | - | - | - | 0.24 | 71 | Yes | Yes | |
| | - | - | - | 0.36 | 131 | No | No | |
| | $0.05 | $0.05 | 8,192 | 0.33 | 73 | No | No | |
 | $0.62 | $0.62 | 65,535 | 0.50 | 11 | No | No | |
 | $0.70 | $0.70 | 131,072 | 0.18 | 35 | No | Yes | |
| | $0.10 | $0.20 | - | 0.48 | 148 | No | Yes | |
| | $0.70 | $2.50 | 163,840 | 1.42 | 19 | Yes | Yes | |
| | deepinfra cheapest fastest | $0.50 | $2.15 | 163,840 | 0.56 | 33 | Yes | No |
| | $0.06 | $0.12 | 32,768 | 0.22 | 58 | No | Yes | |
 | $1.25 | $1.25 | 163,840 | 0.30 | 71 | No | No | |
| | - | - | - | - | - | - | - | |
| | $1.25 | $1.25 | 163,840 | 0.23 | 70 | No | No | |
| | $0.01 | $0.03 | 32,768 | 0.58 | 183 | No | Yes | |
| | novita fastest | $0.60 | $3.00 | 262,144 | 1.27 | 38 | Yes | Yes |
| | deepinfra cheapest | $0.45 | $2.25 | 262,144 | 0.90 | 33 | Yes | Yes |
| | $0.55 | $1.66 | 32,000 | 0.72 | 55 | No | No | |
| | $0.27 | $0.85 | 1,048,576 | 0.47 | 68 | No | Yes | |
| | $0.27 | $1.12 | 163,840 | 1.25 | 31 | Yes | No | |
| | deepinfra cheapest fastest | $0.24 | $0.90 | 163,840 | 0.75 | 84 | Yes | Yes |
 | $0.25 | $0.50 | - | 1.35 | 42 | Yes | Yes | |
| | $0.20 | $0.40 | - | 1.49 | 51 | No | Yes | |
| | $0.82 | $2.92 | - | 0.59 | 58 | No | Yes |