Inference Providers
·
Metrics for top trending models
 | together cheapest | $3.00 | $15.00 | 1,000,000 | 1.16 | 54 | No | Yes |
| | $3.00 | $15.00 | 1,048,576 | 1.07 | 73 | Yes | No | |
| | baseten fastest | $3.00 | $15.00 | 1,048,576 | 0.86 | 79 | Yes | Yes |
 | $1.40 | $4.40 | 1,048,576 | 0.85 | 53 | Yes | No | |
| | $1.40 | $4.40 | 512,000 | 0.32 | 48 | Yes | Yes | |
| | $1.40 | $4.40 | 1,048,576 | 2.24 | 24 | Yes | No | |
| | - | - | - | 2.49 | 65 | No | No | |
| | scaleway fastest | $2.05 | $6.27 | - | 0.74 | 86 | Yes | Yes |
| | $1.40 | $4.40 | 1,048,576 | 1.03 | 74 | Yes | Yes | |
| | deepinfra cheapest | $0.75 | $2.40 | 1,048,576 | 0.37 | 66 | Yes | Yes |
 | together cheapest fastest | $0.50 | $1.20 | 524,288 | 0.27 | 168 | Yes | No |
| | $0.50 | $1.20 | 524,288 | 0.36 | 135 | Yes | No | |
 | $0.14 | $0.28 | 1,048,576 | 1.69 | 68 | Yes | No | |
| | fireworks-ai fastest | $0.14 | $0.28 | 1,048,576 | 0.98 | 91 | Yes | No |
| | deepinfra cheapest | $0.09 | $0.18 | 1,048,576 | 0.38 | 39 | Yes | Yes |
 | $0.00 | $0.00 | 262,144 | 0.30 | 93 | Yes | No | |
| | together cheapest | $1.00 | $4.05 | 524,288 | 0.20 | 116 | Yes | Yes |
| | - | - | 1,048,576 | 0.42 | 105 | Yes | Yes | |
| | $1.00 | $4.05 | 1,048,576 | 0.21 | 99 | Yes | Yes | |
| | deepinfra fastest | $1.00 | $4.05 | 524,288 | 0.49 | 116 | Yes | No |
 | scaleway fastest | $0.29 | $1.71 | - | 0.44 | 183 | Yes | Yes |
| | deepinfra cheapest | $0.10 | $0.95 | 262,144 | 0.26 | 71 | Yes | Yes |
| | ovhcloud cheapest fastest | $0.47 | $3.19 | 262,144 | 0.57 | 74 | Yes | Yes |
| | $0.32 | $3.20 | 262,144 | 0.28 | 59 | Yes | Yes | |
| | $0.95 | $4.00 | 262,144 | 1.40 | 29 | Yes | Yes | |
| | together fastest | $0.95 | $4.00 | 262,144 | 0.59 | 127 | Yes | Yes |
| | $0.95 | $4.00 | 262,144 | 0.81 | 87 | Yes | No | |
| | $0.95 | $4.00 | 262,000 | 0.55 | 55 | Yes | Yes | |
| | deepinfra cheapest | $0.74 | $3.50 | 262,144 | 0.62 | 75 | Yes | Yes |
| | $1.60 | $3.20 | 1,048,576 | 2.08 | 50 | Yes | No | |
| | together fastest | $1.74 | $3.48 | 512,000 | 0.67 | 74 | Yes | Yes |
| | $1.74 | $3.48 | 1,048,576 | 0.52 | 62 | Yes | No | |
| | $1.74 | $3.48 | 262,144 | 0.50 | 73 | Yes | No | |
| | deepinfra cheapest | $1.30 | $2.60 | 1,048,576 | 0.49 | 40 | Yes | Yes |
 | $0.14 | $0.40 | 262,144 | 0.65 | 67 | Yes | No | |
| | cerebras fastest | $0.99 | $1.49 | 131,072 | 0.19 | 611 | Yes | No |
| | $0.39 | $0.97 | 262,144 | 0.18 | 91 | No | No | |
| | deepinfra cheapest | $0.13 | $0.38 | 262,144 | 0.81 | 49 | No | Yes |
 | novita cheapest | $0.30 | $1.20 | 1,000,000 | 1.52 | 54 | Yes | No |
| | $0.30 | $1.20 | 524,288 | 0.57 | 47 | Yes | Yes | |
| | fireworks-ai fastest | $0.30 | $1.20 | 512,000 | 0.68 | 121 | Yes | No |
| | $0.30 | $1.20 | 524,288 | 0.53 | 67 | Yes | No | |
 | novita cheapest | $0.02 | $0.05 | 16,384 | 0.46 | 141 | No | No |
| | nscale fastest | $0.06 | $0.06 | 131,072 | 0.44 | 154 | No | Yes |
| | $0.02 | $0.05 | 131,072 | 0.37 | 30 | Yes | No | |
 | $0.15 | $0.75 | 131,072 | 0.15 | 438 | Yes | No | |
| | $0.05 | $0.25 | 131,072 | 1.10 | 67 | Yes | Yes | |
| | cerebras fastest | $0.35 | $0.75 | 131,072 | 0.21 | 1,224 | Yes | No |
| | $0.10 | $0.40 | 131,072 | 0.57 | 114 | Yes | Yes | |
| | $0.15 | $0.60 | 131,072 | 0.20 | 180 | Yes | Yes | |
| | $0.15 | $0.60 | 131,072 | 0.20 | 220 | Yes | No | |
| | $0.17 | $0.68 | - | 0.32 | 164 | Yes | Yes | |
| | $0.10 | $0.50 | 128,072 | 0.26 | 229 | Yes | Yes | |
| | $0.09 | $0.47 | 131,072 | 0.28 | 164 | Yes | Yes | |
| | deepinfra cheapest | $0.04 | $0.17 | 131,072 | 0.38 | 47 | Yes | Yes |
 | $0.82 | $2.92 | - | 0.52 | 67 | Yes | Yes | |
| | $0.07 | $0.18 | 40,960 | 0.55 | 113 | Yes | No | |
| | together fastest | $0.17 | $0.25 | 262,144 | 2.64 | 59 | Yes | Yes |
| | $0.12 | $0.18 | 262,144 | 0.45 | 41 | Yes | No | |
| | deepinfra cheapest | $0.10 | $0.15 | 262,144 | 0.40 | 18 | Yes | Yes |
| | $0.70 | $2.50 | 64,000 | 0.79 | 32 | Yes | No | |
| | $0.10 | $0.20 | - | 1.00 | 143 | Yes | Yes | |
| | groq fastest | $0.10 | $0.50 | 131,072 | 0.23 | 755 | Yes | No |
| | $0.04 | $0.15 | 131,072 | 0.34 | 110 | No | Yes | |
| | $0.05 | $0.20 | 131,072 | 0.56 | 147 | Yes | Yes | |
| | $0.05 | $0.20 | 131,072 | 0.23 | 75 | Yes | Yes | |
| | $0.07 | $0.30 | 131,072 | 0.31 | 98 | Yes | No | |
| | $0.05 | $0.18 | 131,072 | 0.31 | 84 | Yes | Yes | |
| | deepinfra cheapest | $0.03 | $0.14 | 131,072 | 0.41 | 119 | Yes | Yes |
| | $0.13 | $0.40 | 262,144 | 1.15 | 38 | Yes | No | |
| | scaleway fastest | $0.29 | $0.57 | - | 0.42 | 158 | Yes | No |
| | deepinfra cheapest | $0.07 | $0.34 | 262,144 | 0.74 | 16 | Yes | Yes |
 | $0.40 | $2.00 | 262,144 | 3.04 | 17 | Yes | Yes | |
 | $0.14 | $0.58 | 262,144 | 0.58 | 56 | Yes | Yes | |
 | $0.10 | $0.75 | 262,144 | 0.25 | 48 | Yes | Yes | |
| | novita cheapest | $0.80 | $3.40 | 262,144 | 1.48 | 44 | Yes | No |
| | together fastest | $1.20 | $4.50 | 262,144 | 0.47 | 180 | Yes | Yes |
| | $0.95 | $4.00 | 262,144 | 0.62 | 53 | Yes | No | |
| | $0.95 | $4.00 | 262,000 | 0.36 | 108 | Yes | Yes | |
| | $0.75 | $3.50 | 262,144 | 0.66 | 62 | Yes | Yes | |
 | together fastest | $0.60 | $3.60 | 512,288 | 0.22 | 129 | Yes | Yes |
| | fireworks-ai cheapest | $0.60 | $2.40 | 262,144 | 0.68 | 84 | Yes | No |
| | $0.20 | $1.50 | 262,144 | 0.82 | 127 | Yes | No | |
| | $0.30 | $0.30 | 32,768 | 0.29 | 79 | Yes | Yes | |
| | $0.40 | $3.20 | 262,144 | 0.80 | 113 | Yes | No | |
| | deepinfra cheapest fastest | $0.29 | $2.40 | 262,144 | 0.28 | 147 | Yes | No |
| | novita cheapest fastest | $0.07 | $0.40 | 200,000 | 0.65 | 77 | Yes | No |
| | - | - | - | 1.91 | 75 | Yes | No | |
| | $0.06 | $0.40 | 202,752 | 0.51 | 65 | Yes | No | |
| | $0.03 | $0.03 | 8,192 | 1.09 | 80 | No | No | |
| | $0.23 | $0.91 | - | 0.34 | 130 | Yes | Yes | |
| | - | - | - | 2.78 | 58 | Yes | No | |
 | $0.20 | $1.15 | 262,144 | 0.27 | 148 | Yes | No | |
| | novita fastest | $0.40 | $1.30 | 64,000 | 1.15 | 35 | Yes | No |
| | deepinfra cheapest | $0.32 | $0.89 | 163,840 | 0.84 | 21 | Yes | Yes |
| | novita cheapest | $0.30 | $2.40 | 262,144 | 1.47 | 55 | Yes | No |
| | deepinfra fastest | $0.26 | $2.60 | 262,144 | 0.26 | 78 | Yes | Yes |
| | $0.05 | $0.10 | 131,072 | 0.34 | 23 | Yes | Yes | |
| | $0.60 | $3.00 | 262,144 | 0.85 | 35 | Yes | Yes | |
| | deepinfra cheapest fastest | $0.45 | $2.25 | 262,144 | 0.55 | 95 | Yes | Yes |
| | groq fastest | $0.59 | $0.79 | 131,072 | 0.28 | 255 | Yes | No |
| | novita cheapest | $0.14 | $0.40 | 6,000 | 0.58 | 31 | Yes | No |
| | $1.04 | $1.04 | 131,072 | 0.38 | 111 | Yes | Yes | |
| | $1.03 | $1.03 | - | 0.34 | 88 | Yes | Yes | |
| | $0.74 | $0.74 | 131,072 | 0.45 | 31 | Yes | Yes | |
| | novita fastest | $0.25 | $2.00 | 262,144 | 0.76 | 124 | Yes | No |
| | deepinfra cheapest | $0.14 | $1.00 | 262,144 | 0.51 | 81 | Yes | Yes |
| | $1.00 | $5.00 | 262,144 | 1.02 | 54 | Yes | Yes | |
| | $0.30 | $1.20 | 204,800 | 1.49 | 46 | Yes | No | |
| | fireworks-ai fastest | $0.30 | $1.20 | 196,608 | 0.56 | 171 | Yes | No |
| | deepinfra cheapest | $0.25 | $1.00 | 196,608 | 0.52 | 32 | Yes | No |
| | $0.01 | $0.03 | 262,144 | 0.49 | 69 | Yes | Yes | |
| | $0.60 | $2.20 | 204,800 | 1.51 | 39 | Yes | No | |
| | cerebras fastest | $2.25 | $2.75 | 131,072 | 0.14 | 435 | Yes | No |
| | - | - | - | 2.36 | 41 | No | No | |
| | $0.60 | $2.20 | 200,000 | 0.58 | 125 | Yes | Yes | |
| | deepinfra cheapest | $0.40 | $1.75 | 202,752 | 0.67 | 29 | Yes | No |
| | $0.10 | $0.20 | - | 0.87 | 94 | No | Yes | |
| | $0.15 | $1.50 | 131,072 | 0.57 | 146 | Yes | No | |
| | novita fastest | $0.20 | $0.80 | 40,960 | 0.42 | 28 | No | No |
| | nscale cheapest | $0.20 | $0.60 | 32,000 | 0.62 | 16 | Yes | No |
| | novita cheapest | $0.13 | $0.85 | 131,072 | 0.66 | 63 | Yes | No |
| | zai-org fastest | - | - | - | 1.97 | 64 | Yes | No |
| | $0.60 | $3.60 | 262,144 | 1.57 | 54 | Yes | No | |
| | $0.68 | $4.10 | - | 0.61 | 98 | Yes | Yes | |
| | ovhcloud fastest | $0.71 | $4.25 | 262,144 | 0.40 | 136 | Yes | Yes |
| | deepinfra cheapest | $0.45 | $3.00 | 262,144 | 0.22 | 67 | Yes | Yes |
| | - | - | - | - | - | - | - | |
| | - | - | - | - | - | - | - | |
| | nscale cheapest | $0.08 | $0.25 | 40,960 | 0.54 | 48 | Yes | Yes |
| | deepinfra fastest | $0.08 | $0.28 | 40,960 | 0.24 | 63 | Yes | No |
| | $0.82 | $2.92 | - | 0.52 | 59 | No | Yes | |
| | $0.00 | $0.00 | 262,144 | 0.37 | 95 | Yes | No | |
| | nscale cheapest fastest | $0.07 | $0.20 | 40,960 | 0.45 | 96 | Yes | Yes |
| | $0.12 | $0.24 | 40,960 | 0.24 | 40 | Yes | No | |
| | $1.00 | $3.00 | 1,048,576 | 0.32 | 75 | Yes | Yes | |
| | novita fastest | $0.30 | $1.20 | 204,800 | 0.93 | 58 | Yes | No |
| | deepinfra cheapest | $0.15 | $1.15 | 196,608 | 0.48 | 44 | Yes | No |
| | $0.05 | $0.15 | 131,072 | 0.39 | 60 | Yes | Yes | |
 | $0.40 | $0.40 | - | 1.29 | 55 | Yes | No | |
 | - | - | - | 0.19 | 45 | No | No | |
| | - | - | - | 0.35 | 21 | Yes | No | |
| | novita fastest | $0.20 | $0.70 | 131,072 | 1.02 | 93 | Yes | Yes |
| | deepinfra cheapest | $0.15 | $0.60 | 262,144 | 0.34 | 25 | Yes | Yes |
 | $0.30 | $2.50 | 262,144 | 0.77 | 88 | Yes | No | |
| | - | - | - | - | - | - | - | |
| | $0.12 | $0.50 | 40,960 | 0.23 | 77 | Yes | Yes | |
| | $0.06 | $0.20 | 131,072 | 0.56 | 46 | No | Yes | |
 | $0.07 | $0.14 | 16,384 | 0.21 | 73 | No | Yes | |
| | $0.27 | $0.40 | 163,840 | 1.51 | 22 | Yes | Yes | |
| | - | - | - | - | - | - | - | |
| | $0.57 | $2.30 | 131,072 | 0.81 | 34 | Yes | No | |
| | $0.60 | $2.50 | 262,144 | 0.82 | 35 | Yes | Yes | |
| | - | - | - | 2.41 | 53 | Yes | No | |
| | $0.04 | $0.14 | 65,536 | 0.50 | 83 | No | No | |
| | $0.01 | $0.03 | 131,072 | 0.53 | 129 | No | Yes | |
| | - | - | - | 0.26 | 109 | Yes | No | |
| | scaleway fastest | $0.29 | $0.57 | - | 0.38 | 49 | Yes | Yes |
| | deepinfra cheapest | $0.08 | $0.16 | 131,072 | 0.26 | 30 | Yes | Yes |
| | - | - | - | 0.17 | 134 | No | No | |
| | zai-org fastest | - | - | - | 3.71 | 35 | Yes | No |
| | deepinfra cheapest | $1.05 | $3.50 | 202,752 | 0.77 | 24 | Yes | Yes |
 | $0.10 | $0.20 | - | 2.31 | 3 | No | No | |
| | $0.15 | $0.15 | 131,072 | 0.47 | 169 | No | No | |
 | $0.25 | $0.50 | - | 1.60 | 47 | Yes | Yes | |
| | novita cheapest | $0.30 | $0.90 | 131,072 | 0.69 | 62 | Yes | No |
| | zai-org fastest | - | - | - | 4.47 | 64 | No | No |
| | $0.38 | $1.55 | 262,144 | 1.43 | 48 | Yes | Yes | |
| | $0.80 | $0.80 | 8,192 | 0.81 | 25 | No | No | |
 | $0.10 | $0.20 | - | - | - | Yes | No | |
| | novita cheapest | $0.38 | $0.40 | 32,000 | 0.54 | 16 | Yes | No |
| | deepinfra fastest | $0.36 | $0.40 | 32,768 | 0.27 | 23 | Yes | Yes |
| | $0.01 | $0.03 | 262,144 | 0.49 | 159 | No | Yes | |
 | $0.42 | $1.25 | 123,000 | 1.27 | 40 | No | No | |
| | - | - | - | - | - | - | - | |
| | $0.18 | $0.59 | 131,072 | 0.38 | 37 | No | No | |
| | nscale cheapest fastest | $0.09 | $0.29 | 890,000 | 0.54 | 73 | Yes | Yes |
| | $0.10 | $0.30 | 327,680 | 0.40 | 45 | Yes | Yes | |
| | $0.30 | $1.20 | 204,800 | 1.16 | 55 | Yes | No | |
| | $1.00 | $3.20 | 202,800 | 1.23 | 39 | Yes | No | |
| | - | - | - | 3.29 | 38 | Yes | No | |
| | deepinfra cheapest fastest | $0.60 | $2.08 | 202,752 | 0.73 | 61 | Yes | No |
| | - | - | - | 0.22 | 61 | Yes | No | |
| | - | - | 131,072 | 0.15 | 766 | Yes | No | |
| | - | - | - | 0.17 | 120 | No | No | |
| | $0.10 | $0.30 | 262,144 | 0.23 | 149 | Yes | No | |
| | - | - | - | 3.79 | 34 | Yes | No | |
| | $0.09 | $0.58 | 131,072 | 0.76 | 49 | Yes | Yes | |
| | $0.20 | $0.60 | 32,768 | 0.64 | 14 | Yes | Yes | |
| | scaleway fastest | $0.86 | $2.57 | - | 0.31 | 100 | Yes | Yes |
| | deepinfra cheapest | $0.09 | $0.55 | 262,144 | 0.27 | 23 | Yes | Yes |
| | - | - | - | 1.98 | 62 | Yes | No | |
| | - | - | - | 0.47 | 8 | No | No | |
| | - | - | - | 0.20 | 89 | Yes | No | |
| | - | - | - | 0.25 | 42 | No | No | |
| | novita cheapest | $0.60 | $1.80 | 65,536 | 1.00 | 77 | Yes | No |
| | zai-org fastest | - | - | - | 1.60 | 93 | Yes | No |
| | novita fastest | $0.55 | $2.20 | 204,800 | 1.13 | 41 | Yes | No |
| | - | - | - | 3.31 | 38 | Yes | No | |
| | deepinfra cheapest | $0.50 | $2.00 | 202,752 | 0.51 | 20 | Yes | Yes |
| | - | - | - | 3.14 | 23 | Yes | No | |
| | - | - | - | 1.80 | 77 | Yes | No | |
| | - | - | - | 0.41 | 69 | Yes | No | |
 | $0.28 | $0.86 | 262,144 | 0.25 | 42 | Yes | No | |
| | - | - | - | 3.14 | 55 | Yes | No | |
| | - | - | - | 0.16 | 134 | No | No | |
| | - | - | - | 0.23 | 132 | No | No | |
| | together fastest | $0.20 | $0.20 | 1,048,576 | 0.16 | 13 | No | No |
| | deepinfra cheapest | $0.18 | $0.18 | 163,840 | 0.43 | 7 | No | No |
| | - | - | - | 2.03 | 60 | Yes | No | |
| | $0.06 | $0.12 | 32,768 | 0.32 | 16 | No | Yes | |
 | $1.25 | $1.25 | 163,840 | 0.28 | 72 | No | No | |
| | - | - | - | - | - | - | - | |
| | $1.25 | $1.25 | 163,840 | 0.30 | 68 | No | No | |
| | novita fastest | $0.30 | $3.00 | 131,072 | 0.93 | 61 | Yes | No |
| | deepinfra cheapest | $0.23 | $2.30 | 262,144 | 0.40 | 36 | Yes | No |
| | $0.27 | $0.41 | 163,840 | 1.58 | 26 | Yes | Yes | |
| | $0.98 | $3.95 | 131,072 | 0.78 | 53 | Yes | No | |
| | $0.30 | $1.50 | 131,072 | 0.74 | 52 | Yes | Yes | |
| | novita fastest | $0.27 | $1.00 | 131,072 | 1.71 | 26 | Yes | Yes |
| | deepinfra cheapest | $0.27 | $0.95 | 163,840 | 0.87 | 14 | No | Yes |
| | novita fastest | $0.27 | $1.00 | 131,072 | 1.70 | 26 | Yes | Yes |
| | deepinfra cheapest | $0.25 | $0.95 | 163,840 | 0.74 | 13 | Yes | Yes |
| | $0.55 | $2.20 | 1,000,000 | 1.01 | 49 | Yes | No | |
| | novita fastest | $0.70 | $2.50 | 163,840 | 0.82 | 18 | No | No |
| | deepinfra cheapest | $0.50 | $2.15 | 163,840 | 0.53 | 16 | No | No |
| | $0.55 | $1.66 | 32,000 | 0.84 | 44 | No | No | |
| | $0.27 | $0.85 | 1,048,576 | 0.41 | 62 | No | Yes | |
| | $0.27 | $1.12 | 163,840 | 1.11 | 33 | Yes | No | |
| | deepinfra cheapest fastest | $0.24 | $0.90 | 163,840 | 0.49 | 46 | Yes | Yes |
 | $0.05 | $0.05 | 8,192 | 0.39 | 51 | No | No | |
 | $0.62 | $0.62 | 65,535 | 0.55 | 17 | No | No | |
| | $0.05 | $0.05 | 8,192 | 0.49 | 96 | No | No | |
| | $0.05 | $0.05 | 131,072 | 0.54 | 146 | No | Yes | |
| | $0.20 | $0.40 | - | 1.72 | 13 | No | Yes | |
| | $1.01 | $1.01 | 32,768 | 0.45 | 31 | No | Yes | |
| | $0.20 | $0.20 | 131,072 | 0.55 | 94 | No | No | |
 | $1.20 | $1.20 | 65,536 | 0.59 | 55 | No | Yes | |
| | $0.01 | $0.03 | 32,768 | 0.56 | 179 | No | Yes | |
| | $0.10 | $0.75 | 262,144 | 0.20 | 110 | Yes | Yes | |
| | $0.30 | $1.20 | 204,800 | 1.11 | 55 | Yes | No |