Overcast handles its AI needs with 50 Mac Minis.
- Overcast handles its AI needs with 50 Mac Minis.
- If you don't need the power of the frontier models, it's possible to do inference at multiple orders of magnitude cheaper.[b]
- Not bullish for the major labs, given that the models are already ludicrously over-capable for most applications.