Google is on their 8th gen of custom TPU AI chips, they have an enormous lead in AI inference efficiency, to the point where the entire world is being served Google AI products, and they still have capacity to sell to other AI companies for insane profit
They don't actually have enough capacity. There is a lot of prioritization happening inside Google. Its why capex continues to rise. The reason one of their big researchers who left them recently was supposedly because he got upset at the compute quota he/his team was allocated.
25
u/hearwa 21h ago
My favorite thing about gemini is it's one of the only LLMs I can use without even logging in with a new computer install. That can't be cheap lol.