Should AI agents and inference spread broadly, or wait on reliability and cost?
Expand agent use
Agent workflows could become widespread, and enterprise applications are forecast to use inference pervasively.
It's very possible that we take the 100 IQ agentic workflow that still kind of becomes almost ubiquitous within the next 12 to 18 months, and we find really cool ways to use it.
But if you just zoom out five to seven years, I think that quite a few, if not Most of the enterprise applications that we use and that exist today are going to be using inference in a pervasive way.
Proでさらに1件の引用
Wait on limits
Broader use depends on task-specific reliability and lower inference costs; current costs remain too high for pervasive use.
The cost of inference has come down quite a bit in the last few years, but it's still an order of magnitude too expensive in my opinion for it to be used as pervasively as possible.
Different tasks have different sort of reliability thresholds, but you smoothly improve and then at some point it's just reliable enough to be good.