For anyone thinking of doing a CodeGen startup:
Low value: generating basic code from basic instructions
High value: generating context-specific code from detailed instructions
While I strongly believe Generative AI is a game changer, I was never worried about The Singularity.
That’s because GenAI models have the same limitation as all other ML models: they can’t handle novel tasks.
In other words, they can interpolate, but not extrapolate.
