AI-ntrusive thoughts
I recently came across the following figure, which I find quite thought-provoking.
Essentially, all the popular generative models today “learn” from the Internet in the broadest sense. A good summary of the technology itself can be found on javax0’s blog.
The image shows a sharp decline in StackOverflow visits and, in parallel, user activity. But here’s the thing: the most important source of all programming-related topics for all these models is StackOverflow itself! If the content disappears from there, what will the robot learn from? And what will happen to future technologies?
This question is a bit of a chicken and egg problem, but it’s clearly becoming more pressing now that even more people will use coding assistants after GitHub copilot became free.