Indeed, Musk suggested that synthetic data — data generated by AI models themselves — is the path forward. “The only way to supplement [real-world data] is with synthetic data, where the AI creates [training data],” he said. “With synthetic data … [AI] will sort of grade itself and go through this process of self-learning.”

Tech tycoon Elon Musk says artificial intelligence will now have to write an essay or a thesis then grade itself, because the 'cumulative sum of human knowledge has been exhausted'