For now, there are still many features of the brain that aren’t incorporated into these transformers.
“Modern AI is all based on the basic principles of neuroscience,” says Sejnowski. Conversely, as  the fields of AI and neuroscience continue to converge, advances in large language models  such as the utilization of transformers — a type of neural network that learns context — are impacting the way neuroscientists think about the brain. For now, there are still many features of the brain that aren’t incorporated into these transformers. ChatGPT and other large language models can’t yet have goals or long-term memory, but Sejnowksi says they will, and that’s where we’re headed.