Training a large network can take months on powerful servers with hundreds of thousands of processors.
Neural networks have grown from a few million to nearly 200 billion parameters. Each parameter must be computed, causing an increasingly great demand for high-performance computing resources and energy. Artificial intelligence programs have beaten humans at chess and in the more complicated game of Go. Programs such as ChatGPT can weave exciting stories and answer complex questions. Training a large network can take months on powerful servers with hundreds of thousands of processors.