Sparse Expert Models (Switch Transformers, GLAM, and more... w/ the Authors)
nlp #sparsity #transformers This video is an interview with Barret Zoph and William Fedus of Google Brain about Sparse Expert ...