Overview
Noam Shazeer is a machine-learning researcher (long at Google; co-founder of Character.AI, later returned to Google DeepMind), known for foundational contributions to neural sequence models and large-scale deep learning.
Key Contributions / Features
- Scaled dot-product and multi-head attention (Vaswani et al. 2017): proposed the scaled dot-product attention, multi-head attention, and the parameter-free position representation of the Transformer.
- Work on the mixture-of-experts layer, efficient Transformer variants, and large language models.
Related