| An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale A Dosovitskiy*, L Beyer*, A Kolesnikov*, D Weissenborn*, X Zhai*, ... International Conference on Learning Representations (ICLR), 2021 | 25467 | 2021 |
| MLP-Mixer: An all-MLP Architecture for Vision I Tolstikhin*, N Houlsby*, A Kolesnikov*, L Beyer*, X Zhai, T Unterthiner, ... Advances in Neural Information Processing Systems (NeurIPS), 2021 | 1621 | 2021 |
| Big Transfer (BiT): General Visual Representation Learning A Kolesnikov*, L Beyer*, X Zhai*, J Puigcerver, J Yung, S Gelly, ... European Conference on Computer Vision (ECCV), 2020 | 1106 | 2020 |
| S4l: Self-supervised semi-supervised learning X Zhai*, A Oliver*, A Kolesnikov*, L Beyer*, *equal contribution International Conference on Computer Vision (ICCV), 1476-1485, 2019 | 859 | 2019 |
| Revisiting Self-Supervised Visual Representation Learning A Kolesnikov*, X Zhai*, L Beyer*, *equal contribution Computer Vision and Pattern Recognition (CVPR), 2019 | 765 | 2019 |
| Scaling Vision Transformers X Zhai*, A Kolesnikov*, N Houlsby, L Beyer*, *equal contribution Computer Vision and Pattern Recognition (CVPR), 2022 | 667 | 2022 |
| Underspecification Presents Challenges for Credibility in Modern Machine Learning A D'Amour*, K Heller*, D Moldovan*, B Adlam, B Alipanahi, A Beutel, ... Journal of Machine Learning Research (JMLR), 2020 | 580 | 2020 |
| How to train your ViT? Data, Augmentation, and Regularization in Vision Transformers A Steiner*, A Kolesnikov*, X Zhai*, R Wightman, J Uszkoreit, L Beyer*, ... Transactions on Machine Learning Research (TMLR), 2022 | 360 | 2022 |
| Self-Supervised GANs via Auxiliary Rotation Loss T Chen, X Zhai, M Ritter, M Lucic, N Houlsby Computer Vision and Pattern Recognition (CVPR), 12154-12163, 2019 | 316 | 2019 |
| LiT: Zero-Shot Transfer with Locked-image Text Tuning X Zhai*, X Wang*, B Mustafa*, A Steiner*, D Keysers, A Kolesnikov, ... Computer Vision and Pattern Recognition (CVPR), 2022 | 280 | 2022 |
| Learning cross-media joint representation with sparse and semisupervised regularization X Zhai, Y Peng, J Xiao IEEE Transactions on Circuits and Systems for Video Technology (TCSVT) 24 (6 …, 2013 | 279 | 2013 |
| Are we done with ImageNet? L Beyer*, OJ Hénaff*, A Kolesnikov*, X Zhai*, A Oord*, *equal contribution arXiv preprint arXiv:2006.07159, 2020 | 278 | 2020 |
| A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark X Zhai*, J Puigcerver*, A Kolesnikov*, P Ruyssen, C Riquelme, M Lucic, ... arXiv preprint arXiv:1910.04867, 2019 | 263* | 2019 |
| Pali: A jointly-scaled multilingual language-image model X Chen, X Wang, S Changpinyo, AJ Piergiovanni, P Padlewski, D Salz, ... International Conference on Learning Representations (ICLR), 2022 | 240 | 2022 |
| Revisiting the Calibration of Modern Neural Networks M Minderer, J Djolonga, R Romijnders, F Hubis, X Zhai, N Houlsby, ... Advances in Neural Information Processing Systems (NeurIPS), 2021 | 188 | 2021 |
| A large-scale study on regularization and normalization in GANs K Kurach, M Lučić, X Zhai, M Michalski, S Gelly International conference on machine learning, 3581-3590, 2019 | 184 | 2019 |
| Simple Open-Vocabulary Object Detection with Vision Transformers M Minderer, A Gritsenko, A Stone, M Neumann, D Weissenborn, ... European Conference on Computer Vision (ECCV), 2022 | 159* | 2022 |
| Knowledge distillation: A good teacher is patient and consistent L Beyer*, X Zhai*, A Royer*, L Markeeva*, R Anil, A Kolesnikov*, ... Computer Vision and Pattern Recognition (CVPR), 2022 | 157 | 2022 |
| High-Fidelity Image Generation With Fewer Labels M Lučić, M Tschannen, M Ritter, X Zhai, O Bachem, S Gelly International Conference on Machine Learning (ICML), 4183-4192, 2019 | 156 | 2019 |
| The gan landscape: Losses, architectures, regularization, and normalization K Kurach, M Lucic, X Zhai, M Michalski, S Gelly International Conference on Machine Learning (ICML), 2019 | 154 | 2019 |
Lucas BeyerGoogle DeepMind, Google Brain, RWTH AachenVerified email at google.com
