How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding

Published in The 2021 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021

Recommended citation: Tianda Li, Ahmad Rashid, Aref Jafari, Pranav Sharma, Ali Ghodsi, Mehdi Rezagholizadeh (2021). "How to Select One Among All? An Extensive Empirical Study Towards the Robustness of Knowledge Distillation in Natural Language Understanding." 2021 EMNLP Findings 1.

Download paper here