Sentence-BERT: Sentence Embeddings using Siamese BERT …

← Back to document page

Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processingand the 9th International Joint Conference on Natural Language Processing, pages 3982 3992,Hong Kong, China, November 3 7, 2019 Association for Computational Linguistics3982Sentence-BERT: Sentence Embeddings using Siamese BERT-NetworksNils Reimers and Iryna GurevychUbiquitous Knowledge Processing Lab (UKP-TUDA)Department of Computer Science, Technische Universit at (Devlin et al., 2018) and RoBERTa (Liuet al., 2019) has set a new state-of-the-artperformance on Sentence -pair regression taskslike semantic textual similarity (STS).

also tested XLNet (Yang et al.,2019), but it led in general to worse results than BERT. A large disadvantage of the BERT network structure is that no independent sentence embed-dings are computed, which makes it difficult to de-rive sentence embeddings from BERT. To bypass this limitations, researchers passed single sen-

  Xlnet