From ee92603657fef89f14c176372b6c6d2d6a0857bc Mon Sep 17 00:00:00 2001 From: Sean Lee Date: Wed, 18 Oct 2023 14:05:49 +0800 Subject: [PATCH 1/3] add supervised models --- README.md | 9 +++++++++ 1 file changed, 9 insertions(+) diff --git a/README.md b/README.md index 1be5b65..5bb8ba5 100644 --- a/README.md +++ b/README.md @@ -8,6 +8,7 @@ The leaderboard of Unsupervised STS is also available. * [BERT-large](https://github.com/Doragd/Awesome-Sentence-Embedding#bert-large) * [RoBERTa-base](https://github.com/Doragd/Awesome-Sentence-Embedding#roberta-base) * [RoBERTa-large](https://github.com/Doragd/Awesome-Sentence-Embedding#roberta-large) +* [Supervised STS leaderboard](https://github.com/Doragd/Awesome-Sentence-Embedding#supervised-sts-leaderboard) * [Related Papers](https://github.com/Doragd/Awesome-Sentence-Embedding#related-Papers) * [Main Track of Sentence Embeddings](https://github.com/Doragd/Awesome-Sentence-Embedding#main-track-of-sentence-embeddings) * [Others Track of Sentence Embeddings](https://github.com/Doragd/Awesome-Sentence-Embedding#others-track-of-sentence-embeddings) @@ -146,6 +147,13 @@ You can search by model name (alias) to find the corresponding paper in the [Rel |CARDS|74.63|86.27|79.25|85.93|83.17|83.86|72.77|80.84| |SNCSE|73.71|86.73|80.35|86.8|83.06|84.31|77.43|81.77| + +## Supervised STS leaderboard +### LLaMA +|Methods|STS12|STS13|STS14|STS15|STS16|STS-B|SICK-R|avg.| +|:----|:----|:----|:----|:----|:----|:----|:----|:----| +|AnglE-LLaMA-7B|78.68|90.58|85.49|89.56|86.91|88.92|81.18|85.90| + ## Related Papers ### Main Track of Sentence Embeddings ``` @@ -283,3 +291,4 @@ Tips: - 【ICLR2023】 Self-Consistent Learning: Cooperation between Generators and Discriminators - 【TMLR2022】 Unsupervised dense information retrieval with contrastive learning - 【NAACL2021】 Supporting Clustering with Contrastive Learning +- 【Preprint】 AnglE: Angle-optimized Text Embeddings From dcd48127dd0570f24851595caf896a18fb1f3015 Mon Sep 17 00:00:00 2001 From: Sean Lee Date: Wed, 18 Oct 2023 14:06:33 +0800 Subject: [PATCH 2/3] add simcse llama --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 5bb8ba5..f250950 100644 --- a/README.md +++ b/README.md @@ -152,6 +152,7 @@ You can search by model name (alias) to find the corresponding paper in the [Rel ### LLaMA |Methods|STS12|STS13|STS14|STS15|STS16|STS-B|SICK-R|avg.| |:----|:----|:----|:----|:----|:----|:----|:----|:----| +|SimCSE-LLaMA-7B|78.39|89.95|84.80|88.50|86.04|87.86|81.11|85.24| |AnglE-LLaMA-7B|78.68|90.58|85.49|89.56|86.91|88.92|81.18|85.90| ## Related Papers From 6fb483006766395d7228a293de43893ae9c44807 Mon Sep 17 00:00:00 2001 From: Sean Lee Date: Wed, 18 Oct 2023 14:07:26 +0800 Subject: [PATCH 3/3] add angle url --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index f250950..a325968 100644 --- a/README.md +++ b/README.md @@ -292,4 +292,4 @@ Tips: - 【ICLR2023】 Self-Consistent Learning: Cooperation between Generators and Discriminators - 【TMLR2022】 Unsupervised dense information retrieval with contrastive learning - 【NAACL2021】 Supporting Clustering with Contrastive Learning -- 【Preprint】 AnglE: Angle-optimized Text Embeddings +- 【Preprint】 [AnglE: Angle-optimized Text Embeddings](https://arxiv.org/abs/2309.12871)