提示

Sentence Transformers v4.1 刚刚发布，将 ONNX 和 OpenVINO 后端带回 CrossEncoder (又名 reranker) 模型。阅读 Cross Encoder > Usage > Speeding up Inference 以了解更多关于您可以预期的性能提升。

提示

Sentence Transformers v4.0 最近发布，为 CrossEncoder (又名 reranker) 模型引入了新的训练 API。阅读 Cross Encoder > Training Overview 以了解更多关于训练 API 的信息，并查看 v4.0 发布说明 以了解其他更改的详细信息。

SentenceTransformers 文档

Sentence Transformers (又名 SBERT) 是用于访问、使用和训练最先进的嵌入和 reranker 模型的首选 Python 模块。它可用于使用 Sentence Transformer 模型 (快速开始) 计算嵌入，或使用 Cross-Encoder (又名 reranker) 模型 (快速开始) 计算相似度分数。这解锁了广泛的应用，包括 语义搜索、语义文本相似度 和 释义挖掘。

超过 10,000 个预训练 Sentence Transformers 模型 的广泛选择可立即在 🤗 Hugging Face 上使用，包括来自 大规模文本嵌入基准 (MTEB) 排行榜 的许多最先进的模型。此外，使用 Sentence Transformers 训练或微调您自己的 嵌入模型 或 reranker 模型 非常容易，使您能够为您的特定用例创建自定义模型。

Sentence Transformers 由 UKPLab 创建，并由 🤗 Hugging Face 维护。如果出现问题或您有其他问题，请随时在 Sentence Transformers 仓库 上提出 issue。

用法

另请参阅

请参阅 快速开始，了解有关如何使用 Sentence Transformers 的更多快速信息。

使用 Sentence Transformer 模型非常简单

from sentence_transformers import SentenceTransformer

# 1. Load a pretrained Sentence Transformer model
model = SentenceTransformer("all-MiniLM-L6-v2")

# The sentences to encode
sentences = [
    "The weather is lovely today.",
    "It's so sunny outside!",
    "He drove to the stadium.",
]

# 2. Calculate embeddings by calling model.encode()
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 384]

# 3. Calculate the embedding similarities
similarities = model.similarity(embeddings, embeddings)
print(similarities)
# tensor([[1.0000, 0.6660, 0.1046],
#         [0.6660, 1.0000, 0.1411],
#         [0.1046, 0.1411, 1.0000]])

from sentence_transformers import CrossEncoder

# 1. Load a pretrained CrossEncoder model
model = CrossEncoder("cross-encoder/ms-marco-MiniLM-L6-v2")

# The texts for which to predict similarity scores
query = "How many people live in Berlin?"
passages = [
    "Berlin had a population of 3,520,031 registered inhabitants in an area of 891.82 square kilometers.",
    "Berlin has a yearly total of about 135 million day visitors, making it one of the most-visited cities in the European Union.",
    "In 2013 around 600,000 Berliners were registered in one of the more than 2,300 sport and fitness clubs.",
]

# 2a. Either predict scores pairs of texts
scores = model.predict([(query, passage) for passage in passages])
print(scores)
# => [8.607139 5.506266 6.352977]

# 2b. Or rank a list of passages for a query
ranks = model.rank(query, passages, return_documents=True)

print("Query:", query)
for rank in ranks:
    print(f"- #{rank['corpus_id']} ({rank['score']:.2f}): {rank['text']}")
"""
Query: How many people live in Berlin?
- #0 (8.61): Berlin had a population of 3,520,031 registered inhabitants in an area of 891.82 square kilometers.
- #2 (6.35): In 2013 around 600,000 Berliners were registered in one of the more than 2,300 sport and fitness clubs.
- #1 (5.51): Berlin has a yearly total of about 135 million day visitors, making it one of the most-visited cities in the European Union.
"""

下一步？

考虑阅读以下部分之一来回答相关问题

引用

如果您觉得这个仓库有帮助，请随时引用我们的出版物 Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

@inproceedings{reimers-2019-sentence-bert,
  title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
  author = "Reimers, Nils and Gurevych, Iryna",
  booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
  month = "11",
  year = "2019",
  publisher = "Association for Computational Linguistics",
  url = "https://arxiv.org/abs/1908.10084",
}

如果您使用多语言模型之一，请随时引用我们的出版物 Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation

@inproceedings{reimers-2020-multilingual-sentence-bert,
  title = "Making Monolingual Sentence Embeddings Multilingual using Knowledge Distillation",
  author = "Reimers, Nils and Gurevych, Iryna",
  booktitle = "Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing",
  month = "11",
  year = "2020",
  publisher = "Association for Computational Linguistics",
  url = "https://arxiv.org/abs/2004.09813",
}

如果您使用 数据增强 的代码，请随时引用我们的出版物 Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks

@inproceedings{thakur-2020-AugSBERT,
  title = "Augmented {SBERT}: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks",
  author = "Thakur, Nandan and Reimers, Nils and Daxenberger, Johannes  and Gurevych, Iryna",
  booktitle = "Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies",
  month = jun,
  year = "2021",
  address = "Online",
  publisher = "Association for Computational Linguistics",
  url = "https://www.aclweb.org/anthology/2021.naacl-main.28",
  pages = "296--310",
}