Dataset Card for MTEB Benchmark

Dataset Summary

MTEB is a heterogeneous benchmark that has been built from diverse tasks:

• BitextMining: BUCC , Tatoeba
• Classification: AmazonCounterfactualClassification , AmazonPolarityClassification , AmazonReviewsClassification , Banking77Classification , EmotionClassification , ImdbClassification , MassiveIntentClassification , MassiveScenarioClassification , MTOPDomainClassification , MTOPIntentClassification , ToxicConversationsClassification , TweetSentimentExtractionClassification
• Clustering: ArxivClusteringP2P , ArxivClusteringS2S , BiorxivClusteringP2P , BiorxivClusteringS2S , MedrxivClusteringP2P , MedrxivClusteringS2S , RedditClustering , RedditClusteringP2P , StackExchangeClustering , StackExchangeClusteringP2P , TwentyNewsgroupsClustering
• Pair Classification: SprintDuplicateQuestions , TwitterSemEval2015 , TwitterURLCorpus
• Reranking: AskUbuntuDupQuestions , MindSmallReranking , SciDocs , StackOverflowDupQuestions
• Retrieval: ArguAna , ClimateFEVER , CQADupstackRetrieval , DBPedia , FEVER , FiQA2018 , HotpotQA , MSMARCO , MSMARCOv2 , NFCorpus , NQ , QuoraRetrieval , SCIDOCS , SciFact , Touche2020 , TRECCOVID
• STS: BIOSSES , SICK-R , STS12 , STS13 , STS14 , STS15 , STS16 , STS17 , STS22 , STSBenchmark
• Summarization: SummEval

All these datasets have been preprocessed and can be used for your experiments.