您尚未登录账户
您的企业账号申请正在审核中
数据集:
embedding-data/WikiAnswers
中文Dataset Card for "WikiAnswers"
Dataset Summary
The WikiAnswers corpus contains clusters of questions tagged by WikiAnswers users as paraphrases. Each cluster optionally contains an answer provided by WikiAnswers users. There are 30,370,994 clusters containing an average of 25 questions per cluster. 3,386,256 (11%) of the clusters have an answer.
Supported Tasks
- Sentence Transformers training; useful for semantic search and sentence similarity.
Languages
- English.
Dataset Structure
Each example in the dataset contains 25 equivalent sentences and is formatted as a dictionary with the key "set" and a list with the sentences as "value".
{"set": [sentence_1, sentence_2, ..., sentence_25]}
{"set": [sentence_1, sentence_2, ..., sentence_25]}
...
{"set": [sentence_1, sentence_2, ..., sentence_25]}
This dataset is useful for training Sentence Transformers models. Refer to the following post on how to train models using similar sentences.
Usage Example
Install the ? Datasets library with pip install datasets and load the dataset from the Hub with:
from datasets import load_dataset
dataset = load_dataset("embedding-data/WikiAnswers")
The dataset is loaded as a DatasetDict and has the format for N examples:
DatasetDict({
train: Dataset({
features: ['set'],
num_rows: N
})
})
Review an example i with:
dataset["train"][i]["set"]
Data Instances
Data Fields
Data Splits
Dataset Creation
Curation Rationale
Source Data
Initial Data Collection and Normalization Who are the source language producers?Annotations
Annotation process Who are the annotators?Personal and Sensitive Information
Considerations for Using the Data
Social Impact of Dataset
Discussion of Biases
Other Known Limitations
Additional Information
Dataset Curators
Licensing Information
Citation Information
@inproceedings{Fader14,
author = {Anthony Fader and Luke Zettlemoyer and Oren Etzioni},
title = {{Open Question Answering Over Curated and Extracted
Knowledge Bases}},
booktitle = {KDD},
year = {2014}
}