Dataset Card for MC4_Legal: A Corpus Covering the Legal Part of MC4 for European Languages

Dataset Summary

This dataset contains large text resources (~133GB in total) from mc4 filtered for legal data that can be used for pretraining language models.

Use the dataset like this:

from datasets import load_dataset
dataset = load_dataset("joelito/mc4_legal", "de", split='train', streaming=True)

Supported Tasks and Leaderboards

The dataset supports the task of masked language modeling.

Languages

The following languages are supported: bg, cs, da, de, el, en, es, et, fi, fr, ga, hu, it, lt, lv, mt, nl, pl, pt, ro, sk, sl, sv

Dataset Structure

Data Instances

The file format is jsonl.xz and there is one split available ("train").

Source	Size (MB)	Words	Documents	Words/Document
all	448980	28599300521	9873288	2896
bg	57	2390349	379	6306
cs	31005	1840827375	677796	2715
da	162	10466716	3231	3239
de	105739	6184578784	3164461	1954
el	30	1155977	307	3765
en	13734	966539309	359283	2690
es	132053	9058939804	2281888	3969
et	2059	110198368	49987	2204
fi	1270	62799074	44875	1399
fr	30878	2117306229	598983	3534
ga	1	32772	8	4096
hu	4677	244911748	58857	4161
it	46957	3053920779	990823	3082
lt	156	9142223	1529	5979
lv	1	58702	16	3668
mt	65	3479869	731	4760
nl	326	21962633	6875	3194
pl	37950	2235839721	827641	2701
pt	20120	1338147828	382173	3501
ro	8816	551372510	136513	4038
sk	5850	349265172	130701	2672
sl	1742	107493024	32574	3299
sv	5332	328471555	123657	2656

Data Fields

[More Information Needed]

Data Splits

[More Information Needed]

Dataset Creation

The dataset was created by filtering mc4 for legal data. We used terms indicating legal citations to get the texts. Note that this dataset can be quite noisy, and the quality is not known.

Curation Rationale

[More Information Needed]

Source Data

Initial Data Collection and Normalization

[More Information Needed]

Who are the source language producers?

[More Information Needed]

Annotations

Annotation process

[More Information Needed]

Who are the annotators?

[More Information Needed]

Personal and Sensitive Information

[More Information Needed]

Considerations for Using the Data

Social Impact of Dataset

[More Information Needed]

Discussion of Biases

[More Information Needed]

Other Known Limitations

[More Information Needed]

Additional Information

Dataset Curators

[More Information Needed]

Licensing Information

[More Information Needed]

Citation Information

[More Information Needed]

Contributions

Thanks to @JoelNiklaus for adding this dataset.