Wikimedia Datasets
Wikimedia datasets, across languages and modalities, from different Wikimedia projects, on the hub. Not all tested.
Updated • 24.8k • 553Note Wikipedia: The largest and most widely used Wikipedia dataset on Hugging Face.
copenlu/wiki-stance
Preview • Updated • 193 • 3Note Wikipedia: Wikipedia communities' article for deletion discussions in English, Turkish, and German, with a focus on stance and policy prediction.
wikimedia/wikipedia
Viewer • Updated • 61.6M • 58.1k • 584Note Wikipedia: Dataset of Wikipedia articles across all languages, with Wikitext (the Wikimedia markup language) removed.
Salesforce/wikitext
Viewer • Updated • 3.71M • 335k • 361Note Wikipedia: Dataset based on good and featured articles on Wikipedia.
wikimedia/wit_base
Viewer • Updated • 108k • 1.81k • 54Note Wikipedia: A image-text dataset based on Wikipedia articles and the associated Wikipedia images.
aiintelligentsystems/vel_commons_wikidata
Viewer • Updated • 772k • 94 • 1Note Wikimedia Commons: Dataset leveraging the structured data from Wikidata that the community adds to describe images for the task of visual entity linking, including license information.
MLCommons/speech-wikimedia
Viewer • Updated • 16 • 796 • 10Note Wikimedia Commons: A dataset of Wikimedia Commons audio files and transcriptions across languages.
calm-and-collected/knives_and_time
Viewer • Updated • 325 • 38Note Wikimedia Commons: Dataset of public domain images, manually collected for damaged images, paintings, and photographs (collected from Wikimedia Commons)[https://huggingface.co/calm-and-collected/knives_and_time]
kdm-daiict/freebase-wikidata-mapping
Viewer • Updated • 2.08M • 48 • 2Note Wikidata: Links Wikidata to the widely used, but outdated Freebase knowledge Graph.
rvashurin/wikidata_simplequestions
Updated • 25 • 2Note Wikidata: The simple questions dataset, based on Wikidata, on Hugging Face.
rayliuca/WikidataLabels
Viewer • Updated • 654M • 531 • 1Note Wikidata: Dataset of entity labels across languages, extracted from Wikidata.
imvladikon/paranames
Viewer • Updated • 78M • 91Note Wikidata: Dataset of 118 million names across 400 languages.
wikimedia/wikisource
Viewer • Updated • 1.66M • 1.6k • 73Note Wikisource: Dataset of all Wikisource articles across all languages, without Wikitext.
mostol/wiktionary-ipa
Viewer • Updated • 80.1k • 21 • 5Note Wiktionary: IPA strings and their respective pronunciation as audio files.
malteos/wikinews
Viewer • Updated • 249k • 3.36k • 2Note Wikinews: Dataset of Wikinews articles without Wikitext across different languages, including the revision timestamp, categories, and sources.
taln-ls2n/wikinews-fr-100
Updated • 95 • 1Note Wikinews: Dataset for keyphrase extraction and generation models, including 100 French Wikinews articles.
erhwenkuo/wikinews-zhtw
Viewer • Updated • 9.83k • 50 • 2Note Wikinews: Dataset of cleaned Chinese Wikinews articles from 2023.
caretech-owl/wikiquote-de-quotes
Viewer • Updated • 16.2k • 50Note Wikiquote: Dataset of German quotes and their authors from Wikiquote.
domenicrosati/TruthfulQA
Viewer • Updated • 817 • 50 • 6Note Wikiquote: Dataset testing humans’ false believes’ representation in language models. One of the sources is Wikiquote.