emailconfirmed
952
edits
Main Page: Difference between revisions
Jump to navigation
Jump to search
→Our Wikibase.cloud unboxing experience and first findings
OlafJanssen (talk | contribs) |
OlafJanssen (talk | contribs) |
||
| (16 intermediate revisions by the same user not shown) | |||
| Line 1: | Line 1: | ||
= | =Unofficial Wikibase sandbox for the national library of The Netherlands.= | ||
==Disclaimer== | |||
''<span style="color:maroon">This Wikibase sandbox is for playing, experimenting, learning about the functionalities, possibilities and limitations etc. of Wikibase, and knowledge sharing activities resulting from these learnings. It is maintained by [https://www.wikidata.org/wiki/User:OlafJanssen Olaf Janssen], the Wikimedia coordinator of the KB, mainly as a '''tool for experimentation, learning, skill-building, knowledge sharing and consultancy about Wikibase''', both towards KB staff, (inter)national Wiki(base) communities, GLAMs, KB network partners, as well as other 3rd parties. It does not contain any offical data(sets) of the KB, and the data can be changed/deleted at any time. This instance is not supported by the KB, nor is it part of the official KB IT infrastructure. If you are interested in the official Wikibase instance of the KB, please visit xxx.</span>'' | |||
== Quick links == | == Quick links == | ||
| Line 135: | Line 137: | ||
=== Nog verder bekijken, waarschijnlijk relevant=== | === Nog verder bekijken, waarschijnlijk relevant=== | ||
* https://github.com/LeMyst/WikibaseIntegrator | * https://github.com/LeMyst/WikibaseIntegrator. Zie ook de verdere import opties op https://www.mediawiki.org/wiki/Wikibase/Importing | ||
==Reconciliation service for this Wikibase== | |||
https://github.com/KBNLresearch/OpenRefine-Wikibase | |||
* Recon service o.b.v. Docker: https://openrefine-wikibase.readthedocs.io/en/latest/install.html | |||
* Example config file: https://github.com/KBNLresearch/OpenRefine-Wikibase/blob/main/config.py | |||
* Configuration of OpenRefine: add URLs of recon service and manifest to OpenRefine | |||
* Example manifest: https://github.com/KBNLresearch/OpenRefine-Wikibase/blob/main/kb-test-wikibase-cloud-manifest.json | |||
== Snelheid van bulk data-importeren == | == Snelheid van bulk data-importeren == | ||
| Line 142: | Line 151: | ||
== Wikibase.cloud project updates == | == Wikibase.cloud project updates == | ||
* https://meta.wikimedia.org/wiki/Wikibase/Wikibase.cloud | * https://meta.wikimedia.org/wiki/Wikibase/Wikibase.cloud | ||
== Wikibase.cloud documenation == | |||
* https://www.mediawiki.org/wiki/Wikibase/Wikibase.cloud | |||
== Our Wikibase.cloud unboxing experience and first findings == | == Our Wikibase.cloud unboxing experience and first findings == | ||
In June-July 2002 the KB created and configured this instance on Wikibase.cloud. Many of the steps we needed to take in the setup process were as to be expected when working with fresh MediaWiki instances in general, and Wikidata in particular. However, some steps were not immediately logical, manifest, clearly documented or simply beyond our (then) knowledge and experience. We created a '''[https://commons.wikimedia.org/wiki/File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf presentation]''' in which we share experiences and first impressions of unboxing, setting up, configuring and tweaking '''our [https://kbtestwikibase.wikibase.cloud/wiki/Main_Page Wikibase.cloud | |||
'''<big>The text below is a transcript of the presentation ''[https://commons.wikimedia.org/wiki/File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf KB's Wikibase.cloud Unboxing Experience]''</big>''' | |||
In June-July 2002 the KB created and configured this instance on Wikibase.cloud. Many of the steps we needed to take in the setup process were as to be expected when working with fresh MediaWiki instances in general, and Wikidata in particular. However, some steps were not immediately logical, manifest, clearly documented or simply beyond our (then) knowledge and experience. We created a '''[https://commons.wikimedia.org/wiki/File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf presentation]''' in which we share experiences and first impressions of unboxing, setting up, configuring and tweaking '''our [https://kbtestwikibase.wikibase.cloud/wiki/Main_Page Wikibase.cloud sandbox instance]'''. We also present solutions for most of the issues we encountered. | |||
Below is an overview of the most important issues we encountered. The numbering refers to the corresponding slides in the presentation: | Below is an overview of the most important issues we encountered. The numbering refers to the corresponding slides in the presentation: | ||
| Line 180: | Line 195: | ||
: SOLUTION: No solution yet, see Phabricator [https://phabricator.wikimedia.org/T310787 T310787]. | : SOLUTION: No solution yet, see Phabricator [https://phabricator.wikimedia.org/T310787 T310787]. | ||
* ISSUE: ''Default data import speed is rather limited''. When importing items into a Wikibase using REST API-based tools such as [https://www.wikidata.org/wiki/Help:QuickStatements QuickStatements], [https://www.mediawiki.org/wiki/Manual:Pywikibot pywikibot] or [https://github.com/SuLab/WikidataIntegrator WikidataIntegrator], the maximum import speed is about 3-10 items per second, as explained in the article ''[https://www.wikibase.consulting/fast-bulk-import-into-wikibase/ Fast Bulk Import Into Wikibase]'' by [https://www.wikibase.consulting/ The Wikibase Consultancy]. This is an OK speed for small datasets, but if you (like the KB) plan to import millions of items, this is obviously too slow. | * ISSUE: ''Default data import speed is rather limited''. When importing items into a Wikibase using REST API-based tools such as [https://www.wikidata.org/wiki/Help:QuickStatements QuickStatements], [https://www.mediawiki.org/wiki/Manual:Pywikibot pywikibot] or [https://github.com/SuLab/WikidataIntegrator WikidataIntegrator], the maximum import speed is about 3-10 items per second, as explained in the article ''[https://www.wikibase.consulting/fast-bulk-import-into-wikibase/ Fast Bulk Import Into Wikibase]'' by [https://www.wikibase.consulting/ The Wikibase Consultancy]. This is an OK speed for small datasets, but if you (like the KB) plan to import millions of items, this is obviously too slow. | ||
: SOLUTION: PHP scripts or direct SQL tools such as [https://github.com/UB-Mannheim/RaiseWikibase RaiseWikibase], as further outlined in the article. | : SOLUTION: PHP scripts or direct SQL tools such as [https://github.com/UB-Mannheim/RaiseWikibase RaiseWikibase], as further outlined in the article. At the moment these solutions are not considered nor used by the KB. | ||
;Where to get help? ([https://commons.wikimedia.org/w/index.php?title=File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf&page=53 slide 53] - [https://commons.wikimedia.org/w/index.php?title=File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf&page=58 slide 58]) | ;Where to get help? ([https://commons.wikimedia.org/w/index.php?title=File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf&page=53 slide 53] - [https://commons.wikimedia.org/w/index.php?title=File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf&page=58 slide 58]) | ||