emailconfirmed
952
edits
Main Page: Difference between revisions
Jump to navigation
Jump to search
→Our Wikibase.cloud unboxing experience and first findings
OlafJanssen (talk | contribs) |
OlafJanssen (talk | contribs) |
||
| Line 183: | Line 183: | ||
: SOLUTION: No solution yet, see Phabricator [https://phabricator.wikimedia.org/T310787 T310787]. | : SOLUTION: No solution yet, see Phabricator [https://phabricator.wikimedia.org/T310787 T310787]. | ||
* ISSUE: ''Default data import speed is rather limited''. When importing items into a Wikibase using REST API-based tools such as [https://www.wikidata.org/wiki/Help:QuickStatements QuickStatements], [https://www.mediawiki.org/wiki/Manual:Pywikibot pywikibot] or [https://github.com/SuLab/WikidataIntegrator WikidataIntegrator], the maximum import speed is about 3-10 items per second, as explained in the article ''[https://www.wikibase.consulting/fast-bulk-import-into-wikibase/ Fast Bulk Import Into Wikibase]'' by [https://www.wikibase.consulting/ The Wikibase Consultancy]. This is an OK speed for small datasets, but if you (like the KB) plan to import millions of items, this is obviously too slow. | * ISSUE: ''Default data import speed is rather limited''. When importing items into a Wikibase using REST API-based tools such as [https://www.wikidata.org/wiki/Help:QuickStatements QuickStatements], [https://www.mediawiki.org/wiki/Manual:Pywikibot pywikibot] or [https://github.com/SuLab/WikidataIntegrator WikidataIntegrator], the maximum import speed is about 3-10 items per second, as explained in the article ''[https://www.wikibase.consulting/fast-bulk-import-into-wikibase/ Fast Bulk Import Into Wikibase]'' by [https://www.wikibase.consulting/ The Wikibase Consultancy]. This is an OK speed for small datasets, but if you (like the KB) plan to import millions of items, this is obviously too slow. | ||
: SOLUTION: PHP scripts or direct SQL tools such as [https://github.com/UB-Mannheim/RaiseWikibase RaiseWikibase], as further outlined in the article. | : SOLUTION: PHP scripts or direct SQL tools such as [https://github.com/UB-Mannheim/RaiseWikibase RaiseWikibase], as further outlined in the article. At the moment these solutions are not considered nor used by the KB. | ||
;Where to get help? ([https://commons.wikimedia.org/w/index.php?title=File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf&page=53 slide 53] - [https://commons.wikimedia.org/w/index.php?title=File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf&page=58 slide 58]) | ;Where to get help? ([https://commons.wikimedia.org/w/index.php?title=File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf&page=53 slide 53] - [https://commons.wikimedia.org/w/index.php?title=File:KB_Wikibase.cloud_Unboxing_Experience,_Netherlands_Wikibase_Knowlegde_Group,_22-07-2022.pdf&page=58 slide 58]) | ||