Commons:Batch uploading/Tropenmuseum Expeditions

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

Tropenmuseum Expeditions[edit]

First file uploaded as an example
Second file I uploaded from this set, as an example
  • Source to upload from: This spreadsheet. The metadata has been extensively cleaned and prepared by Spinster (talk). I have the files on my hard drive and can provide them or place them in a downloadable spot by request. Upload tips are in this Google doc.
    • Did you observe an URL pattern


    • Do you know whether the site has an API


    • What else can ease uploading (is the site valid XHTML, WCM they use…)?


    • Did you contact the site owner?

The metadata and images were provided to me by Richard van Alphen, coordination collection digitization at the Nationaal Museum van Wereldculturen (= the new name of the museum in which the Tropenmuseum was merged).

  • Describe the works to be uploaded in detail (audio files, images by …):

720 photographs from the Tropenmuseum collection. All images in this upload are related to expeditions and missions, most notably

  1. the 1903 North New Guinea Expedition
  2. ethnomusicologist Jaap Kunst
  3. the Siboga Expedition
  4. various Christian missions in Africa, Suriname, Indonesia

The upload is part of the project Expedition Wikipedia.

  • Which license tag(s) should be applied?

Variations on {{KIT-license}}. See the spreadsheet: I already provided the correct license template for each image.

  • Is there a template that could be used on the file description pages? Do you think a special template should be created?

Please use {{Photograph}}, this is appropriate and the provided metadata fits nicely. See Sample file 1 and Sample file 2. More information and tips for the upload in this Google doc. Feel free to ask me any questions!

Spinster (talk) 12:26, 25 August 2015 (UTC)


Looks easy enough. I can take care of it, using my battle-tested MassUploadLibrary + GlamWiki Toolset. Jean-Fred (talk) 20:42, 3 September 2015 (UTC)

@Jean-Frédéric: Are you still looking at this? I may pick it up if not. This is already so nicely prepared that we ought to be able to knock it out easily. BMacZero (talk) 22:28, 29 February 2016 (UTC)
@BMacZero: @Spinster: contacted me again about it a couple of weeks ago, and decided to not be looking at this per lack of time (I should have updated here too, sorry about that) and suggested some alternatives. Spinster answered she had one someone else interested in this. Can you confirm Spinster? (I certainly agree it’s very nice prepared ;) Jean-Fred (talk) 15:11, 3 March 2016 (UTC)
@BMacZero: @Jean-Frédéric: Thanks for your offer to help! I know that Wikimedia Nederland is also looking for someone to do this upload, but perhaps if you have a quick routine you might be able to do it more easily than someone who is new to mass uploads. I'm emailing Arne Wossink from WMNL so that he can get in touch with you about this directly. Spinster (talk) 09:34, 6 March 2016 (UTC)
@Spinster: Thanks! Yes, I have a bot that's been doing batch uploads and I should be able to do this one in short order once I have the files. BMacZero (talk) 23:09, 6 March 2016 (UTC)
Arne asked me a few weeks ago to work on this batch upload. I was planning on doing so somewhere in the coming weeks. I've to look a bit at what is the easiest way to upload these. The files are on my pc (folder 100MB) and not via a weburl (making GWToolset not really an option?). Should I proceed as planned or would you like to work on this BMacZero? Mvg, Basvb (talk) 20:46, 7 March 2016 (UTC)
@Basvb: If it's all the same to you, I can take care of it pretty easily. I just write custom C# scripts for these, it won't take long for me to adapt one to this upload. I can have it ready to go in few days once I have the files. BMacZero (talk) 23:00, 8 March 2016 (UTC)
Ok, I've asked Arne if he wants to play it along to you. I'd likely not have any problem finding a way of uploading, just need to find a day to do so somewhere in the next weeks, so if you're ready to go that could speed up the process a bit. Basvb (talk) 17:40, 10 March 2016 (UTC)
If i can be of any use for uploading from a URL with GlamWikiToolset, just let me know. Hansmuller (talk) 16:36, 17 March 2016 (UTC)
I discussed it with Arne, he prefered if I would upload, as this can help out with understanding the Dutch. Hans, the images are not via URL, but on my computer, but I don't think I will have any issues uploading, thank you for offering the help. Just need to find a little time somewhere in the next two weeks. Mvg, Basvb (talk) 19:21, 17 March 2016 (UTC)
Okay, got it. BMacZero (talk) 00:32, 19 March 2016 (UTC)
@Spinster:: Ik ben begonnen met het werken aan de upload, ik denk over een paar uur klaar te zijn om te uploaden (heb de meest technische zaken overwonnen). Wel had ik twee vraagjes/opmerkingen. 1.: Er zitten 858 afbeeldingen in de zipfile die ik van Arne had ontvangen. In het metadatadocument zitten echter maar 720 rijen met bestanden. Ik zal er dus 720 kunnen uploaden, maar ben benieuwd of de andere 138 ook vrijgegeven zijn, of dat je daar bijvoorbeeld nog wat voor wil uitzoeken? 2.: Over de bestandsnamen: de naam van het museum in all-caps komt wel erg schreeuwerig over. Daarnaast is het volgens mij handiger om de titel vooraan te hebben en daarna pas de museumnaam (zodat in categorieën mensen gelijk kunnen zien wat het bestand afbeeld). Ik kom dan op bijvoorbeeld de volgende bestandsnaam uit: "Children paddling the proa of protestant missionary Van Hasselt, ... - Collectie stichting Nationaal Museum van Wereldculturen - TM-60010069.jpg", is deze afwijking van naamgeving ok, of wil je graag dat ik bij de aangegeven namen blijf? Misschien kan zelfs het "collectie stichting" stukje eraf om de naam nog wat korter en makkelijker te hanteren te maken? Tot slot lijkt het me mooi om alle bestanden in een technische (niet zichtbare) categorie te zetten, zodat je ze met verschillende tools kunt blijven volgen. Iets als "Images from the Nationaal Museum van Wereldculturen"? Mvg, Basvb (talk) 19:00, 5 April 2016 (UTC)
I've uploaded 3 sample images: File:Mission exhibition in the Colonial Institute's museum - Collectie stichting Nationaal Museum van Wereldculturen - TM-10000436.jpg, File:Mission exhibition in the Colonial Institute's museum - Collectie stichting Nationaal Museum van Wereldculturen - TM-10000437.jpg and File:Tentoonstelling over Missie en Zending in het museum van het Kolo... - Collectie stichting Nationaal Museum van Wereldculturen - TM-10000438.jpg. If the files are good and we decide on a upload specific category (or not to use one) I can start the upload, which will take circa 2 hours. Basvb (talk) 20:11, 5 April 2016 (UTC)
@Basvb: Uploads look good!
  • One small detail: times end with 00:00:00, perhaps this can be omitted?
  • Only 720 images: that's correct; the other ones are not OK in terms of copyright.
  • OK to do the name of the collection at the end and to drop the ALL CAPS
  • But I would not take away the 'collectie stichting' - I think the museum does want this mentioned
  • And an invisible category is a great idea of course. How about Category:Files from the Nationaal Museum van Wereldculturen? Maybe at some point they'll do sound and video too.
Thanks for your efforts, highly appreciated :-) Spinster (talk) 10:11, 6 April 2016 (UTC)
Thanks for the quick reply. About the times: I'm thinking of fixing those after the upload is done (using visualfilechange). Parsing all the different times before is possible, but doing it after the upload is just a little bit quicker. And I'll add the category and start the upload. Basvb (talk) 12:21, 6 April 2016 (UTC)
@Spinster:: The upload is done, on 12 or 13 files there was a naming issue (wrong characters in the title), I'll be uploading those by hand asap. The much linked creator template from Gijs van der Sande is a red link, can you create that one Spinster? Basvb (talk) 15:35, 6 April 2016 (UTC)
I wrote down the numbers of the failed uploads and fixed them now, it does however seems like I've missed as there are currently only 719 files. Basvb (talk) 18:48, 6 April 2016 (UTC)
I searched the Google Doc for other potential candidates to be missing but there are none (with a question mark in the title, which was the reason for failed titles, those are forbidden in commons file titles). Not a good idea on how to find the last failed file easily. Basvb (talk) 19:00, 6 April 2016 (UTC)
Ok, I've fixed all the dates now, everything is done now (except for this one missing file, but I don't know an efficient solution for that). Do you plan on posting something in the Dutch village pump Spinster? Any other things to quickly make these files better usable? Basvb (talk) 18:10, 7 April 2016 (UTC)
@Basvb: thank you so much! I made the creator template for Gijsbert van der Sande and am going through the files to see if I can add more info (categories and such). We'll publicize this upload via all Wkimedia Nederland channels and via GLAM mailing lists and the GLAM newsletter, among others. Spinster (talk) 09:15, 11 April 2016 (UTC)
Sounds like a good plan, shall I move this request to the completed requests? Basvb (talk) 14:01, 14 April 2016 (UTC)
Assigned to Progress Bot name Category
User:Basvb Upload done User:BasBot Category:Files from the Nationaal Museum van Wereldculturen