Commons:Village pump/Technical

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search

Shortcuts: COM:VP/T • COM:VPT

Welcome to the Village pump technical section

This page is used for technical questions relating to the tools, gadgets, or other technical issues about Commons; it is distinguished from the main Village pump, which handles community-wide discussion of all kinds. The page may also be used to advertise significant discussions taking place elsewhere, such as on the talk page of a Commons policy. Recent sections with no replies for 30 days and sections tagged with {{Section resolved|1=--~~~~}} may be archived; for old discussions, see the archives; the latest archive is Commons:Village pump/Technical/Archive/2021/05.

Please note
SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 1 day and sections whose most recent comment is older than 30 days.


MediaWiki:Gadget-Geotoolbox.js, also known as "Geocoding tools" in Special:Preferences, is a very simple gadget activated by 2,625 editors (298 active). It adds three links to the left sidebar toolbox: Geocoding Recent Changes Geocoding Search Geocoding Daily Log. There's only one problem: all three links are dead. I intend to remove the gadget from MediaWiki:Gadgets-definition, but figured I'd post here to make sure there were no objections. AntiCompositeNumber (talk) 22:14, 11 May 2021 (UTC)

I've blanked the gadget code, and will wait a bit longer before removing it from the gadget page. AntiCompositeNumber (talk) 02:08, 21 May 2021 (UTC)

Large tif upload from China[edit]

I want to upload many tif files of ancient Chinese paintings up tp 3 GB. While I can upload jpg files and smaller tif files without trouble, big tif files fails. Is there a way to do it? --維基小霸王 (talk) 14:36, 12 May 2021 (UTC)

You're probably looking for Help:Chunked upload. TommyG (talk) 17:31, 12 May 2021 (UTC)
@維基小霸王: There are known issues with uploads larger than 100MB. See this thread. You may need to request a Server-side upload for these. Xover (talk) 22:12, 12 May 2021 (UTC)
OK.--維基小霸王 (talk) 04:29, 13 May 2021 (UTC)
@維基小霸王: I looked at your files and find them to be extremely beautiful and important works (which is kind of logical regarding the subject). I would highly recommend that you add at least minimal information on each item in English (such as date, depicted object and artist), which is now hardly existent. This would make the files much more useful, as people will hardly include them in Wikipedia articles without having information thereon. Remember, there are almost only amateurs around here. Greetings, Pittigrilli (talk) 23:16, 17 May 2021 (UTC)
However, there is a huge amount of them so I can't do it for all... I will try to use wikidata item as author in future uploads.
I have problem in uploading big tifs. I need help. An experienced user has agreed to help but I don't know if it will work. If it doesn't work, I will ask here...--維基小霸王 (talk) 00:44, 18 May 2021 (UTC)
@維基小霸王: If it doesn't work out with the other experienced user, I will try to help you. In that case, I will need access to the files to download to my side and a list of the metadata. Inductiveload (talk) 18:31, 19 May 2021 (UTC)
@Inductiveload: Great! Have you tried uploading big files up to 3 GB?--維基小霸王 (talk) 04:01, 20 May 2021 (UTC)
@維基小霸王: I'll be using Pywikibot in async chunked mode, which has certainly done > 1GB for me before. If you can point me to an example file, I'll give it a try and see how it goes. Inductiveload (talk) 04:20, 20 May 2021 (UTC)
@Inductiveload: Thanks. But baidu wangpan, the net drive I use, requires an paid account for fast downloading big files. I will set up one for you. It may take a bit time.--維基小霸王 (talk) 01:23, 23 May 2021 (UTC)
@維基小霸王: any progress on this? If you're struggling, another alternative might be to create a .torrent file and I can torrent them directly from you? Otherwise, if you can get access to Dropbox, I can give you a shared folder to upload to. You can email me with any private links.
In the meantime, I will also need the files' metadata to make the file descriptions. Inductiveload (talk) 08:30, 28 May 2021 (UTC)
@Inductiveload: I have sent you an email for download instructions. --維基小霸王 (talk) 13:24, 29 May 2021 (UTC)
@維基小霸王: OK, so I have downloaded the demo file and tried to upload it (twice). While I can upload all the chunks now, the process still dies after several minutes of re-assembly with stashfailed: Could not store upload in the stash (UploadStashFileException): "An unknown error occurred in storage backend "local-swift-codfw".". I guess we might really be looking at a server-side upload. Inductiveload (talk) 22:15, 10 June 2021 (UTC)
Thanks for trying! Can you tell me your downloading speed from Baidu Wangpan? --維基小霸王 (talk) 22:19, 10 June 2021 (UTC)
@維基小霸王: Looks pretty good: ~10MBps at the moment.
I started to upload some of the "Tianjin" files to the IA: (might be easier to hand them over for server-side upload that way). However, uploading to the IA is incredibly slow. I also don't have a filename -> info mapping, so I haven't been able to construct metadata for testing small file uploaded (possibly the smaller files are possible to upload). Inductiveload (talk) 01:21, 11 June 2021 (UTC)
May be we could reorganize the files before uploading?There are actually duplicated files.--維基小霸王 (talk) 08:00, 11 June 2021 (UTC)
@維基小霸王: Sure, all I need is a mapping from filename to metadata (artist, title, page number/side, that kind of thing). A spreadsheet will work, for example. 15:36, 11 June 2021 (UTC)
I will require a lot of work. I will tell you if it's ready.維基小霸王 (talk) 07:05, 18 June 2021 (UTC)

Create a tag for User:Jack who built the house/Convenient Discussions[edit]

Hi, more and more users are using this script, and I would like to move the tag from the edit description to the correct place. You can see what I talking about here. Can you create, please? :)
MediaWiki:Tag-convenient-discussions -> [[Special:MyLanguage/User:Jack who built the house/Convenient Discussions|CD]]
MediaWiki:Tag-convenient-discussions-description -> Edit made using [[Special:MyLanguage/User:Jack who built the house/Convenient Discussions|Convenient Discussions]]. Iniquity (talk) 17:46, 13 May 2021 (UTC) Iniquity (talk) 17:52, 13 May 2021 (UTC)

No objections for nearly a month, I have created tags rubin16 (talk) 11:06, 5 June 2021 (UTC)

Did I observe correctly that CropTool writes sth like "new uploaded, derivated file of the present one" into source files, but DerivativeFX doesn't [SOLVED][edit]

Example: File:Bose Acoustic Wave Music System 3000 CD&Radio (cropped).jpeg was created as new file with CropTool, and the source file has got a nice little thumb at "other version" together with the text "This file has an extracted image: [Filename]". In comparison, this file File:Bahnhof München-Pasing, 2012 (cropped).jpg was uploaded with DerivativeFX, but the source file File:Bahnhof München-Pasing, 2012.jpg was not altered at all, hence it has no hint to the derivative work, which I find improvable. I reproduced the above with some files and did get same result. Pittigrilli (talk) 20:30, 17 May 2021 (UTC)

My above question/remark is now 10 days old, without any response. Given the un-questionable significance of the adressed subject, I find this a bit strange. Either my observation is something which is intended, then a "no problem" as an answer would not have been difficult. If I found sth. which is improvable, an "oh thanks for pointing this out" would have made sense. Pittigrilli (talk) 23:00, 26 May 2021 (UTC)
I found out that the error I saw is/was real - However, this seems to have occurred only for some files in a row (see above) some weeks ago. Now, also DerivativeFX automatically inserts a label "This file has derivative works" in the source files for me. Pittigrilli (talk) 09:13, 5 June 2021 (UTC)

Is there a way to search "All pages by default" in the SDC "Google-like" search engine[edit]

I really like the new search engine in a lot of ways... Unfortunately, it still has a lot of issues, among which that you can't choose to display the list of results in the old way (which is superior), or the fact that opens up images in a viewer automatically (like Ecosia, Microsoft Bing, Yahoo!, Google, DuckDuckGo, Etc.) rather than open the image in the same tab or new tab. However, the most annoying issue I have with it is that it doesn't search "All pages" by default, if I type in a category or policy page name it directs me to (usually) irrelevant images, I understand that Wikimedia Commons exists for the media but it would make more sense if "All pages" was the default.

Even for unregistered casual "visitors" this would make more sense, as they could be looking for a discriminate category rather than a more indiscriminate list of images and other files as the category is easier to navigate. --Donald Trung 『徵國單』 (No Fake News 💬) (WikiProject Numismatics 💴) (Articles 📚) 06:42, 20 May 2021 (UTC)

This search tool is called "MediaSearch" it is only made for searching for media files. For all other MediaWiki pages you need to use the old search. --GPSLeo (talk) 11:58, 20 May 2021 (UTC)

Font size decreased[edit]

Hi, As mentioned at Commons:Village_pump#Font_size my font size has decreased dramatically, despite me going to Phab it's been marked as resolved with the person saying they can't reproduce the problem .... and nothing further has been done.
So basically it's in all in my head and doesn't exist apparently.
This issue is only affecting Commons - Font sizes on EN Wiki, Simple Wiki AND external sites all look fine .... the issue is solely with Commons ....
So can anything be done as at this point as Phab are beyond hopeless (or atleast the dealing person was!). (my settings are all fine and Chromes defult).
Thanks, –Davey2010Talk 19:13, 20 May 2021 (UTC)

@Davey2010 does adding ?safemode=1 to the end of the URL help? AntiCompositeNumber (talk) 19:37, 20 May 2021 (UTC)
Hi AntiCompositeNumber, Apologies for the delay in getting back to you, It did! :) - When I add that the font size is normal on all pages, Thanks, –Davey2010Talk 20:02, 20 May 2021 (UTC)
@Davey2010, alright, that means the problem is in your gadgets, User:Davey2010/common.js, or User:Davey2010/vector.css. You'll have to just start disabling things until you figure out what caused the problem. AntiCompositeNumber (talk) 20:06, 20 May 2021 (UTC)
Hi AntiCompositeNumber, Thank you so much for your help, I cleared my history and the same issue is now at EN so this does indeed look to be a problem with a gadget, Thank you so so much AntiCompositeNumber honestly cannot thank you enough, Truly appreciate your help thanks again, Take care, Warm Regards, –Davey2010Talk 20:11, 20 May 2021 (UTC)
Hi again AntiCompositeNumber, User:Davey2010/vector.css was the culprit - I've blanked the page and then enabled "Typographyrefresh" in gadgets and the problem returned so it's something to do with the coding or atleast the font-size coding. Anyway thank you again for your help it's greatly appreciated! :), Thanks, –Davey2010Talk 20:38, 20 May 2021 (UTC)
  • Resolved - Apologies for the above ranty message - Essentially got told there wasn't a problem which made me feel like I wasn't being believed, and then certain actions within the old Phab ticket occurred (such as marking the ticket as resolved when it wasn't and renaming the ticket ignoring my original complaint) which ticked me off and then I began pulling my hair out trying to out what the issue was and where it was. Phab ticket's now at Thanks again AntiCompositeNumber. –Davey2010Talk 23:17, 20 May 2021 (UTC)

Tech News: 2021-21[edit]

17:04, 24 May 2021 (UTC)

Files idling in a category[edit]

There is a category, where some files were originally deployed via the template. Then the template was changed to deploy files into subcategories. For some files, it was changed manually, for others via perform batch task script (PBT). Those which were fixed via PBT left the mother category, while files fixed by hand stays in the mother category still. I wonder what is the problem? Maybe some jobs on the server still haven't been done after days? --Juandev (talk) 18:01, 24 May 2021 (UTC)

@Juandev: After changing a template, pages including it may remain in categories and Special:WhatLinksHere lists for quite a long time, at least on Commons (for a template, formerly used on tens of millions of files, it took about a year to WhatLinksHere to become empty!). A workaround is null editing all files either manually, or using a bot (I chose the latter one, the category should be empty within a few minutes). —Tacsipacsi (talk) 13:04, 27 May 2021 (UTC)

User talk:Wardi 96[edit]

What is happening on this user talk page? I can't find any stray characters that would cause {{Autotranslate}} to malfunction, so why are the templates not parsed correctly? De728631 (talk) 16:33, 26 May 2021 (UTC)

Too many templates, so Mediawiki stops parsing. TommyG (talk) 16:58, 26 May 2021 (UTC)
Oh, I didn't know this limitation even exists. Thank you for clarifying. De728631 (talk) 11:01, 27 May 2021 (UTC)

EN language subtitles showing in EU Wikipedia[edit]

Hi, I hope I am in the right place. I actually posted a similar question some time ago with no answer. I have this video with subtitles in Basque and English.

Still when I play the video on a Basque WP page, the English subtitles appear, and actually no Basque subtitle option in Closed Caption, despite there actually being subtitles in Basque. This is a bit confusing and annoying, is there any way to automatically trigger the subtitles in the relevant language according to the WP. On another WP article, no subtitles appear at all, and CC options go "no text tracks available". Iñaki LL (talk) 20:56, 28 May 2021 (UTC)

Actually, it seems to take some time until the the right subtitles trigger, but they do trigger! So for the time being, this seems to be solved. Iñaki LL (talk) 18:58, 2 June 2021 (UTC)

Babel boxes[edit]


Does anyone know why the level text in the Babel boxes has become bolder? (screenshot). --Thibaut (talk) 07:05, 29 May 2021 (UTC)

Apparently the bug only affects Firefox 88.0.1 and {{Babel}}, {{#babel}} works fine. --Thibaut (talk) 08:17, 29 May 2021 (UTC)
I think it depends on the font used, not the browser. (At least it also depends on the font; I didn’t see it in Firefox 89.0b15.) Anyways, it was caused by this edit, and I (hope to) have fixed it in this edit. —Tacsipacsi (talk) 10:31, 29 May 2021 (UTC)
It fixed it! Thank you. --Thibaut (talk) 11:10, 29 May 2021 (UTC)

Tech News: 2021-22[edit]

17:04, 31 May 2021 (UTC)

Is it possible to swap two files?[edit]

I uploaded,_the_earliest_Kurdish%E2%80%93Arabic_dictionary_in_verse,_18th_century_(Or._5932,_f._9v).jpg and,_18th_century_(Or._5932,_f._14v).jpg In the process, I noticed that the information in the source I was uploading from was probably incorrect. Nevertheless, I uploaded the two files with the information available. I made enquiries, and I have now had word that my suspicions were correct: there had been a mix-up, and the source's data has now been corrected accordingly. Now, it would be ideal if everything remained the same (name, description, caption) except for the actual images themselves, which should be swapped over. Or rather, all the information besides the .jpgs themselves should be swapped. Is there a short-cut for doing this? GPinkerton (talk) 04:58, 2 June 2021 (UTC)

Failure to upload large webm file[edit]


I cannot complete the process of uploading a .webm of 2.9 GB using the standard Special:UploadWizard. The uploading part seems to work (it takes me about 2 hours to complete), but at the very end I get the error "The server did not respond within the expected time.". I tried with Firefox 88 and Chromium 91 on Ubuntu 20.04. What are my options? Is it worth it to try a command line tool (Commons:Command-line upload) or a desktop application (Commons:Upload_tools#Standalone_desktop_applications)? The file is in fact the product of the concatenation (via ffmpeg) of two .webm files (1.8 GB + 1.1 GB). Maybe I could upload these two files and some administrator could run ffmpeg -f concat -safe 0 -i list.txt -c copy output.webm on the server?

Note: the .webm file is a video tutorial on how to contribute to Wikimedia Commons (in French).

--Mathieugp (talk) 15:02, 3 June 2021 (UTC)

UPDATE: @Jmabel: suggested it could be a timeout issue on the browser side. Is it worth looking into it in your opinion? --Mathieugp (talk) 15:11, 3 June 2021 (UTC)
It could be any one of a number of issues, but the long and short of it is that uploads over 100MB are currently broken. See this discussion and several Phabricator tickets. As I understand it the issue is architectural and requires rather invasive code surgery to fix. I think there is work happening there, but I haven't seen anyone actually detailing that anywhere so I could be wrong.
In the mean time, some uploads work at random times so you can just keep trying and it may go through eventually. If it absolutely won't go through you can request a server-side upload. Xover (talk) 16:16, 3 June 2021 (UTC)
Thanks @Xover:! If all else fails, I will do as you suggest and request a server-side upload. --Mathieugp (talk) 09:38, 7 June 2021 (UTC)
@Xover: So, I opened up a request for a server-side upload on phabricator yesterday (T284617). Hopefully I did it right and some generous soul will have time for me very soon. Thanks again for your help! --Mathieugp (talk) 12:44, 9 June 2021 (UTC)

Tech News: 2021-23[edit]

20:01, 7 June 2021 (UTC)

OpenStreetMap “Hjuston”[edit]

In OpenStreetMap maps available on Wikipedia (and sourced to a Data: page here), Houston, Texas is displayed as “Hjuston.” (This problem is universal with OSM maps, but can be seen clearly here.) This problem does not occur on the OSM website, however. I don’t know what is the cause of this problem, which is why I bring this question to the technical forum. TE(æ)A,ea. (talk) 12:41, 9 June 2021 (UTC)

The mobile interface improved, I want update logs[edit]

I noticed that the "Mobile 📱 interface" for Wikimedia websites improved, for example mobile users can now use HotCat (including all its flaws) and view categories, layouts also seem to have improved sometime during the past week.

But oddly enough, I didn't see these changes listed in Tech News, where can I watch all the MediaWiki software developments and do discussions around them take place? --Donald Trung 『徵國單』 (No Fake News 💬) (WikiProject Numismatics 💴) (Articles 📚) 08:32, 12 June 2021 (UTC)

"Unknown warning"[edit]

I got this message...

When attempting to upload an image I keep getting this warning. Is this normal? (As in, are other people experiencing it? Or is it just the file?) --Donald Trung 『徵國單』 (No Fake News 💬) (WikiProject Numismatics 💴) (Articles 📚) 18:51, 12 June 2021 (UTC)

@Donald Trung: Wild guess: could it be that the file's file name matches a filter (possibly an abuse filter, title blacklist, or internal filter in MW et al) that is designed to prevent reupload of thumbnails downloaded from Commons? Perhaps removing the "462px-" prefix on the name will help? Xover (talk) 09:58, 13 June 2021 (UTC)
@Xover:, Likely, I changed its name to "Newname" and I could upload it. The file wasn't identical to any pre-existing file so I must've hit a blacklist, just find it odd that often in the Mediawiki software 👩‍💻 errors don't say why something is an error, until recently if you used a link on the global spam blacklist and tried to save it while using the "Mobile view" it wouldn't say why the edit failed, only "Error, couldn't save edit", so if you used several dozens of links it was a guessing game to find out which one was blacklisted. The lack of transparency is really a bane for users, but I am sure that this is by design. --Donald Trung 『徵國單』 (No Fake News 💬) (WikiProject Numismatics 💴) (Articles 📚) 11:38, 13 June 2021 (UTC)
@Donald Trung: It is, I'm guessing, a slightly overzealous attempt at user friendly design: the underlying errors are often really technical and inscrutable, so the top level interfaces like UploadWizard tend to try to catch specific errors to present pretty and friendly error messages for them instead of the original message. The flip side of that is often that any error that they don't specifically code for ends up hidden behind a catchall "Something went wrong" message that tells you nothing and requires the assistance of a developer digging through logs to identify (no need to guess how often they'll have the time to actually do that). Personally I think this is really rather misguided: most users, no matter how non-technical, will not faint with the shock or run away screaming if presented with even the ugliest and most obscure error message. And armed with that message they are enabled to seek assistance from more technically-minded users (and ultimately developers) with sufficient information to have any hope of figuring out what's going on. The irony here is that if there's one thing developers really hate, it's bug reports that fail to include any error message emitted from the software… Xover (talk) 12:04, 13 June 2021 (UTC)
@Xover:, again, this is deliberate. Wikimedia isn't the only website family with this, this also occurred with Google websites and services, before (a decade or so ago) Google Chrome had lengthy error reports which showed what to tell the developers, now it's either "Monkeys are working on it" or "Take a look at this picture of a dinosaur". Before Microsoft Windows 8 the "Blue Screen of Death" (BSOD) included an error message that allowed people to know why their computer crashed, since Microsoft Windows 8 people get a message in the form of this emoticon :-( . This has become common industry practice and people have been complaining about it for the better part of a decade.
A good alternative would be a button that states "See error report" when an error occurs, or a way to automatically submit errors to the Phabricator or perhaps some page here on Wikimedia Commons to be logged so developers have access to the data and know exactly when certain errors occur. Currently we have "a solution" that talks down on non-technical people and irritates technical people, it's a lose-lose situation. --Donald Trung 『徵國單』 (No Fake News 💬) (WikiProject Numismatics 💴) (Articles 📚) 12:38, 13 June 2021 (UTC)
We appear to be in vehement agreement. :) Xover (talk) 17:31, 13 June 2021 (UTC)

User talk:CommonsDelinker/commands/Category moves - reason[edit]

In User talk:CommonsDelinker/commands/Category moves, i add many move commands, copied from moved categories. I wrote earlier reason with username, that applied to all move commands added by me in that time. Did i need to add it to all of them, because of message: "Warning: Please add a reason. Warning: Username of requester missing (user parameter). For transparency and to prevent abuse, please add your username.". VVerka5 (talk) 09:31, 14 June 2021 (UTC)

@VVerka5 hi. Yes, you need to do it for each of the command rubin16 (talk) 09:59, 14 June 2021 (UTC)

Tech News: 2021-24[edit]

20:25, 14 June 2021 (UTC)

Override number of files shown on category pages[edit]


Can you override the default 200 files that are shown per page at category pages?Jonteemil (talk) 00:05, 16 June 2021 (UTC)

It seems to be fixed when you configure a wiki: mw:Manual:$wgCategoryPagingLimit. Trying to override it on the url, with "?limit=500", doesn't have any effect. --ghouston (talk) 00:57, 16 June 2021 (UTC)

Why are mobile users still second-class citizens on Wikimedia websites?[edit]

Why are categories only visible for logged in users? They serve as a navigational tool for the readers, not only as an exclusive maintenance tool for editors. It has always baffled me how unusable the mobile website is for most casual readers, I have actually had friends complain when I link them with the "m." URL's because many handy features available for people that only read Wikipedia aren't available to them then.

Maybe handicapping mobile screens made sense when every phone had 512 MB RAM, but today most phones have more power than most high end laptops when these limitations when added.

On Wikimedia Commons categories are literally the navigational tool, I don't think having A DELIBERATELY mobile unfriendly website really benefits anyone. --Donald Trung 『徵國單』 (No Fake News 💬) (WikiProject Numismatics 💴) (Articles 📚) 09:27, 17 June 2021 (UTC)