User talk:Zhuyifei1999

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search


This is a Wikimedia Commons user talk page.

This is not an article, file or the talk page of an article or file. If you find this page on any site other than the Wikimedia Commons you are viewing a mirror site. Be aware that the page may be outdated and that the user to whom this talk page belongs may have no personal affiliation with any site other than the Wikimedia Commons itself. The original page is located at

This is the user talk page of Zhuyifei1999, where you can send messages and comments to Zhuyifei1999.
  • Please sign and date your entries by clicking on the appropriate button or by typing four tildes (~~~~) at the end.
  • Put new text under old text.
  • New to Wikimedia Commons? Welcome! Ask questions, get answers as soon as possible.
  • Click here to start a new topic.

বাংলা | български | čeština | Deutsch | Deutsch (Sie-Form)‎ | English | español | français | hrvatski | italiano | 한국어 | മലയാളം | português | русский | sicilianu | 中文 | +/−

  • Be polite.
  • Be friendly.
  • Assume good faith.
  • No personal attacks.

Strange behaviour of the bot

I can see this for the second time. The bot takes a file, strips redundant data and uploads it under a new name – note the dash just after the colon. --jdx Re: 18:57, 11 September 2018 (UTC)

wtf?! o.O The bot doesn't even copy the wikitext. It must have been pywikibot. But it checks the page's existence before overwriting. How is this possible? I'm kinda busy this week. Will hopefully find something this weekend --Zhuyifei1999 (talk) 19:44, 11 September 2018 (UTC)
No problem, this occurs very rarely. Here is the 2nd example: File:From Sehwan, start of the travel.jpg and File:-From Sehwan, start of the travel.jpg. --jdx Re: 03:48, 12 September 2018 (UTC)
All I see in the logs is:
Working on: File:From Sehwan, start of the travel.jpg at 2018-09-08T11:24:55Z

>>> [[File:From Sehwan, start of the travel.jpg]] <<<
After 6.9MiB (7218688 bytes, via Ending): Identified type: image/jpeg (JPEG image data, Exif standard: [TIFF image data, little-endian, dirent
ries=4, xresolution=62, yresolution=70, resolutionunit=2], baseline, precision 8, 1616x1080, frames 3)
Upload successful.
Working on: File:During travel.jpg at 2018-09-08T11:24:57Z
I cannot see any way a - could have been added till the API request to MediaWiki. After MediaWiki API that's outside my realm of knowing-how-to-debug --Zhuyifei1999 (talk) 22:12, 16 September 2018 (UTC)

Need your help with gigapixel upload

Hello Zhuyifei1999! How are you? A museum with which friends and I are leading a GlamWiki initiative, Museu do Ipiranga, launched a couple of days ago a Google Arts & Culture project. In this context, GAC has uploaded a series of very large reproductions of important paintings, taken with the Art Camera. These are gigapixel files. I understand they can be uploaded to the Commons, but I have not figured out how this is done. I have seen you were able to do one of these uploads. Would you mind telling me how it works? I am for instance very interested in uploading this painting, one of the most important of Brazilian art. Thanks a lot! --Joalpe (talk) 17:14, 14 September 2018 (UTC)

I'll look into it this weekend. The script has been in the process of rewriting for a long time and is almost always broken :( --Zhuyifei1999 (talk) 17:16, 14 September 2018 (UTC)
@Joalpe: The script is totally broken since I tried to rewrite it last November. The older version might somewhat work but meh. How urgent is this? If it's urgent I guess I'll do something with the older version. If it's not urgent could you wait for the rewrite? It could take a week or two. Though, since you asked about how it works, I wrote about it last October in an email, which I've copied to phab:P7554. --Zhuyifei1999 (talk) 04:24, 17 September 2018 (UTC)
Hi. Thanks for your answer --and I am also marking Mike Peel, who is interested in understanding how you managed this upload. We can definitely wait a week or two for the upload. We are hoping to upload all 27 gigapixel files that were produced from the collection of this particular museum in Brazil. Thanks a lot! --Joalpe (talk) 23:18, 17 September 2018 (UTC)
@Joalpe, Mike Peel: I mostly finished that part that scraps tiles. See [1] and [2]. That's the harder part. I'll make the script that combines tiles starting from tomorrow.
BTW, is either of you on IRC by any chance? I could message you on how to set the script up and/or how each part works. --Zhuyifei1999 (talk) 21:24, 18 September 2018 (UTC)
Zhuyifei1999, I'm not on IRC, but Mike Peel is. Thanks for working on this! --Joalpe (talk) 03:02, 20 September 2018 (UTC)
@Joalpe, Mike Peel: I've updated the fetch code to save the tiles, and wrote [3] that merges the tiles into one gigantic PNG (and that should be lossless), but that might end up larger than 4 GiB and be non-uploadable. There's a maximum size for JPEGs (65535 x 65,535) so you can't really save that gigapixel in one piece of gigantic JPEG either. I think ImageMagick will suit pretty well for the purposes of converting / splitting / downscaling to make the gigapixel uploadable. Also @Mike Peel what is your IRC nick? I'm unable to find you. --Zhuyifei1999 (talk) 01:49, 21 September 2018 (UTC)
I got all the tiles for xQEMjjFlwma5eQ (Independência ou Morte - Pedro Américo de Figueiredo e Mello) at 2035206740 bytes (about 2 GiB). The latest version of the script needs about 1.5 seconds per tile --Zhuyifei1999 (talk) 01:38, 23 September 2018 (UTC)
Sorry for the slow reply. I'm on irc as 'mpeel', but not very often. I'm happy to help if needed, but it looks like you have it under control? Let me know if you need any help. Thanks. Mike Peel (talk) 22:38, 23 September 2018 (UTC)
@Joalpe, Mike Peel: I mean, I thought you and Joalpe are interested in the method of how this is done, and are willing to upload the images yourselves. I am very much willing to demonstrate it so that you may get all the 27 gigapixels uploaded (or more if you ever need in the future). I personally do not have the time capacity to do many gigapixel downloads, and then there's the issue of merging tiles costs a huge amount of disk space (xQEMjjFlwma5eQ specifically requires 129GiB of disk space for pixel cache when merged as a whole), which I often don't have the infrastructure to support. I would be very happy if you could get them uploaded, and I can fix any issue that might arise with my scripts. --Zhuyifei1999 (talk) 23:10, 23 September 2018 (UTC)

Tech News: 2018-38

21:58, 17 September 2018 (UTC)

Flickr bot shutdown?

Dear Zhuyifei1999,

Has the flickr bot shut down for repairs? Just asking. I notice the flickr bot review was 2000 images. Best, --Leoboudv (talk) 05:35, 18 September 2018 (UTC)

Probably the NFS maintenance broke it. I restarted it. --Zhuyifei1999 (talk) 14:29, 18 September 2018 (UTC)

New discussion on Commons talk:Structured data

Hello. I've started a new, important discussion about creating properties for Commons on Wikidata. Please come join in, if the process is something that interests you or if you can help. Keegan (WMF) (talk) 16:48, 19 September 2018 (UTC)

Is the Embedded Data Bot still working?

There have been no new entries in Special:Contributions/Embedded Data Bot since Monday's evening what seems to be strange. --jdx Re: 13:12, 20 September 2018 (UTC)

The NFS maintenance probably broke it as well. Restarted. --Zhuyifei1999 (talk) 14:18, 20 September 2018 (UTC)


Jotzet (talk) 10:12, 21 September 2018 (UTC)