Help:Chunked upload

From Wikimedia Commons, the free media repository
Jump to: navigation, search


This page transcludes User talk:Rillke/bigChunkedUpload.js and Commons:Chunked uploads until the former is integrated into the latter.
Screenshot of the script's main dialog

Help

Gist: Helps you to get done with individual, huge uploads.

This script is intended to be used by power users who want to overwrite or upload new files over a slow connection, in relation to the file size. It assumes its users know or can imagine what a chunk, a byte, the upload stash and an offset are and how to write wiki markup. Hint: The latter is what you enter if you prefer not to use the VisualEditor. At Wikimedia Commons, the most important template is {{Information}}, which you certainly want to use on every of your file description pages.

If you don't know, you can still try your luck but don't blame me for any unexpected incidents.

Activation link probably under the edit tab. Otherwise it's in the Tools box of the side bar

How to install

Add

 importScript('User:Rillke/bigChunkedUpload.js');

to /common.js

Global or foreign wiki installation

Note that the uploads always go to the wiki you are on! Cross-Wiki upload is not supported yet.

Add

 mw.loader.load( '//commons.wikimedia.org/w/index.php?title=User:Rillke/bigChunkedUpload.js&action=raw&ctype=application/javascript' );

to m:Special:MyPage/global.js. Make sure you remove any imports of this script at Wikimedia Commons before enabling global import, i.e. check your Special:MyPage/common.js and Special:MyPage/vector.js that you do not import the script there.

mw:mw:Extension:GWToolset toollabs:video2commons toollabs:videoconvert User talk:Rillke/bigChunkedUpload.js Commons:VicuñaUploader Commons:Upload Wizard other: 11,123 uploads (76.2%)Circle frame.svg
Market share of uploading tools for top revisions of files equal to or above 200 MiB uploaded since Sun, 01 Mar 2015 00:00:00 +0000 at Wikimedia Commons last updated Sat, 12 Nov 2016 17:21:35 +0000; 100% = 14589

How to use

Overwriting an existing file

  1. Choose the second option of the upload link of any file page:
    Upload a new version of this file (chunked upload)
  2. Fill out the reason field in the pop up and select the file to upload.

Creating a new file

  1. Navigate to File:DesiredFileName.ext Please amend the file name before selecting a file to be useful.
    Press upload (chunked) from your "Tools" box in the sidebar, or from the drop-down menu next to the create (or edit) tab. The location of the link depends on your system and settings.
  2. Fill out the file description field in the pop up and then select the file to upload.

Compatibility

For a rough estimation c.f. http://caniuse.com/xhr2

Troubleshooting

  • In case the last chunk was uploaded and you see an error, please go to your UploadStash and try publishing from there.
    • If publishing doesn't work, you might be running across this error. To workaround it, follow the instructions here.
  • Always select a reasonable chunk size. Uploading a 500 MiB video in 100 KiB chunks will likely fail due to server quotas while assembling the chunk. Uploading a 100 MiB video through a crappy connection with a chunk size of 20 MiB will likely be unsuccessful, too because none of the chunks will make it in one piece to the server.
  • There is currently a known issue with larger DJVUs and PDFs. To successfully upload them, you have to un-tick the checkbox use stash and async (recommended for large videos and photos). Don't do this generally as it makes the upload process more unreliable.
  • If larger chunks are told be uploaded 100% within no time and you encounter errors, it is most likely a proxy is taking all the data from your browser. Check your browser's and system's proxy settings then.
  • Report any other issues to my talk page.

See also


Upload Wizard uses chunked uploads to provide better reliability during the upload of large files. In addition, it allows a greater maximum file size (4 GB as opposed to the usual 100 MB).

During a chunked upload, the file is split into small parts and these parts are uploaded. If some parts failed to upload, the whole file does not have to be re-uploaded, only the parts that failed. All this is done in the background in UploadWizard.

It provides better reliability not just for UploadWizard, but also for bots using the API, especially for files uploaded through the API.

See also

Chunked upload fails (2012)
Stashed upload manual draft
Chunked upload tracking bug
Uploadstash errors tracking