User:SFauconnier/OpenRefine page update 202207
OpenRefine is a free and open source (FOSS) tool with which you can (batch) edit and upload files on Wikimedia Commons. It can be used to add and edit structured data.
| Statistics |
| |
| files have been uploaded with 💎 OpenRefine |
Wikimedia Commons edits with OpenRefine 3.6 💎 Wikimedia Commons edits with OpenRefine 3.7 💎 Wikimedia Commons files uploaded with OpenRefine
About OpenRefine[edit]
.svg)
OpenRefine is a free data wrangling tool that can be used to process, manipulate and clean tabular (spreadsheet) data and connect it with knowledge bases ("spreadsheets on steroids" / "a swiss army knife for data").
OpenRefine is widely used by librarians, in the cultural sector, by journalists and scientists for more than ten years, and is taught in many curricula and workshops around the world. It has been a popular tool for Wikidata editing since 2018, and now also supports Wikimedia Commons thanks to a Wikimedia grant (2021-22).
OpenRefine is a community-supported open source project, licensed under the BSD license. It has a graphical user interface in more than 15 languages. You can help by translating its interface to your language!
- OpenRefine's website – https://openrefine.org
- OpenRefine's documentation – https://docs.openrefine.org
- OpenRefine on GitHub – https://github.com/OpenRefine/OpenRefine
- User mailing list – https://groups.google.com/g/openrefine
This page contains information about OpenRefine for the Wikimedia Commons community. OpenRefine is a popular tool for batch editing Wikidata too; see Wikidata:Tools/OpenRefine for more info and documentation about OpenRefi on Wikidata.
Install and run OpenRefine[edit]
As a local application on your computer[edit]
OpenRefine can be downloaded as an application and works on desktop and laptop computers with Windows, Mac and Linux operating systems. It runs a small server on your computer and you then use a web browser to interact with it. It works best with browsers based on Webkit, such as Google Chrome, Chromium, Opera and Microsoft Edge, and is also supported on Firefox.
You can download OpenRefine here. Installation instructions are available in OpenRefine's documentation.
In the cloud (via Wikimedia PAWS)[edit]
If you are unable to install OpenRefine on your computer, or if it runs very slowly, then you can also use it in the cloud (on wmcloud.org through PAWS). Everyone with a Wikimedia account can access OpenRefine here. Visit https://hub.paws.wmcloud.org/, log in, and click on the OpenRefine (blue diamond) logo.
 | PAWS sometimes does not (yet) run the most recent OpenRefine version. OpenRefine via PAWS is not managed by the OpenRefine team; if you have any questions or comments about this service, you can submit a ticket in the PAWS project on Phabricator or ask a question on its talk page. |
Edit files on Wikimedia Commons with OpenRefine (version 3.6 and newer)[edit]
| For editing Wikimedia Commons, you need OpenRefine 3.6 or newer. Wikimedia Commons is not supported in OpenRefine 3.5 or earlier versions. |
Explanation / link to subpage
Upload files to Wikimedia Commons with OpenRefine (version 3.7 and newer)[edit]
| For uploading files to Wikimedia Commons, you need OpenRefine 3.7 or newer. Wikimedia Commons is not supported in OpenRefine 3.5 or earlier versions. |
Uploading files to Wikimedia Commons is a brand new feature that is still under heavy development. If you want to give it a try, do so at your own risk! You will need to download a snapshot release of OpenRefine 3.7 via GitHub. In this Google document you find step-by-step instructions.
This feature is being improved and made more user-friendly in the upcoming months. You can expect the release of an official/stable version of OpenRefine with Commons upload functionalities by end October 2022. Documentation of that feature will also be published then.
Bug reports and feature requests[edit]
Did you discover a bug, or do you have a feature request for Wikimedia Commons features in OpenRefine? You will make the team very happy by reporting this on GitHub, where issues and tasks for OpenRefine are tracked.
- File a bug report on GitHub
- Post a feature request on GitHub
- Note: please search existing GitHub issues first! Maybe the bug has already been reported or the feature has already been requested before :-)
Contact[edit]
Feel free to ask questions on the talk page, or get in touch with Sandra directly.
The team that works on OpenRefine and SDC (until end October 2022):
- Sandra Fauconnier (talk) (product manager)
- Eugene Egbe (developer)
- Joey Salazar (developer)
- Lozana Rossenova (designer)
- Antonin Delpeuch (advisor)
Stay up to date[edit]
Join OpenRefine meetups, events and office hours[edit]
The OpenRefine team is happy to organize, or participate in, meetups, tutorials and office hours. We will list interesting upcoming meetups here. Get in touch with Sandra if you and/or your community would like an OpenRefine tutorial, introduction or other kind of session.
Past meetups and events[edit]
- OpenRefine community meetup with demo of Structured Data on Commons functionalities, February 22, 2022. Slides and meeting recording
- One hour demo for beginners: Wikimedia Commons batch editing with OpenRefine (tutorial by Sandra Fauconnier), May 19, 2022 during Image Description Week.
- OpenRefine and SDC editing tutorial, Wikidata Lab XXXIV, June 9, 2022. Video recording
- Past office hours took place at: (no notes/recording as these were informal meetings)
- Tuesday, March 22, 2022 at 9AM UTC
- Tuesday, April 19, 2022 at 4PM UTC
- Tuesday, May 24, 2022 at 8AM UTC
- Tuesday, June 21, 2022 at 4PM UTC
Receive updates on your talk page[edit]
Development[edit]
Over 2021-22, OpenRefine is being extended with Structured Data on Wikimedia Commons (SDC) support. This project is funded by a Wikimedia Foundation Project Grant.
You can check the planning and milestones of the project, and short monthly reports, on Meta. Notes of the development team meetings are collected in this public Etherpad.
Development work on this project is tracked on GitHub (main issue tracker) and Phabricator (specifically for the Wikimedia Commons reconciliation service). Feel free to subscribe to, and participate in the discussions!
- Workboards and issues related to development for this project on GitHub:
- Ongoing work on SDC support in OpenRefine: https://github.com/orgs/OpenRefine/projects/2/
- Commons Extension for OpenRefine https://github.com/OpenRefine/CommonsExtension/issues
- Workboards related to development for this project on Phabricator:
- OpenRefine https://phabricator.wikimedia.org/tag/openrefine/
- Reconciliation https://phabricator.wikimedia.org/tag/reconciliation/