User:Jheald/IIIF 180815
Notes for part of IIIF community conference call, 15 August 2018 [1][2]
Current IIIF (test) service and use of IIIF on Wiki projects, with a look into the immediate future
A video of me talking through the content of this page and demonstrating the links is available at [3], from 1:45 to 25:30
Commons IIIF trial service
[edit]Installed by Daniel Schwen (User:Dschwen)
Service isn't provided by MediaWiki's built-in maintained image infrastructure and scalers, but as a third-party service running on the Toolserver, aka WMF Labs, WMF's cluster for user-provided bots, scripts, and services
- Origins in a tile-based ZoomViewer gadget for larger images from 2010, eg [4] -> [5], served by IIP Image back-end:
- IIIF endpoint added to the service in 2015 (phab:T89552):
- File:Godward_Idleness_1900.jpg -- Commons image
- https://tools.wmflabs.org/zoomviewer/proxy.php?iiif=Godward_Idleness_1900.jpg/full/full/0/default.jpg -- painting
- https://tools.wmflabs.org/zoomviewer/proxy.php?iiif=Godward_Idleness_1900.jpg/pct:65,81,35,15/full/0/default.jpg -- kitten
- https://tools.wmflabs.org/zoomviewer/proxy.php?iiif=Godward_Idleness_1900.jpg/pct:65,81,35,15/full/270/gray.jpg -- rotated greyscale kitten (bug?)
- https://tools.wmflabs.org/zoomviewer/proxy.php?iiif=Godward_Idleness_1900.jpg/info.json -- information
- "My script pulls the images from commons, uses VIPS to generate the multiresolution TIF pyramid and then uses IIP to serve the tiles", according to Daniel [6].
- Initial processing of an image on first request can take some seconds, then once served, the image pyramid is cached for future use. Not clear how well the service might stand up to some really heavy and wide use of a large number of images all for the first time, but it seems to work well for the current amount of image zooming. There can also be occasional issues of availability and resets with the Toolserver service; and in the past from time to time the cache of image pyramids has sometimes suffered some corruption; but currently seems to be okay.
- In future it is possible that the service may be more integrated with Commons's main production image service. (Brion?)
Wikidata relative position within image (P2677)
[edit]Main use of IIIF endpoint from Wiki communities so far has been to display crops of areas of interest of paintings with items on Wikidata, WMF's triplestore for representing facts about the world.
Syntax: <Wikidata item for painting> depicts (P180) <Wikidata item for thing depicted>, qualifier relative position within image (P2677) -> "pct:82.5,53.7,17.6,16.3"
For example:
- Idleness (Q19953492) -- Wikidata item for the painting above
- d:Q19953492#P180 -- P180 "depicts" section
- To show P2677 value as a blue link, a script-call (invoking d:User:Husky/ifff-viewer-link.js) can be added to a user's
common.js
file on Wikidata- eg d:User:Jheald/common.js (added by this diff)
- Example with more items: Portrait of a Woman with a Squirrel (Q17335769) by Montemezzano
Crops cannot yet be displayed on Wikipedia pages, but can be shown by external tools,
- eg Crotos -- portal by User:Shonagon for faceted exploration of paintings etc on Wikidata
- Details in "Ancient Rome" by Panini (1759), from query
- Also a cropping tool to measure coordinates for a detail
- and a service to show different representations of a particular detail, eg a candle, (from query)
However, rather few details as yet have this position data:
- Wikidata currently has 240,000 depicts (P180) statements, about 80,000 different items (mostly paintings); but only 436 have relative position within image (P2677) qualifiers (query)
Future: depicts (P180) on Commons, with P2677 qualifiers
[edit]Currently depicts (P180) and relative position within image (P2677) can only be used on Wikidata items (ie for a painting considered as an entity in its own right).
But from early next year (2019), it will be possible to add such statements to individual images on Commons.
(This is the "Structured Data for Commons" project, to provide Commons with its own "wikibase for Commons" (more informally: "CommonsData"), analogous to Wikidata, but for images on Commons).
- Commons:Structured data/Get involved/Feedback requests/Depicts -- good draft introduction to depicts (P180) on Commons, by the Structured Data team
- slides -- discussion
- New UIs and dialogues to help users provide this information at upload
- Other main properties, beyond depicts (P180), will follow later in the year -- eg authorship, copyright & licensing, etc.
Annotations on Commons: currently provided/edited via ImageAnnotator tool (see also usage guideline)
- eg File:De_kunstgalerij_van_Jan_Gildemeester_Jansz_Rijksmuseum_SK-A-4100.jpeg
- "At a later date, ImageAnnotations will have to be tied into depicts as part of “structuring” them" (slide deck, 21-23)
- Information will be derived both from information recorded about the image specifically (on CommonsData), and information recorded generally for anything it represents (on Wikidata)
- -- so write information about a painting once on Wikidata, and it becomes accessible on potentially many images on Commons representing that painting.
- (Some coordinate mapping may be required).
Future: IIIF manifests for/from Wikipedia pages, Commons categories, Wikidata & CommonsData queries, etc.
[edit]From queries and Wikidata:
- Example: https://manducus.net/ can create an IIIF manifest for a painting if it has an item on Wikidata and an image on Commons
- we have already seen how Crotos gathers information from Wikidata queries
From Wikipedia pages and Commons categories:
- Clicking an image on the page (eg) currently leads to a slideshow of images, with information, in MediaViewer (if not disabled)
- -- could this also be provided as an IIIF manifest ? (initially, perhaps, as a user-script, adding a 'IIIF download' button at the page top).
- Tom Crane gives an example based on the en-wiki page for en:Los caprichos by Goya, translated into an IIIF manifest: [7], and then viewed in the Wellcome/British Library Universal Viewer: [8],
Future: Other types of content
[edit]- Multimedia -- User:Brion Vibber (WMF) is particularly involved with the IIIF working group in this area.
- 3D -- Commons has recently begun supporting 3d files: see Category:STL_files
Links
[edit]- phab:T173346 -- Tracking ticket for IIIF on Phabricator
- Commons:International Image Interoperability Framework -- Commons coordination page
- IIIF:Wikimedia Touchpoints and Ambassadors
- File:Indexation iconographique sur les projets Wikimédia via IIIF - Journée IIIF Biblissima - 15 mars 2018.pdf