Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Aereo: An experimental bird’s eye view of the d...

Aereo: An experimental bird’s eye view of the digital collections from the State Library of New South Wales

Presentation of Aereo: a project made for the 2019 DX Lab Fellowship of the State Library of New South Wales.

More info at: https://dxlab.sl.nsw.gov.au/blog/building-aereo

Mauricio Giraldo

July 02, 2020
Tweet

More Decks by Mauricio Giraldo

Other Decks in Research

Transcript

  1. Mauricio Giraldo Arteaga - July 2020 An experimental bird’s eye

    view of the digital collections from the State Library of NSW
  2. - Marcia J. Bates “the query is satisfied not by

    a single final retrieved set, but by a series of selections of individual references and bits of information at each stage of the ever-modifying search”
  3. *that i could research, design, and implement in eight weeks

    this is my attempt at addressing this*
  4. “I propose enhancing the Manuscripts, Oral History and Pictures Catalogue

    with computer-generated metadata to create new pathways for patron exploration. By focusing on the 300,000+ digitised image set that is currently available…”
  5. “I propose enhancing the Manuscripts, Oral History and Pictures Catalogue

    with computer-generated metadata to create new pathways for patron exploration. By focusing on the 300,000+ digitised image set that is currently available…”
  6. the scale of the dataset was a big challenge in

    this project 2 million images…
  7. emphasis in visual materials 1,199,477 things., photographs, negatives, published maps,

    drawings, objects, pictures, ephemera, journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  8. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  9. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  10. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  11. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  12. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  13. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  14. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  15. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  16. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  17. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  18. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  19. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  20. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  21. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  22. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  23. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  24. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  25. 1,199,477 manuscripts, photographs, negatives, published maps, drawings, objects, pictures, ephemera,

    journals, prints, medals, unpublished maps, paintings, coins, architectural drawings, newspapers, posters, and stamps.
  26. ended up using 1.2 million… still a lot for any

    web browser, let alone a smartphone 2 million images! ⏳
  27. single pixels can convey a lot of information… but i

    wanted everything these are all “just” pixels
  28. …with lots of data cleanup and cloud computing time Python

    + Node.js for image similarity and color palettes
  29. Special thanks to •DX Lab team: Paula Bray, Kaho Cheung,

    and Luke Dearnley •Web team: Jenna Bain and Robertus Johansyah •Mitchell Librarian Richard Neville •State Librarian Dr John Vallance •Staff from the State Library of New South Wales •The State Library of NSW Foundation
  30. Acknowledgments •Cyril Diagne •Douglas Duhaime - Yale DH Lab •Gene

    Kogan •Mario Klingemann •Ricardo Cabello - Three.js