Publications and Presentations of Note
This work began in 2016 and was originally published as part of an Environmental Scan of Metadadata Assessement (Archived). We continue to actively collect citations of interest in the Metadata Assessment Zotero Group and welcome any additions or updates. This group intends to periodically review the citations for additions to the Publications and Presentations sections below.
Summary
The group initially surveyed more than 50 documents in 2016 produced as early as 2002, ranging from journal articles, white papers, and reports to blog posts and wikis. In 2019, the group reviewed more than 100 articles added to the Metadata Assessment Zotero Group since 2016 to determine if changes or additions should be made to this list of publications of note.
Metadata assessment involves articulating conceptual criteria and frameworks as well as developing actionable methods to collect specific information about collections. The documents we surveyed tend to focus on the following themes:
- Development of conceptual frameworks/models/metrics for defining metadata quality
- Enrichment of existing datasets to meet quality metrics
- Changes to metadata over time
- Measurement of auditing quality
- Considerations for shared metadata
Exploring what metadata quality means in large-scale aggregators, such as Europeana and DPLA, is another topic discussed in recent work.
Bruce and Hillmann’s 2004 article, “The Continuum of Metadata Quality,” which defines a framework with seven categories of metadata quality (completeness, accuracy, conformance to expectations, logical consistency, accessibility, timeliness, provenance), is particularly noteworthy for influencing the subject’s subsequent exploration.
In 2013, Hillmann and Bruce revisited their original framework in the context of the linked open data environment, highlighting additional considerations such as licensing, correct/consistent data modeling, and the implications of linked data technology on definitions of metadata quality.
A common theme across the publications we reviewed is the subjective nature of “quality,” since its definition is dependent upon local context and content as well as institutional goals. According to Hillmann and Bruce (2013), conceptual criteria are “the lenses that help us know quality when we see it.” Through building a community of practice for assessing metadata quality, we will be better positioned to have a shared vision, one that provides for the sustainability of our resources and meets the needs of our users and systems.
Publications of Note
We have identified a sub-selection of these articles, listed below, which we recommend as good starting points for librarians interested in learning about metadata assessment. The articles review foundational concepts, present sound frameworks for analysis, cover particular common aspects of assessment, and/or have been influential in other research.
- Amrapali, Zaveri, Lehmann, Jens, Rula, Anisa, Maurino, Andrea, Pietrobon, Ricardo, and Auer, Sören. “Quality Assessment for Linked Data: A Survey.” Semantic Web 7, no. 1 (2016): 63–93.
- Bruce, Thomas R., and Diane I. Hillmann. “Metadata Quality in a Linked Data Context.” VOXPOPULII (blog), January 24, 2013. https://blog.law.cornell.edu/voxpop/2013/01/24/metadata-quality-in-a-linked-data-context/.
- Bruce, Thomas R., and Diane I. Hillmann. “The Continuum of Metadata Quality: Defining, Expressing, Exploiting.” In Metadata in Practice. ALA Editions, 2004.
- DAMA UK Working Group, and Data Quality Dimensions Working Group. “The Six Primary Dimensions for Data Quality Assessment.” White paper. DAMA UK, October 2013. https://web.archive.org/web/20190725222019/https://www.whitepapers.em360tech.com/wp-content/files_mf/1407250286DAMAUKDQDimensionsWhitePaperR37.pdf.
- Dangerfield, Marie-Claire, and Lisette Kalshoven. “Report and Recommendations from the Task Force on Metadata Quality.” Europeana Task Force on Metadata Quality, May 2015. https://pro.europeana.eu/files/Europeana_Professional/Europeana_Network/metadata-quality-report.pdf.
- Gavrilis, Dimitris, Dimitra-Nefeli Makri, Leonidas Papachristopoulos, Stavros Angelis, Konstantinos Kravvaritis, Christos Papatheodorou, and Panos Constantopoulos. “Measuring Quality in Metadata Repositories.” In Measuring Quality in Metadata Repositories, 56–67. Poznań, Poland: Inbetriebnahme Verfahrenstechnischer Anlagen (9783662481615), 2015.
- Gueguen, Gretchen. “Metadata Quality at Scale: Metadata Quality Control at the Digital Public Library of America.” Journal of Digital Media Management 7, no. 2 (2019): 115–26.
- Harper, Corey A. “Metadata Analytics, Visualization, and Optimization: Experiments in Statistical Analysis of the Digital Public Library of America (DPLA).” Code{4}Lib Journal, no. 33 (July 19, 2016). http://journal.code4lib.org/articles/11752.
- Park, Jung-ran, and Tosaka Yuji. “Metadata Quality Control in Digital Repositories and Collections: Criteria, Semantics, and Mechanisms.” Cataloging and Classification Quarterly 48, no. 8 (2010): 696–715.
- Reiche, Konrad Johannes. “Assessment and Visualization of Metadata Quality for Open Government Data.” Freie Universität Berlin, 2013. http://www.inf.fu-berlin.de/inst/ag-se/theses/Reiche13-metadata-quality.pdf.
- Stvilia, Besiki, and Les Gasser. “Value-Based Metadata Quality Assessment.” Library and Information Science Research 30, no. 1 (2008): 67–74.
- Zavalina, Oksana L., Priya Kizhakkethil, Daniel Gelaw Alemneh, Mark E. Phillips, and Hannah Tarver. “Building a Framework of Metadata Change to Support Knowledge Management.” Journal of Information & Knowledge Management 14, no. 01 (March 1, 2015). https://doi.org/10.1142/S0219649215500057.
Presentations of Note
- Averkamp, Shawn, Matt Miller, Josh Hadro, and Sara Rubinow. “Measuring Your Metadata Preconference.” Presentations (communicative events) presented at the Code4Lib Philadelphia, March 7-10 2016, Philadelphia, PA, USA, March 7, 2016. https://github.com/saverkamp/measure-metadata-workshop.
- Charles, Valentine, and Juliane Stiller. “Evaluation of Metadata Enrichment Practices in Digital Libraries: Steps towards Better Data Enrichments (Slides).” Slides presented at the SWIB 2015, Hamburg, Germany, 2015. http://swib.org/swib15/slides/charles_enrichment.pdf.
- Charles, Valentine, and Juliane Stiller. “Evaluation of Metadata Enrichment Practices in Digital Libraries: Steps towards Better Data Enrichments (Video).” Presentations (communicative events) presented at the SWIB 2015, Hamburg, Germany, 2015. https://youtu.be/U90Ajgjk6ic?list=PL7fMsenbLiQ0eKJtpz3NCv0937HPwbWqV.
- Christina Harlow. “Get Your Recon.” Presentations (communicative events) presented at the Code4Lib2016, Philadelphia, PA, USA, March 8, 2016. http://2016.code4lib.org/Get-Your-Recon.
- Dalmau, Michelle, and Jenn Riley. “Cushman Exposed! Exploiting Controlled Vocabularies to Enhance Browsing and Searching of an Online Photograph Collection.” Presentations (communicative events) presented at the Indiana University Digital Library Program Brown Bag Presentation, Bloomington, IN, USA, May 17, 2004. http://www.slideshare.net/jenlrile/cushman-brownbag.
- Glendon, Ivy. “We’ve Gone MAD: Launching a Metadata Analysis & Design Unit at the University of Virginia Library.” Presentations (communicative events) presented at the ALA Annual Conference (San Francisco, 2015): ALCTS Metadata Interest Group Meeting, San Francisco, CA, USA, August 20, 2015. http://connect.ala.org/node/243993.
- Gueguen, Gretchen, Corey Harper, and Chris Stanton. “Perspectives on Data and Quality (Session Information).” Presentations (communicative events) presented at the DPLAFest 2016, Washington, DC, USA, April 15, 2016. https://dplafest2016.sched.com/event/6Fou/perspectives-on-data-and-quality.
- Gueguen, Gretchen, Corey Harper, and Chris Stanton. “Perspectives on Data and Quality (Slides).” Presentations (communicative events) presented at the DPLAFest 2016, Washington, DC, USA, April 15, 2016. https://drive.google.com/drive/folders/0BzpQeSFqkiZKVWRHYnR3UEVJQm8?resourcekey=0-RKKnFUYvn2gssjvLweD2lQ.
- Harlow, Christina. “Metadata Quality Analysis.” Presentations (communicative events) presented at the ShareFest2015, Nashville, TN, USA, October 23, 2015. https://github.com/cmh2166/ShareFest15MetadataQA.
- Harlow, Christina, and Heather Wilson. “Data Remediation: A View from the Trenches.” Presentations (communicative events) presented at the LITA Forum 2015, Minneapolis, MN, USA, November 2015. https://goo.gl/MFZP1t.
- Harper, Corey. “Can Metadata Be Quantified? (Slides).” Presentations (communicative events) presented at the DPLAfest 2015, Indianapolis, IN, USA, April 18, 2015. https://static.sched.com/hosted_files/dplafest2015/c1/CanMetadataBeQuantifiedSlides.pdf.
- Harper, Corey. “Can Metadata Be Quantified? (Video).” Presentations (communicative events) presented at the DPLAfest 2015, Indianapolis, IN, USA, April 18, 2015. http://nbviewer.ipython.org/github/chrpr/dpla-analytics/blob/master/nltk/demo.ipynb.
- Harper, Corey. “Statistical DPLA: Metadata Counting and Word Analysis.” Presentations (communicative events) presented at the 2015 DLF Forum, Vancouver, BC, Canada, October 26, 2015. https://docs.google.com/document/d/1egAKg_Nw2kUvYJbuKOcpOGTTrQ4kIz4v5KYzGVLUEYw/edit.
- Koster, Lukas. “DatAMazeD: Analysing Library Data Flows, Data Manipulations and Data Redundancies (Notes on Presentation).” Presentations (communicative events) presented at the ELAG 2015, Stockholm, Sweden, June 9, 2015. https://docs.google.com/document/d/1Cm3gFdiHJIV3ptiS6i4z874QebkqMJd_lPMIAcyE4eQ/edit#heading=h.g4usus9cnso5.
- Koster, Lukas. “DatAMazeD: Analysing Library Data Flows, Data Manipulations and Data Redundancies (Slides).” Presentations (communicative events) presented at the ELAG 2015, Stockholm, Sweden, June 9, 2015. http://www.slideshare.net/lukask/datamazed-with-notes.
- Neatrour, Anna, and Jeremy Myntti. “Automating Controlled Vocabulary Reconciliation.” Presentations (communicative events) presented at the DLF Forum 2015, Vancouver, BC, Canada, October 26, 2015. http://www.slideshare.net/aneatrour/automating-controlled-vocabulary-reconciliation.
- Weidner, Andrew, and Annie Wu. “Metadata Quality Control for Content Migration: The Metadata Migration Project at the University of Houston.” Presentations (communicative events) presented at the International Conference on Dublin Core and Metadata Applications DC-2015, Sāo Paulo, Brazil, September 1, 2015. http://dcevents.dublincore.org/IntConf/dc-2015/paper/view/339.