Reflections on the UW Libraries Data Information Literacy Reading Group

Presentation given as part of the UW Teaching + Learning brown bag series, February 2016.

Transcript

1. Reflections on the ! UW Libraries Data Info Literacy ! Reading Group! Brianna Marshall | February 3, 2016! UW Libraries Teaching + Learning Forum!
2. About Brianna Marshall! Lead, Research Data Services! –  Education + training! –  Consultations! –  Data management plans (DMPs)! ! researchdata.wisc.edu! @UWMadRschSvcs!
3. Why a Reading Group? •  Designated time to read + learn! •  Increase RDS visibility! •  Grow shared knowledge, investment! •  Create RDM/DIL evangelists!!
4. Introduction This poster describes a drop-in data management and visualization workshop under development. The workshop, scheduled for October 2013, will be aimed at graduate student researchers but open to all. The authors have mapped the core competencies for data information literacy outlined in "Determining Data Information Literacy Needs: A Study of Students and Research Faculty" (2011) with the workshop learning outcomes. Workshop planning considerations, content, and problems faced are described below. While this poster describes a workshop being developed at Indiana University, the authors hope this model will prove informative for other institutions looking to create similar workshops pairing data management and visualization. Planning Process •Tools chosen are freely available; two are open source •Team met weekly to discuss learning outcomes, data sources, data analysis techniques, and assessment strategies Some ideas were discarded over the course of planning: •Digital humanities data in HathiTrust (HT) and HT-related software were not publicly available for use, so the authors replaced HT data analysis with that of open humanities data provided by the IU Digital Collection Services. We plan to use the tool Voyant to visualize this data. •“Frameworks for a Data Management Curriculum” (Lamar Soutter Library et al, 2012) course plans were originally intended to be adapted for this workshop. They proved to be too technical and detailed for incorporation into a beginner-level class. Considerations Designing our tutorials •Emphasize analysis over datasets themselves •Future workshops responsive to feedback Finding appropriate data sources •Diversity of available datasets •Chose a wide breadth of examples to fit our expected audience •Criteria for selection: usable format, properly documented, serendipity Assessing the learning outcomes •Difficult in one-off workshops •Self-reporting of understanding less than perfect •Project-based assessment would be ideal References Carlson, Jake R.; Fosmire, Michael; Miller, Chris; and Sapp Nelson, Megan, "Determining Data Information Literacy Needs: A Study of Students and Research Faculty" (2011). Libraries Faculty and Staff Scholarship and Research. Paper 23. http://docs.lib.purdue.edu/lib_fsdocs/23 Lamar Soutter Library, University of Massachusetts Medical School and the George C. Gordon Library, and Worcester Polytechnic Institute. (2012). “Frameworks for a Data Management Curriculum: Course plans for data management instruction to undergraduate and graduate students in science, health sciences, and engineering programs.” Retrieved from http://library.umassmed.edu/data_management_frameworks.pdf Integrating Data Management Literacies with Data Visualization Instruction A One-Shot Workshop DIL Core Competencies mapped to Learning Outcomes DIL Core Competencies Learning Outcome Skills Required Assessment Measure Data Management and Organization Introduction to Databases and Data Formats Data Conversion and Interoperability Understand data management and organization concepts. Identify data types, define data and its lifecycle, and describe how data is used and reused in research. List reasons why data management and organization is important to researchers. Related questions on incoming and outgoing questionnaires. Data Visualization Quality Assurance Design effective data visualizations. Apply Illinsky’s four principles of data visualization. Use Google Refine to clean data in order to assure data quality. Use Sci2 to perform various types of analysis on data sets. Use Gephi to visualize the data. Critique visualizations according to rubric. Introduction to Databases and Data Formats Discovery and Acquisition of Data Data Analysis Find and select appropriate data—and apply proper analysis—to create a visualization that answers a particular research question. Identify research question. Choose appropriate types and formats of data for topical, network, burst, and temporal analysis. Navigate to data sources. Download data in proper format. Analyze data. Successful completion of questionnaire addressing skills needed to answer research question. Cultures of Practice Introduction to Databases and Data Formats Understand how cultures of practice influence the way data may be collected, described, or formatted. Based on intended audience for visualization and source of data, identify culture of practice/discipline. Be able to access information on discipline’s data collection standards [literature search], relevant metadata schema and controlled vocabularies [libraries website and DCC guide], and what tools and formats are common to particular disciplines [literature search]. Successful literature searches (and reading) for data collection and analysis methodologies. Successful access of disciplinary metadata schema. Metadata Data Preservation Save data to IU-supported research storage for both short- and long-term storage. Identify best storage options for short- and long-term data storage. Successfully navigate to appropriate storage solutions, log in. Transfer data from local drives to cloud storage accounts. Questionnaire. Ethics (including citation of data) Data Preservation Handle data and data visualizations ethically. Cite data from other sources in visualizations and documentation. Decide which data to make available, based on sensitivity. Store data on appropriate technologies using safeguards, based on sensitivity. Create visualizations that accurately represent the source dataset (i.e. does not manipulate or skew results). Questionnaire. [In a more in-depth workshop, one idea would be to have students create projects which are then reviewed and scored against a rubric after class ends.] Data Curation and Re-use Ethics (including citation of data) Data Management and Organization Prepare data and visualizations for re-use. Create documentation for others to reference when reusing data that describes methodology for finding, analyzing, and visualizing data. Cite data source and visualization creator in visualization caption(s). Organize and format data appropriately for future processing by tools. Questionnaire. [In a more in-depth workshop, one idea would be to have students create projects which are then reviewed and scored against a rubric after class ends.] Stacy Konkiel, Brianna Marshall & David Edward Polley | Indiana University-Bloomington • Topical • Temporal • Spatial • Network Workshop Specifics • ISI / Web of Knowledge • Open Congress • ICPSR • Open humanities data from IU Tools Data Sources Analyses Contact skonkiel@Indiana.edu // @skonkiel bhmarsha@umail.iu.edu // @nososternlib Download poster and handouts http://hdl.handle.net/2022/16814 This work is licensed under a Creative Commons Attribution 3.0 United States License. https://scholarworks.iu.edu/dspace/handle/2022/16814 !
5. Participants •  Ariel Andrea! •  Barb Sisolak! •  Brooke Williams! •  Cameron Cook! •  Cid Freitag! •  Deb Helman! •  Erin Carrillo! •  Josh Zimmerman! •  Kerry Kresse! •  Morgaine Gilchrist-Scott! •  Sheila Stoeckel!
6. DIL + Related Literacies Data Literacy! Access, assess, manipulate, summarize, and present data! ! Statistical Literacy! Think critically about basic stats in everyday media! ! Information Literacy! Think critically about concepts; read, interpret, evaluate info! ! Data Information Literacy! The ability to use, understand, and manage data! Schield, Milo. "Information literacy, statistical literacy and data literacy." IASSIST Quarterly 28.2/3 (2004): 6-11.!
7. DIL Team Approaches Institution Discipline Approach Purdue University! Electrical and computer engineering! Embedded librarianship! Purdue University! Agricultural and biological engineering! Series of workshops! Cornell University! Natural resources! 6-week mini-course! University of Minnesota! Civil engineering! Hybrid in-person/online course! University of Oregon! Ecology/landscape architecture! One-shot seminar! Carlson, Jake, and Lisa Johnston. Data Information Literacy: Librarians, Data, and the Education of a New Generation of Researchers. !
8. 12 DIL Competencies Data Processing and Analysis Data Curation and Re-use Data Management and Organization Data Conversion and Interoperability Data Preservation Data Visualization and Representation Databases and Data Formats Discovery and Acquisition Ethics and Attribution Metadata and Data Description Data Quality and Documentation Cultures of Practice Carlson, Jake, and Lisa Johnston. Data Information Literacy: Librarians, Data, and the Education of a New Generation of Researchers. !
9. Overall Findings •  The competencies were seen as important for students to develop.! •  Students were seen as lacking in these competencies.! •  Assumption that students have or should have acquired the competencies earlier.! •  Lack of formal training for students working with data.! •  Learning is largely self-directed through “trial and error.”! http://www.slideshare.net/asist_org/rdap-15-lessons-learned-from-the-data-information-literacy-project
10. Overall Findings •  Training from advisor tends to occur at point of need, often framed in the context of the immediate issue.! •  Students focus on data mechanics over deeper concepts.! •  Faculty were often unsure of best practices or how to approach the competencies themselves.! •  Lack of formalized policies in the lab.! http://www.slideshare.net/asist_org/rdap-15-lessons-learned-from-the-data-information-literacy-project
11. FIGURE 9.1 ! ! Stages of developing a data information literacy program.! Carlson, Jake, and Lisa Johnston. ! Data Information Literacy: Librarians, Data, and the ! Education of a New Generation of Researchers. !
12. READING GROUP " MEMBER THOUGHTS
13. ERIN CARRILLO Public Services Librarian, Steenbock Library!
14. Interesting takeaways •  Ecology DIL workshop! –  Discipline specific! –  DIL interview! What are the most exciting opportunities for UW? How do we get there? •  Data sharing! –  Competencies (preserving, publishing, citing)! •  Stand alone for credit, or within existing courses! •  Online?!!
15. ARIEL ANDREA Chemistry Librarian, General Library System!
16. Interesting takeaways •  Data information literacy is discipline specific ! – Generalizing DIL makes it less palatable, less relevant for researchers! – One person can not be responsible for helping all of campus – liaisons must be involved! •  Getting DIL practices ingrained in researcher workflows takes time! – Set manageable goals for any new initiatives!
17. What are the most exciting opportunities for UW? How do we get there? •  Campus needs a data repository with support staff! – Could library staff be a part of the effort, promote it, etc! •  Library needs to take ownership of the scholarly publishing/access portion of data management at least! – Professional development for liaison librarians!
18. BROOKE WILLIAMS Resident Librarian for Information Literacy Instruction,! College and Steenbock Libraries!
19. Interesting takeaways •  Librarians should have a place in the data conversation!! •  Data information literacy fits right in with “regular” information literacy! •  There are a lot of people who need this training: not just students, but researchers, lab staff, professors, librarians.!
20. What are the most exciting opportunities for UW? How do we get there? •  1: We’re an R1, so there is a lot of research happening & data being generated on this campus. The libraries can definitely jump in to offer support to those researchers, whether through workshops, one-credit courses, liaison connections, etc. This is a place for us to fill a real need and set a standard.!
21. CAMERON COOK Digital Curation Assistant, SLIS Student!
22. Interesting takeaways •  There’s not a one size fits all template! •  space vs. time vs. community ! •  The idea of failure!
23. What are the most exciting opportunities for UW? How do we get there? •  Shift in culture happening! •  DMPs (eventually, maybe?)! •  Starting small - not ‘DIL’ but focus on manageable competencies! •  Finding hooks in the pieces of the cycle that we work with!
24. SHEILA STOECKEL Director for Teaching & Learning Programs, UW-Madison Libraries!
25. Interesting takeaways •  Learning from our successful models to move forward ! •  Specific competencies vs. concepts! •  Generalization vs. customization (Grad/ Faculty) !
26. What are the most exciting opportunities for UW? How do we get there? •  Leveraging and developing our expertise with data information literacy concepts! – Staff development! – Communication & promotion ! •  Expanding our role in educating students, especially graduate students.! – New conversation with instructors we work with! – Mapping research cycles and curricula for entry points!
27. JOSHUA ZIMMERMAN Linux Systems Administrator, General Library System!
28. Interesting takeaways •  The majority of DIL competencies are not new! •  Many DIL competencies are too broad or domain specific for it to likely be worthwhile to try to introduce them all, at the same time, to all of campus!
29. What are the most exciting opportunities for UW? How do we get there? •  The UW has an amazing opportunity to create exemplary communities of practice with regards to collecting, storing and sharing data! •  We stand to create the opportunity for professionals across campus to cross train and learn about domains and ideas they currently know nothing about! •  We can really only get there through true collaboration across campus!
30. CID FREITAG Program Manager, DoIT Academic Technology!
31. Interesting takeaways •  Intertwined literacies! What are the most exciting opportunities for UW? How do we get there? •  New literacies for students! •  New pedagogies! •  UW-Madison Essential Learning Outcomes! •  ’It takes a village’!
32. systems! education! strategy! policy!
35. Image courtesy of Flickr user danbri (CC BY)
36. What next? •  Read more about DIL: www.datainfolit.org/ ! •  Come to an RDS meeting! –  February 22, 1:30-3pm - Memorial Library 362! –  May 30, 1:30-3pm – Steenbock Library! –  August 15, 1:30-3pm - Memorial Library 362! –  November 3, 1:30-3pm – Steenbock Library! •  New iteration of an RDM reading group?! •  Tell your AULs and supervisors (or anyone who will listen) that you think this is important!!
37. find these slide decks at:! speakerdeck.com/bmarshall! digital scholarship workshop series + +
40. Interested in RDS updates? http://connect.ala.org/node/248942
41. Thanks for listening! Brianna Marshall @notsosternlib! brianna.marshall@wisc.edu! ! ! Research Data Services researchdata.wisc.edu! @UWMadRschSvcs!