Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Publication and Citation of Scientific Software...

Martin Fenner
September 08, 2014

Publication and Citation of Scientific Software with Persistent Identifiers

Presentation given at the OA Days in Cologne, Germany

Martin Fenner

September 08, 2014
Tweet

More Decks by Martin Fenner

Other Decks in Science

Transcript

  1. Publication and Citation of Scientific Software with Persistent Identifiers Martin

    Fenner, for Martin Hammitzsch and the SciForge project Technical Lead Article-Level Metrics Public Library of Science
  2. Scientific software has become an essential component of the research

    process. ! but ! Software development in general is not perceived as a scientific achievement.
  3. Software Journals and Articles Describe software in the traditional journal

    article format, ideally with special considerations for software (e.g. software repositories, peer review) ! Software journals are a new concept similar to data journals – only a few examples currently exist. TrakEM2 Software for Neural Circuit Reconstruction Albert Cardona1*, Stephan Saalfeld2, Johannes Schindelin2, Ignacio Arganda-Carreras3, Stephan Preibisch2, Mark Longair1, Pavel Tomancak2, Volker Hartenstein4, Rodney J. Douglas1 1 Institute of Neuroinformatics, University of Zurich and ETH Zurich, Zurich, Switzerland, 2 Max Planck Institute of Molecular Cell Biology and Genetics, Dresden, Germany, 3 Massachusetts Institute of Technology, Boston, Massachusetts, United States of America, 4 Molecular Cell and Developmental Biology Department, University of California Los Angeles, Los Angeles, California, United States of America Abstract A key challenge in neuroscience is the expeditious reconstruction of neuronal circuits. For model systems such as Drosophila and C. elegans, the limiting step is no longer the acquisition of imagery but the extraction of the circuit from images. For this purpose, we designed a software application, TrakEM2, that addresses the systematic reconstruction of neuronal circuits from large electron microscopical and optical image volumes. We address the challenges of image volume composition from individual, deformed images; of the reconstruction of neuronal arbors and annotation of synapses with fast manual and semi-automatic methods; and the management of large collections of both images and annotations. The output is a neural circuit of 3d arbors and synapses, encoded in NeuroML and other formats, ready for analysis. Citation: Cardona A, Saalfeld S, Schindelin J, Arganda-Carreras I, Preibisch S, et al. (2012) TrakEM2 Software for Neural Circuit Reconstruction. PLoS ONE 7(6): e38011. doi:10.1371/journal.pone.0038011 Editor: Aravinthan Samuel, Harvard University, United States of America Received March 22, 2012; Accepted April 28, 2012; Published June 19, 2012 Copyright: ß 2012 Cardona et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Funding: This work was funded primarily by Kevan A. Martin and the Institute of Neuroinformatics, University of Zurich and ETH Zurich; and also by grant NIH 1- R01 NS054814-05 to VH and grant SNSF 31003A_132969 to AC. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Competing Interests: The authors have declared that no competing interests exist. * E-mail: [email protected] Introduction There is a growing consensus that detailed volumetric reconstructions of thousands of neurons in millimeter-scale blocks of tissue are necessary for understanding neuronal circuits [1,2]. Modern electron microscopes (EM) with automatic image acquisition are able to deliver very large collections of image tiles [3–8]. Unfortunately, the problems of acquiring the data have so far been easier to solve than that of interpreting it [9,10]. Increasingly, neuroscience laboratories require automated tools for managing these vast EM data sets using affordable consumer desktop computers. Here, we present such a tool. It is an open source software package, named TrakEM2, that is optimised for neural circuit reconstruction from tera-scale serial section EM image data sets. The software handles all the required steps: rapid entry, organization, and navigation through tera-scale EM image collections. Semi- and automatic image registration is easily perfomed within and across sections. Efficient tools enable manipulating, visualizing, reconstructing, annotating, and mea- suring neuronal components embedded in the data. An ontology- controlled tree structure is used to assemble hierarchical groupings of reconstructed components in terms of biologically meaningful entities such as neurons, synapses, tracts and tissues. TrakEM2 allows millions of reconstructed entities to be manipulated in nested groups that encapsulate the desired abstract level of analysis, such as ‘‘neuron’’, ‘‘compartment’’ or ‘‘neuronal lineage’’. The end products are 3D morphological reconstructions, measurements, and neural circuits specified in NeuroML [11] and other formats for functional analysis elsewhere. TrakEM2 has been used successfully for the reconstruction of targeted EM microvolumes of Drosophila larval central nervous system [7], for array tomography [12], for the reconstruction and automatic recognition of neural lineages in LSM stacks [13], for the reconstruction of thalamo-cortical connections in the cat visual cortex [14] and for the reconstruction of the inhibitory network relating selective-orientation interneurons in a 10 Terabyte EM image data set of the mouse visual cortex [8], amongst others. Results From Raw Collections of 2d Images to Browsable Recomposed Sample Volumes An EM volume large enough to encapsulate significant fractions of neuronal tissue and with a resolution high enough to discern synapses presents numerous challenges for visualization, process- ing and annotation. The data generally consists of collections of 2d image tiles acquired from serial tissue sections (Figure 1; [7,8]) or from the trimmed block face (Block-face Serial EM or SBEM, [3,15]; focused ion beam scanning EM or FIBSEM, [6]) that are collectively far larger than Random Access Memory (RAM) of common lab computers and must be loaded and unloaded on demand from file storage systems. Additional experiments on the same data sample may have generated light-microscopical image volumes that must then be overlaid on the EM images, such as in array tomography [12,16] or correlative calcium imaging [8,15]. TrakEM2 makes browsing and annotating mixed, overlaid types of images (Figure S1) over terabyte-sized volumes fast (Text S1, section ‘‘Browsing large serial EM image sets’’) while enabling the independent manipulation of every single image both from a point-and-click graphical user interface (GUI; Figure 1e, S2, S3, PLoS ONE | www.plosone.org 1 June 2012 | Volume 7 | Issue 6 | e38011 Some of the most highly cited papers in traditional journals are software (or data) papers, e.g. Berman, H. M., Westbrook, J., Feng, Z., Gilliland, G., Bhat, T. N., Weissig, H., et al. (2000). The Protein Data Bank. Nucleic Acids Research, 28(1), 235–242. doi:10.1093/ nar/28.1.235 http://dx.doi.org/10.1371/journal.pone.0038011
  4. Peer Review • Is the software in a suitable repository?!

    • Does the software have a suitable open licence? ! • If the Archive section is filled out, is the link in the form of a persistent identifier, e.g. a DOI? Can you download the software from this link?! • If the Code Repository section is filled out, does the identifier link to the appropriate place to download the source code? Can you download the source code from this link?! • Is the software license included in the software in the repository? Is it included in the source code?! • Is sample input and output data provided with the software?! • Is the code adequately documented? Can a reader understand how to build/ deploy/install/run the software, and identify whether the software is operating as expected?! • Does the software run on the systems specified? (if you do not have access to a system with the prerequisite requirements, let us know).! • Is it obvious what the support mechanisms for the software are? http://openresearchsoftware.metajnl.com/
  5. Code Review http://arxiv.org/abs/1311.2412 Pilot study with professional Mozilla developers doing

    code review on code snippets from already published PLOS Computational Biology papers. Focus on ! • Version control and packaging • Comments and documentation • Tests • Readability and code structure ! Positive feedback from authors and reviewers, limitation was lack of context (domain expertise or direct contact)
  6. Software Repositories General or specific for language and/or scientific domain

    Almost always open source software with source code No concept of global persistent identifiers or long-term preservation
  7. Preservation Repositories Journal of Open Research Software distinguishes: • A

    source code repository holds many versions of the software as it is being developed • A preservation or institutional repository will preserve a set of files deposited for the long term ! Both Figshare and Zenodo integrate with Github Neither repository offers long-term storage of executable code (e.g. storing all software dependencies or virtual machines) http://zenodo.org/ http://figshare.com/
  8. Persistent Identifiers Persistent identifiers for software are not (yet) common

    practice. ! DataCite DOIs should be the preferred persistent identifier: • do not invent yet another identifier • DataCite metadata describe software well • software and data often used together ! Challenge are source code repositories without long-term preservation
  9. Versioning • Semantic versioning (MAJOR.MINOR.PATCH, e.g. 2.3.2) of software is

    evolving standard • Resolving dependencies is a major challenge • DataCite suggests to register new DOIs for major and minor versions • DataCite metadata can describe relationship: isNewVersionOf, isPreviousVersionOf http://semver.org/ http://dx.doi.org/10.5438/0008
  10. Research Infrastructure Support for scientific software with persistent identifiers needed

    in ! • Institutional Repositories • Research Information Systems (CRIS) • Journal submission systems • Reference Managers • Kerndatensatz Forschung !
  11. Open Licenses http://opensource.org/ The Open Source Institute (OSI) has reviewed

    approved licenses that comply with their Open Source definition. Popular licenses include • Apache License 2.0 • MIT license • BSD license • GNU General Public License ! Two topics of discussion are • copyleft vs. permissive licenses (the former require the same license for derivative works) • software in source code repositories without a license
  12. Further Reading Wilson, G., Aruliah, D. A., Brown, C. T.,

    Hong, N. P. C., Davis, M., Guy, R. T., et al. (2012, October 1). Best Practices for Scientific Computing. arXiv.org.! ! Stodden, V., & Miguez, S. (2014). Best Practices for Computational Science: Software Infrastructure and Environments for Reproducible and Extensible Research. Journal of Open Research Software, 2(1), e21. doi: 10.5334/jors.ay! ! Osborne, J. M., Bernabeu, M. O., Bruna, M., Calderhead, B., Cooper, J., Dalchau, N., et al. (2014). Ten simple rules for effective computational research. PLoS Comput Biol, 10(3), e1003506. doi:10.1371/journal.pcbi.1003506
  13. This presentation is made available under a CC-BY 4.0 license.!

    http://creativecommons.org/licenses/by/4.0/