Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Catalog-Driven Workflows

Avatar for Rich Signell Rich Signell
July 13, 2016
0
110

Catalog-Driven Workflows

SciPy 2016 Lightning Talk

Avatar for Rich Signell

Rich Signell

July 13, 2016
Tweet

More Decks by Rich Signell

See All by Rich Signell
Pangeo: A Scalable, Flexible Framework for Geoprocessing
Avatar for Rich Signell rsignell
1
120
Handling Ocean/Met/Hydro Model Output
Avatar for Rich Signell rsignell
0
83
Reducing Data Friction in Ocean Science
Avatar for Rich Signell rsignell
0
100
A Standards-Based Portal for Oceanographic Models and Data
Avatar for Rich Signell rsignell
0
85
A Standardized Framework for Reproducible Model Skill Assessment
Avatar for Rich Signell rsignell
0
93
Exploiting IOOS: A Distributed, Standards-Based Framework and Software Stack for Searching, Accessing, Analyzing and Visualizing Met-Ocean Data
Avatar for Rich Signell rsignell
1
140
Toward OGC Support for the Next Generation of Climate and Forecast Models
Avatar for Rich Signell rsignell
0
130
Catalog-driven, Reproducible Workflows for Ocean Science
Avatar for Rich Signell rsignell
0
95
Catalog-driven workflows using CSW
Avatar for Rich Signell rsignell
0
140

Featured

See All Featured
Facilitating Awesome Meetings
Avatar for Lara Hogan lara
55
6.5k
Build The Right Thing And Hit Your Dates
Avatar for Maggie C. maggiecrowley
37
2.8k
Making Projects Easy
Avatar for Brett Harned brettharned
117
6.3k
Product Roadmaps are Hard
Avatar for C. Todd Lombardo iamctodd
PRO
54
11k
Done Done
Avatar for chrislema chrislema
185
16k
How To Stay Up To Date on Web Technology
Avatar for Chris Coyier chriscoyier
790
250k
Bootstrapping a Software Product
Avatar for Garrett Dimon garrettdimon
PRO
307
110k
Statistics for Hackers
Avatar for Jake VanderPlas jakevdp
799
220k
The Power of CSS Pseudo Elements
Avatar for Geoffrey Crofte geoffreycrofte
77
5.9k
A designer walks into a library…
Avatar for Paul Jervis Heath pauljervisheath
207
24k
Practical Orchestrator
Avatar for Shlomi Noach shlominoach
190
11k
The MySQL Ecosystem @ GitHub 2015
Avatar for Sam Lambert samlambert
251
13k

Transcript

  1. Catalog-driven Workflows Rich Signell , USGS, Woods Hole, MA, USA

    Filipe Fernandes, SECOORA, Salvador, Brazil Kyle Wilcox, Axiom Data Science, Wickford, RI, USA SciPy 2016 2016-07-13 Lightning Talk

  2. 2015 Boston Light Swim, Aug 15, 7:00am since 1907, 8

    miles, no wet suit How cold will the water be?

  3. NECOFS Massbay Forecast

  4. US Integrated Ocean Observing System (IOOS® ) IOOS® Plan defines:

    • Global Component • Coastal Component  17 Federal Agencies  11 Regional Associations

  5. IOOS Core Principles • Adopt open standards & practices •

    Avoid customer-specific stovepipes • Standardized access services implemented at data providers 5 Customer Web access service Data Provider Observations Models

  6. pycsw for providing CSW services

  7. OWSLib for accessing OGC Services

  8. Catalog-Driven Notebook

  9. None
  10. None

  11. Final Result

  12. Bias-Corrected Forecast

  13. Check it out on Github/Binder