About
NASA Earthdata-Openscapes answers a NASA Earthdata call to support scientific researchers using data from NASA Distributed Active Archive Centers (DAACs) as they migrate workflows to the cloud.
Openscapes
Openscapes champions open, inclusive practices in environmental and Earth science to help uncover data-intensive solutions faster. We do this through our flagship Champions mentorship program, as well as through community organizing, training, and coaching, leveraging existing resources from open communities along with our own.
Flywheel Preprint
Our flywheel shows our approach to engaging, empowering, and amplifying research communities in open data science — how we describe kinder, better science in less time. See our preprint: The Openscapes Flywheel: A framework for managers to facilitate and scale inclusive Open science practices
The NASA Openscapes Framework
The overarching vision is to support scientific researchers using NASA Earthdata as they migrate their workflows to the cloud. We are doing this working with NASA Distributed Active Archive Centers (DAACs) over three years by:
Developing a cross-DAAC Mentor community that supports growth into confident cloud data instructors, and create, curate and use shared resources and have a tutorial review process
Empowering science teams to experiment migrating their download-intensive data analysis workflows to the cloud through a partnership with Carpentries and 2i2c
Scaling the Openscapes Champions program with DAAC Mentors to support science cohorts and amplify as many open science leaders as possible, transforming their workflows towards open, kinder science and the cloud
Project Impact Summary Years 1-3
NASA Openscapes is a multi-year effort to grow a cross-DAAC Mentor community supporting Open NASA Earth Science in the Cloud. Looking back from where we started in February 2020: we have changed the way NASA teaches Cloud. There is now a way to teach Cloud, and we have built and supported a growing community of learner-oriented empathetic teachers who are user-support staff from across 11 DAACs. These “NASA Openscapes Mentors” practice open science daily to create a common set of tutorials, organize and lead virtual, hybrid, and in-person workshops, and have a feedback & review process for tutorial creation and teaching. The successes and momentum of NASA Openscapes is due to the Mentors having paid time as part of their jobs to collaborate and learn together. NASA Openscapes work is not extra: it is the “how” to do the work aligned with DAAC and broader NASA goals. We are appreciative of DAAC Managers and NASA leadership for supporting Mentors’ time.
In Year 3, we have focused on “operational hardening” to formalize processes, move toward sustainability, communicate impact, and engage more expansively with the broader open community. We report on this as a new first section, adding to the sections included in Year 1&2 Annual Reports. 2023 is the Year of Open Science, and we have continued to be active members of the global open science community, amplifying NASA work and connecting with and amplifying collaborator efforts. Throughout this project, we have not only used technology, but we’ve collaborated with technology builders to improve the user/learner experience for these technologies for Open science and Cloud. This includes 2i2c and Jupyter, Quarto from Posit/RStudio; OPeNDAP, MATLAB from Mathworks, the R community, Coiled, as well as connected communities across NASA Earthdata, NOAA Fisheries, EPA, Black in Marine Science (BIMS), Black Women in Ecology, Evolution, and Marine Science (BWEEMS), Fred Hutch Cancer Center, RLadies, and beyond.
We approach this work as movement building. We developed the Openscapes Flywheel, an open source tool – we reach for this tool for planning, progress, and impact tracking as we would reach for R and Quarto for data analysis and documentation. We developed it with NASA Earth science Mentors, using the concept where transformations occur from consistently doing key activities that add up over time (Collins). The Flywheel supports teams across NASA DAACs to to grow morale and technical capacity across their organizations by (1) Engage bright spots, through welcoming them and creating space and place; (2) Empower a learning culture through investing in learning and trust and working openly (3) Amplify Open science leaders, through leveraging the common and inspiring the bigger movement (Robinson & Lowndes 2022).
Through this work, some highlights of impact to date:
(1 Engage): 11 DAACs participating (NSIDC, PO.DAAC, LP DAAC, GES DISC, ASDC, ASF, ORNL, SEDAC, GHRC, OB.DAAC, LAADS) (and we will join the 12th CDDIS’s first User Working Group in January 2024); have a JupyterHub and Notebook-Quarto-GitHub workflow for documentation and publishing; have co-created a consistent set of tutorials, teaching style, and mindset; co-led the 2021 Cloud Hackathon and 2022+2023 Champions programs; have documented our work through the Flywheel publication and Approach Guide; and have given many “imagine what’s possible” talks & keynotes about NASA Openscapes work – including the global announcement of Quarto and a talk on Documenting Things that describes 3 approaches to onboarding NASA Mentors.
(2 Empower): Mentors have led 10+ workshops internally with DAAC staff and externally with researchers; developed the Earthdata Cloud Cookbook; Reused tutorials, slides, graphics and facilitation and open practices; were more aware cross-DAAC, less recreating; from user feedback developed Cheatsheets and the earthaccess python library; wrote the Value of Hosted JupyterHubs (White paper RFI); Collaborating on Hackweeks, developed a 2i2c access policy and onboard/offboard approach; and also started meeting regularly with Openscapes Mentors from NASA, EPA, Fred Hutch, and Pathways to Open Science, connecting about challenges and opportunities beyond NASA – we developed coaching skills that make us better open data science mentors and co-authored a preprint called Shifting institutional culture to develop climate solutions with Open Science that is now in peer-review. We now support R and MATLAB users in 2 ways (as we do python users): Python, R, and MATLAB part of the 2i2c JupyterHub (via corn environment); and we teach how to work in these languages: partnering with Mathworks and Carl Boettiger, who have created `earthaccess` equivalent approaches and identifying needs for dev and teaching to support.
(3 Amplify): Mentors are amplifying across-DAACs and beyond: Career advancement & bringing mindset to new places; Speaking up in other meetings (User Needs TIM, TRAIN, Cloud Playground conversations); Connecting & consulting based on experiences - Pathfinder for 2i2c, comparing w/ SMCE; AWS; Engaging beyond (Pangeo Forge, Ladies of Landsat, pyOpenSci).
From one Mentor, Cassandra Nickles (PO.DAAC):
Openscapes has created a collaborative environment for DAAC staff to collectively support open science initiatives for NASA Earthdata users. It enables us to work more openly with other DAACs toward our common goal of making the Earthdata ecosystem more accessible and inclusive. We’ve developed awesome material to help Earthdata users such asworkflow cheatsheets, a python package (earthaccess), and data recipes hosted in the cross-DAACNASA Earthdata Cloud Cookbook. Perhaps just as important as what we’ve done however, are mindsets we’ve grown into along the way. It’s okay to share imperfect works in progress. The virtual environment can be conducive to laughter and connection. Ideas are not too big or too small to share. We are better at dreaming and implementing the future together.
Blog
We are cross-posting news blog posts about NASA Openscapes from our main openscapes.org blog.
Additional blogs about our work:
From Onboarding to Fledging and Beyond—An Openscapes Journey, September 17, 2024. NASA Earthdata blog.
Easier Access to NASA Earth Science Data in the Cloud, June 5, 2024, NASA Earthdata Blog.
Cooking up collaborative resources on how to use the Earthdata Cloud, October 10, 2023. National Snow and Ice Data Center (NSIDC)
Using the NASA Openscapes Framework to enable open science, by Audrey Payne, March 14, 2023. National Snow and Ice Data Center (NSIDC)
White Paper: The Value of Hosted JupyterHubs
The Value of Hosted JupyterHubs in enabling Open NASA Earth Science in the Cloud - Nickles et al. 2023.
This is a response from NASA Openscapes to NASA Request for Information (RFI) NNH23ZDA005L: Scientific Data and Computing Architecture to Support Open Science.
Slides
Slides, recordings, and posters
Forking as a Worldview: A big idea that frames Openscapes thinking - Julie Lowndes. September 10, 2024. NASA Earthdata PI Planning Plenary.
earthaccess: Simplifying Earth Science in The Cloud - Luis López (NSIDC) et al., August 14, 2024. posit::conf
Supporting NASA Earthdata users in the Cloud: NASA Openscapes onboarding & fledging - Alexis Hunzinger (GES DISC), Danny Kaufman (ASDS), Aaron Friesz (LP DAAC), Andy Barrett (NSIDC), Rhys Leahy (GES DISC), Michele Thronton (ORNL), Eli Holmes (NOAA Fisheries), Julie Lowndes (Openscapes). July 23, 2024. ESIP Summer Meeting (video)
earthaccess: Improving Access Patterns to Mission Data - Luis López (NSIDC) et al. June 2024. NASA Physical Oceanography Data Center (PO.DAAC) User Working Group
How the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud - Julie Lowndes, May 30, 2024. Ocean Biology (OB.DAAC) User Working Group.
How the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud - Julie Lowndes & Celia Ou (PO.DAAC), May 23, 2024. NASA Jet Propulsion Laboratory. (recording)
How the NASA Openscapes community supports Earthdata users migrating workflows to the Cloud - Julie Lowndes & Ian Carroll (OB.DAAC), May 14, 2024. NASA Crustal Dynamics Data Information System (CDDIS) and NOAA Enterprise Data Management Workshop (EDMW)
earthaccess: Programmatic search and access of NASA Earthdata in Python - Luis López et al. May 9, 2024. Software for the NASA Science Mission Directorate Workshop 2024
Open Science/Source around ASDC, Openscapes - Danny Kaufman. March 15, 2024. Atmospheric Science Data Center (ASDC) Feedback Friday (subset of original slides)
NASA Openscapes: How we work supporting Earthdata science in the Cloud (First story of a scientist “fledging” from JupyterHub!) - Julie Lowndes, Erin Robinson, NASA Openscapes Mentors. March 5, 2024. ESDSWG, Huntsville Alabama.
earthaccess: Accelerating NASA Earthdata access through open, collaborative development - Luis López, Matt Fisher, Aaron Friesz, Qiusheng Wu, Amy Steiker, earthaccess community. Feb 26, 2024. NASA ESDS Tech Spotlight.
NASA Openscapes: Better Science for Future Us - Bri Lind, Julie Lowndes, Erin Robinson & NASA Openscapes Mentors. Jan 9, 2024. SEDAC Open Science Day (zenodo(video start at 1:31)
Examing Environmental Justice through Open and Cloud Native Tools - Carl Boettiger. Jan 9, 2024. SEDAC Open Science Day (zenodo(video start at 3:55:05)
NASA Openscapes: Supporting NASA EarthData Users Transition to the Cloud - Erin Robinson, Julie Lowndes & NASA Openscapes Mentors. Jan 16, 2024. Crustal Dynamics Data Information Systems (CDDIS) Telecon
NASA Earthdata: Open Science Workflows & Techniques from Openscapes - Cassie Nickles & the NASA Openscapes Community. Jan 9, 2024. SEDAC Open Science Workshop (zenodo(video start at 3:19)
NASA Openscapes: Approaches and Stories of Kinder, Open Science in the Cloud - Julie Lowndes, Erin Robinson & NASA Openscapes Mentors. Dec 15, AGU Fall Meeting
Accessing NASA Earthdata in the Cloud: Experiences Using MATLAB on NASA Openscapes’ 2i2c JupyterHub - Dec 12, 2024, Lisa Kempler, MathWorks
Enabling Analysis in the Cloud Using NASA Earth Science Data - Dec 10, Cassie Nickles, Michele Thornton et al. AGU Fall Meeting Workshops (video)
NASA Openscapes: Supporting NASA EarthData Users Transition to the Cloud - Nov 2 2023. Erin Robinson, GHRC User Working Group
Cloud Environment Opportunities: Managed JupyterHub options for Cryosphere and Earthdata user communities - September 2023. Amy Steiker, Andrew Barrett, & Luis López, NSIDC User Working Group. (blog post)
Open Science Webinar: Making Arctic Science Open Science - September 28, 2023. Navigating the New Arctic Community Office, co-convened by Andy Barrett with speakers Julie Lowndes, Matt Fisher, and Mohommad Afzal Shadab.
Documenting things: openly for Future Us - September 19, 2023. Julie Lowndes, Posit Conf.
NASA Openscapes Mentors’ Retreat 2023: Summary and Moving Toward Sustainability - September 18, 2023. Catalina Taglialatela et al, NASA HQ Meeting
NASA Openscapes: Open communities and continued learning - August 11, 2023. ICESat-2 Hackweek
Getting to Know Open Science: How to Engage and Flourish in the Growing Open Science Community - August 9, 2023. Bri Lind. NASA Hyperwall, Ecological Society of America 2023 Annual Meeting, Portland, Oregon.
Training for culture change in Open Science - June 18, 2023. Julie Lowndes & Erin Robinson, Down To Earth: A podcast for Geoscientists by Geoscientist.
Accessing data from NASA’s DAACs & Earthdata - Spring 2023, Michele Thornton, USFS Applications workshop.
NASA Openscapes: Movement building with the Flywheel - March 31, 2023, Erin Robinson & Julie Lowndes. NASA Open Source Science Working Group
Communicating impact: NASA Openscapes - March 22 2023, Julie Lowndes, Erin Robinson, & Justin Rice. NASA ESDSWG Meeting, Baltimore Maryland
3 approaches for the year of open science - March 2023 Clatterbuck et al.: blog post from our ESIP session with colleagues from NASA, NOAA, California WaterBoards, UNC Chapel Hill
Lessons from NASA Openscapes - February 2023 presentation to AWS Cloud team
Working with NASA Earthdata in the Cloud - January 24, 2023 - Amy Steiker, Bri Lind, Julie Lowndes, Luis López, Michele Thornton, and the NASA Openscapes Mentors. ESIP Winter Meeting “Enabling Open Science with NASA’s Earthdata in the Cloud” Session
Supporting open science as a daily practice - December 16, 2022 - Julie Lowndes, Erin Robinson, Openscapes Mentors. AGU Fall Conference Talk, “The Future is Open” session
earthaccess
: A Python Library for NASA Earthdata - December 13, 2022 - Luis López, Andrew P. Barrett, Julie Lowndes, Joseph H. Kennedy, Erin Robinson, Amy Steiker, Jessica Scheick, The NASA Openscapes mentors team. AGU Fall Conference Poster (slide)NASA Openscapes: Lessons Learned supporting Cross-DAAC User Services to migrate to the Cloud - December 13, 2022, Aaron Friesz, Alexis Hunzinger, Amy Steiker, Catalina Oaida Taglialatela, Luis López, Cassandra Nickles, Bri Lind, Mahsa Jami, Celia Ou, Julia Stewart Lowndes, Erin Robinson, NASA Openscapes DAAC Mentor Community. AGU Fall Conference Poster (slide)
Curating information to guide NASA Earthdata users into the cloud with workflow diagrams and cheatsheets - December 13, 2022 - Cassandra Nickles, Catalina Oaida Taglialatela, Julie Stewart Lowndes, Amy Steiker, Alexis Hunzinger, Aaron Friesz. AGU Fall Conference Poster (slide)
Early lessons learned from supporting end user’s transition to the cloud - November 16, 2022, Alexis Hunzinger, LAADS DAAC User Working Group 2022
NASA Openscapes Cloud Infrastructure - October 13, 2022, Luis Lopez (video)
Efforts to support end users in the journey to the cloud - September 27, 2022: Open Source Science Data Repositories Workshop 2022 Steiker, Hunzinger, López, Oaida Taglialatela, Friesz (video)
NASA Earthdata Cloud: Myths, Truths, Questions - September 7, 2022. Steiker, Heightley (NSIDC)
Efforts to support end users in the journey to the cloud - August 17, 2022: ESDIS SE TIM 2022 Oaida Taglialatela, Hunzinger, Smit, López, Steiker
NASA Briefing to Unidata - July 2022, Christine Smit
Hello Quarto: share • collaborate • teach • reimagine — July 28, 2022: Keynote at RStudio Conference - Julie Lowndes and Mine Çetinkaya-Rundel (video)
NSIDC DAAC User Working Group - May 20, 2022. Barrett, Steiker, Meier, Roebuck, Beig, Lopez, (NSIDC)
NASA Earthdata Cloud & The Cloud Paradigm - April 2022. Friesz (LP DAAC)
NASA Openscapes Lessons from Year 1 - April 21, 2022: ESDSWG Robinson, Lowndes, López
NASA Openscapes Cloud Infrastructure - February 9, 2021: NSIDC by Luis López
Community Building: The NASA Openscapes Framework - January 18, 2022: ESIP Winter Meeting
NASA Earthdata Access in the Cloud Using Open-source libraries - December 17, 2021: invited talk by Amy Steiker at the Open Science in Action Session at the AGU Fall meeting (30 minutes)
Open Project Design: Lessons from the NASA Openscapes Framework — December 17, 2021: invited talk at the Open Science in Action Session at the AGU Fall meeting (30 minutes)
Openscapes: Better Science for Future Us — December 8, 2021: invited talk about data interoperability at the National Academies of Science, Engineering, and Medicine (NASEM) meeting co-hosted by the Mapping Sciences Committee and the Geographical Sciences Committee
Cross-DAAC Collab via Openscapes: Infusing Openscapes training, mentorship, and community building models into EOSDIS — October 26, 2021: SE TIM lightning talk by Amy Steiker
Openscapes: Better Science for Future Us — October 14, 2021: NASA’s Open Source Science for Data Processing and Archives Workshop
-
- September 16, 2021: NSIDC User Working Group
- September 8, 2021: GES DISC User Working Group
Openscapes: Better Science for Future Us. Supporting NASA Earth science research teams’ migration to the cloud - August 12, 2021: LP DAAC User Working Group
Openscapes - July 6, 2021: SAFe Plenary by Amy Steiker
Better Science for Future Us - June 30, 2021: Pangeo Showcase (PANGEO Discourse, Zenodo)
NASA DAACs Openscapes Framework - March 25, 2021: NASA ESDS-ESDIS-DAACs-IMPACT Meeting
Why NASA Earthdata? Why Openscapes?
We are getting these questions a lot, so here is our take.
NASA Earth Science Data Systems missions collect Earth data, including sea ice, physical oceanography, vegetation and many other parameters – data used by researchers around the world for many different purposes, including answering pressing questions in ecology and environmental science. Further, NASA promotes open science – from the NASA Earth Science Data Systems (ESDS) program 2020 Highlights report:
Open data are the foundation of ESDS efforts to fulfill the program’s vision of accelerating scientific advancement for societal benefit through innovative Earth science data stewardship and technology development….to leverage the diversity of global Earth science communities to advance open science.
Openscapes’ long-term goal is to enable robust, inclusive, and enduring science- and data-driven solutions to global and time-sensitive challenges. We approach open science as a spectrum, as a behavior change, and as a movement. We see data analysis and stewardship as entryways to meet scientists where they are, helping them develop new skill sets and mindsets while empowering them as leaders. With NASA support, the project team and the partners, the Openscapes Framework fundamentally changes the paradigm for supporting research teams and DAAC mentors, first to work more openly with their teams on the cloud, and ultimately to advance open science!
Openscapes is co-directed by project leads Lowndes and Robinson, and operated at the National Center for Ecological Analysis and Synthesis (NCEAS), University of California Santa Barbara.
Project Leads
Julia Stewart Lowndes, PhD
Openscapes
julia at openscapes.org
Erin Robinson, MSc
Metadata Game Changers
Project Lead 2020-2024
Project Teams
NASA-Openscapes Mentors are a cross-DAAC Mentor community that is co-creating common tutorials, resources, and teaching approaches to support researchers migrating worksflows to the Cloud.
Partners
This project allows us to partner with organizations that share Openscapes’ values of open, reproducible, and inclusive science:
- The Carpentries teach foundational coding and data science skills to researchers worldwide. Openscapes is joining The Carpentries through this project in Years 1-3 to provide instructor training opportunities to the NASA DAAC community.
- 2i2c develops, deploys, customizes, and manages open source tools and cloud services for interactive computing in research and education. They deploy community-driven infrastructure, inspired by use-cases such as the UC Berkeley DataHubs and the Pangeo project, that provides easy “one-click-to-cloud” access with Jupyter Notebooks through the web browser designed to reduce the startup burden for new learners, and this approach will also benefit the NASA DAAC community.