import xarray as xr
import dask
import hvplot.xarray
Using OPeNDAP to Access Data from On-Prem and Earthdata Cloud Archives
Requirements Earthdata Login
- OPeNDAP (Hyrax Server)
- On-prem Endpoint - Open
- On-prem Endpoint - Earthdata Login Authentication
- Earthdata Cloud Endpoint - Earthdata Login Authentication
Import Packages
Access On-prem OPeNDAP (Hyrax Server) - Open
= 'https://podaac-opendap.jpl.nasa.gov/opendap/allData/ghrsst/data/GDS2/L4/GLOB/NCEI/AVHRR_OI/v2/1981/244/19810901120000-NCEI-L4_GHRSST-SSTblend-AVHRR_OI-GLOB-v02.0-fv02.0.nc' opd_sst_url
= xr.open_dataset(opd_sst_url)
opd_sst_ds opd_sst_ds
<xarray.Dataset> Dimensions: (lat: 720, lon: 1440, time: 1, nv: 2) Coordinates: * lat (lat) float32 -89.88 -89.62 -89.38 ... 89.38 89.62 89.88 * lon (lon) float32 -179.9 -179.6 -179.4 ... 179.4 179.6 179.9 * time (time) datetime64[ns] 1981-09-01 Dimensions without coordinates: nv Data variables: lat_bnds (lat, nv) float32 -90.0 -89.75 -89.75 ... 89.75 89.75 90.0 lon_bnds (lon, nv) float32 -180.0 -179.8 -179.8 ... 179.8 180.0 time_bnds (time, nv) datetime64[ns] 1981-09-01 1981-09-02 analysed_sst (time, lat, lon) float32 ... analysis_error (time, lat, lon) float32 ... mask (time, lat, lon) float32 ... sea_ice_fraction (time, lat, lon) float32 ... Attributes: (12/48) product_version: Version 2.0 spatial_resolution: 0.25 degree Conventions: CF-1.6,ACDD-1.3 title: NCEI global 0.25 deg daily sea surface t... references: Reynolds, et al.(2009) What is New in Ve... institution: NCEI ... ... source: AVHRR_Pathfinder-NODC-L3C-v5.1,ICOADS_SH... summary: NOAA's 1/4-degree Daily Optimum Interpol... time_coverage_start: 19810901T000000Z time_coverage_end: 19810902T000000Z uuid: 39832cc3-d409-438a-820e-2bb1b38ebca8 DODS_EXTRA.Unlimited_Dimension: time
xarray.Dataset
- lat: 720
- lon: 1440
- time: 1
- nv: 2
- lat(lat)float32-89.88 -89.62 ... 89.62 89.88
- long_name :
- latitude
- standard_name :
- latitude
- axis :
- Y
- units :
- degrees_north
- comment :
- Uniform grid with centers from -89.875 to 89.875 by 0.25 degrees.
- bounds :
- lat_bnds
- valid_max :
- 90.0
- valid_min :
- -90.0
array([-89.875, -89.625, -89.375, ..., 89.375, 89.625, 89.875], dtype=float32)
- lon(lon)float32-179.9 -179.6 ... 179.6 179.9
- long_name :
- longitude
- standard_name :
- longitude
- axis :
- X
- units :
- degrees_east
- comment :
- Uniform grid with centers from -179.875 to 179.875 by 0.25 degrees.
- bounds :
- lon_bnds
- valid_max :
- 180.0
- valid_min :
- -180.0
array([-179.875, -179.625, -179.375, ..., 179.375, 179.625, 179.875], dtype=float32)
- time(time)datetime64[ns]1981-09-01
- long_name :
- reference time of sst field
- standard_name :
- time
- axis :
- T
- bounds :
- time_bnds
- comment :
- Nominal time because observations are from different sources and are made at different times of the day.
array(['1981-09-01T00:00:00.000000000'], dtype='datetime64[ns]')
- lat_bnds(lat, nv)float32...
- comment :
- This variable defines the latitude values at the north and south bounds of every 0.25-degree pixel.
array([[-90. , -89.75], [-89.75, -89.5 ], [-89.5 , -89.25], ..., [ 89.25, 89.5 ], [ 89.5 , 89.75], [ 89.75, 90. ]], dtype=float32)
- lon_bnds(lon, nv)float32...
- comment :
- This variable defines the longitude values at the west and east bounds of every 0.25-degree pixel.
array([[-180. , -179.75], [-179.75, -179.5 ], [-179.5 , -179.25], ..., [ 179.25, 179.5 ], [ 179.5 , 179.75], [ 179.75, 180. ]], dtype=float32)
- time_bnds(time, nv)datetime64[ns]...
- comment :
- This variable defines the start and end of the time span for the data.
array([['1981-09-01T00:00:00.000000000', '1981-09-02T00:00:00.000000000']], dtype='datetime64[ns]')
- analysed_sst(time, lat, lon)float32...
- long_name :
- analysed sea surface temperature
- standard_name :
- sea_surface_temperature
- units :
- kelvin
- valid_min :
- -300
- valid_max :
- 4500
- comment :
- Single-sensor Pathfinder 5.0/5.1 AVHRR SSTs used until 2005; two AVHRRs at a time are used 2007 onward. Sea ice and in-situ data used also are 'near real time' quality for recent period. SST (bulk) is at ambiguous depth because multiple types of observations are used.
- source :
- AVHRR_Pathfinder-NODC-L3C-v5.1,ICOADS_SHIP-NCAR-IN_SITU-v2.4,ICOADS_BUOY-NCAR-IN_SITU-v2.4,GSFC_25KM-NSIDC-ICE
[1036800 values with dtype=float32]
- analysis_error(time, lat, lon)float32...
- long_name :
- estimated error standard deviation of analysed_sst
- units :
- kelvin
- valid_min :
- 0
- valid_max :
- 32767
- comment :
- Sum of bias, sampling and random errors.
[1036800 values with dtype=float32]
- mask(time, lat, lon)float32...
- long_name :
- sea/land field composite mask
- flag_meanings :
- water land
- comment :
- Binary mask distinguishing water and land only.
- flag_masks :
- [1 2]
- source :
- RWReynolds_landmask_V1.0
- valid_max :
- 2
- valid_min :
- 1
[1036800 values with dtype=float32]
- sea_ice_fraction(time, lat, lon)float32...
- long_name :
- sea ice area fraction
- valid_min :
- 0
- valid_max :
- 100
- standard_name :
- sea_ice_area_fraction
- units :
- 1
- comment :
- 7-day median filtered . Switch from 25 km NASA team ice (http://nsidc.org/data/nsidc-0051.html) to 50 km NCEP ice (http://polar.ncep.noaa.gov/seaice) after 2004 results in artificial increase in ice coverage.
- source :
- GSFC_25KM-NSIDC-ICE
[1036800 values with dtype=float32]
- product_version :
- Version 2.0
- spatial_resolution :
- 0.25 degree
- Conventions :
- CF-1.6,ACDD-1.3
- title :
- NCEI global 0.25 deg daily sea surface temperature analysis based mainly on Advanced Very High Resolution Radiometer, final
- references :
- Reynolds, et al.(2009) What is New in Version 2. Available at http://www.ncdc.noaa.gov/sites/default/files/attachments/Reynolds2009_oisst_daily_v02r00_version2-features.pdf; Daily 1/4 Degree Optimum Interpolation Sea Surface Temperature (OISST)- Climate Algorithm Theoretical Theoretical Basis Document, NOAA Climate Data Record Program CDRP-ATBD-0303 Rev. 2 (2013). Available at http://www1.ncdc.noaa.gov/pub/data/sds/cdr/CDRs/Sea_Surface_Temperature_Optimum_Interpolation/AlgorithmDescription.pdf.
- institution :
- NCEI
- netcdf_version_id :
- 4.3.2
- history :
- 2015-11-02T19:52:40Z: Modified format and attributes with NCO to match the GDS 2.0 rev 5 specification.
- start_time :
- 19810901T000000Z
- stop_time :
- 19810902T000000Z
- westernmost_longitude :
- -180.0
- easternmost_longitude :
- 180.0
- southernmost_latitude :
- -90.0
- northernmost_latitude :
- 90.0
- comment :
- The daily OISST version 2.0 data contained in this file are the same as those in the equivalent GDS 1.0 file.
- Metadata_Conventions :
- ACDD-1.3
- acknowledgment :
- This project was supported in part by a grant from the NOAA Climate Data Record (CDR) Program. Cite this dataset when used as a source. The recommended citation and DOI depends on the data center from which the files were acquired. For data accessed from NOAA in near real-time or from the GHRSST LTSRF, cite as: Richard W. Reynolds, Viva F. Banzon, and NOAA CDR Program (2008): NOAA Optimum Interpolation 1/4 Degree Daily Sea Surface Temperature (OISST) Analysis, Version 2. [indicate subset used]. NOAA National Centers for Environmental Information. http://doi.org/doi:10.7289/V5SQ8XB5 [access date]. For data accessed from the NASA PO.DAAC, cite as: Richard W. Reynolds, Viva F. Banzon, and NOAA CDR Program (2008): NOAA Optimum Interpolation 1/4 Degree Daily Sea Surface Temperature (OISST) Analysis, Version 2. [indicate subset used]. PO.DAAC, CA, USA. http://doi.org/10.5067/GHAAO-4BC01 [access date].
- cdm_data_type :
- Grid
- creator_name :
- Viva Banzon
- creator_email :
- viva.banzon@noaa.gov
- creator_url :
- http://www.ncdc.noaa.gov
- date_created :
- 20091203T000000Z
- file_quality_level :
- 3
- gds_version_id :
- 2.0r5
- geospatial_lat_resolution :
- 0.25
- geospatial_lat_units :
- degrees_north
- geospatial_lon_resolution :
- 0.25
- geospatial_lon_units :
- degrees_east
- id :
- NCEI-L4LRblend-GLOB-AVHRR_OI
- keywords :
- Oceans>Ocean Temperature>Sea Surface Temperature
- keywords_vocabulary :
- NASA Global Change Master Directory (GCMD) Science Keywords, Version 8.1
- license :
- No constraints on data access or use.
- metadata_link :
- http://doi.org/10.7289/V5SQ8XB5
- naming_authority :
- org.ghrsst
- platform :
- NOAA-7
- processing_level :
- L4
- project :
- Group for High Resolution Sea Surface Temperature
- publisher_email :
- oisst_contacts@noaa.gov
- publisher_name :
- OISST Operations Team
- publisher_url :
- http://www.ncdc.noaa.gov/sst
- sensor :
- AVHRR_GAC
- standard_name_vocabulary :
- CF Standard Name Table v29
- source :
- AVHRR_Pathfinder-NODC-L3C-v5.1,ICOADS_SHIP-NCAR-IN_SITU-v2.4,ICOADS_BUOY-NCAR-IN_SITU-v2.4,GSFC_25KM-NSIDC-ICE
- summary :
- NOAA's 1/4-degree Daily Optimum Interpolation Sea Surface Temperature (OISST) (sometimes referred to as Reynold's SST, which however also refers to earlier products at different resolution), currently available as version 2, is created by interpolating and extrapolating SST observations from different sources, resulting in a smoothed complete field. The sources of data are satellite (AVHRR) and in situ platforms (i.e., ships and buoys), and the specific datasets employed may change over. At the marginal ice zone, sea ice concentrations are used to generate proxy SSTs. A preliminary version of this file is produced in near-real time (1-day latency), and then replaced with a final version after 2 weeks. Note that this is the AVHRR-ONLY DOISST, available from Oct 1981, but there is a companion DOISST product that includes microwave satellite data, available from June 2002.
- time_coverage_start :
- 19810901T000000Z
- time_coverage_end :
- 19810902T000000Z
- uuid :
- 39832cc3-d409-438a-820e-2bb1b38ebca8
- DODS_EXTRA.Unlimited_Dimension :
- time
=0).hvplot.image(cmap='Inferno') opd_sst_ds.analysed_sst.isel(time
Access On-prem OPeNDAP (Hyrax Server) - Authentication
import opendap_auth
opendap_auth.create_dodsrc()
'.dodsrc file created: /home/jovyan/.dodsrc'
Integrated Multi-satellitE Retrievals for GPM (IMERG) Level 3 IMERG Final Daily 10 x 10 km (GPM_3IMERGDF)
= 'https://gpm1.gesdisc.eosdis.nasa.gov/opendap/GPM_L3/GPM_3IMERGDF.06/2021/07/3B-DAY.MS.MRG.3IMERG.20210704-S000000-E235959.V06.nc4' opd_prec_url
= xr.open_dataset(opd_prec_url)
opd_prec_ds opd_prec_ds
syntax error, unexpected WORD_WORD, expecting SCAN_ATTR or SCAN_DATASET or SCAN_ERROR
context: HTTP^ Basic: Access denied.
syntax error, unexpected WORD_WORD, expecting SCAN_ATTR or SCAN_DATASET or SCAN_ERROR
context: HTTP^ Basic: Access denied.
syntax error, unexpected WORD_WORD, expecting SCAN_ATTR or SCAN_DATASET or SCAN_ERROR
context: HTTP^ Basic: Access denied.
syntax error, unexpected WORD_WORD, expecting SCAN_ATTR or SCAN_DATASET or SCAN_ERROR
context: HTTP^ Basic: Access denied.
KeyboardInterrupt:
=0).hvplot.image(cmap='rainbow') opd_prec_ds.precipitationCal.isel(time
Access Earthdata cloud OPeNDAP (Hyrax Server) - Authentication
= 'https://opendap.earthdata.nasa.gov/providers/POCLOUD/collections/ECCO%20Sea%20Surface%20Height%20-%20Daily%20Mean%200.5%20Degree%20(Version%204%20Release%204)/granules/SEA_SURFACE_HEIGHT_day_mean_1992-01-01_ECCO_V4r4_latlon_0p50deg.dap.nc' edc_odp_ssh_url
= xr.open_dataset(edc_odp_ssh_url)
edc_odp_ssh_ds edc_odp_ssh_ds
= 'https://opendap.earthdata.nasa.gov/providers/POCLOUD/collections/GHRSST%20Level%204%20MUR%20Global%20Foundation%20Sea%20Surface%20Temperature%20Analysis%20(v4.1)/granules/20190201090000-JPL-L4_GHRSST-SSTfnd-MUR-GLOB-v02.0-fv04.1.dap.nc4' url
xr.open_dataset(url)
= 'https://opendap.earthdata.nasa.gov/collections/C1968980576-POCLOUD/granules/S6A_P4_2__LR_RED__NR_025_001_20210713T162644_20210713T182234_F02.nc4' url
xr.open_dataset(url)
= 'https://opendap.earthdata.nasa.gov/providers/POCLOUD/collections/ECCO%20Sea%20Surface%20Height%20-%20Daily%20Mean%200.5%20Degree%20(Version%204%20Release%204)/granules/SEA_SURFACE_HEIGHT_day_mean_1992-01-01_ECCO_V4r4_latlon_0p50deg.dap.nc4' url
xr.open_dataset(url)