Annual Report from Space Physics Data Facility (SPDF) 2025

Annual Report from Space Physics Data Facility (SPDF) Robert Candey, Lan Jian, Tamara Kovalick NASA Goddard Space Flight Center, MD, USA International Heliophysics Data Environment Alliance (IHDEA) Meeting San Antonio, Texas 23 October 2024 https://spdf.gsfc.nasa.gov Introduction ❑SPDF team includes 10 curation scientists (mostly part time, covering a wide range of heliophysics domains) and 11 technical and development staff ❑Established in 1990s, SPDF is now the active and final archive of non-solar or space physics data (mostly in situ data) from NASA Heliophysics missions, including joint missions with other US or foreign agencies, to enable correlative and collaborative research across discipline and mission boundaries ❑SPDF also archives other data relevant to NASA Heliophysics Science Objectives (often per the request of missions/projects) •Related data from planetary missions (e.g., MAVEN, New Horizons) •Heliophysics data from satellites of NOAA, DoD, or other agencies (e.g., GOES, DMSP) •Ground-based magnetometers, aurora cameras, radars, etc., which are funded by NSF or other agencies (the majority are archived at relevant facilities other than SPDF) ❑Besides local archival, data are backed up in Iron Mountain and NCCS (NASA Center for Climate Simulation) on premises 2 Mission Data Volume Archived at SPDF 3 SPDF data holdings (~770 TB) span 100+ missions over 65 years Covering from the Sun to the local interstellar medium including magnetosphere – ionosphere – thermosphere – mesosphere (M-ITM) of Earth and other applicable planets File Numbers of Mission Data Archived at SPDF 4 ~110M files, ~3000 CDF datasets (68% with SPASE records, 55% with DOIs), ~5000 non-CDF datasets (some with SPASE and DOI) SPDF’s Science-Enabling Services ❑Coordinated Data Analysis Web (CDAWeb) ▪Data access through web browser, API, IDL, Python ▪Interface for browsing, correlating, and displaying data (audio and movie for special cases) from 60+ missions or mission groups and multiple instruments ▪Inventory plot and usage statistics for mission data ❑Satellite Situation Center (SSC) ▪Data access through web browser, API ▪~160 missions, orbit/ground track displays and queries ▪Coordinate transformation tools ❑OMNI Web (including COHO Web) ▪Solar wind plasma, magnetic field, and energetic particle data at the nose of Earth’s bow shock and other locations of the heliosphere ▪Interface for plotting, filtering, and statistical analysis ❑Critical Infrastructures for the Heliophysics Data Environment ▪Common Data Format (CDF): self-describing science file format (cdf.gsfc.nasa.gov) ▪International Solar-Terrestrial Physics (ISTP) Metadata Standards for CDF (and netCDF) data including global and variable attributes ▪Heliophysics Data Portal: discipline-wide data inventory and access service 5 SPDF Activities Since 2024 October •Supported data releases of many missions, added data from AWE, MSL, CIRBE, and other missions •Upgraded CDF to Version 3.9.1, new quick start guides (would love your feedback) •Released new SPDF, SSCweb and CDF websites following US government web design system, working on new CDAWeb and OMNI sites •Fixed defunct URLs in hundreds of CDAWeb master CDFs •Replaced ephemeris data helio1day to helio1hr for heliospheric/planetary missions •Copied science level data from SPDF/CDAWeb to HelioCloud, supported helio.data development and HDRL outreach ~50% of JGR-Space Physics and 60% of Space Weather papers in 2024 acknowledged SPDF services and data https://spdf.gsfc.nasa.gov/Acknowledgements.html Online ISTP Metadata Editor https://spdf.gsfc.nasa.gov/istp-metadata-editor/ New JavaScript tool to create/update CDF/netCDF datasets with ISTP and SPASE metadata. It can convert file format (CDF, skeleton, JSON, SPASE XML), check ISTP compliance, and compare files. 7 Eric Grimes’s Poster Plot Walk for Pre-Generated Plots https://spdf.gsfc.nasa.gov/plot_walk/ Summary or quick-look plots from ~30 missions (~17 million plots) 8 •Added inventory plots for mission groups •Connected plot sets to SPASE records •Made new orbit plots with an updated list of s/c, using timedependent solar wind conditions and thus varying (more realistic) locations of bow shock and magnetopause SPDF Plans 1. Data archiving and service for new missions (LEXI, EZIE, REAL, TRACERS, IMAP, Carruthers all launched in 2025) 2. Final archiving of data, documentation, and static websites for ending missions 3. Standardizing ISTP Metadata Guidelines with version control, etc. 4. Improving the ISTP Metadata Editor with the updates of ISTP and SPASE metadata standards 5. Making higher resolution (e.g., to 1-min) orbit data for missions in SSC database 6. Adding more planetary coordinates and simulated physical boundaries to the new 4D Orbit Viewer 7. Adding support for CDF to command line netCDF tools, Octave, GDL, Excel, C++, and others. CDF gap checker to write filename, variable name, time, and any gaps greater than a threshold 8. Improving SPDF documentation (quick start guides and tutorials) 9. Making web services for event lists of burst mode data or science events, using CDAWeb and SSCWeb to find previous/next burst or event and better serve them 10. Modernizing more user-friendly and interactive web analysis system. For instance, HTML5/JavaScript-based browser interface for CDAWeb/SSCWeb, building on the 4D Orbit Viewer, expanded to add interactive data plotting and sonification tied to the orbit display, perhaps with data glyphs along the orbits as well (using JSON output from CDAWeb and SSC web services)