Search Help Show/Hide Menu
Summary
Item Identification
Keywords
Physical Location
Data Set Info
Support Roles
Extents
Spatial Info
Access Info
Distribution Info
URLs
Tech Environment
Data Quality
Data Management
Lineage
Related Items
Catalog Details

Summary

Short Citation
OCM Partners, 2024: 2023 USGS Lidar DEM: San Francisco, CA, https://www.fisheries.noaa.gov/inport/item/73506.
Full Citation Examples

Abstract

Original Dataset Product: These are Digital Elevation Model (DEM) data for California as part of the required deliverables for the CA_SanFrancisco_B23, Work Unit 300449 project. Class 2 (ground) LiDAR points in conjunction with the hydro breaklines were used to create a 0.25 meter hydro-flattened Raster DEM.

Original Dataset Geographic Extent: 4 counties (Alameda, Marin, San Francisco, San Mateo) in California, covering approximately 53 total square miles.

Original Dataset Description: The CA_SanFrancisco_B23, Work Unit 300449 project called for the planning, acquisition, processing, and derivative products of lidar data to be collected at a nominal pulse spacing (NPS) of 0.15 meters. Project specifications are based on the U.S. Geological Survey National Geospatial Program Base LiDAR Specification, 2023 Rev. A. The data were developed based on a horizontal projection/datum of NAD 1983 2011 San Francisco CS13 Meters, Meter and vertical datum of NAVD88 Geoid18, Meter. LiDAR data were delivered as processed Classified LAS 1.4 files formatted to 654 individual 1000 m x 1000 m tiles, as tiled intensity imagery, and as tiled bare earth DEMs; all tiled to the same 1000 m x 1000 m schema. Continuous breaklines were produced in Esri file geodatabase format.

Original Dataset Collection Ground Conditions: LiDAR was collected in spring 2023, while no snow was on the ground and rivers were at or below normal levels. In order to post process the LiDAR data to meet task order specifications and meet ASPRS vertical accuracy guidelines, NV5 Geospatial utilized a total of 13 ground control points that were used to calibrate the LiDAR to known ground locations established throughout the project area. An additional 41 independent accuracy checkpoints, 30 in Bare Earth and Urban landcovers (30 NVA points), 11 in Tall Weeds categories (11 VVA points), were used to assess the vertical accuracy of the data. These checkpoints were not used to calibrate or post process the data.

This metadata record supports the data entry in the NOAA Digital Coast Data Access Viewer (DAV). For this data set, the DAV is leveraging the USGS GeoTiff files hosted by USGS on Amazon Web Services.

Distribution Information

  • Not Applicable

    Create custom data files by choosing data area, map projection, file format, etc. A new metadata will be produced to reflect your request using this record as a base.

  • GeoTIFF

    Bulk download of data files in GeoTiff format, San Francisco SC13 NAD83(2011), meters coordinates and elevations in NAVD88 (Geoid18) meters.

Access Constraints:

None

Use Constraints:

Users should be aware that temporal changes may have occurred since this data set was collected and some parts of this data may no longer represent actual surface conditions. Users should not use this data for critical applications without a full awareness of its limitations.

Controlled Theme Keywords

COASTAL ELEVATION, DIGITAL ELEVATION/TERRAIN MODEL (DEM), elevation, TERRAIN ELEVATION

Child Items

No Child Items for this record.

Contact Information

Point of Contact
NOAA Office for Coastal Management (NOAA/OCM)
coastal.info@noaa.gov
(843) 740-1202
https://coast.noaa.gov

Metadata Contact
NOAA Office for Coastal Management (NOAA/OCM)
coastal.info@noaa.gov
(843) 740-1202
https://coast.noaa.gov

Extents

Geographic Area 1

-122.516107825° W, -122.326425283° E, 37.8373975022° N, 37.6969866729° S

Time Frame 1
2023-04-20

Item Identification

Title: 2023 USGS Lidar DEM: San Francisco, CA
Short Name: ca2023_sanfran_m10174_metadata
Status: Completed
Creation Date: 2023
Publication Date: 2024
Abstract:

Original Dataset Product: These are Digital Elevation Model (DEM) data for California as part of the required deliverables for the CA_SanFrancisco_B23, Work Unit 300449 project. Class 2 (ground) LiDAR points in conjunction with the hydro breaklines were used to create a 0.25 meter hydro-flattened Raster DEM.

Original Dataset Geographic Extent: 4 counties (Alameda, Marin, San Francisco, San Mateo) in California, covering approximately 53 total square miles.

Original Dataset Description: The CA_SanFrancisco_B23, Work Unit 300449 project called for the planning, acquisition, processing, and derivative products of lidar data to be collected at a nominal pulse spacing (NPS) of 0.15 meters. Project specifications are based on the U.S. Geological Survey National Geospatial Program Base LiDAR Specification, 2023 Rev. A. The data were developed based on a horizontal projection/datum of NAD 1983 2011 San Francisco CS13 Meters, Meter and vertical datum of NAVD88 Geoid18, Meter. LiDAR data were delivered as processed Classified LAS 1.4 files formatted to 654 individual 1000 m x 1000 m tiles, as tiled intensity imagery, and as tiled bare earth DEMs; all tiled to the same 1000 m x 1000 m schema. Continuous breaklines were produced in Esri file geodatabase format.

Original Dataset Collection Ground Conditions: LiDAR was collected in spring 2023, while no snow was on the ground and rivers were at or below normal levels. In order to post process the LiDAR data to meet task order specifications and meet ASPRS vertical accuracy guidelines, NV5 Geospatial utilized a total of 13 ground control points that were used to calibrate the LiDAR to known ground locations established throughout the project area. An additional 41 independent accuracy checkpoints, 30 in Bare Earth and Urban landcovers (30 NVA points), 11 in Tall Weeds categories (11 VVA points), were used to assess the vertical accuracy of the data. These checkpoints were not used to calibrate or post process the data.

This metadata record supports the data entry in the NOAA Digital Coast Data Access Viewer (DAV). For this data set, the DAV is leveraging the USGS GeoTiff files hosted by USGS on Amazon Web Services.

Purpose:

To acquire detailed surface elevation data for use in conservation planning, design, research, floodplain mapping, dam safety assessments and elevation modeling, etc. Classified LAS files are used to show the manually reviewed bare earth surface. This allows the user to create intensity images, breaklines and raster DEMs. The purpose of these LiDAR data was to produce high accuracy 3D hydro-flattened digital elevation models (DEMs) with a 0.25 meter cell size. These raw LiDAR point cloud data were used to create classified LiDAR LAS files, intensity images, 3D breaklines, and hydro-flattened DEMs as necessary.

Supplemental Information:

Raster File Type = GeoTIFF; Bit Depth/Pixel Type = 32-bit float; Raster Cell Size = 0.25 meter; Interpolation or Resampling Technique = Triangulated Irregular Network (TIN), Linear Interpolation, Proprietary; Required Vertical Accuracy = 0.196

Keywords

Theme Keywords

Thesaurus Keyword
Global Change Master Directory (GCMD) Science Keywords
EARTH SCIENCE > LAND SURFACE > TOPOGRAPHY > TERRAIN ELEVATION
Global Change Master Directory (GCMD) Science Keywords
EARTH SCIENCE > LAND SURFACE > TOPOGRAPHY > TERRAIN ELEVATION > DIGITAL ELEVATION/TERRAIN MODEL (DEM)
Global Change Master Directory (GCMD) Science Keywords
EARTH SCIENCE > OCEANS > COASTAL PROCESSES > COASTAL ELEVATION
ISO 19115 Topic Category
elevation

Spatial Keywords

Thesaurus Keyword
Global Change Master Directory (GCMD) Location Keywords
CONTINENT > NORTH AMERICA > UNITED STATES OF AMERICA
Global Change Master Directory (GCMD) Location Keywords
CONTINENT > NORTH AMERICA > UNITED STATES OF AMERICA > CALIFORNIA
Global Change Master Directory (GCMD) Location Keywords
VERTICAL LOCATION > LAND SURFACE

Instrument Keywords

Thesaurus Keyword
Global Change Master Directory (GCMD) Instrument Keywords
LIDAR > Light Detection and Ranging

Platform Keywords

Thesaurus Keyword
Global Change Master Directory (GCMD) Platform Keywords
Airplane > Airplane

Physical Location

Organization: Office for Coastal Management
City: Charleston
State/Province: SC

Data Set Information

Data Set Scope Code: Data Set
Data Set Type: Elevation
Maintenance Frequency: None Planned
Data Presentation Form: Model (digital)
Distribution Liability:

Any conclusions drawn from the analysis of this information are not the responsibility of NOAA, the Office for Coastal Management or its partners.

Data Set Credit: NV5 Geospatial, USGS

Support Roles

Data Steward

CC ID: 1348195
Date Effective From: 2024
Date Effective To:
Contact (Organization): NOAA Office for Coastal Management (NOAA/OCM)
Address: 2234 South Hobson Ave
Charleston, SC 29405-2413
Email Address: coastal.info@noaa.gov
Phone: (843) 740-1202
URL: https://coast.noaa.gov

Distributor

CC ID: 1348194
Date Effective From: 2024
Date Effective To:
Contact (Organization): NOAA Office for Coastal Management (NOAA/OCM)
Address: 2234 South Hobson Ave
Charleston, SC 29405-2413
Email Address: coastal.info@noaa.gov
Phone: (843) 740-1202
URL: https://coast.noaa.gov

Distributor

CC ID: 1348198
Date Effective From: 2024
Date Effective To:
Contact (Organization): U.S. Geological Survey
Address: 12201 Sunrise Valley Drive
Reston, VA 20191
USA
URL: USGS Home

Metadata Contact

CC ID: 1348196
Date Effective From: 2024
Date Effective To:
Contact (Organization): NOAA Office for Coastal Management (NOAA/OCM)
Address: 2234 South Hobson Ave
Charleston, SC 29405-2413
Email Address: coastal.info@noaa.gov
Phone: (843) 740-1202
URL: https://coast.noaa.gov

Point of Contact

CC ID: 1348197
Date Effective From: 2024
Date Effective To:
Contact (Organization): NOAA Office for Coastal Management (NOAA/OCM)
Address: 2234 South Hobson Ave
Charleston, SC 29405-2413
Email Address: coastal.info@noaa.gov
Phone: (843) 740-1202
URL: https://coast.noaa.gov

Extents

Currentness Reference: Ground Condition

Extent Group 1

Extent Group 1 / Geographic Area 1

CC ID: 1348222
W° Bound: -122.516107825
E° Bound: -122.326425283
N° Bound: 37.8373975022
S° Bound: 37.6969866729

Extent Group 1 / Time Frame 1

CC ID: 1348221
Time Frame Type: Discrete
Start: 2023-04-20

Spatial Information

Spatial Representation

Representations Used

Grid: Yes
Vector: No
Text / Table: No
TIN: No
Stereo Model: No
Video: No

Reference Systems

Reference System 1

CC ID: 1348224

Coordinate Reference System

CRS Type: Vertical
EPSG Code: EPSG:5703
EPSG Name: NAVD88 height
See Full Coordinate Reference System Information

Reference System 2

CC ID: 1348384

Coordinate Reference System

CRS Type: Projected
EPSG Code: EPSG:7131
EPSG Name: NAD83(2011) / San Francisco CS13
See Full Coordinate Reference System Information

Access Information

Security Class: Unclassified
Data Access Procedure:

Data is available online for bulk and custom downloads.

Data Access Constraints:

None

Data Use Constraints:

Users should be aware that temporal changes may have occurred since this data set was collected and some parts of this data may no longer represent actual surface conditions. Users should not use this data for critical applications without a full awareness of its limitations.

Distribution Information

Distribution 1

CC ID: 1348199
Start Date: 2024-09-05
End Date: Present
Download URL: https://coast.noaa.gov/dataviewer/#/lidar/search/where:ID=10174/details/10174
Distributor: NOAA Office for Coastal Management (NOAA/OCM) (2024 - Present)
File Name: Customized Download
Description:

Create custom data files by choosing data area, map projection, file format, etc. A new metadata will be produced to reflect your request using this record as a base.

Distribution Format: Not Applicable
Compression: Zip

Distribution 2

CC ID: 1348200
Start Date: 2024
End Date: Present
Download URL: https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/OPR/Projects/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/TIFF/
Distributor: U.S. Geological Survey (2024 - Present)
File Name: Bulk Download
Description:

Bulk download of data files in GeoTiff format, San Francisco SC13 NAD83(2011), meters coordinates and elevations in NAVD88 (Geoid18) meters.

Distribution Format: GeoTIFF

URLs

URL 1

CC ID: 1348201
URL: https://coast.noaa.gov/dataviewer/
Name: NOAA's Office for Coastal Management (OCM) Data Access Viewer (DAV)
URL Type:
Online Resource
File Resource Format: HTML
Description:

The Data Access Viewer (DAV) allows a user to search for and download elevation, imagery, and land cover data for the coastal U.S. and its territories. The data, hosted by the NOAA Office for Coastal Management, can be customized and requested for free download through a checkout interface. An email provides a link to the customized data, while the original data set is available through a link within the viewer.

URL 2

CC ID: 1348204
URL: https://prd-tnm.s3.amazonaws.com/StagedProducts/Elevation/metadata/CA_SanFrancisco_B23/USGS_CA_SanFrancisco_B23_Project_Report.pdf
Name: USGS Project Report
URL Type:
Online Resource
File Resource Format: pdf
Description:

Link to the USGS Project Report that provides information about the project, vertical accuracy results, and the point classes and sensors used.

URL 3

CC ID: 1348205
URL: https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/metadata/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/
Name: USGS Additional Info
URL Type:
Online Resource
Description:

Link to the reports, breaklines, metadata, and spatial metadata.

URL 4

CC ID: 1348206
URL: https://prd-tnm.s3.amazonaws.com/StagedProducts/Elevation/metadata/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/reports/CA_SanFrancisco_LiDAR_ProjectReport.pdf
Name: Lidar Report
URL Type:
Online Resource
File Resource Format: pdf
Description:

Link to the lidar report.

Technical Environment

Description:

MicroStation Connect; TerraScan Version 21.016; STRIPALIGN 2.21 ; TerraModeler Version 21.008; GeoCue Version 2020.1.22.1; Esri ArcGIS 10.6; Global Mapper 19/20; RiProcess 1.8.6; Windows 10 Operating System

\\point_cloud\tilecls\*.las

Data Quality

Horizontal Positional Accuracy:

Lidar horizontal accuracy is a function of Global Navigation Satellite System (GNSS) derived positional error, f lying altitude, and INS derived attitude error. The obtained RMSEr value is multiplied by a conversion factor of 1.7308 to yield the horizontal component of the National Standards for Spatial Data Accuracy (NSSDA) reporting standard where a theoretical point will fall within the obtained radius 95% of the time. Based on a flying altitude of 1056 meters, an IMU error of 0.002 decimal degrees, and a GNSS positional error of 0.015 meters, this project was compiled to meet 0.12 meter horizontal accuracy at the 95% confidence level or 0.06 cm RMSEr.

Vertical Positional Accuracy:

This data set was produced to meet ASPRS Positional Accuracy Standard for Digital Geospatial Data (2014) for a 10-cm RMSEz Vertical Accuracy Class.

USGS Determined DEM Vertical Accuracy:

Tested NVA RMSEz = 1.63 cm

Tested 95th percentile value for VVA = 11.05 cm

For more information see the USGS project report and the lidar report. The links to these reports are provided in the URL section of this metadata record.

Completeness Report:

These LAS data files include all data points collected. No points have been removed or excluded. A visual qualitative assessment was performed to ensure data completeness. No void areas or missing data exist. The raw point cloud is of good quality and the data pass Non-Vegetated Vertical Accuracy specifications.

Conceptual Consistency:

Data cover the entire area specified for this project.

Data Management

Have Resources for Management of these Data Been Identified?: Yes
Approximate Percentage of Budget for these Data Devoted to Data Management: Unknown
Do these Data Comply with the Data Access Directive?: Yes
Actual or Planned Long-Term Data Archive Location: NCEI-NC
How Will the Data Be Protected from Accidental or Malicious Modification or Deletion Prior to Receipt by the Archive?:

Data is backed up to cloud storage.

Lineage

Lineage Statement:

The NOAA Office for Coastal Management (OCM) ingested references to the USGS GeoTiff files that are hosted on Amazon Web Services (AWS), into the Digital Coast Data Access Viewer (DAV). The DAV accesses the raster data as it resides on AWS.

Sources

USGS GeoTiff files

CC ID: 1348213
Contact Role Type: Publisher
Contact Type: Organization
Contact Name: USGS
Citation URL: https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/OPR/Projects/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/TIFF/
Citation URL Name: GeoTiff files for CA_SanFrancisco_1

Process Steps

Process Step 1

CC ID: 1348214
Description:

Raw Data and Boresight Processing: The boresight for each lift was done individually as the solution may change slightly from lift to lift. The following steps describe the Raw Data Processing and Boresight process: 1) Technicians processed the raw data to LAS format flight lines using the final GPS/IMU solution. This LAS data set was used as source data for boresight. 2) Technicians first used NV5 Geospatial proprietary and commercial software to calculate initial boresight adjustment angles based on sample areas selected in the lift. These areas cover calibration flight lines collected in the lift, cross tie, and production flight lines. These areas are well distributed in the lift coverage and cover multiple terrain types that are necessary for boresight angle calculation. The technicians then analyzed the results and made any necessary additional adjustment until it was acceptable for the selected areas. 3) Once the boresight angle calculation was completed for the selected areas, the adjusted settings were applied to all of the flight lines of the lift and checked for consistency. The technicians utilized commercial and proprietary software packages to analyze how well flight line overlaps matched for the entire lift and adjusted as necessary until the results met the project specifications. 4) Once all lifts were completed with individual boresight adjustment, the technicians checked and corrected the vertical misalignment of all flight lines and also the matching between data and ground truth. The relative accuracy was less than or equal to 7 cm RMSEz within individual swaths and less than or equal to 10 cm RMSEz or within swath overlap (between adjacent swaths). 5) The technicians ran a final vertical accuracy check of the boresighted flight lines against the surveyed checkpoints after the z correction to ensure the requirement of NVA = 19.6 cm 95% Confidence Level (Required Accuracy) was met.

Process Date/Time: 2024-01-01 00:00:00

Process Step 2

CC ID: 1348215
Description:

LAS Point Classification: The point classification is performed as described below. The bare earth surface is then manually reviewed to ensure correct classification on the Class 2 (Ground) points. After the bare-earth surface is finalized, it is then used to generate all hydro-breaklines through heads-up digitization. All ground (ASPRS Class 2) lidar data inside of the Lake Pond and Double Line Drain hydro flattening breaklines were then classified to water (ASPRS Class 9) using TerraScan macro functionality. A buffer of 0.5 feet was also used around each hydro-flattened feature to classify these ground (ASPRS Class 2) points to Ignored ground (ASPRS Class 10). All Lake Pond Island and Double Line Drain Island features were checked to ensure that the ground (ASPRS Class 2) points were reclassified to the correct classification after the automated classification was completed. All overlap data was processed through automated functionality provided by TerraScan to classify the overlapping flight line data to approved classes by USGS. The overlap data was classified using standard LAS overlap bit. These classes were created through automated processes only and were not verified for classification accuracy. Due to software limitations within TerraScan, these classes were used to trip the withheld bit within various software packages. These processes were reviewed and accepted by USGS through numerous conference calls and pilot study areas. All data was manually reviewed and any remaining artifacts removed using functionality provided by TerraScan and TerraModeler. Global Mapper us used as a final check of the bare earth dataset. GeoCue was then used to create the deliverable industry-standard LAS files for both the All Point Cloud Data and the Bare Earth. Proprietary software was used to perform final statistical analysis of the classes in the LAS files, on a per tile level to verify final classification metrics and full LAS header information.

Process Date/Time: 2024-01-01 00:00:00

Process Step 3

CC ID: 1348216
Description:

Maximum Surface Height Rasters were produced as ancillary data from the classified lidar point cloud in order to evaluate the withheld bit flag proof of performance for points that cannot be reasonably interpreted as valid surface returns. These were produced using all returns, withheld flagged points excluded, and using the highest elevation point value from each pixel. These rasters are 32-bit, floating point format and delivered as GeoTIFF files per tile. MSHR are generated from the point cloud data and will not be altered after creation nor will there be further maintenance on this product.

Process Date/Time: 2024-01-01 00:00:00

Process Step 4

CC ID: 1348217
Description:

Swath Separation Imagery was produced for the entire project area. Swath separation images use color-coding to illustrate differences in elevation (z-) values where swaths overlap. The color-coded images are semi-transparent and overlay the lidar intensity image. They are ancillary data used as visual aids to more easily identify regions within point cloud datasets that may have suspect interswath alignment or other geometric issues. Imagery was created using last returns with all classification and bit flags, except for noise and withheld bit flag are included. SSI are generated from the point cloud data and will not be altered after creation nor will there be further maintenance on this product.

Process Date/Time: 2024-01-01 00:00:00

Process Step 5

CC ID: 1348218
Description:

Hydro-Flattened Raster DEM Processing: Class 2 (Ground) LiDAR points in conjunction with the hydro-breaklines were used to create a 0.25 meter hydro-flattened raster DEM. Using automated scripting routines in proprietary software, GeoTIFF files were created for each tile. Each surface was reviewed using Global Mapper to check for any surface anomalies or incorrect elevations found within the surface.

Process Contact: U.S. Geological Survey

Process Step 6

CC ID: 1348219
Description:

The NOAA Office for Coastal Management (OCM) created references to the USGS GeoTiff files that were ingested into the NOAA Digital Coast Data Access Viewer (DAV). No changes were made to the data. The DAV will access the raster data as it resides on Amazon Web Services (AWS).

This is the location of the GeoTiffs that are being accessed:

https://prd-tnm.s3.amazonaws.com/index.html?prefix=StagedProducts/Elevation/OPR/Projects/CA_SanFrancisco_B23/CA_SanFrancisco_1_B23/TIFF/

Process Date/Time: 2024-09-16 00:00:00
Process Contact: Office for Coastal Management (OCM)

Related Items

Item Type Relationship Type Title
Data Set (DS) Cross Reference 2023 USGS Lidar: San Francisco, CA

Catalog Details

Catalog Item ID: 73506
GUID: gov.noaa.nmfs.inport:73506
Metadata Record Created By: Rebecca Mataosky
Metadata Record Created: 2024-09-16 14:58+0000
Metadata Record Last Modified By: Rebecca Mataosky
Metadata Record Last Modified: 2024-11-05 14:57+0000
Metadata Record Published: 2024-09-16
Owner Org: OCMP
Metadata Publication Status: Published Externally
Do Not Publish?: N
Metadata Last Review Date: 2024-09-05
Metadata Review Frequency: 1 Year
Metadata Next Review Date: 2025-09-05