2018 - 2020 NOAA USGS Lidar: Hawaii, HI
Data Set (DS) | Office for Coastal Management (OCM)GUID: gov.noaa.nmfs.inport:68082 | Updated: October 17, 2023 | Published / External
Summary
Short Citation
Office for Coastal Management, 2024: 2018 - 2020 NOAA USGS Lidar: Hawaii, HI, https://www.fisheries.noaa.gov/inport/item/68082.
Full Citation Examples
Product: Processed, classified lidar point cloud data tiles in LAS 1.4 format.
Geographic Extent: Approximately 4,028 square miles encompassing the Big Island of Hawaii.
Dataset Description: The HI Hawaii Island Lidar NOAA 2017 B17 lidar project called for the planning, acquisition, processing, and production of derivative products of lidar data to be collected at a nominal pulse spacing (NPS) of 0.35 meters. Project specifications were based on the U.S. Geological Survey National Geospatial Program Base Lidar Specification 2020 Revision A. The data was developed based on a horizontal datum/projection of NAD83 (PA11) UTM Zone 5N Meters (EPSG 6635) and a vertical datum of NAVD88 (GEOID12B) Meters. Lidar data was delivered as processed LAS 1.4 files formatted to 8,629 individual 1,000-meter x 1,000-meter tiles.
Ground Conditions: Lidar was collected from January 30, 2018 through January 6, 2020 by Leica Geosystems, Inc. while no snow was on the ground and rivers were at or below normal levels. In order to post process the lidar data to meet task order specifications and meet ASPRS vertical accuracy guidelines, Woolpert established 70 ground control points that were used to calibrate the lidar to known ground locations established throughout the project area. Additional independent accuracy checkpoints were collected by NOAA and used to assess the vertical accuracy of the data. These checkpoints were not used to calibrate or post process the data.
This dataset has been noted to have issues with ground classification in areas of dense vegetation. Please read the data use constraints section for further details.
Distribution Information
-
Create custom data files by choosing data area, product type, map projection, file format, datum, etc. A new metadata will be produced to reflect your request using this record as a base. Change to an orthometric vertical datum is one of the many options.
-
LAS/LAZ - LASer
Bulk download of data files in LAZ format, geographic coordinates, orthometric heights. Note that the vertical datum (hence elevations) of the files here are different than described in this document. They will be in an orthometric datum.
None
Users should be aware that temporal changes may have occurred since this data set was collected and some parts of this data may no longer represent actual surface conditions. Users should not use this data for critical applications without a full awareness of its limitations.
Areas of dense vegetation will have fewer points that reach the ground. In some areas, this may be enough to inhibit ground classification of the points. If those areas are near cliffs, it is possible for elevation models derived from these points to imply false cliff conditions. There are areas of this dataset where these conditions have been noted. Care should be taken to note voids in ground classifications and interpret any derived products appropriately.
Controlled Theme Keywords
COASTAL ELEVATION, elevation, TERRAIN ELEVATION
Child Items
No Child Items for this record.
Contact Information
Point of Contact
NOAA Office for Coastal Management (NOAA/OCM)
coastal.info@noaa.gov
(843) 740-1202
https://coast.noaa.gov
Metadata Contact
NOAA Office for Coastal Management (NOAA/OCM)
coastal.info@noaa.gov
(843) 740-1202
https://coast.noaa.gov
Extents
-156.073778° W,
-155.057848° E,
20.280495° N,
18.903687° S
2018-01-30 - 2020-01-06
Item Identification
Title: | 2018 - 2020 NOAA USGS Lidar: Hawaii, HI |
---|---|
Short Name: | 2018 big island lidar m9635 |
Status: | Completed |
Publication Date: | 2020-12-29 |
Abstract: |
Product: Processed, classified lidar point cloud data tiles in LAS 1.4 format. Geographic Extent: Approximately 4,028 square miles encompassing the Big Island of Hawaii. Dataset Description: The HI Hawaii Island Lidar NOAA 2017 B17 lidar project called for the planning, acquisition, processing, and production of derivative products of lidar data to be collected at a nominal pulse spacing (NPS) of 0.35 meters. Project specifications were based on the U.S. Geological Survey National Geospatial Program Base Lidar Specification 2020 Revision A. The data was developed based on a horizontal datum/projection of NAD83 (PA11) UTM Zone 5N Meters (EPSG 6635) and a vertical datum of NAVD88 (GEOID12B) Meters. Lidar data was delivered as processed LAS 1.4 files formatted to 8,629 individual 1,000-meter x 1,000-meter tiles. Ground Conditions: Lidar was collected from January 30, 2018 through January 6, 2020 by Leica Geosystems, Inc. while no snow was on the ground and rivers were at or below normal levels. In order to post process the lidar data to meet task order specifications and meet ASPRS vertical accuracy guidelines, Woolpert established 70 ground control points that were used to calibrate the lidar to known ground locations established throughout the project area. Additional independent accuracy checkpoints were collected by NOAA and used to assess the vertical accuracy of the data. These checkpoints were not used to calibrate or post process the data. This dataset has been noted to have issues with ground classification in areas of dense vegetation. Please read the data use constraints section for further details. |
Purpose: |
This data is intended for use in coastal management decision making, including applications such as support for local hydrologists and watershed managers in their decision-making processes and for formulating a sediment budget and identifying soil erosion hotspots. |
Supplemental Information: |
USGS Contract No. G16PC00022, NOAA Contract No. EA133C33CQ0010. USGS Task Order No. G17PD01353. NOAA Task Order No. T-0040. CONTRACTOR: Woolpert. Sub-contractor: Leica Geosystems, Inc. This work was funded by: NOAA Office for Coastal Management, FEMA Region 9, FEMA HQ, USDA NRCS, County of Hawaii, USGS HVO, and USGS 3DEP The following are the USGS lidar fields in JSON: {
"ldrinfo" : {
"ldrspec" : "USGS NGP Base Specifications v1.2", "ldrsens" : "Leica SPL 100", "ldrmaxnr" : "2000", "ldrnps" : "0.35", "ldrdens" : "8", "ldranps" : "0.35", "ldradens" : "8", "ldrfltht" : "3200-4420", "ldrfltsp" : "180", "ldrscana" : "30", "ldrscanr" : "21.0", "ldrpulsr" : "50.0", "ldrpulsd" : "0.5", "ldrpulsw" : "0.149", "ldrwavel" : "532", "ldrmpia" : "0", "ldrbmdiv" : "0.08", "ldrswatw" : "2000", "ldrswato" : "20", "ldrgeoid" : "GEOID12B" }, "ldraccur" : {
"ldrchacc" : "0", "rawnva" : "0", "rawnvan" : "0", "clsnva" : "0", "clsnvan" : "0", "clsvva" : "0", "clsvvan" : "0" }, "lasinfo" : {
"lasver" : "1.4", "lasprf" : "6", "laswheld" : "Geometrically unreliable points were identified using a combination of automated and manual techniques and subsequently classified as high or low noise and given the standard Withheld bit.", "lasolap" : "Swath "overage" points were identified in these files using the standard LAS overlap bit.", "lasintr" : "16", "lasclass" : {
"clascode" : "1", "clasitem" : "Processed but not classified" }, "lasclass" : {
"clascode" : "2", "clasitem" : "Bare earth ground" }, "lasclass" : {
"clascode" : "5", "clasitem" : "Vegetation" }, "lasclass" : {
"clascode" : "7", "clasitem" : "Noise" }, "lasclass" : {
"clascode" : "9", "clasitem" : "Water" }, "lasclass" : {
"clascode" : "10", "clasitem" : "Ignored ground" }, "lasclass" : {
"clascode" : "17", "clasitem" : "Bridge Decks" }, "lasclass" : {
"clascode" : "18", "clasitem" : "High Noise" } }} |
Keywords
Theme Keywords
Thesaurus | Keyword |
---|---|
Global Change Master Directory (GCMD) Science Keywords |
EARTH SCIENCE > LAND SURFACE > TOPOGRAPHY > TERRAIN ELEVATION
|
Global Change Master Directory (GCMD) Science Keywords |
EARTH SCIENCE > OCEANS > COASTAL PROCESSES > COASTAL ELEVATION
|
ISO 19115 Topic Category |
elevation
|
Spatial Keywords
Thesaurus | Keyword |
---|---|
Global Change Master Directory (GCMD) Location Keywords |
CONTINENT > NORTH AMERICA > UNITED STATES OF AMERICA
|
Global Change Master Directory (GCMD) Location Keywords |
CONTINENT > NORTH AMERICA > UNITED STATES OF AMERICA > HAWAII
|
Global Change Master Directory (GCMD) Location Keywords |
VERTICAL LOCATION > LAND SURFACE
|
UNCONTROLLED | |
None | Hawaii County |
Instrument Keywords
Thesaurus | Keyword |
---|---|
Global Change Master Directory (GCMD) Instrument Keywords |
LIDAR > Light Detection and Ranging
|
Platform Keywords
Thesaurus | Keyword |
---|---|
Global Change Master Directory (GCMD) Platform Keywords |
Airplane > Airplane
|
Physical Location
Organization: | Office for Coastal Management |
---|---|
City: | Charleston |
State/Province: | SC |
Data Set Information
Data Set Scope Code: | Data Set |
---|---|
Data Set Type: | Elevation |
Maintenance Frequency: | None Planned |
Data Presentation Form: | Model (digital) |
Distribution Liability: |
Any conclusions drawn from the analysis of this information are not the responsibility of NOAA, the Office for Coastal Management or its partners |
Data Set Credit: | NOAA, USGS, Woolpert |
Support Roles
Data Steward
Date Effective From: | 2022 |
---|---|
Date Effective To: | |
Contact (Organization): | NOAA Office for Coastal Management (NOAA/OCM) |
Address: |
2234 South Hobson Ave Charleston, SC 29405-2413 |
Email Address: | coastal.info@noaa.gov |
Phone: | (843) 740-1202 |
URL: | https://coast.noaa.gov |
Distributor
Date Effective From: | 2022 |
---|---|
Date Effective To: | |
Contact (Organization): | NOAA Office for Coastal Management (NOAA/OCM) |
Address: |
2234 South Hobson Ave Charleston, SC 29405-2413 |
Email Address: | coastal.info@noaa.gov |
Phone: | (843) 740-1202 |
URL: | https://coast.noaa.gov |
Metadata Contact
Date Effective From: | 2022 |
---|---|
Date Effective To: | |
Contact (Organization): | NOAA Office for Coastal Management (NOAA/OCM) |
Address: |
2234 South Hobson Ave Charleston, SC 29405-2413 |
Email Address: | coastal.info@noaa.gov |
Phone: | (843) 740-1202 |
URL: | https://coast.noaa.gov |
Point of Contact
Date Effective From: | 2022 |
---|---|
Date Effective To: | |
Contact (Organization): | NOAA Office for Coastal Management (NOAA/OCM) |
Address: |
2234 South Hobson Ave Charleston, SC 29405-2413 |
Email Address: | coastal.info@noaa.gov |
Phone: | (843) 740-1202 |
URL: | https://coast.noaa.gov |
Extents
Currentness Reference: | Ground Condition |
---|
Extent Group 1
Extent Group 1 / Geographic Area 1
W° Bound: | -156.073778 | |
---|---|---|
E° Bound: | -155.057848 | |
N° Bound: | 20.280495 | |
S° Bound: | 18.903687 |
Extent Group 1 / Time Frame 1
Time Frame Type: | Range |
---|---|
Start: | 2018-01-30 |
End: | 2020-01-06 |
Spatial Information
Spatial Resolution
Horizontal Distance: | 0.35 Meter |
---|
Spatial Representation
Representations Used
Grid: | No |
---|---|
Vector: | Yes |
Text / Table: | No |
TIN: | No |
Stereo Model: | No |
Video: | No |
Vector Representation 1
Point Object Present?: | Yes |
---|---|
Point Object Count: | 112953918556 |
Reference Systems
Reference System 1
Coordinate Reference System |
|||||||||||||||||||||||||||||||||||||||||||||||||||
|
Access Information
Security Class: | Unclassified |
---|---|
Data Access Procedure: |
Data is available online for bulk or custom downloads |
Data Access Constraints: |
None |
Data Use Constraints: |
Users should be aware that temporal changes may have occurred since this data set was collected and some parts of this data may no longer represent actual surface conditions. Users should not use this data for critical applications without a full awareness of its limitations. Areas of dense vegetation will have fewer points that reach the ground. In some areas, this may be enough to inhibit ground classification of the points. If those areas are near cliffs, it is possible for elevation models derived from these points to imply false cliff conditions. There are areas of this dataset where these conditions have been noted. Care should be taken to note voids in ground classifications and interpret any derived products appropriately. |
Distribution Information
Distribution 1
Start Date: | 2022-10-25 |
---|---|
End Date: | Present |
Download URL: | https://coast.noaa.gov/dataviewer/#/lidar/search/where:ID=9635/details/9635 |
Distributor: | NOAA Office for Coastal Management (NOAA/OCM) (2022 - Present) |
File Name: | Customized Download |
Description: |
Create custom data files by choosing data area, product type, map projection, file format, datum, etc. A new metadata will be produced to reflect your request using this record as a base. Change to an orthometric vertical datum is one of the many options. |
File Type (Deprecated): | Zip |
Compression: | Zip |
Distribution 2
Start Date: | 2022-10-25 |
---|---|
End Date: | Present |
Download URL: | https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid12b/9635/index.html |
Distributor: | NOAA Office for Coastal Management (NOAA/OCM) (2022 - Present) |
File Name: | Bulk Download |
Description: |
Bulk download of data files in LAZ format, geographic coordinates, orthometric heights. Note that the vertical datum (hence elevations) of the files here are different than described in this document. They will be in an orthometric datum. |
File Type (Deprecated): | LAZ |
Distribution Format: | LAS/LAZ - LASer |
Compression: | Zip |
URLs
URL 1
URL: | https://coast.noaa.gov/dataviewer/ |
---|---|
Name: | NOAA's Office for Coastal Management (OCM) Data Access Viewer (DAV) |
URL Type: |
Online Resource
|
File Resource Format: | HTML |
Description: |
The Data Access Viewer (DAV) allows a user to search for and download elevation, imagery, and land cover data for the coastal U.S. and its territories. The data, hosted by the NOAA Office for Coastal Management, can be customized and requested for free download through a checkout interface. An email provides a link to the customized data, while the original data set is available through a link within the viewer. |
URL 2
URL: | https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid12b/9635/supplemental/2018-2020_bigIsland_extent_m9635.kmz |
---|---|
Name: | Browse graphic |
URL Type: |
Browse Graphic
|
File Resource Format: | KML |
Description: |
This graphic displays the footprint for this lidar data set. |
URL 3
URL: | https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid12b/9635/supplemental/HI_Hawaii_Island_Lidar_NOAA_2017_B17_Lidar_Report.pdf |
---|---|
Name: | Contractor Report |
URL Type: |
Online Resource
|
File Resource Format: | |
Description: |
Project report by the contractor. Describes the project and data prior to any NOAA changes. |
URL 4
URL: | https://noaa-nos-coastal-lidar-pds.s3.amazonaws.com/laz/geoid12b/9635/supplemental/Low_confidence_polygons.zip |
---|---|
Name: | low confidence areas |
URL Type: |
Online Resource
|
File Resource Format: | zip |
Description: |
Geospatial features indicating where there is low confidence in the ground values. |
Issues
Issue 1
Issue Date: | 2022-10-25 |
---|---|
Author: | Waters, Kirk |
Issue: |
Full list of contributors still needs to be added. |
Technical Environment
Description: |
Microsoft Windows 10 Version 1607 (Build 14393.2189); ArcMap 10.7; ArcCatalog 10.7; TerraScan ver. 20; TerraModeler ver. 20; Geocue 2018.2.59.5. |
---|
Data Quality
Vertical Positional Accuracy: |
NOAA collected independent checkpoints located in non-vegetated and vegetated land cover classes in order to perform independent vertical accuracy testing on the lidar point cloud swath and DEM data. Preliminary quantitative value: 0.11 meters RMSE in non-vegetated areas, 0.50 m in vegetated areas. These figures were calculated by Woolpert using the NOAA checkpoints. USGS Determined Vertical Accuracy: Non-Vegetated Vertical Accuracy (NVA) = 21.09 cm at 95% Confidence Level or 10.65 cm RMSE Vegetated Vertical Accuracy (VVA) = 90.91 cm at the 95th Percentile |
---|---|
Completeness Report: |
A visual qualitative assessment was performed to ensure data completeness. |
Conceptual Consistency: |
Data covers the entire area specified for this project. |
Data Management
Have Resources for Management of these Data Been Identified?: | Yes |
---|---|
Approximate Percentage of Budget for these Data Devoted to Data Management: | Unknown |
Do these Data Comply with the Data Access Directive?: | Yes |
Actual or Planned Long-Term Data Archive Location: | NCEI-CO |
How Will the Data Be Protected from Accidental or Malicious Modification or Deletion Prior to Receipt by the Archive?: |
Data is backed up to cloud storage. |
Lineage
Sources
classified lidar data
Contact Role Type: | Originator |
---|---|
Contact Type: | Organization |
Contact Name: | Woolpert |
Publish Date: | 2022-10-14 |
Process Steps
Process Step 1
Description: |
Lidar Point Cloud Classification: The Single Photon Lidar (SPL) data acquisition was acquired at a density greater than the task order specified density of QL1 or 8 points per square meter. USGS and NOAA agreed the density of the data should be reduced to provide a more manageable data set. The data was decimated to provide a density not less than 8 points per square meter, however due to significant overlap of acquisition flight lines in some areas of the project, the density in some cases exceeds 8 points per square meter. The Single Photon Lidar (SPL) data acquisition occurred between multiple acquisition seasons creating significant data overlap between seasons. To reduce excessive density, the data was processed to eliminate excess overlap in these areas. The point cloud underwent a classification process to determine bare-earth points and non-ground points utilizing "first and only" as well as "last of many" lidar returns. This process determined Processed, but Unclassified (Class 1), Bare Earth Ground (Class 2), Vegetation (Class 5), Low Noise (Class 7), Water (Class 9), Ignored Ground (Class 10), Bridge Decks (Class 17), and High Noise (Class 18). The bare-earth (Class 2 - Ground) lidar points underwent a manual QA/QC step to verify the quality of the DEM as well as a peer-based QC review. This included a review of the DEM surface to remove artifacts and ensure topographic quality. |
---|---|
Process Date/Time: | 2020-12-29 00:00:00 |
Process Step 2
Description: |
After the bare-earth surface is finalized, it is then used to generate all hydro-breaklines through a semi-automated process. All ground (Class 2) lidar data inside of the Lake Pond and Double Line Drain hydro flattening breaklines were then classified to water (Class 9) using TerraScan/LP360 macro functionality. A buffer of 0.7 meters was also used around each hydro-flattened feature to classify these ground (Class 2) points to Ignored ground (Class 10). All Lake Pond Island and Double Line Drain Island features were checked to ensure that the ground (Class 2) points were reclassified to the correct classification after the automated classification was completed. These classes were created through automated processes only and were not verified for classification accuracy. Due to software limitations within TerraScan, these classes were used to trip the withheld bit within various software packages. These processes were reviewed and accepted by USGS through numerous conference calls and pilot study areas. |
---|---|
Process Date/Time: | 2020-12-29 00:00:00 |
Process Step 3
Description: |
The single photon lidar data acquisition for this award occurred across two separate deployments. The approximate date range of the first acquisition window was from January 2018 to March 2018 and second window was from November 2019 to January 2020. Given the complexity of the terrain, the flight plan for the project included significant overlapping and off-angle lines between the 2018 and 2019/2020 collection which can create more opportunity to notice differences than is normally seen in a lidar collection where lines tend to follow a single direction and acquisition across years is cut into more complete blocks. For each acquisition season, the acquired data was processed and geometrically calibrated by Woolpert's teaming and data acquisition partner Hexagon. During the calibration, the data was processed to meet the required accuracy specifications per each mission as well as between adjacent missions of the differing flight dates within a given acquisition season. Once the calibration was complete and the data entered full processing, Woolpert made the best efforts to populate delivery tiles containing flights from different acquisition seasons with data acquired from a single season. In these tiles preference was given to the points acquired during the 2018 season because of the significant data processing had occurred within these tiles prior to the second acquisition season. In some areas pieces of lines from the different acquisitions created the edge artifacts. Low confidence polygons were generated around these areas to make the user aware of the discrepancy. All data was manually reviewed and any remaining artifacts removed using functionality provided by TerraScan and TerraModeler. Global Mapper was used as a final check of the bare earth dataset. GeoCue was then used to create the deliverable industry-standard LAS files. Woolpert proprietary software and LP360 was used to perform final statistical analysis of the classes in the LAS files, on a per tile level to verify final classification metrics and full LAS header information. |
---|---|
Process Date/Time: | 2020-12-29 00:00:00 |
Process Step 4
Description: |
NOAA Office for Coastal Management received the classified point cloud data from Woolpert in Orthometric (Geoid12b) NAD83(PA11) UTM zone 5 coordinates with units of meters. An examination of the histograms of height by class indicated that some issues with low points. The withheld points were removed as being geometrically unreliable. In addition, all points below -30 meters were reclassed to low noise (class 7). Data were converted to geographic coordinates in ellipsoid heights for use in the Data Access Viewer. |
---|---|
Process Date/Time: | 2022-10-18 00:00:00 |
Process Contact: | NOAA Office for Coastal Management (NOAA/OCM) |
Phone (Voice): | (843) 740-1202 |
Email Address: | coastal.info@noaa.gov |
Source: | classified lidar data |
Process Step 5
Description: |
The point clouds for two tiles (5QKB800850.laz and 5QKB810850.laz) were re-examined to find ground points near the cliffs. The lack of ground points identified near the edge caused issues in DEM generation as the TIN process was cutting off the cliffs. This work was done by the original lidar contractor, Woolpert. The original tiles were replaced with the new tiles. |
---|---|
Process Date/Time: | 2023-04-14 00:00:00 |
Process Contact: | NOAA Office for Coastal Management (NOAA/OCM) |
Phone (Voice): | (843) 740-1202 |
Email Address: | coastal.info@noaa.gov |
Related Items
Item Type | Relationship Type | Title |
---|---|---|
Data Set (DS) | Cross Reference |
2018-2020 HI Hawaii Island Lidar Hydro-Flattened Bare-Earth DEM Digital Elevation Model derived from this point cloud |
Catalog Details
Catalog Item ID: | 68082 |
---|---|
GUID: | gov.noaa.nmfs.inport:68082 |
Metadata Record Created By: | Kirk Waters |
Metadata Record Created: | 2022-10-25 13:10+0000 |
Metadata Record Last Modified By: | SysAdmin InPortAdmin |
Metadata Record Last Modified: | 2023-10-17 16:12+0000 |
Metadata Record Published: | 2022-10-28 |
Owner Org: | OCM |
Metadata Publication Status: | Published Externally |
Do Not Publish?: | N |
Metadata Last Review Date: | 2022-10-25 |
Metadata Review Frequency: | 2 Years |
Metadata Next Review Date: | 2024-10-25 |