VMS forms Output Tables

These output tables contain parsed and format validated data from the various VMS forms that are sent from any given vessel, while at sea, from the VMS devices on their vessels. Forms included are:

Catch reports for Herring, Multispecies, Scallop, Mackerel/Squid.

Preland reports for Herring, Scallop, Mackerel.

Monk overage reports - vessels can indicate if they've caught more monkfish than a trip allows, permitted under current regulations.

Trip start and trip end hails for Sector trips, RSA/EFP trips.

Gulf of Maine Cod trip limit exemption.

This dataset describes parsed and validated VMS data.

Many of these tables existed prior to the creation of the parsing engine and needed to have columns added or modified to accommodate the engine.

Server Room

Although the details vary with the form type, all forms contain the date/time the message was sent, latitude and longitude of the fishing vessel, and operator permit number. Many forms also contain a VTR number, date the fish were caught, estimated arrival time, estimated offload time, and number of pounds of the given species that were caught.

All fishing industry related data managed by IRM is considered to be business confidential and may not be released without written consent of the data originator.

Access to data is governed by 50CFR600 - Confidentiality of Information. Access by state fishery management agency staff and Fisheries Management Council staff may be allowed through Memorandum of Understanding that are signed by the Greater Atlantic Regional Administrator and Directors of the State Agency or Councils that describe the need and uses of the data and list the individuals who will have access to the data. Contractors may be granted access provided they are working under contract to NOAA or a cooperating partner (state, Council, Commission) on a specific project under the oversight of a partner.

Access is restricted to personnel authorized in accordance with NOAA Administrative Order 216-100. A signed non-disclosure agreement must be on file for all authorized personnel. The IRM help desk or APSD Data Request staff are the POC for non-disclosure forms.

Relational database.

N/A

N/A

N/A

N/A

N/A

N/A

100%

GARFO has established an "industry data investigation" (IDI) team whose responsibility is to investigate and correct data errors on GARFO's critical datasets including vessel trip reports, dealer reports, and various associated fishing activity reports, including VMS reports. QC on these datasets is performed regularly since data is securely displayed on various web portals to its owners. JIRA is the tool used for tracking quality control.

Access to this data is tightly controlled. Most access is read-only. Write access is given only after data owners have authorized (accompanied by a signed NDA), and data is usually edited via an access controlled application. Data is QAQC'd on a regular basis by authorized personnel, and backed up both to disk and tape on a daily basis.

This dataset is generated with the following steps:

1. Vessel enters fishing activity data into whatever specific VMS form(s) that his fishing activities require by regulation, and sends.

2. Data is transmitted via a satellite network directly to one of several data repositories, depending on the VMS equipment that the vessel is using.

3. GARFO and OLE have processes which work together to pull data securely and regularly from these repositories (of which there are several) into raw data tables.

4. A VMS parsing engine managed by GARFO pulls from these raw tables, validates each form for format and a few other validation types, then inserts validated data into production output tables.

5. These output tables can then be displayed in Fishtank, Fish Online, or used by a variety of data analysis processes.