6.0 DATA MANAGEMENT
Principal Investigator and GTE Project Office
responsibilities for data handling, submittal and publication are
defined in this section. The specifics of the data protocol and
schedules for data submittal and publications were developed and
agreed to by the TRACE-P Science Team.
6.1 Data Protocol
The purpose of the TRACE-P data protocol is to:
(1) encourage an orderly and timely analysis, interpretation and
publication of data obtained during integrated field expeditions
in pursuit of the goals of the NASA Tropospheric Chemistry Program;
(2) foster collaboration among investigator teams; and (3) establish
a procedure to produce an integrated expedition archive that will
serve as a central repository of data products to be released to
the public domain. Participation in this data protocol by investigators
from other collaborating investigating teams, will be in accordance with agreements between
the respective Science Teams and the TRACE-P Project.
Members of the TRACE-P Science Team and collaborating
investigators receiving TRACE-P data have agreed to this
TRACE-P protocol:
(a) All measurements and/or data products acquired
or developed as part of the TRACE-P mission by any member of the
TRACE-P Science Team will be submitted to the TRACE-P Data Archive
in the GTE Format described in Appendix
E;
(b) Measurements acquired during the field
deployment phase of the mission will be submitted to the GTE Data
Manager within 24 hours after each flight, will constitute the
TRACE-P Preliminary archive and may be used only by TRACE-P Science
Team members until the final archive is available. Model and meteorological
products will be submitted via ftp to the Science Team site, as
they become available, and become part of the data archive;
(c) The final submission of the TRACE-P measurements
and/or data products will be submitted to the GTE data archive
in accordance with the Data Products Schedule given in Section
8.2;
(d) Appropriate results of modeling and analyses in
support of the TRACE-P objectives will be provided to the GTE
Data Archive. Flight
planning products, except for those derived from ECMWF data,
will be available publicly as soon as they are available in the
archive;
(e) All members of the TRACE-P Science Team
will have free access to, and use of, all measurements and/or data
products in the Preliminary and Final TRACE-P Data Archive, except
as noted in this section;
(f) Neither measurements nor data products
emerging from analysis of the measurements in the Preliminary archive
may be published or used in any publication without the permission
of the PI responsible for the measurements or data products;
(g) All measurements and/or data products used
in presentations and publications shall be submitted to the GTE
Data archive;
(h) The first publication of results from the
TRACE-P mission shall be in a special issue or section of a scientific
journal selected by the Science Team and will be in accordance
with the Data Products Schedule in Section
8.2;
(i) Any TRACE-P Science Team member preparing
a part for the special publication which uses measurements and/or
data products submitted to the GTE archive by another PI (e. g.
paragraph (h)) must obtain permission from the PI and offer the
PI co-authorship on the publication;
(j) A member of the TRACE-P Science Team may present
his or her own data during a seminar or presentation. Use of another
PI’s data in a seminar requires the permission of the PI responsible
for the subject data;
(k) Publication of special papers prior to
the TRACE-P Special publication submission date may occur with
the permission of the TRACE-P Science Team members;
(l) PIs’ may incorporate their own measurements
and/or data products as well as analyses and preliminary texts
in their own web sites so long as the material is password-protected
for the TRACE-P Science Team members use prior to the special publication
submission date;
(m) Pre-public release exchange of TRACE P archive
products with other interested scientific groups is planned where
that group offers their data which is of interest to the TRACE
P Science Team in exchange. Members
of such groups will not make TRACE P products available to third
parties. Members of
groups requesting TRACE P products will agree to abide by this
protocol, as the TRACE P Science Team will agree to abide by their
protocol, prior to receiving any TRACE P products. The
TRACE P PI will be informed when data is requested by a non-TRACE
P collaborator, until the date when the TRACE P data becomes public. This
agreement will be in effect until each groups’ products are publicly
available. Agreements
for data exchange are in various stages of negotiation with the
groups indicated in Appendix N and others will be added as appropriate;
(n) The Data Protocol described in this section
will be effective until the submission date for the first special
publication for TRACE-P per the schedule in Section
8.2. Publication or presentation of TRACE-P measurements after
this date is encouraged and are not subject to this protocol:
(o) The Data Protocol described in this section will
be effective until the submission date for the first special
publication for TRACE P per the schedule in Section
8.2. Publication
or presentation of TRACE P measurements after this date is encouraged
and are not subject to this protocol;
6.1.1 TRACE-P Data Archive
Format
All data submitted to the TRACE-P Preliminary
Data Archive and to the Final Data Archive will be in the GTE Format
described in Appendix E.
6.1.2 Archive Data Submittal
All data and data products submitted for the Preliminary
and the Final Data Archive will be submitted to the GTE Data Manager.
Submittal to the Preliminary Archive Data will be on 3.5-inch disk.
Submittal to the Final Archive will be via FTP.
6.1.3 TRACE-P Data Archive
The TRACE-P Archive will consist of all measurements
and data products that are acquired or generated as part of the
TRACE-P mission. Tables
4.2-1, 4.2-2, 4.7-1,
and 4.8-1 define
the instrumentation, modeling activities, and satellite data analysis
activities that have been funded as part of the mission. Measurements
and products from the instrumentation and modeling investigations
will comprise the TRACE-P Data Archive. Data
from the satellite data analyses will be available on the individual
instrument web pages.
6.1.3.1 Preliminary Archive
During the field deployment phase of TRACE-P,
results from measurements acquired during each DC-8 and P-3B-B
flight will be submitted to the Data Manager in the standard archive
format described in Appendix E,
within 24 hours of completion of each flight. The Preliminary Data
Archive will be comprised of these field submissions. Use of the
Preliminary Archive will be governed by Data Protocol described
in Section 6.1.
6.1.3.2 Final Archive
The Final TRACE-P Archive will be comprised of
all measurements and data products emerging from the investigations
listed in Tables
4.2-1, 4.2-2,
and 4.7-1. Measurements
and data products will be submitted to the GTE Project Office in
the GTE Format described in Appendix
E (published separately) per the data schedule given in Section
8.2.
6.1.4 Data Handling and
Certification for Release to Archive
Investigators are responsible for acquiring, processing,
certifying, and reducing the data from their instruments and providing
required data products on schedule. Only certified data shall be
submitted to the GTE Data Manager for inclusion in the Final Data
Archive.
The GTE Data Manager will verify that all data
files submitted to the Preliminary Archive and the Final Archive
adheres to the GTE Archive format. Data files submitted to the
Final Archive will be further examined for logical consistency
with regard to the time sequence of the data entries, dates, position,
etc. Submissions that do not adhere to the format specification
and/or that have logical inconsistencies will be returned to the
investigator for correction and resubmission.
The Preliminary Archive will be available to the
TRACE-P Science Team at the conclusion of the field deployment
phase of the expedition. These data are preliminary and should
only be used by members of the TRACE-P Science Team per the restrictions
noted in Section 6.1.
The Final Archive will be released to the TRACE-P
Science Team via FTP per the data schedule in Section
8.3 to provide a period of 3 months for team validation of
the measurements prior to release to the Langley DAAC and to the
public via the GTE home page. GTE Data Archive CD-ROMs are also
produced and can be obtained from the GTE Data Archive web site
(http://www-gte.larc.nasa.gov/GTE_CD.html)
or by email. Please specify the number of CD-ROMs you require.
6.1.5 Data Release to DAAC
The GTE Data Manager will produce an expedition
archive of certified data for release to the Langley DAAC. The
archive will include all final data as submitted by investigators.
Public release of the final archive will be accomplished by submittal
of the archive to the Langley
DAAC, the GTE home
page web site, the GTE
anonymous FTP site, and through GTE Data Archive CD-ROM distribution
(see section 6.1.4).
6.1.6 Data Retrieval from
GTE and DAAC Archives
The Global Tropospheric Experiment (GTE) is among
the projects supported by the NASA-Langley DAAC. The most current
information about the GTE data sets archived can be found on the
GTE Home Page, http://www-gte.larc.nasa.gov/ or
on the Langley DAAC Home Page, http://eosweb.larc.nasa.gov/;
follow "Projects Supported" link.
Please contact the Langley DAAC User Services
staff with any questions about supported data sets, ordering instructions,
or problems with ordering data:
Langley DAAC Science, User and Data Support Office
NASA-Langley Research Center
Mail Stop 157D
Hampton, VA 23681-2199
Phone: (757) 864-8656
FAX: (757) 864-8807
E-Mail: larc@eos.nasa.gov
Retrieval of data from the GTE Data Archive is
described in Appendix E.
6.1.7 Presentations and
Publications
There will be no TRACE-P Science Team member presentations
or publications of TRACE-P data except by approval of the TRACE-P
Science Team or as defined in Section
6.1. Use of another investigator's data should be accompanied
by an offer for co-authorship and significant participation in
the development of any resulting publication and/or presentations.
6.2 Airborne Data Systems
The GTE Project Office will provide the data acquisition,
display, storage, distribution, and archival of housekeeping and
ancillary data during the TRACE-P Expedition. Basic aircraft housekeeping
data will be recorded and distributed to investigator stations
on board the DC-8 aircraft via the Data Acquisition and Distribution
System (DADS) as described in Appendix
F and to investigator stations on board the P-3B via the Project
Distribution System (PDS) as described in Appendix
G. The capability for real-time displays of selected housekeeping,
ancillary, and PI data sets during flight is provided on both aircraft
via the respective video distribution system. The PDS and DADS
will also provide the capability to record and display selected
PI measurements (per agreement of the respective PI). Provisions
for input of PI measurements to the PDS or DADS will be in analog
format with a range of ± 10 Volts. This data will be used for real-time
display purposes. A PI whose data is recorded by the PDS may notify
the Project Office within 24 hours after the flight to retain the
recorded data for submittal to the Preliminary Archive. Otherwise,
the recorded data will be removed and the PI must provide a data
file to the Preliminary Archive.
The GTE Project office will also produce preliminary
tabular and graphical summaries of the housekeeping and ancillary
data for each flight during the expedition. Final data analysis
and submittal of the housekeeping and ancillary data in the GTE
Archive will be in accordance with the data protocol schedule adopted
by the TRACE-P Science Team.
6.2.1 DADS (DC-8)
Housekeeping, ancillary, and selected PI measurements
will be recorded by DADS (Appendix
F) and video cameras. DADS will record and distribute the aircraft
navigational and meteorological data from the Navigational Management
System (NMS), which combines GPS and ground-based location data.
NMS is used by the DC-8 flight crew to incorporate GPS accuracy
with flight profiles. In addition DADS creates and distributes
a real time track map display with optional wind field data. NOAA
polar orbiter AVHRR satellite images captured in flight on the
Automatic Picture Transmission system (APT) are available on monitors
at investigator stations. DADS updates recorded parameters at 1
Hz and distributes a serial data stream throughout the aircraft
at transmission rates of 1200, 9600, and 19.2K baud. Tables F4 and F5 of Appendix
F list the parameters and describe the DADS serial data stream
format. All data parameters are in engineering units. Units are
not included in the data stream. Additional information on the
DADS is available in the DC-8 Airborne Laboratory Experimenters
Handbook. Table F7 lists
the ancillary measurements that are recorded by the DADS and information
recorded by video cameras. DADS will provide tabulated data sets
that can be selectively viewed on monitors located at PI instrument
racks.
6.2.2 PDS (P-3B)
The GTE-PDS (Appendix
G) is the primary data acquisition, display, and distribution
system for housekeeping and ancillary measurements on board the
P-3B aircraft. PDS system will record aircraft navigational and
meteorological data, ancillary measurements, and selected PI
measurements and distributes a serial data stream of these data
at 1 Hz throughout the aircraft at a transmission rate of 19.2K
baud. All data parameters are in engineering units. Units are
not included in the data stream. PDS will provide tabulated data
sets and plots that can be selectively viewed on monitors located
at various locations in the aircraft.
6.2.3 Recording Analog
Signals
The DADS/ICATS and PDS systems offer the capability
to record analog signals from selected investigator instruments.
The recorded data are merged with the housekeeping and ancillary
data and displayed in
tabular and graphical formats during each flight to assist
the Mission Scientists in assessing the overall mission status.
The measurements listed in Table
6.2.3-1 are recorded data for real-time display during flight.
Table 6.2.3-1: Measurements to be recorded displayed by
DADS/ICATS and PDS
Principal Investigator |
Organization |
Measurement |
Aircraft |
Anderson |
LaRC |
CN |
DC-8 |
Sachse |
LaRC |
CO, CH4 |
DC-8/P3-B |
Sandholm |
Ga. Tech. |
NO |
DC-8 |
Avery/Vay |
LaRC |
O3, CO2 |
DC-8/P-3B |
Barrick |
LaRC |
H2O Vapor |
DC-8/P-3B |
Clark |
U of Hawaii |
CN, scattering coeff. |
P-3B |
Kondo |
Nagoya U. |
NO, NOy |
P-3B |
Weber |
Ga. Tech. |
UCN, aerosol ions |
P-3B |
6.3 Data Timing
Both aircraft will be using GPS signals to generate Universal
Time (UT) to be used as the 1 Hz reference for data acquisition.
6.3.1 Time Reference
DADS and PDS will provide a standard IRIG B signal,
which may be used by PIs when a timing accuracy better than 1 second
is required. The IRIG B signal provides a timing pulse that is
accurate to 1 ms.
6.3.2 Data Recording Frequency
DADS and PDS will record selected PIs signals
along with housekeeping and ancillary data at 1 Hz. The mission
data will be available to PIs after flight completion in electronic
format as a field product. Time series and altitude summary plots
of key parameters will also be provided.
PI recording system(s) should operate at a frequency
appropriate to the phenomena being measured.
6.4 In-flight Data
The GTE Project Office is responsible for the
acquisition, display, storage, distribution, and archival of housekeeping
and ancillary data. DADS and PDS will provide data recorded from
the aircraft systems, selected PIs signals, images from cloud videos
and the Storm Scope. PIs are responsible for the acquisition, recording,
and archiving of their measurements.
6.4.1 Availability
The data collected by DADS and PDS will be made
available to PIs in visual tabular and graphical format via the
video distribution system. Data are also transmitted to PIs via
the serial distribution system in ASCII format (Section
6.4.2) on both aircraft.
6.4.2 Serial Data System
(SDS)
6.4.2.1 DADS (DC-8) SDS
The SDS is supported on the DC-8 by DADS. Serial
data parameters are transmitted via the SDS at 1200, 9600, and
19.2K baud rates. A parameter list and description of the serial
data block formats for the various baud rates are listed in Appendix
F (Tables F2-F5).
Data records are 392 characters in length and in ASCII format.
6.4.2.2 PDS (P-3B) SDS
The SDS is supported on the P-3B by PDS. Serial
data parameters are transmitted via the SDS at 19.2K baud rate.
The parameter list and block format is described in Appendix
G (Tables G1 and G2).
Data records are 392 characters in length and in ASCII format.
6.4.3 Video Distribution
System (VDS)
The VDS on the P-3B consists of flat-panel LCD
monitors. Monitors will be distributed throughout the P-3B to provide
visual access to all PIs. There will be four (4) displays available
that can be independently selected by the PIs on each monitor.
These displays include: (1) the primary alpha-numeric housekeeping
data, (2) selected graphical plots, (3) forward cloud camera view,
and (4) a quad-view of the storm scope display, nadir and forward
cloud camera, and selected graphical data plots.
The VDS on the DC-8 consists of various type monitors
located at PI instrument racks. There are several flight displays
available which can be selected independently by PIs. These displays
include: (1) alpha-numeric data, (2) graphical data, (3) track
plot, (4) Weather Satellite APT Receiver, and (5) optional displays
(e.g. LIDAR images). Further details are given in Appendix
F.
6.5 Data Products
Data products for the TRACE-P mission will be
comprised of all measurements and/or model generated parameters
from PI or GTE Project measurements. The P-3B PDS and DC-8 DADS
will convert all voltage signals to engineering units, where feasible,
and display subsets of data to the video display system Section
6.4.3) on board the aircraft. Table
F1 in Appendix F is an
example of the tabular data, which will be displayed on the DC-8
VDS, and Figure G2 in Appendix
G is the video screen, which will be displayed on the P-3B
VDS.
Distribution of the data products will be in the
form of a Preliminary Data Archive and the Final Data Archive.
The Preliminary Data Archive will be assembled using the field
data products available from PI's and Project measurements within
24 hours after each flight. The Final Data Archive will contain
final data submission of all PI measurements, Project measurements,
model-generated data products, and meteorological parameters acquired
during the field deployment.
6.5.1 Field Products
The TRACE-P Science Team has committed to a free
and open exchange of preliminary data in the field. Each investigator
will provide to the GTE Data Manager preliminary data from each
flight within 24 hours after flight completion. Preliminary data
recorded by the DADS and the PDS will be made available to the
Science Team within 24 hours following each flight. The field products
provided by investigators and the Project Office is preliminary
data. Use of this data shall be in accordance with Section
6.1.
The DC-8 DADS field data products include aircraft
position and parameter plots, diskettes containing the archived
DADS serial ASCII data stream, and printed copies of the Mission
Director's log files.
The GTE Project Office will produce preliminary
mission data summaries for each flight on both aircraft during
the expedition and provide copies to each PI group. The mission
summaries include the following:
1. One-minute averaged listings of key navigational/meteorological
parameters. These parameters include time, day, latitude, longitude,
altitude, cabin altitude, true air speed, ground speed, ground
track, wind speed, wind direction, static pressure, static air
temperature, dew/frost point, surface temperature, pitch, roll,
and UV (zenith & nadir).
2. Time series summary plots for the flight. Plot
types include position (latitude & longitude), and time series
of altitude, static air temperature, and dew/frost points (ozone
may also be included).
3. Altitude plots for each spiral or ramp flight
segment. These plots show the vertical distribution of static air
temperature and dew/frost points plotted vs. altitude with time
as a secondary axis.
The Project Office will also produce 10-second
averages of the housekeeping and ancillary data recorded during
each flight formatted in GTE Data
Archive Format, and recorded on 3.5" floppy disks. These may
be copied and used by investigator groups. The original video recordings
will be available for viewing in the field. Copies of these videotapes
will be distributed upon request post mission.
6.5.2 Data Products Distribution
The DC-8 DADS data (Table
F4, Appendix F) will
be converted to the GTE Archive Format under the direction of
the GTE Data Manager. The resulting data product will be distributed
in concert with final meteorological products to the Science
Team 60 days following the mission. Data recorded by the GTE
PDS on board the P-3B aircraft will also be distributed to the
Science Team 60 days following the mission.
Parameters to be included in these final data
products are identified in the Data Products Tables.
6.5.3 Archival Products
The Project Office serves as a central repository
and distribution center for all data products obtained during the
TRACE-P mission. The mission archive consists of all measurements
and/or model products developed as part of the TRACE-P mission.
Each investigator is responsible for submitting preliminary field
results to the GTE Data Manager, or his designee, within 24 hours
after each flight for distribution to the Science Team during the
mission. Final validated results from the mission must be submitted
to the GTE Data Manager within 60 days following completion of
the field deployment phase. The GTE Data Manager is responsible
for submitting the TRACE-P data to the Langley Distributed Active
Archive Center, which will be the repository for all the mission
data.
The Project Office, with the Co-Mission Meteorologists,
will arrange for the acquisition, and subsequent distribution to
the Science Team, of meteorological data supporting the mission
objectives. These data include meteorological products for flight
planning and post mission products to support analysis and publication
of results.
Data platforms, measurement techniques, species
measured, and modeling activities are described in section
4.0. Measurements and products included in the archive are
listed in Tables
4.2-1, 4.2-2,
and 4.7-1. Meteorological
data sources are discussed in Section
5.4 and meteorological products to be submitted to the archive
are listed in Table
5.4-1. All data products should be submitted in the GTE Data
Archive Format (Appendix E, published
as a separate document). Schedules for submission of data to the
archive and distribution of the archive are given in Table
8.2-1.
6.5.4 Expedition Archive
The final data submitted by the investigators will be scanned
by the GTE Project Office to ensure that the data has been submitted
in the proper format prior to release to the public domain. Public
release of the expedition archive will be to the Langley DAAC (refer
to Section 6.1.6).
6.6 Data Analysis/Publication
Plan
Early and comprehensive publication of GTE TRACE-P
results is a primary objective of the Science Team. Each PI is
responsible for producing publication products in support of this
objective. All published data must be submitted to the mission
archive.
6.6.1 Data Workshops
Three data workshops are anticipated following
the mission. Data Workshop 1 will provide the first opportunity
for participants to discuss and review the complete set of field
measurements. Data Workshop 2, following the submittal of model
results, will focus on model/measurement results and initiation
of outlines for journal papers. Data Workshop 3 will be scheduled
at the first workshop and focus on review of draft manuscripts.
The schedule for data workshops 1 and 2 are given in Section
8.2.
6.6.2 Conference Presentation
Oral presentations of selected results by investigators
prior to manuscript submission to the selected journal may take
place at a conference to be determined by the TRACE-P Science Team
at the first workshop. Copies of presentation abstracts shall also
be sent to the GTE Project Manager at the time of submittal to
the conference. Presentation of results at other meetings before
manuscript submission must be approved by the Science Team.
6.6.3 Journal Special Issue
Initial publication of results from the TRACE-P
Expedition will be in a special issue of an appropriate journal
to be determined by the Science Team at the first workshop. Copies
of papers should be sent to the GTE Project Manager for inclusion
in the mission archive and for summary in the overview paper of
significant results.
6.6.4 Collaborating Science
Team Usage of Measurements
The protocol for exchange of TRACE-P measurements
and data products with other collaborating Science Teams will be
governed by agreements between the respective Science Teams and
signed by the GTE Project Office and the respective representative
of the collaborating Science Team. Collaboration between all such
Science Teams requires the approval of the GTE Program Manager.
Back
to Expedition Plan Table of Contents