Data dictionary instructions
It is required to include a data dictionary (_dd.csv) for each csv file in a dataset, or a single data dictionary file for an entire dataset. As mentioned in the detailed instructions for the terminology file, it may be useful to generate a master terminology file that includes the required (and optional) fields for all csv files and then pull from there the relevant fields for each _dd.csv file. Figure 1 shows an example of how a master terminology file could be structured to comply with the _dd.csv template as well as the terminology template (i.e., by including the “Unit” and “Column_or_Row_Long_Name” fields, as well as “Term_Type”) in order to allow for a single master file collection of all terminology used within a dataset/project/team etc. Note that the Column header “Term” should be replaced by “Column_or_Row_Name” in all _dd.csv files.
The following instructions are from the ESS-DIVE file level metadata reporting format and are designed to facilitate File-Level Metadata extraction of some fields using the File Level Metadata Extractor.
- 1.Create a CSV data dictionary using the CSV_dd_template. You can create either:a. One data dictionary for each data file orb. One data dictionary representing all data files in your dataset
- 3.Enter a new row in the data dictionary for each column/row name in your data matrixa. Use "*" wildcard when the description applies to multiple column/row namesb. For example - if the same description applies to all spectra data column names in the data file(s)
- 1.one row in the data dictionary can refer to "wave_*" and this definition will be understood to apply to multiple column names within a data sheet
- 5.Save the CSV_dd template following the CSV Reporting Format guidance with the filename "dd.csv" or "*_dd.csv". Alternatively you may choose to name you data dictionary:a. With the same name as the associated data file, but include '_dd.csv' at the end of the file nameb. Create a unique filename for your data dictionaryc. Incorporate a wildcard into the filename if data dictionary applies to multiple data files (for example - "soil_cores_*_dd.csv")
Following the recommended format and structure of the CSV Reporting Format will facilitate File-Level Metadata extraction of some fields using the File Level Metadata Extractor.
Diagram showing an example terminology file with terms used by a project. This diagram includes terms, their definitions, and other important information about the terms. This template includes both required and optional fields.
Figure 1. Example of a terminology file that is structured to include all terms used by a project (i.e. including headers etc that are required in the _dd.csv files) - i.e., serving as a complete dictionary. Note that the shaded fields are the only ones required for a terminology file included as part of a water-soil-sed-chem dataset, and the unshaded (appearing white) fields are added because they are required in the _dd.csv files. If you prefer to keep the data dictionaries and the other terminology files separate, then disregard columns B and D above for the terminology file and remove column E (Term_Type) for the data dictionary files.