DEOS SHEFout Program Operations Guide

DEOS Technical Note #10

Dr. Geoffrey E. Quelch

Research Fellow,
University of Delaware,
Center for Climatic Research


   University of Delaware
   NewarkDE 19716
   
  

Version 2

All material herein is copyright by the Delaware Environmental Observing System

Published: August 20th 2004

Revision History
Revision 1.12004/08/20GEQ
Initial version
Revision 1.22004/09/09GEQ
Added the offset option.
Revision 1.32004/11/19GEQ
Added the sheffilename option.
Revision 1.42005/03/25GEQ
Major revision to the command line arguments, removed those beginning "SHEF".
Revision 1.52006/07/13GEQ
Corrected description of program and other errors.
Revision 2.12006/09/26GEQ
Incremented version number of this document to 2.

Abstract

This technical note describes the DEOS shefout program, and the options for its use.


Table of Contents

Introduction
Running the Program
Command Line Options
User Option
Password Option
Database Option
Stream Option
Time Option
Offset Option
Range Option
Verbose Option
Help Option
Database Parameters
Data_Types
Operational Use

Introduction

The DEOS shefout function provides the capability to extract data from the database for a specified time period, create a SHEF format file and transfer it to a designated recipient host.

Running the Program

The program is executed by the command shefout from the command line.

shefout { -u user-name | --user user-name } { -p password | --password password } { -d database | --database database } { -s stream | --stream-name stream } [ -t timestring | --time timestring ] [ -o value | --offset value ] [ -r value | --range value ] [ -v value | --verbosevalue ] [ -h | --help ]

Command Line Options

The shefout program uses database configuration parameters to determine the data streams recipient data.

User Option

The specification for the user option is:

{ -u username | --user username | --user=username }

This option will allow the program to connect to the database using the username provided. The user must already exist, and have sufficient permissions to access the database specified. This item is required.

Password Option

The specification for the password option is:

{ -p password | --password password | --password=password }

This option in combination with the username allows the program to connect to the database using the username provided. This item is required.

Database Option

The specification for the database option is:

{ -d database | --database database | --database=database }

This option will specify which database the program should use as a source of data, configuration items and a destination for any event logging items. This item is required.

Stream Option

The specification for the stream option is:

{ -s stream name | --stream stream name | --stream=stream name }

This option specifies the stream name for retrieval. This is a required argument.

Time Option

The specification for the time option is:

[ -t timestring | --time timestring | --time=timestring ]

This option specifies a timestamp for data extraction to begin. The time string format can be either YYYYMMDDHHMMSS or YYYY-MM-DD HH:MM:SS. If the latter is used, the string must be placed in quotes.

Offset Option

The specification for the offset option is:

[ -o value | --offset value | --offset=value ]

This option specifies the time interval by which the entered date will be corrected. The value is assumed to be in minutes. Positive values are assumed to point the date to earlier times. This option is intended to be used for real-time use as in a cron.

Range Option

The specification for the range option is:

[ -r value | --range value | --range=value ]

This option specifies the time interval over which a process is to be performed. The value is assumed to be in minutes. Default is 60.

Verbose Option

The specification for the verbose option is:

[ -v value | --verbose value ]

The value provided for the verbose setting (a digit between 0 and 5) indicates how much output is generated, 0 being minimal and 5 being extremely verbose. Positive values of setting send data to the ELF, negative value also print the message to the screen. If no value is provided, the setting is assumed to be 1.

Help Option

The specification for the help option is:

[ -h | --help ]

This option prints a summary of all the command line options and exits.

Database Parameters

The following database tables provide configuration options for the shefout program.

Data_Types

This table contains metadata about the various data types DEOS handles. In particular, it contain the data type code used in the SHEF format and the duration value used to create the range summary of the data.

Operational Use

For operational use, it is expected that the shefout program be run from inside the cron system, and to be run at an appropriate time interval.