Data manipulation operators

Several context-sensitive pages in the Variable Properties dialog box are displayed for virtual variables. The pages that are displayed depend on the operator that was used to create the virtual variables.

One or more of the following virtual variable pages will be present when Data Manipulation operators are used:

Background Noise Removal page
Cell statistic
Deadzone Estimation page
Generator page
Match Ping Times page
Motion correction page
Ping Subset page
Ping Time Shift page
Region Statistic page
Resample page
Threshold page
Towed Body page

Background Noise Removal page

The Background Noise Removal page is displayed on the Variable Properties dialog box if the Background noise removal operator has been applied to create the selected virtual variable. The following settings are used by the Background noise removal algorithm which is based on the concepts discussed by De Robertis and Higginbottom (2007). The algorithm page also offers practical advice on background noise removal strategies.

Averaging Cell

Settings that configure the averaging cell that is used to find the noise estimate of each ping.

Settings

Description

Horizontal extent (pings)

Specifies the horizontal size of the averaging cell (number of pings). The cell width defines an averaging ping interval that examines samples for the noise estimate for the middle ping of the interval.

The default value is 20 pings. The value is cited in the Sensitivity to grid size discussion in De Robertis and Higginbottom (2007).

Vertical units

Specifies the units for the vertical axis of the averaging cell. Available units are Samples or Meters.

Notes:

  • The number of samples within the Vertical extent of the averaging cell can affect the statistics of the noise estimate. Too few samples may result in a poor noise estimate.
  • Under Meters, a value for samples per meter is evaluated once (only), for the first group of calibrated pings and is applied to all pings in the echogram. In the case where the ping calibration changes within the data, the evaluated value may be inaccurate. Also be aware that too few samples per meter may result in a poor noise estimate.
  • Meters are used in De Robertis and Higginbottom (2007).

Vertical extent (samples)

Vertical extent (meters)

Specifies the vertical size of the averaging cell. The averaging ping interval averages its samples in vertical averaging intervals.

Note: De Robertis and Higginbottom (2007) use a vertical cell size of 10 m for their data.

Vertical overlap (%)

Specifies the percentage vertical overlap of the averaging cell down the samples of the averaging ping interval.

  • The default overlap is zero. De Robertis and Higginbottom (2007) use non-overlapping averaging cells.
  • Calculation time increases with an increase in Vertical overlap.
  • Specify an overlap, when the calculated noise estimate is too high and the wanted signal in the echogram is undesirably affected by the operator.

Thresholds

Settings that specify the limits of acceptable noise and SNR for the operand data.

Settings

Description

Maximum noise (dB)

Specifies the maximum acceptable noise (dB) for the operand data. The algorithm uses this value when the calculated noise is greater than the Maximum Noise.

The default value is -125 dB. De Robertis and Higginbottom (2007) use this value for their data.

Maximum Noise is equivalent to Noisemax used by De Robertis and Higginbottom (2007).

"...Noisemax represents an upper limit for background noise expected under the operating conditions. Noisemax must be determined empirically and will depend on the echosounder, its installation, and the radiated noise of the vessel."

Minimum SNR

Specifies the acceptable signal to noise ratio (dB) for samples in the operand data. The algorithm evaluates the noise-corrected-signal to calculated-noise ratio and tests to see it satisfies a minimum desired SNR. If the ratio is less than Minimum SNR then the signal is deemed to be unacceptably distinguishable from the noise. In this case, the corrected Sv is set to -999.

The default value is 10 dB.

Minimum SNR is equivalent to thresholdSNR used by De Robertis and Higginbottom (2007).

"...SNR is a measure of the relative contribution of signal and noise and can be used objectively to identify data that contain sufficient signal to warrant further analysis, such as echo integration or multifrequency comparisons...The minimum thresholdSNR required to suppress the contribution from these pixels can be estimated by examining distributions of Powercal from areas dominated by noise and selecting a threshold above the mean value that will exclude contributions from it. This value will depend on the equipment used, the operational settings, and the extent to which data are averaged..."

Cell statistic page

The Cell statistic page is displayed on the Variable Properties dialog box if the Cell statistic operator or Cell statistic (Single targets) operator has been applied to create the selected virtual variable. A grid is required for Operand 1. The data type of the output is determined by the selected Cell statistic. Further information is available under Cell statistic algorithms and About the Cell statistic operator.

Note: No data samples are ignored for under all algorithms. The treatment of thresholded samples is specified by the selected Cell statistic algorithm.

Statistic

Settings

Description

Algorithm

Available Cell statistic algorithms are selected from the Algorithm list.

Input operand 1 Output data type Algorithm

Sv

Single targets

Sv

TS

Mean

The mean of eligible sample values in an Operand 1 cell is assigned to the samples in the associated cell in the Cell statistic variable.

Sv

Single targets

Sv

TS

Minimum

The minimum of the eligible sample values in an Operand 1 cell is assigned to the samples in the associated cell in the Cell statistic variable.

Sv

Single targets

Sv

TS

Maximum

The maximum of the eligible sample values in an Operand 1 cell is assigned to the samples in the associated cell in the Cell statistic variable.

Sv

Single targets

Sv

TS

Median

The median of the eligible sample values in an Operand 1 cell is assigned to the samples in the associated cell in the Cell statistic variable.

Sv

Single targets

Sv

TS

Percentile

The percentile of the eligible sample values in an Operand 1 cell is assigned to the samples in the associated cell in the Cell statistic variable.

The percentile value is specified under the Percentile section.

Sv

Single targets

Linear

Linear

Number of targets/Number of samples

The number of eligible samples or the eligible number of single targets in an Operand 1 cell is assigned to the samples in the associated cell in the Cell statistic variable.

Sv

Single targets

Linear

Linear

Beam volume sum

The calculated Beam volume sum of pings in the Operand 1 cell is assigned to the samples in the associated cell in the Cell statistic variable.

Single targets

Linear

Echo density

The calculated Echo density in the Operand 1 cell is assigned to the samples in the associated cell in the Cell statistic variable. Echo density can be used in the Sawada calculations of Nv and M.

Fill empty cells with the mean value of surrounding cells

Select this setting to fill empty cells with the mean value of surrounding cells.

Clear this setting to leave empty cells empty.

Selection of adjacent cells to use in the mean calculation

Description

All

Eight surronding cells used for the mean calculation.

Left, right, above and below

Left and right, and above and below, surrounding cells used for the mean calculation.

Left, right

Left and right surrounding cells used for the mean calculation.

Above and below

Above and below surrounding cells used for the mean calculation.

Mean calculation

The mean is calculated by considering the original cell values of the nearest-neighbor cells (up to 8 cells). Cells that have a no-data value do not contribute to the mean calculation (in the numerator or divisor).

Deadzone Estimation page

The Deadzone estimation page is displayed on the Variable Properties dialog box if the Deadzone estimation operator has been applied to create the selected virtual variable.

Settings

Description

Acoustic bottom

Select the line that denotes the start of the bottom echo trace.

True bottom

Select the line that denotes the end of the bottom echo trace.

Averaging layer thickness (m)

Enter the thickness of the layer (on the transducer side of the acoustic bottom line) for which the average volume backscatter should be calculated. The calculated value will be used to fill the layer between the acoustic bottom and true bottom.

Note: A deadzone estimation will not be applied to any pings in the virtual echogram if either the Acoustic bottom or True bottom is set to "None".

See About the deadzone for more information.

Generator page

The Generator page is displayed on the Variable Properties dialog box if the Data Generator operator has been applied to create the selected virtual variable.

The available settings on this page change with selected Output type and Algorithm:

Output type Sv:

Setting

Description

Algorithm

Select one of the following algorithms for the Data Generator operator:

When selecting the TVG curve or Constant + TVG Curve algorithms check to see if the Logged draft warning applies to the input operand.

Sv at 1m (dB)

Specifies Sv (dB) at 1 meter.

Sv (dB)

Specifies Sv (dB).

Apply TVG override

When checked, specifies the value used to override the TVG spread for the algorithm.

Output type TS:

Setting

Description

Algorithm

Select one of the following algorithms for the Data Generator operator:

When selecting the TVG curve or Constant + TVG Curve algorithms check to see if the Logged draft warning applies to the input operand.

TS at 1m (dB)

Specifies TS (dB) at 1 meter.

TS (dB)

Specifies TS (dB).

Apply TVG override

When checked, specifies the value used to override the TVG spread for the algorithm.

Output type Unspecified dB:

Setting

Description

Algorithm

The Constant algorithm applies a value specified by Constant (dB), to all data samples in the virtual variable.

Constant (dB)

Specifies a value (dB). 

Output type Linear:

Setting

Description

Algorithm

The Constant algorithm applies a value specified by Constant (linear), to all data samples in the virtual variable.

Constant (linear)

Specifies a value (linear).

Match Ping Times page

The Match Ping Times page is displayed on the Variable Properties dialog box if the Match Ping Times operator has been applied to create the selected virtual variable.

Setting

Description

Allowed slop

The maximum allowable difference in ping times between the two operands for a successful match. If no successful match is found, then that ping from the second operand does not appear in the resulting echogram.

Motion correction page

The Motion correction page is displayed on the Variable Properties dialog box if the Motion correction (Dunford method) operator has been applied to create the selected virtual variable.

Setting

Description

 3dB beam angle factor

A multiplying factor for the 3dB beam angle used to threshold the motion correction output. This setting enables you to specify the degree to which the Dunford algorithm is applied to your data.

Values in the Information section of the Motion correction page show the impact of the threshold on your data.

Refer to the Motion correction (Dunford) algorithm for more information.

Ping Subset page

The Ping Subset page is displayed on the Variable Properties dialog box if the Ping Subset operator has been applied to create the selected virtual variable.

Settings

Description

Ping range(s)

Select whether the ranges will be specified by ping number, time or distance in meters or nautical miles. Specify the pings in the operand to be used in the virtual variable. Ranges are separated by commas. The actual range of the operand and an example specification are shown.

Number

Specify pings by their numbers, in order. Single numbers or ranges may be used. An unterminated range spans to the last ping.

e.g.: 5,7, 9-20, 25-

Time

Specify pings by one or more times ranges in abbreviated ISO 8601 format.

e.g.: 2012-6-28 12:30 = 13:45, 16:00 =

You can write times in full or you use these abbreviation rules:

Rule Specification Abbreviation Description
OMIT LEADING ZEROS 1970-01-02 03:04:05.06 1970-1-2 3:4:5.06 Leading zeros may be omitted (except in the milliseconds).
OMIT TRAILING ZEROS 1970-1-1 0:0:0.000 1970 An incomplete time is filled in with the minimums (1 or 0).
OMIT LEADING DUPLICATE FIELDS 2012-1-20 = 2012-1-22 2012-1-20 = --22 An omitted leading field takes its value from the previous time.
OMIT UNUSED DATE SEPARATORS 2012-1-20 11:15 = -- :45 2012-1-20 11:15 = :45 If the date is omitted then the dashes are not needed.
Distance (m)

Distance (m) specification is entered as a start distance (m), a dash and a stop distance (m).

e.g. 0-9.5

Distance (nmi)

Distance (nmi) specification is entered as start distance (nmi), a dash and a stop distance (nmi).

e.g. 2.58-4.00

Ping Inclusion

Select whether the specified ranges are to be included or excluded.

Pings

The Pings section lists the actual pings included or excluded, next to the corresponding ranges.

Ping Time Shift page

The Ping Time Shift page is displayed on the Variable Properties dialog box if the Ping time shift operator has been applied to create the selected virtual variable.

Setting

Description

Assign ping times from the relative ping index

Choose to shift the ping times relative to the ping index entered. A positive value shifts pings forward in time, a negative value shifts pings back in time.

Region Statistic page

This page is displayed if the Region statistic operator has been applied to create the selected virtual variable.

Settings

Description

Region class

Choose one or all region classes to apply the statistic.

Statistic to calculate

Select the statistic to be calculated for the selected region class. You can choose from one of:

  • Minimum
  • Mean
  • Maximum
  • Standard Deviation

All will produce a virtual variable of the same data type as the operand. The choice of standard deviation will result in a linear variable which with all samples outside of regions receiving the no data value.

Resample page

The Resample page is displayed on the Variable Properties dialog box if the Resample by distance interval, Resample by number of pings or Resample by time interval operator has been applied to create the selected virtual variable.

The Input section determines the pings that are to be sampled for each sample interval.

Settings

Description

Ping selection

Choose to apply statistical functions to all pings in interval, or to the middle ping in the sample interval.

Note: In the Select middle ping mode, if there is an original ping in the time interval corresponding to the resampled ping, the closest one to the ping center is selected. If not, no ping is selected and a no data ping is output on the echogram.

Distance mode

For resampling by distance there is a choice of resampling using GPS or Vessel logs (if available) in units of either nautical miles or meters.

Distance interval

Number of pings in interval

Time interval

Specify the distance (nautical miles) / number of pings / time (seconds) sample interval for resampling.

The Operation section determines the statistical operation to be used for resampling.

Settings

Description

Resampling operation

Choose the statistical operation to use in resampling your data.

See Resample operator algorithms for more information.

Percentile

For resampling using the percentile operation, enter the required percentile. For example a percentile of 90 will return that value below which 90% of the sampled datapoints lie.

Mean algorithm in range dimension

This setting is only accessible when resampling using the Mean resampling operation. Four Mean resampling algorithms are available:

  • Weighted mean (recommended)
  • Unweighted mean
  • Linear interpolation
  • Linear interpolation | Weighted mean

Weighted mean (recommended) is selected by default (in new EV files). When you change the data range (from the original range), is is advised to use this setting.

If the sample thickness is increased, the resampled value of samples is calculated using a weighted mean.

If the sample thickness is decreased, the resampled value of samples is calculated using interpolation.

Weighting along-track

This setting is only accessible when resampling using the Mean resampling operation on the Resample by time interval and Resample by distance interval operators.

If selected, the resampled value is calculated using a weighted mean, otherwise an ordinary mean (unweighted) is used.

The Output section is used to set the display limits and data resolution to output for the resampled pings.

Settings

Description

Use ranges from operand 1

Click Use ranges from operand 1 to use the ranges specified by operand 1.

Note: This setting is unsuitable to use where Operand 1 contains pings with no samples in them. In this case, Echoview encounters problems with the Start range and Stop range of such empty pings.

Custom ranges

Click Custom ranges to enter and use your own ranges.

Custom ranges together with Start range and Stop range define the Start sample range and End sample range boundaries of the output ping. Number of data points defines the resolution of the samples within those bounds. In the range dimension the resampling can sometimes look like a zoom.

resample in range

Resample variable

Not resampled in the along-track direction.

Start range = 50 m

Stop range = 100 m

Data points = 20

Input variable

Start range = 0.096 m

Stop range = 249.9 m

Data points = 1301

Start range

Enter the start range in meters, i.e. the range of the first sample in the output echogram.

Stop range

Enter the stop range in meters, i.e. the range of the last sample in the output echogram.

Number of datapoints

Specify the desired data resolution to output for the depth range specified.

Note: Where data is available on the input echogram between the Start range and Stop range it will be used to create the pings in the output echogram. Where no data is available on the input echogram in this range, "no data" appears in the output echogram.

Threshold page

The Threshold page is displayed on the Variable Properties dialog box if the Threshold operator has been applied to create the selected virtual variable.

Setting

Description

Use Operand 2 as the Maximum threshold

When this setting is selected, this operator behaves as a Maximum threshold operator.

The value of a datapoint in Operand 1 is compared to the value of the corresponding datapoint in Operand 2.

When the value of Operand 1 is greater than that of Operand 2, the output datapoint is set to the value specified for Set thresholded values to, otherwise it is set the the value of the datapoint from Operand 1.

Use Operand 2 as the Minimum threshold

When this setting is selected, this operator behaves as a Minimum threshold operator.

The value of a datapoint in Operand 1 is compared to the value of the corresponding datapoint in Operand 2.

When the value of Operand 1 is less than that of Operand 2, the output datapoint is set to the value specified for Set thresholded values to, otherwise it is set the the value of the datapoint from Operand 1.

Set thresholded values to

Select required output for Operand 1 thresholded values.

Towed Body page

The Towed Body page is displayed on the Variable Properties dialog box if the Towed body operator has been applied to create the selected virtual variable.

Setting

Description

Using line

Select the line that represents the path of the towed body. The depth of this line at each ping will be added to the depth of all samples in that ping to create the virtual echogram.

See also

Variable Properties dialog box
About virtual variables
Operators