Off Limit Tagger*


This stage supports the filtering of data with the specified threshold values. The specific logic is as follows:

  • Input data with the specified lower limit and upper limit values (Outlier Detection) are filtered.

  • Verify if the value of the record.measurepoint.value field in the record falls in the specified min,max range.

    • If the data value does not fall in the range, the value of the /attr/isOutlier field in the output is set to true.

    • If the data value falls in the range, the value of the /attr/isOutlier field in the output is set to false.

  • The configured threshold values and parameters will be included in the /attr/outlierAttr field as output.

  • Incompatible with old data formats, i.e. cannot filter data by ModelId::PointId.

Configuration

The configuration tabs for this stage are General, Basic, and Input/Output.

General

Name

Required?

Description

Name

Yes

The name of the stage.

Description

No

The description of the stage.

Stage Library

Yes

The streaming operator library to which the stage belongs.

Required Fields

No

The fields that the data records must contain. If the specified fields are not included, the record will be filtered out.

Preconditions

No

The conditions that must be satisfied by the data records. Records that do not meet the conditions will be filtered out. For example, ${record:value('/value') > 0}. For the syntax of EL expressions, see Expression Language.

On Record Error

Yes

The processing method for error data.

  • Discard: Error data will be discarded and ignored

  • Send to Error: Error messages will be reported

  • Stop Pipeline: The pipeline will be stopped

Basic

Name

Required?

Description

Quality Filter

No

Filter the data according to the data quality. Only records that meet the quality conditions will be processed by this stage.

Input/Output

Name

Required?

Description

Input Measurement

Yes

Data input point

OpenClose

Yes

Select the format of the threshold.

  • (x,y)

  • (x,y]

  • [x,y)

  • [x,y]

  • (-∞,y)

  • (-∞,y]

  • (x,+∞)

  • [x,+∞)

  • (-∞,+∞)

Min-Max

Yes

Specify the lower limit value and upper limit value of the threshold, separated by comma.

Output Measurement

Yes

Data output point.When a threshold judgment is made on the input points, Streaming tags the record that exceeds the upper and lower limits and outputs the marking result, and the data output point is the measurement point that carries the output result.

Output Results

The output results of this stage are included in the attr struct. The description of the fields are as follows:

Name

Data Type

Description

isOutlier

Boolean

Whether the measurepoint value exceeds the threshold.

minValue

Int/Double/Float

The set lower limit of the threshold.

maxValue

Int/Double/Float

The set upper limit of the threshold.

enableMinJudger

Boolean

Whether minimum value juder is enabled.

enableMaxJudger

Boolean

Whether maximum value juder is enabled.

Output Example

../../../_images/minmax_outlier_result11.png