Skip to main content
Version: 4.48.0

Deduplicate

The deduplicate component will look at a property-key from the incoming message. It will only send unique messages to the Output.

When a key is not present in an object an error will be sent to the Error-output, or will be logged if nothing is connected to this output.

Configuration​

In the configuration you must specify what the property-key is to inspect.

  • Property Key: The path of the property to inspect.
  • No Show: Whether or not to show the most frequent duplicates and their occurrence counts.
  • Limit: How many entries to show.

Property Key​

A property key in its simplest form is just a single property name. For example, the property key _id will look for that field of the incoming object, resulting in the key abcd-e1fgh-i1jkl from the following object:

{
    "_id": "abcd-e1fgh-i1jkl",
    "data": "some value"
}

When a property is nested deeper in an object, you can append multiple keys separated by a dot (.). For example user._id. This will look recursively for the key.

Inputs​

Input

Any message that is an object can be sent through, but should by design be an object that has the key defined in the Property Key.

Outputs​

Output

If and only if this key is encountered for the first time, will the incoming message be sent to this output.

Duplicates

If a key is detected for a second time, the incoming message will be sent to this output.