Elasticsearch Bulk
Component that can talk to Elasticsearch and utilizes bulk API endpoint. Requires Elasticsearch 8.4.x or higher.
Configuration
Inputs | Outputs
Description:
Performs multiple operations in a single API call. This reduces overhead and can greatly increase indexing speed. As an input, this component takes any operations and combines them until reaching the bulk size or until the bulk timeout is reached and then triggers the request.
On successful execution, the output will be the response of Elasticsearch.
On error, the default error handling applies.
Example:
A message containing the operation and, depending on the type of operation, the data.
{
"operation":{},
"data":{}
}
Example: Most common types of operations:
Index operation
{
"operation":{ "index" : { "_index" : "test", "_id" : "1" } },
"data":{ "field1" : "value1" }
}
Delete operation
{
"operation":{ "delete" : { "_index" : "test", "_id" : "2" } },
"data":{}
}
Update operation
{
"operation":{ "update" : {"_id" : "1", "_index" : "test"} },
"data":{ "doc" : {"field2" : "value2"} }
}