ElasticSearch

Description

Typically you would use ElasticSearch to store and analyze large amounts of data which are of different structures and formats. An ElasticSearch cluster is composed of Clusters, Indices, Nodes, and Shards that help organize and manage how your data is stored. The data can then be efficiently and powerfully searched and analyzed.

ElasticSearch is usually used as a Pipeline destination when your log data needs to be indexed for searching. By setting up a Pipeline for your ElasticSearch data, you can use Pipeline Processors like Dedupe and Remove Fields to clean data or drop it if it’s not valuable before sending it to ElasticSearch.

Configuration Options

Option	Description
End-to-End Acknowledgement	Enable this option to receive verification that log data is being received by ElasticSearch.
Compression	Compression type to apply to your log data.
Strategy	The authentication strategy of your ElasticSearch destination, with options for Basic and AWS.
Endpoints	The full URL(s) of the ElasticSearch destination(s).
Pipeline	The name of the ElasticSearch ingest pipeline to use.
Custom Index	The index name or pattern of the ElasticSearch destination.

Last updated on May 1, 2023

Was this page helpful?