Logstash

Improving the performance of Logstash persistent queues

This article is available at: https://www.elastic.co/blog/using-parallel-logstash-pipelines-to-improve-persistent-queue-performance

Using Logstash to drive filtered data from a single source into multiple output destinations

This article is available at: https://www.elastic.co/blog/using-logstash-to-split-data-and-send-it-to-multiple-outputs

Using Logstash prune capabilities to whitelist sub-documents

Overview Logstash’s prune filter plugin can make use of whitelists to ensure that only specific desired fields are output from Logstash, and that all other fields are dropped. In this blog post we demonstrate the use of Logstash to whitelist desired fields and desired sub-documents before indexing into Elasticsearch. Example input file As an input to Logstash, we use a CSV file that contains stock market trades. A few example CSV stock market trades are given below. ...

Deduplicating documents in Elasticsearch

This article is available at: https://www.elastic.co/blog/how-to-find-and-remove-duplicate-documents-in-elasticsearch