Using Logstash prune capabilities to whitelist sub-documents

Overview Logstash’s prune filter plugin can make use of whitelists to ensure that only specific desired fields are output from Logstash, and that all other fields are dropped. In this blog post we demonstrate the use of Logstash to whitelist desired fields and desired sub-documents before indexing into Elasticsearch. Example input file As an input to Logstash, we use a CSV file that contains stock market trades. A few example CSV stock market trades are given below. ...

August 28, 2018

Deduplicating documents in Elasticsearch

This article is available at: https://www.elastic.co/blog/how-to-find-and-remove-duplicate-documents-in-elasticsearch

July 23, 2018