How to install Logstash?

We will start with Introduction to Logstash and end post with installing logstash from binaries and docker.

1. What is Logstash?

Logstash is data processing pipeline which ingests the data simultaneously from multiple data sources, transform it and send it to different stash i.e. Elasticsearch, Redis, database, rest endpoint etc. For example; Ingesting logs files; cleaning and transforming it to machine and human readable formats.

There are three components in Logstash i.e. Inputs, Filters and Outputs.

1.1. Inputs

It ingests data of any kind, shape and size. For examples: Logs, AWS metrics, Instance health metrics etc.

1.2. Filters

Logstash filters parse each event, build a structure, enrich the data in event and also transform it to desired form. For example: Enriching geo-location from IP using GEO-IP filter, Anonymize PII information from events, transforming unstructured data to structural data using GROK filters etc.

1.3. Outputs

This is the sink layer. There are many output plugins i.e. Elasticsearch, Email, Slack, Datadog, Database persistence etc.

2. Installing Logstash

As of writing Logstash(6.2.3) requires Java 8 to run. To check the java version run the following command.

java -version

The output on my system is

java version "1.8.0_161"
Java(TM) SE Runtime Environment (build 1.8.0_161-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.161-b12, mixed mode)

If Java 8 is not installed then please download it from Oracle website and follows instruction for installation. Also, set the JAVA_HOME variable.

2.1. Installing Logstash from binaries

You can directly download the binaries from its official site.

2.1.1. Installing from package repositories

Installation with APT

wget -qO - | sudo apt-key add -

//add https-transports
sudo apt-get install apt-transport-https

//save the repository definition
echo "deb stable main" | sudo tee -a /etc/apt/sources.list.d/elastic-6.x.list

//installation command
sudo apt-get update && sudo apt-get install logstash

Installation with YUM

// Download and install the public signing key
rpm --import

Add the following in a new .repo file in your /etc/yum.repos.d/ directory.

name=Elastic repository for 6.x packages
// Installation command
sudo yum install logstash

2.2. Docker installation

docker pull

Tags: ELK stack, Configuring Logstash, Logstash, Setting up Logstash

← Back home