Elastic Search & Kibana Including Log stash and Beats

-

 

 Configuration of Elastic Search & Kibana Including Log stash and Beats

 Reliably and securely take data from any source, in any format, then search, analyze, and visualize it in real time

There is flow of data collection to visualization that is described in the picture



Before Configuration of ELK there are some Prerequisites 


A Linux system running Ubuntu 20.04 or 18.04

Access to a terminal window/command line (Search > Terminal)

A user account with sudo or root privileges

Install Java

           java  -version
sudo apt-get install openjdk-8-jdk



        Install Nginx

      sudo apt-get install nginx



        Add Elastic Repository

     wget –qO – https://artifacts.elastic.co/GPG-KEY-elasticsearch | sudo apt-key add –

        install the apt-transport-https package:

    sudo apt-get install apt-transport-https

Add the Elastic repository to your system’s repository list

       echo “deb https://artifacts.elastic.co/packages/7.x/apt stable main” | sudo tee –a /etc/apt/sources.list.d/elastic-7.x.list


 

Install Elasticsearch

        sudo apt-get update

        sudo apt-get install elasticsearch

        sudo nano /etc/elasticsearch/elasticsearch.yml

Comment:Uncomment the lines by deleting the hash (#) sign at the beginning of both lines and replace 192.168.0.1 with localhost.

For  configuring a single node cluster

        discovery.type: single-node

        sudo nano /etc/elasticsearch/jvm.options (size is set to 512MB)

Start Elasticsearch


       sudo systemctl start elasticsearch.service
        sudo systemctl enable elasticsearch.service

 

Test service


       curl –X GET “localhost:9200”

 

Install Kibana


               sudo apt-get install kibana

        sudo nano /etc/kibana/kibana.yml

        server.port: 5601

        server.host: “localhost”

        elasticsearch.hosts: [“http://localhost:9200”]

 

        sudo systemctl start kibana

        sudo systemctl enable kibana

        sudo ufw allow 5601/tcp

        http://localhost:port



Install Logstash

 

        sudo apt-get install Logstash

      sudo systemctl start Logstash

      sudo systemctl enable Logstash

      sudo systemctl status logstash



 

Install Filebeat

 

        sudo atp-get install filebeat

      sudo nano /etc/filebeat/filebeat.yml

        Add these to file
            output.logstash

            hosts: ["localhost:5044"]

 

      sudo filebeat modules enable system

      sudo filebeat setup --index-management –E output.logstash.enabled=false –E 'output.elasticsearch.hosts=["localhost:9200"]'

      sudo systemctl start filebeat

      sudo systemctl enable filebeat

      curl -XGET http:// localhost:port/_cat/indices?v







Comments

Post a Comment

Popular posts from this blog

CI/CD Pipeline in Oracle Forms with maven

-
Image
  Auto compilation Oracle forms DevOps CI/CD     DevOps Approach for Oracle Forms: Step1: Push the Oracle Forms code fmb files, both in the binary and in the xml format to the hosted Git repository on Developer Cloud Service. The xml format will be used for code reviews and can also be used for storing snippets. For pushing the Oracle Forms code to Developer Cloud Git repository, we will have to use the Git CLI. Pre requisite here would be that the Git CLI has to be installed on the developer machine. Below screen shot show the Git usage: DevOps Approach for Oracle Forms: Step2: Push the Oracle Forms code fmb files, both in the binary and in the xml format to the hosted Git repository on Developer Cloud Service. The xml format will be used for code reviews and can also be used for storing snippets. For pushing the Oracle Forms code to Developer Cloud Git repository, we will have to use the Git CLI. Pre requisite here would be that the Git CLI has t...
Read more

Jitsi Meet Configuration On Ubuntu 20.

-
Image
  Jitsi Meet on Ubuntu 20 Before configuration we need to set the host entry of domain. Set host domain name  sudo hostnamectl set-hostname jitsi.your_domain hostname  sudo nano /etc/hosts (127.0.0.1         jitsi.your_domain) Then allow firewall ports that are necessary for Jitsi access. sudo ufw allow 80/tcp sudo ufw allow 443/tcp sudo ufw allow 4443/tcp sudo ufw allow 10000/udp sudo ufw status Download gpg Key for jitsi wget https://download.jitsi.org/jitsi-key.gpg.key sudo apt-key add jitsi-key.gpg.key rm jitsi-key.gpg.key Adding jitsi repository on OS sudo nano /etc/apt/sources.list.d/jitsi-stable.list sudo apt update Now install Jitsi Meet sudo apt install jitsi-meet sudo /usr/share/jitsi-meet/scripts/install-letsencrypt-cert.sh Lets change in script file for configuration sudo nano /etc/prosody/conf.avail/your_domain.cfg.lua (  from=authentication = "anonymous" ) (  to=authentication = "internal_plain" ) also add th...
Read more