ELK_STACK

https://awstutorialseries.com/ This tutorial is setting up Elasticsearch in cluster mode with Logstash monitoring a log file and Kibana reporting off of the data in Amazon! GITHUB For easy copy and paste. https://github.com/andrewpuch/elastic... If you have a strong interest in DevOps I run a Slack channel for DevOps Engineers! Feel free to join http://devopsengineers.com/ https://twitter.com/awstutseries https://www.linkedin.com/in/apuch http://andrewpuch.com/ Amazon Linux AMI 2014.09.2 Elasticsearch 1.4.4 =============== Commands --------------- sudo su yum update -y cd /root wget https://download.elasticsearch.org/el... yum install elasticsearch-1.4.4.noarch.rpm -y rm -f elasticsearch-1.4.4.noarch.rpm cd /usr/share/elasticsearch/ ./bin/plugin -install mobz/elasticsearch-head ./bin/plugin -install lukas-vlcek/bigdesk ./bin/plugin install elasticsearch/elasticsearch-cloud-aws/2.4.1 cd /etc/elasticsearch nano elasticsearch.yml Config --------- cluster.name: awstutorialseries cloud.aws.access_key: ACCESS_KEY_HERE cloud.aws.secret_key: SECRET_KEY_HERE cloud.aws.region: us-east-1 discovery.type: ec2 discovery.ec2.tag.Name: "AWS Tutorial Series - Elasticsearch" http.cors.enabled: true http.cors.allow-origin: "*" Commands --------------- service elasticsearch start Logstash 1.4.2 =========== Commands --------------- sudo su yum update -y cd /root wget https://download.elasticsearch.org/lo... yum install logstash-1.4.2-1_2c0f5a1.noarch.rpm -y rm -f logstash-1.4.2-1_2c0f5a1.noarch.rpm nano /etc/logstash/conf.d/logstash.conf Config (XXX is a greater than symbol youtube does not allow that in the comments) -------------------------------------------------------------------------------------------------------------- input { file { path =XXX "/tmp/logstash.txt" } } output { elasticsearch { host =XXX "ELASTICSEARCH_URL_HERE" protocol =XXX "http" } } Commands --------------- service logstash start Kibana 4.0.1 ============ Commands --------------- sudo su yum update -y cd /root wget https://download.elasticsearch.org/ki... tar xzf kibana-4.0.1-linux-x64.tar.gz rm -f kibana-4.0.1-linux-x64.tar.gz cd kibana-4.0.1-linux-x64 nano config/kibana.yml Config -------- elasticsearch_url: "ELASTICSEARCH_URL_HERE" Commands --------------- nohup ./bin/kibana & Navigate In Browser --------------------------- http://KIBANA_URL:5601/