Our next AWS Michigan Meetup will feature Adis Cesir from Elasticsearch. Adis Cesir is a Solutions Architect at Elastic. Prior to coming to Elastic he has spent 15 years in the Data World working with in Data Warehousing, MDM with various RDBMS, MPP systems. He has spent the last 5 years working with Big Data and various Distributed computing platforms primarily in the Open Source. His presentation and accompanying demo will illustrate how to take log data, use beats and logstash to ship, parse, and enrich the logs. Then show how Kibana can be used to visualize the data and build interactive dashboards to drill down into the data. We will then explore how we can go beyond dashboards and use the capabilities of the Elastic stack to predict future events based on historical data and visualize it with Timelion. And then he will then show a Graph exploration of the log data to explore attacks attempted at the website all from the same log data.
In your presentation, you’ll illustrate how to take log data, use beats and logstash to ship, parse, and enrich the logs. Can you describe what use case these techniques might be used for?
Beats is the platform for single-purpose data shippers. They install as lightweight agents and send data from hundreds or thousands of machines to Logstash or Elasticsearch. Beats are great for gathering data. Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously. Logstash filters parse each event, identify named fields to build structure, and transform them to converge on a common format for easier, accelerated analysis and business value. The combination of Beats and Logstash allows a complex problem of gathering data from multiple sources and applying complex trnasformations and enrichment to be solved much more easily.
Who will benefit most from your AWS Michigan presentation?
Industry specialists in the DevOps, Application Development and System Administration.
What are two or three things that attendees will learn from your presentation?
Attendees will get a better understanding of the Elastic stack and its multi-purpose ability to satisfy use cases around Operational, Logging and Security analytics. Also, a better understanding of the common reference architectures when deploying the Elastic stack as well as new features on the horizon.
Why should folks care about Kibana?
Kibana lets you visualize your Elasticsearch data and navigate the Elastic Stack, so you can do anything from learning why you’re getting paged at 2:00 a.m. to understanding the impact rain might have on your quarterly numbers. It allows complex visualizations of unstructured data to be presented in near real time and is fully interactive in regards to data exploration.
If this sounds interesting to you, we’d love for you to join us!
RSVP and find more information here.