Gartner Blog Network

Monitoring Technology Pick: Week of April 7th – Elasticsearch

by Jonah Kowall  |  April 13, 2014  |  7 Comments

Continuing the blogs topics from last week we are profiling yet another log search and index technology which has begun to emerge as yet another alternative for this necessary technology when troubleshooting today’s complex environments. As the vendor we profiles last week, which utilizes several open source technologies and brings a unique user interface and ingest model the vendor this week leverages much of the same technologies.

Elasticsearch Los Altos, California

Elasticsearch has recently raised a good amount of venture funding to propel open source index and search into the enterprise spotlight. Elasticsearch is the company behind the ELK stack, with a growing set of use cases and products being built upon it. The stack consists of the following open source projects:

  • Elasticsearch is a distributed indexing and storage technology written in Java, the project is designed to scale out with modular systems sharing data storage, indexing, and search responsibilities. The project is complex to setup, maintain, and tune accordingly.
  • Logstash is the data ingest layer, messages are parsed off the hosts or a centralized logging infrastructure and forwarded into the Elasticsearch cluster (or other technologies). Logstash has a complex configuration file with many options for tuning the forwarder and configuring the parsing. The project is based on Java and can have a much larger memory footprint on the hosts than competing forwarder technologies.
  • Kibana is a graphical front end for querying Elasticsearch housed data and deriving insight (think of it as the UI). Kibana has a nice modern UI, but lacks much of the alerting, and administration needed for enterprise log indexing.

The company itself, ElasticSearch is run by a combination of technologists and entrepreneurs. Important technical members include co-founder Shay Banon, the creator of Elasticsearch. Simon Willnauer and Uri Boness who are core members of the Apache Lucene team, another highly visible Java indexing open source project. They have hired Jordan Sissel the creator of Logstash, as well as Rashid Khan the creator of the Kibana project. Matched with the marketing skill of Jen Grant who was a critical member at Box during the rise to enterprise adoption, and has had similar success at Google previously. These products will begin evolving much more quickly with a commercial entity driving the development, and solid marketing and positioning behind them. The first product released was marvel, a commercial management platform for ElasticSearch clusters. This new offering include administrative capabilities such as monitoring, root cause analysis, capacity planning, and is a paid offering, but it’s free for development use. With these innovations the product suite will evolve considerably more quickly and become a commercial alternative to other indexing and search technologies. We expect the company to begin launching commercial products later this year, and be thrust into the spotlight.

Next week, we will be highlighting yet another player in the log index and search market, before moving on to other interesting emerging technologies.

Additional Resources

Complete Your Data and Analytics Strategy With a Clear Value Proposition

As a data and analytics leader, one of the most important things to articulate in your strategy is the value proposition. Learn how to create a modern, actionable D&A strategy that creates common ground amount stakeholders.

Read Free Gartner Research

Category: analytics  data-and-analytics-strategies  it-operations  logfile  monitoring  olm  pick-of-the-week  

Jonah Kowall
Research Vice President
3.5 years with Gartner
20 years IT industry

Jonah Kowall is a research Vice President in Gartner's IT Operations Research group. He focuses on application performance monitoring (APM), Unified Monitoring, Network Performance Monitoring and Diagnostics (NPMD), Infrastructure Performance Monitoring (IPM), IT Operations Analytics (ITOA), and general application and infrastructure availability and performance monitoring technologies. Read Full Bio

Thoughts on Monitoring Technology Pick: Week of April 7th – Elasticsearch

  1. David Mytton says:

    ElasticSearch + Logstash is a great combination, if you can get it set up. The docs are really not very good and when I tried setting it up a few months ago, all the guides were wrong and/or out of date.

    Kibana also had a lot of problems, particularly because it requires direct access from the browser to the ES cluster i.e. direct browser access to your production environment. That is never a good idea so you have to set up complex proxies to give it the access it needs.

    It’s a powerful set of tools once you figure it all out, but it is very difficult to get up and running.

  2. Cưỡng dâm em nữ sinh lồn đẹp vú tròn

  3. Em nữ sinh này là một trong những em tuy không thực sự sở hữu một khuôn mặt đẹp, dáng ngon nhưng vú bướm khá chất lượng và đặc biệt kĩ năng làm tình của em nó phải đạt đến độ thượng thừa.

Leave a Reply

Your email address will not be published. Required fields are marked *

Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.