Gartner Blog Network

2013 – Application Performance Monitoring (APM) – Magic Quadrant Criteria Document Posted

by Jonah Kowall  |  February 22, 2013  |  36 Comments

We have published the inclusion criteria, and the detailed evaluation criteria here : 

Clients only for this link to the published research on the criteria. All Magic Quadrants are open to all vendors who meet the inclusion criteria; if you represent a non-client vendor and think you belong in the MQ, feel free to contact me and I can send you the criteria. Please contact me via email or twitter @jkowall you have questions.

 The evaluation criteria have been enhanced in terms of the detail we published this year to provide better visibility of how the products are graded.

The note outlines reduced interest and investment in synthetic end user experience monitoring tools, as real user monitoring tools continue to become more mainstream and well adopted. This is a trend which has happened over the last few years, but is increasing as the options and cost of real user monitoring has decreased dramatically. The one area this has not happened is mobile APM, where synthetic is the current state of the art. This will be changing throughout 2013, as this year real user and real device mobile APM is adopted by customers. This is a similar transition web applications have gone through over the past several years.

Some areas of note within the document is the increased importance of analytic technologies, these are not the tools which allow you to build reports and filter data, but actually analyze and provide suggestions and insight into what is being collected. In my discussions with vendors every company seems to do Cloud, Big Data Analytics, and SDN. These terms are washed out to the point of being meaningless without context. Please read Will Cappelli’s research and insight in analytics.


Category: analytics  apm  big-data  monitoring  

Jonah Kowall
Research Vice President
3.5 years with Gartner
20 years IT industry

Jonah Kowall is a research Vice President in Gartner's IT Operations Research group. He focuses on application performance monitoring (APM), Unified Monitoring, Network Performance Monitoring and Diagnostics (NPMD), Infrastructure Performance Monitoring (IPM), IT Operations Analytics (ITOA), and general application and infrastructure availability and performance monitoring technologies. Read Full Bio

Thoughts on 2013 – Application Performance Monitoring (APM) – Magic Quadrant Criteria Document Posted

  1. Simon Levin says:


    Per our blog on this matter this is NOT a level playing field so long as the criteria details are only available for clients. The position right now implies a clear bias by Gartner to clients when it comes to assessments.

    • Jonah Kowall says:

      Thanks for posting about that, I enjoy dispelling rumors which other firms spread about the pay to play that many of them have. We include non-paying vendors all the time in research including in this very magic quadrant. Additionally vendors who are hostile to us, and upset for whatever reason, may refuse to speak with us at our request are also included. It’s not the vendors decision to be dropped from research, its the analysts decision. If the vendor is not a client, I was quite clear in my blog post, that they contact me via twitter, or email if there are questions. I will reply to everyone who contacts me, it’s a minimum courtesy I believe strongly in. I am happy to share the inclusion criteria if they feel they qualify.

      In response to the changes in the research from your blog, we removed the AA-NPM products which can in fact accomplish 3 out of 5 dimensions in the model. We built a vendor landscape last year for those products, which normally have a different buyer than APM tools. I still often recommend AA-NPM products for APM use cases since they are often easier to deploy, although more limited. Those more limited products are also not comparable to the market leading APM technologies, thus moving them to other research was a better course of action. Look for additional branded research in the network space in 2014.

      If a vendor has contacted you who feels wronged and has the fact behind them they should contact the analyst directly, or if that fails use the Ombudsman’s office, which is a impartial way to deal with incorrect research.

      Thanks for the commentary and the blog post, even if it’s factually inaccurate :)

  2. […] 2013 – Application Performance Monitoring (APM) – Gartner Blog … Jonah Kowall is a Gartner research director in the IT Operations area. He focuses on application performance management, runbook automation, event ……/2013-application-performance-monitorin… […]

  3. […] Well, part of the answer lies here, in Jonah’s blog entry from 22 February. […]

  4. Jonah Kowall says:

    I have been contacted already by non-vendor clients, but not due to your blog post Simon. They were already in touch since the questionnaires went out to possible participant companies on Friday (3/1). I am very clear on twitter in regards to non-vendors being in research, which happens very regularly in what I publish.

    The only issue I see is that non-clients don’t brief or talk with analysts as often. We also tend to see them mis-aligned with what client demands are; hence they don’t do as well in terms of market execution (being on the client short lists).

    I’ll keep this updated if anyone new contacts me, thanks for the correction on the wording Simon.

  5. Simon Levin says:

    Glad to be of help.

    In my 10 years at Gartner we didn’t have published notes of criteria which could disrupt impartiality between clients and non-clients. These are clearly pieces of real value – but they must always be available to all relevant suppliers if they are published before the assessment cycle starts.

    The minute anyone at Gartner starts offering better quality information to clients to prepare than non-clients then that is the day the company’s reputation for impartiality goes forever. This is an incredibly important core value which you are risking or protecting by your actions.

  6. Jonah Kowall says:

    Well the prior way it was handled was that nothing was published prior to a magic quadrant. This method is an improvement. I’m working with the methodology department on figuring out a way to fully correct visibility with regards to kicking off a magic quadrant and making criteria public early in the cycle.

  7. Eyal says:

    Is there a planned date for the release of Magic Quadrant for APM 2013?

    Thanks in advance,

  8. Jonah Kowall says:

    These are published on our website:

    The APM MQ is scheduled for Q3 this year (and every year).

  9. Jonah Kowall says:

    Sorry we don’t allow guest posts.

  10. Prashant says:

    Any idea if there is a release date yet for APM MQ 2013? says Q3…aren’t we past that?

    • Jonah Kowall says:

      The research was completed in mid-August. Before we publish we allow vendors to review the research for factual accuracy. One of the vendors disagreed with our assessment, and we couldn’t come to an agreement. They escalated the research to our Ombudsman ( and we’ve been dealing with this escalation for the past 7 weeks (which is abnormally long). We are making progress and hope to publish the research very soon.

  11. […] Jonah Kowall Research Director 1 year with Gartner 17 years IT industry. Jonah Kowall is a Gartner research director in the IT Operations area. He focuses on application performance management, runbook automation, event …  […]

  12. R J B says:

    Is the MQ still being reviewed by the Ombudsman?

    P.S. you guys should add Captcha or something…

  13. Jonah Kowall says:

    We are still going through some issues with the research, but we are in the home stretch.

  14. Jenifer Kenn says:

    There passed several months since the planned date of 2013 Magic Quadrant, but there is no progress. Sorry, but this causes trust problems for Gartner.

  15. hexiaoyang says:

    非常希望能够早日看到2013 MQ的早日发布,我们期待这个报告已经已经三个月了。

  16. J W says:

    Any word on a release date for the 2012 APM MQ?

  17. Jonah Kowall says:

    2013… We’re still dealing with a particularly difficult escalation, hence the delays. You can rest assured we are motivated to get this resolved and be able to share the research. We understand this is frustrating.

  18. R J B says:

    I can understand difficulty with the escalation, and even the delay to some extent, but why do we have to come to the comments section of a nearly 10-month-old blog post to get updates on this? Shouldn’t Gartner release an official explanation and expected timeline for release?

  19. Jonah Kowall says:

    RJB : We don’t have a way to do that, blogging is pretty much the only way to communicate outside of social media. We are close to getting this released now. I will know more on Thursday and share it on social media @jkowall on twitter.

  20. Foz says:

    Jonah, where is your update?

  21. Jonah Kowall says:

    No good news to share, there are still delays on the publication.

  22. Dave says:

    How can you call this a 2013 report? Disappointed that a vendor can hold this up. How valid are your findings if you alow this?

  23. Jonah Kowall says:

    The report was released yesterday 12/18/13 we will also be sharing a market update note in January to catch us up due to the delays. Normally vendor escalations to the Ombudsman office ( are handed in 2-3 weeks, but in this case it took significantly longer.

  24. R J B says:

    Hi Jonah,

    Is the market update available?

  25. Jonah Kowall says:

    RJB : Very close now, it’s in editing… I will post and tweet once it’s published.

  26. The nose itself has cultural, ethnic, emotional and psychological significance.

    Rhinoplasty, also called a nose job, is really a surgery that is
    used to reshape and recontour the nose. The bump disturbs the harmony involving
    the cool features in the face.

  27. Latrice says:

    4 million new smartphones and tablets were activated and
    that the craze of mobile browsing emails is certainly going become the next big trend to 2013,
    as proposed by Flurry Analytics. If duration is maybe not properly divided, one will probably
    lose important relationships. Iaa – S providers will either charge that you flat monthly fee
    for usage of his or her servers otherwise by the hour.

  28. zielona kawa says:

    Hi, all is going well here and ofcourse every one
    is sharing facts, that’s in fact fine, keep up writing.

  29. Without the need to house tubes or accommodate
    a labyrinth of wires, they can be created to provide power for the smallest of
    electronic devices. In the warp-speed world of technology, five years is
    an eternity. Producers can supply “original equipment” or non-conforming replacement parts to repair a product
    sold into the market before the Ro – HS took effect.

  30. Anshul says:

    hi Jonah,

    seriously need to add a captcha here.

    do we have anything on APM coming up this year? I am keen to see how this is working for the middleware stack. i cant find any research on it.

    • Jonah Kowall says:

      I do a lot of screening of comments, captcha causes issues with people participating. Yes we have lots of research coming on APM, and it depends how you define “middleware” it’s a pretty vague term today.

  31. pc Softwares says:

    Useful information. Fortunate me I found your site by accident,
    and I am shocked why this coincidence didn’t happened in advance!
    I bookmarked it.

  32. türk porno says:

    I was recommended this website by way of my cousin. I am no longer
    sure whether or not this publish is written through him as nobody else know such designated about my
    trouble. You are incredible! Thank you!

  33. Ophelia says:

    You really make it appear really easy witgh your presentation but I in finding this matter to
    be actually something that I believe I’d never understand.
    It kind of feels too complex and extremely vast for me.
    I’m taking a look forward iin your subsequent submit, I’ll attempt to get the cling
    off it!

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.