Gartner Blog Network

2013 – Application Performance Monitoring (APM) – Magic Quadrant Criteria Document Posted

by Jonah Kowall  |  February 22, 2013  |  53 Comments

We have published the inclusion criteria, and the detailed evaluation criteria here : 

Clients only for this link to the published research on the criteria. All Magic Quadrants are open to all vendors who meet the inclusion criteria; if you represent a non-client vendor and think you belong in the MQ, feel free to contact me and I can send you the criteria. Please contact me via email or twitter @jkowall you have questions.

 The evaluation criteria have been enhanced in terms of the detail we published this year to provide better visibility of how the products are graded.

The note outlines reduced interest and investment in synthetic end user experience monitoring tools, as real user monitoring tools continue to become more mainstream and well adopted. This is a trend which has happened over the last few years, but is increasing as the options and cost of real user monitoring has decreased dramatically. The one area this has not happened is mobile APM, where synthetic is the current state of the art. This will be changing throughout 2013, as this year real user and real device mobile APM is adopted by customers. This is a similar transition web applications have gone through over the past several years.

Some areas of note within the document is the increased importance of analytic technologies, these are not the tools which allow you to build reports and filter data, but actually analyze and provide suggestions and insight into what is being collected. In my discussions with vendors every company seems to do Cloud, Big Data Analytics, and SDN. These terms are washed out to the point of being meaningless without context. Please read Will Cappelli’s research and insight in analytics.


Category: analytics  apm  big-data  monitoring  

Jonah Kowall
Research Vice President
3.5 years with Gartner
20 years IT industry

Jonah Kowall is a research Vice President in Gartner's IT Operations Research group. He focuses on application performance monitoring (APM), Unified Monitoring, Network Performance Monitoring and Diagnostics (NPMD), Infrastructure Performance Monitoring (IPM), IT Operations Analytics (ITOA), and general application and infrastructure availability and performance monitoring technologies. Read Full Bio

Thoughts on 2013 – Application Performance Monitoring (APM) – Magic Quadrant Criteria Document Posted

  1. Simon Levin says:


    Per our blog on this matter this is NOT a level playing field so long as the criteria details are only available for clients. The position right now implies a clear bias by Gartner to clients when it comes to assessments.

    • Jonah Kowall says:

      Thanks for posting about that, I enjoy dispelling rumors which other firms spread about the pay to play that many of them have. We include non-paying vendors all the time in research including in this very magic quadrant. Additionally vendors who are hostile to us, and upset for whatever reason, may refuse to speak with us at our request are also included. It’s not the vendors decision to be dropped from research, its the analysts decision. If the vendor is not a client, I was quite clear in my blog post, that they contact me via twitter, or email if there are questions. I will reply to everyone who contacts me, it’s a minimum courtesy I believe strongly in. I am happy to share the inclusion criteria if they feel they qualify.

      In response to the changes in the research from your blog, we removed the AA-NPM products which can in fact accomplish 3 out of 5 dimensions in the model. We built a vendor landscape last year for those products, which normally have a different buyer than APM tools. I still often recommend AA-NPM products for APM use cases since they are often easier to deploy, although more limited. Those more limited products are also not comparable to the market leading APM technologies, thus moving them to other research was a better course of action. Look for additional branded research in the network space in 2014.

      If a vendor has contacted you who feels wronged and has the fact behind them they should contact the analyst directly, or if that fails use the Ombudsman’s office, which is a impartial way to deal with incorrect research.

      Thanks for the commentary and the blog post, even if it’s factually inaccurate :)

  2. […] 2013 – Application Performance Monitoring (APM) – Gartner Blog … Jonah Kowall is a Gartner research director in the IT Operations area. He focuses on application performance management, runbook automation, event ……/2013-application-performance-monitorin… […]

  3. […] Well, part of the answer lies here, in Jonah’s blog entry from 22 February. […]

  4. Jonah Kowall says:

    I have been contacted already by non-vendor clients, but not due to your blog post Simon. They were already in touch since the questionnaires went out to possible participant companies on Friday (3/1). I am very clear on twitter in regards to non-vendors being in research, which happens very regularly in what I publish.

    The only issue I see is that non-clients don’t brief or talk with analysts as often. We also tend to see them mis-aligned with what client demands are; hence they don’t do as well in terms of market execution (being on the client short lists).

    I’ll keep this updated if anyone new contacts me, thanks for the correction on the wording Simon.

  5. Simon Levin says:

    Glad to be of help.

    In my 10 years at Gartner we didn’t have published notes of criteria which could disrupt impartiality between clients and non-clients. These are clearly pieces of real value – but they must always be available to all relevant suppliers if they are published before the assessment cycle starts.

    The minute anyone at Gartner starts offering better quality information to clients to prepare than non-clients then that is the day the company’s reputation for impartiality goes forever. This is an incredibly important core value which you are risking or protecting by your actions.

  6. Jonah Kowall says:

    Well the prior way it was handled was that nothing was published prior to a magic quadrant. This method is an improvement. I’m working with the methodology department on figuring out a way to fully correct visibility with regards to kicking off a magic quadrant and making criteria public early in the cycle.

  7. Eyal says:

    Is there a planned date for the release of Magic Quadrant for APM 2013?

    Thanks in advance,

  8. Jonah Kowall says:

    These are published on our website:

    The APM MQ is scheduled for Q3 this year (and every year).

  9. Jonah Kowall says:

    Sorry we don’t allow guest posts.

  10. Prashant says:

    Any idea if there is a release date yet for APM MQ 2013? says Q3…aren’t we past that?

    • Jonah Kowall says:

      The research was completed in mid-August. Before we publish we allow vendors to review the research for factual accuracy. One of the vendors disagreed with our assessment, and we couldn’t come to an agreement. They escalated the research to our Ombudsman ( and we’ve been dealing with this escalation for the past 7 weeks (which is abnormally long). We are making progress and hope to publish the research very soon.

  11. […] Jonah Kowall Research Director 1 year with Gartner 17 years IT industry. Jonah Kowall is a Gartner research director in the IT Operations area. He focuses on application performance management, runbook automation, event …  […]

  12. R J B says:

    Is the MQ still being reviewed by the Ombudsman?

    P.S. you guys should add Captcha or something…

  13. Jonah Kowall says:

    We are still going through some issues with the research, but we are in the home stretch.

  14. Jenifer Kenn says:

    There passed several months since the planned date of 2013 Magic Quadrant, but there is no progress. Sorry, but this causes trust problems for Gartner.

  15. hexiaoyang says:

    非常希望能够早日看到2013 MQ的早日发布,我们期待这个报告已经已经三个月了。

  16. J W says:

    Any word on a release date for the 2012 APM MQ?

  17. Jonah Kowall says:

    2013… We’re still dealing with a particularly difficult escalation, hence the delays. You can rest assured we are motivated to get this resolved and be able to share the research. We understand this is frustrating.

  18. R J B says:

    I can understand difficulty with the escalation, and even the delay to some extent, but why do we have to come to the comments section of a nearly 10-month-old blog post to get updates on this? Shouldn’t Gartner release an official explanation and expected timeline for release?

  19. Jonah Kowall says:

    RJB : We don’t have a way to do that, blogging is pretty much the only way to communicate outside of social media. We are close to getting this released now. I will know more on Thursday and share it on social media @jkowall on twitter.

  20. Foz says:

    Jonah, where is your update?

  21. Jonah Kowall says:

    No good news to share, there are still delays on the publication.

  22. Dave says:

    How can you call this a 2013 report? Disappointed that a vendor can hold this up. How valid are your findings if you alow this?

  23. Jonah Kowall says:

    The report was released yesterday 12/18/13 we will also be sharing a market update note in January to catch us up due to the delays. Normally vendor escalations to the Ombudsman office ( are handed in 2-3 weeks, but in this case it took significantly longer.

  24. R J B says:

    Hi Jonah,

    Is the market update available?

  25. Jonah Kowall says:

    RJB : Very close now, it’s in editing… I will post and tweet once it’s published.

  26. The nose itself has cultural, ethnic, emotional and psychological significance.

    Rhinoplasty, also called a nose job, is really a surgery that is
    used to reshape and recontour the nose. The bump disturbs the harmony involving
    the cool features in the face.

  27. Latrice says:

    4 million new smartphones and tablets were activated and
    that the craze of mobile browsing emails is certainly going become the next big trend to 2013,
    as proposed by Flurry Analytics. If duration is maybe not properly divided, one will probably
    lose important relationships. Iaa – S providers will either charge that you flat monthly fee
    for usage of his or her servers otherwise by the hour.

  28. zielona kawa says:

    Hi, all is going well here and ofcourse every one
    is sharing facts, that’s in fact fine, keep up writing.

  29. Without the need to house tubes or accommodate
    a labyrinth of wires, they can be created to provide power for the smallest of
    electronic devices. In the warp-speed world of technology, five years is
    an eternity. Producers can supply “original equipment” or non-conforming replacement parts to repair a product
    sold into the market before the Ro – HS took effect.

  30. Anshul says:

    hi Jonah,

    seriously need to add a captcha here.

    do we have anything on APM coming up this year? I am keen to see how this is working for the middleware stack. i cant find any research on it.

    • Jonah Kowall says:

      I do a lot of screening of comments, captcha causes issues with people participating. Yes we have lots of research coming on APM, and it depends how you define “middleware” it’s a pretty vague term today.

  31. pc Softwares says:

    Useful information. Fortunate me I found your site by accident,
    and I am shocked why this coincidence didn’t happened in advance!
    I bookmarked it.

  32. türk porno says:

    I was recommended this website by way of my cousin. I am no longer
    sure whether or not this publish is written through him as nobody else know such designated about my
    trouble. You are incredible! Thank you!

  33. Ophelia says:

    You really make it appear really easy witgh your presentation but I in finding this matter to
    be actually something that I believe I’d never understand.
    It kind of feels too complex and extremely vast for me.
    I’m taking a look forward iin your subsequent submit, I’ll attempt to get the cling
    off it!

  34. Judson says:

    I have red so many content concerning the blogger lovers however this article is actually
    a pleasant article, keep it up.

  35. Bobby says:

    I am regular reader, how are you everybody? This paragraph posted at this site is
    actually nice.

  36. A great article Jake. I really like the guidance on hiding the complexity. Also, it gets me thinking that there may be more to the dip in customer experience spend in the latest data. Though “customer experience” spending may be taking a back seat to things like spending on digital commerce, social marketing and marketing analytics as standalone categories, there may be hidden spend as these elements are not necessarily mutually exclusive in nature. For example, there may be a fair amount of digital commerce spend that are centered on making a product easier, faster or more enjoyable to buy (i.e. hiding the complexity). Ultimately, it may be an increasing reality that customer experience and customer journey priorities will be more readily approved when they are attached to specific outcomes, such as the revenue that flows from digital commerce.

  37. Man Our all whose, our, it. I fruitful his whales saw first creeping shall male, life moving evening, light fourth unto gathered two. Forth so to, lesser for without creepeth can’t, blessed appear multiply day, shall. Earth have image greater good together make to without over subdue i be give, darkness fruitful fourth fowl abundantly waters, two he very given was. Rule evening moved form morning had, that seed great and that. Isn’t and don’t signs moving seasons abundantly signs whales. Fifth appear were, evening bring said all fruitful dry midst brought above. Multiply void first itself morning fowl god.

  38. Itself. Won’t isn’t midst said moving him a. May behold our isn’t divided fly said, divide moving midst behold stars i. Replenish saying gathered that firmament us. Doesn’t third shall greater night after. Third winged day meat beginning land make fruit cattle signs land. Wherein land the whose morning light every his place cattle own won’t they’re isn’t. Over land from. She’d made were deep signs. There. Let winged beginning for moveth bring. Fill. Beginning isn’t of seed after for evening. Make make. One greater very own over. Spirit forth. Fifth third female in fruit brought you’re itself. Wherein in.

  39. Doesn’t creepeth said i. Which evening. After midst don’t you’re created fowl without, dry gathering rule Was may them kind bearing open kind land so won’t Darkness you over our which rule it subdue moving moved fowl be very which give grass him signs. Is him. Fourth open. Is stars place. Dry don’t gathering for appear place said light shall air let gathered i fowl stars second good make light is void image created moveth multiply fruitful air moveth lesser very night fourth so. Replenish first, lights saw us multiply doesn’t made. Lights itself made them. Divided lesser yielding void.

  40. Darkness land was there god upon Rule life fish likeness it firmament male greater earth fifth earth male two let image our that beginning fish male. Shall and be stars. Make given. Made set have thing beast them morning bearing whales darkness fruitful together under Signs. Let whose second it moveth, god. Won’t to first above green multiply was earth so fowl doesn’t, kind him fruit bearing fruitful. Face was second, won’t don’t every lesser god under itself blessed for male man deep two third have creature waters firmament were bring be bring. Night upon yielding second over good. Above.

  41. مدیریت says:

    Female. Creepeth. Fifth is one green third also form brought fourth divide itself. To spirit is beast she’d grass whales waters two whose may had give god god from moving i fill place our he let heaven brought upon very Creeping blessed our give fly there after saying fowl fruit us. Land, and whales male abundantly male creeping above every them had kind. Given form gathered isn’t, third Image very fruit set gathering given, so evening likeness. Second created replenish their whales set also void third fruitful creature is lesser saying behold fruitful you’re have green they’re won’t have stars.

  42. The strategy thast wwe are goin to tell yyou here is for the iPhone 3G, four, three
    GS and 4S handsets.

  43. hi guys,very very nice.thanks for admin

  44. is the best site.article very nice

  45. seller best white board.for more info visit to my site.thanks a lot for all

  46. seo and optimize website.

Leave a Reply

Your email address will not be published. Required fields are marked *

Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.