Jonah Kowall

A member of the Gartner Blog Network

Jonah Kowall
Research Vice President
3.5 years with Gartner
20 years IT industry

Jonah Kowall is a research Vice President in Gartner's IT Operations Research group. He focuses on application performance monitoring (APM), Unified Monitoring, Network Performance Monitoring and Diagnostics (NPMD), Infrastructure Performance Monitoring (IPM), IT Operations Analytics (ITOA), and general application and infrastructure availability and performance monitoring technologies. Read Full Bio

Coverage Areas:

2013 – Application Performance Monitoring (APM) – Magic Quadrant Criteria Document Posted

by Jonah Kowall  |  February 22, 2013  |  34 Comments

We have published the inclusion criteria, and the detailed evaluation criteria here : 

Clients only for this link to the published research on the criteria. All Magic Quadrants are open to all vendors who meet the inclusion criteria; if you represent a non-client vendor and think you belong in the MQ, feel free to contact me and I can send you the criteria. Please contact me via email or twitter @jkowall you have questions.

 The evaluation criteria have been enhanced in terms of the detail we published this year to provide better visibility of how the products are graded.

The note outlines reduced interest and investment in synthetic end user experience monitoring tools, as real user monitoring tools continue to become more mainstream and well adopted. This is a trend which has happened over the last few years, but is increasing as the options and cost of real user monitoring has decreased dramatically. The one area this has not happened is mobile APM, where synthetic is the current state of the art. This will be changing throughout 2013, as this year real user and real device mobile APM is adopted by customers. This is a similar transition web applications have gone through over the past several years.

Some areas of note within the document is the increased importance of analytic technologies, these are not the tools which allow you to build reports and filter data, but actually analyze and provide suggestions and insight into what is being collected. In my discussions with vendors every company seems to do Cloud, Big Data Analytics, and SDN. These terms are washed out to the point of being meaningless without context. Please read Will Cappelli’s research and insight in analytics.



Category: Analytics APM Big Data Monitoring     Tags:

34 responses so far ↓

  • 1 Simon Levin   March 1, 2013 at 5:54 pm


    Per our blog on this matter this is NOT a level playing field so long as the criteria details are only available for clients. The position right now implies a clear bias by Gartner to clients when it comes to assessments.

  • 2 Jonah Kowall   March 1, 2013 at 6:37 pm

    Thanks for posting about that, I enjoy dispelling rumors which other firms spread about the pay to play that many of them have. We include non-paying vendors all the time in research including in this very magic quadrant. Additionally vendors who are hostile to us, and upset for whatever reason, may refuse to speak with us at our request are also included. It’s not the vendors decision to be dropped from research, its the analysts decision. If the vendor is not a client, I was quite clear in my blog post, that they contact me via twitter, or email if there are questions. I will reply to everyone who contacts me, it’s a minimum courtesy I believe strongly in. I am happy to share the inclusion criteria if they feel they qualify.

    In response to the changes in the research from your blog, we removed the AA-NPM products which can in fact accomplish 3 out of 5 dimensions in the model. We built a vendor landscape last year for those products, which normally have a different buyer than APM tools. I still often recommend AA-NPM products for APM use cases since they are often easier to deploy, although more limited. Those more limited products are also not comparable to the market leading APM technologies, thus moving them to other research was a better course of action. Look for additional branded research in the network space in 2014.

    If a vendor has contacted you who feels wronged and has the fact behind them they should contact the analyst directly, or if that fails use the Ombudsman’s office, which is a impartial way to deal with incorrect research.

    Thanks for the commentary and the blog post, even if it’s factually inaccurate :)

  • 3 Analysts in the Press, 2/26/2013 | Thomas Ward Lynch   March 2, 2013 at 2:58 am

    […] 2013 – Application Performance Monitoring (APM) – Gartner Blog … Jonah Kowall is a Gartner research director in the IT Operations area. He focuses on application performance management, runbook automation, event ……/2013-application-performance-monitorin… […]

  • 4 Oops, Gartner Tilted the Playing Field Again « The Skills Connection   March 4, 2013 at 8:21 am

    […] Well, part of the answer lies here, in Jonah’s blog entry from 22 February. […]

  • 5 Jonah Kowall   March 4, 2013 at 1:27 pm

    I have been contacted already by non-vendor clients, but not due to your blog post Simon. They were already in touch since the questionnaires went out to possible participant companies on Friday (3/1). I am very clear on twitter in regards to non-vendors being in research, which happens very regularly in what I publish.

    The only issue I see is that non-clients don’t brief or talk with analysts as often. We also tend to see them mis-aligned with what client demands are; hence they don’t do as well in terms of market execution (being on the client short lists).

    I’ll keep this updated if anyone new contacts me, thanks for the correction on the wording Simon.

  • 6 Simon Levin   March 4, 2013 at 4:43 pm

    Glad to be of help.

    In my 10 years at Gartner we didn’t have published notes of criteria which could disrupt impartiality between clients and non-clients. These are clearly pieces of real value – but they must always be available to all relevant suppliers if they are published before the assessment cycle starts.

    The minute anyone at Gartner starts offering better quality information to clients to prepare than non-clients then that is the day the company’s reputation for impartiality goes forever. This is an incredibly important core value which you are risking or protecting by your actions.

  • 7 Jonah Kowall   March 8, 2013 at 7:29 pm

    Well the prior way it was handled was that nothing was published prior to a magic quadrant. This method is an improvement. I’m working with the methodology department on figuring out a way to fully correct visibility with regards to kicking off a magic quadrant and making criteria public early in the cycle.

  • 8 Eyal   March 27, 2013 at 11:53 am

    Is there a planned date for the release of Magic Quadrant for APM 2013?

    Thanks in advance,

  • 9 Jonah Kowall   March 27, 2013 at 1:11 pm

    These are published on our website:

    The APM MQ is scheduled for Q3 this year (and every year).

  • 10 Jonah Kowall   August 30, 2013 at 12:29 pm

    Sorry we don’t allow guest posts.

  • 11 Prashant   October 10, 2013 at 3:21 pm

    Any idea if there is a release date yet for APM MQ 2013? says Q3…aren’t we past that?

  • 12 Jonah Kowall   October 10, 2013 at 3:34 pm

    The research was completed in mid-August. Before we publish we allow vendors to review the research for factual accuracy. One of the vendors disagreed with our assessment, and we couldn’t come to an agreement. They escalated the research to our Ombudsman ( and we’ve been dealing with this escalation for the past 7 weeks (which is abnormally long). We are making progress and hope to publish the research very soon.

  • 13 2013 – Application Performance Monitoring...   October 11, 2013 at 7:25 am

    […] Jonah Kowall Research Director 1 year with Gartner 17 years IT industry. Jonah Kowall is a Gartner research director in the IT Operations area. He focuses on application performance management, runbook automation, event …  […]

  • 14 R J B   October 29, 2013 at 12:18 pm

    Is the MQ still being reviewed by the Ombudsman?

    P.S. you guys should add Captcha or something…

  • 15 Jonah Kowall   October 29, 2013 at 9:33 pm

    We are still going through some issues with the research, but we are in the home stretch.

  • 16 Jenifer Kenn   November 6, 2013 at 10:26 pm

    There passed several months since the planned date of 2013 Magic Quadrant, but there is no progress. Sorry, but this causes trust problems for Gartner.

  • 17 hexiaoyang   November 21, 2013 at 2:12 am

    非常希望能够早日看到2013 MQ的早日发布,我们期待这个报告已经已经三个月了。

  • 18 J W   November 26, 2013 at 2:15 pm

    Any word on a release date for the 2012 APM MQ?

  • 19 Jonah Kowall   November 26, 2013 at 2:24 pm

    2013… We’re still dealing with a particularly difficult escalation, hence the delays. You can rest assured we are motivated to get this resolved and be able to share the research. We understand this is frustrating.

  • 20 R J B   December 4, 2013 at 2:30 pm

    I can understand difficulty with the escalation, and even the delay to some extent, but why do we have to come to the comments section of a nearly 10-month-old blog post to get updates on this? Shouldn’t Gartner release an official explanation and expected timeline for release?

  • 21 Jonah Kowall   December 4, 2013 at 2:44 pm

    RJB : We don’t have a way to do that, blogging is pretty much the only way to communicate outside of social media. We are close to getting this released now. I will know more on Thursday and share it on social media @jkowall on twitter.

  • 22 Foz   December 10, 2013 at 2:36 pm

    Jonah, where is your update?

  • 23 Jonah Kowall   December 10, 2013 at 3:01 pm

    No good news to share, there are still delays on the publication.

  • 24 Dave   December 12, 2013 at 9:22 pm

    How can you call this a 2013 report? Disappointed that a vendor can hold this up. How valid are your findings if you alow this?

  • 25 Jonah Kowall   December 19, 2013 at 1:05 pm

    The report was released yesterday 12/18/13 we will also be sharing a market update note in January to catch us up due to the delays. Normally vendor escalations to the Ombudsman office ( are handed in 2-3 weeks, but in this case it took significantly longer.

  • 26 R J B   February 12, 2014 at 4:47 pm

    Hi Jonah,

    Is the market update available?

  • 27 Jonah Kowall   February 12, 2014 at 4:53 pm

    RJB : Very close now, it’s in editing… I will post and tweet once it’s published.

  • 28 rhinoplasty Portland   February 17, 2014 at 9:18 am

    The nose itself has cultural, ethnic, emotional and psychological significance.

    Rhinoplasty, also called a nose job, is really a surgery that is
    used to reshape and recontour the nose. The bump disturbs the harmony involving
    the cool features in the face.

  • 29 Latrice   April 28, 2014 at 11:57 pm

    4 million new smartphones and tablets were activated and
    that the craze of mobile browsing emails is certainly going become the next big trend to 2013,
    as proposed by Flurry Analytics. If duration is maybe not properly divided, one will probably
    lose important relationships. Iaa – S providers will either charge that you flat monthly fee
    for usage of his or her servers otherwise by the hour.

  • 30 zielona kawa   October 7, 2014 at 12:37 am

    Hi, all is going well here and ofcourse every one
    is sharing facts, that’s in fact fine, keep up writing.

  • 31 TQI Electronic Assembly   October 7, 2014 at 1:16 am

    Without the need to house tubes or accommodate
    a labyrinth of wires, they can be created to provide power for the smallest of
    electronic devices. In the warp-speed world of technology, five years is
    an eternity. Producers can supply “original equipment” or non-conforming replacement parts to repair a product
    sold into the market before the Ro – HS took effect.

  • 32 Anshul   October 30, 2014 at 8:01 am

    hi Jonah,

    seriously need to add a captcha here.

    do we have anything on APM coming up this year? I am keen to see how this is working for the middleware stack. i cant find any research on it.

  • 33 Jonah Kowall   November 6, 2014 at 1:30 pm

    I do a lot of screening of comments, captcha causes issues with people participating. Yes we have lots of research coming on APM, and it depends how you define “middleware” it’s a pretty vague term today.

  • 34 pc Softwares   January 25, 2015 at 12:43 am

    Useful information. Fortunate me I found your site by accident,
    and I am shocked why this coincidence didn’t happened in advance!
    I bookmarked it.

Leave a Comment