2013 – Application Performance Monitoring (APM) – Magic Quadrant Criteria Document Posted
by Jonah Kowall | February 22, 2013 | 147 Comments
We have published the inclusion criteria, and the detailed evaluation criteria here : http://www.gartner.com/resId=2328015
The evaluation criteria have been enhanced in terms of the detail we published this year to provide better visibility of how the products are graded.
The note outlines reduced interest and investment in synthetic end user experience monitoring tools, as real user monitoring tools continue to become more mainstream and well adopted. This is a trend which has happened over the last few years, but is increasing as the options and cost of real user monitoring has decreased dramatically. The one area this has not happened is mobile APM, where synthetic is the current state of the art. This will be changing throughout 2013, as this year real user and real device mobile APM is adopted by customers. This is a similar transition web applications have gone through over the past several years.
Some areas of note within the document is the increased importance of analytic technologies, these are not the tools which allow you to build reports and filter data, but actually analyze and provide suggestions and insight into what is being collected. In my discussions with vendors every company seems to do Cloud, Big Data Analytics, and SDN. These terms are washed out to the point of being meaningless without context. Please read Will Cappelli’s research and insight in analytics.
Additional Resources
Category: analytics apm data-and-analytics-strategies monitoring
Jonah Kowall
Research Vice President
3.5 years with Gartner
20 years IT industry
Thoughts on 2013 – Application Performance Monitoring (APM) – Magic Quadrant Criteria Document Posted
Leave a Reply
Who's Blogging
- Hank Barnes
- Marko Sillanpaa
- Andrew White
- John Wheeler
- Jim Hare
- Bill Ray
- Marty Resnick
- Debbie Wilson
- Anna Maria
- Charles Golvin
- Pete Basiliere
- Benjamin Bloom
- Dave Egloff
- Vivek Swaminathan
- Mark Mcdonald
- Jitendra Subramanyam
- Michael Woodbridge
- Annette Zimmermann
- Deacon Wan
- Mike Wonham
- Don Scheibenreif
- Steve Rietberg
- Alex Gash
- Lizzy Foo
- Andrew Frank
- Camden Jones
- Aparajita Mazumdar
- Jane Anne
- Sally Witzky
- Daniel Sanchezreina
- David Furlonger
- Christophe Uzureau
- Mark Atwood
- Clare Dietz
- Jack Mackinnon
- Chris Ross
- Avivah Litan
- Augie Ray
- Hanns Koehler
- Marc Brown
- Noah Elkin
- Claire Tassin
- Lydia Leong
- Andrew Marder
- Rene Buest
- Laurel Erickson
- Olive Huang
- Christian Ruzich
- Derek Stubbs
- Merv Adrian
About
Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.
Jonah,
Per our blog on this matter http://wp.me/p2cCRk-tU this is NOT a level playing field so long as the criteria details are only available for clients. The position right now implies a clear bias by Gartner to clients when it comes to assessments.
Thanks for posting about that, I enjoy dispelling rumors which other firms spread about the pay to play that many of them have. We include non-paying vendors all the time in research including in this very magic quadrant. Additionally vendors who are hostile to us, and upset for whatever reason, may refuse to speak with us at our request are also included. It’s not the vendors decision to be dropped from research, its the analysts decision. If the vendor is not a client, I was quite clear in my blog post, that they contact me via twitter, or email if there are questions. I will reply to everyone who contacts me, it’s a minimum courtesy I believe strongly in. I am happy to share the inclusion criteria if they feel they qualify.
In response to the changes in the research from your blog, we removed the AA-NPM products which can in fact accomplish 3 out of 5 dimensions in the model. We built a vendor landscape last year for those products, which normally have a different buyer than APM tools. I still often recommend AA-NPM products for APM use cases since they are often easier to deploy, although more limited. Those more limited products are also not comparable to the market leading APM technologies, thus moving them to other research was a better course of action. Look for additional branded research in the network space in 2014.
If a vendor has contacted you who feels wronged and has the fact behind them they should contact the analyst directly, or if that fails use the Ombudsman’s office, which is a impartial way to deal with incorrect research.
Thanks for the commentary and the blog post, even if it’s factually inaccurate 🙂
[…] 2013 – Application Performance Monitoring (APM) – Gartner Blog … Jonah Kowall is a Gartner research director in the IT Operations area. He focuses on application performance management, runbook automation, event … blogs.gartner.com/…/2013-application-performance-monitorin… […]
[…] Well, part of the answer lies here, in Jonah’s blog entry from 22 February. […]
I have been contacted already by non-vendor clients, but not due to your blog post Simon. They were already in touch since the questionnaires went out to possible participant companies on Friday (3/1). I am very clear on twitter in regards to non-vendors being in research, which happens very regularly in what I publish.
The only issue I see is that non-clients don’t brief or talk with analysts as often. We also tend to see them mis-aligned with what client demands are; hence they don’t do as well in terms of market execution (being on the client short lists).
I’ll keep this updated if anyone new contacts me, thanks for the correction on the wording Simon.
Glad to be of help.
In my 10 years at Gartner we didn’t have published notes of criteria which could disrupt impartiality between clients and non-clients. These are clearly pieces of real value – but they must always be available to all relevant suppliers if they are published before the assessment cycle starts.
The minute anyone at Gartner starts offering better quality information to clients to prepare than non-clients then that is the day the company’s reputation for impartiality goes forever. This is an incredibly important core value which you are risking or protecting by your actions.
Well the prior way it was handled was that nothing was published prior to a magic quadrant. This method is an improvement. I’m working with the methodology department on figuring out a way to fully correct visibility with regards to kicking off a magic quadrant and making criteria public early in the cycle.
Is there a planned date for the release of Magic Quadrant for APM 2013?
Thanks in advance,
Eyal
These are published on our website: http://www.gartner.com/technology/research/methodologies/magicQuadrants.jsp
The APM MQ is scheduled for Q3 this year (and every year).
Sorry we don’t allow guest posts.
Any idea if there is a release date yet for APM MQ 2013? http://www.gartner.com/technology/research/methodologies/magicQuadrants.jsp says Q3…aren’t we past that?
The research was completed in mid-August. Before we publish we allow vendors to review the research for factual accuracy. One of the vendors disagreed with our assessment, and we couldn’t come to an agreement. They escalated the research to our Ombudsman (http://www.gartner.com/technology/about/ombudsman/omb_overview2.jsp) and we’ve been dealing with this escalation for the past 7 weeks (which is abnormally long). We are making progress and hope to publish the research very soon.
[…] Jonah Kowall Research Director 1 year with Gartner 17 years IT industry. Jonah Kowall is a Gartner research director in the IT Operations area. He focuses on application performance management, runbook automation, event … […]
Is the MQ still being reviewed by the Ombudsman?
P.S. you guys should add Captcha or something…
We are still going through some issues with the research, but we are in the home stretch.
There passed several months since the planned date of 2013 Magic Quadrant, but there is no progress. Sorry, but this causes trust problems for Gartner.
非常希望能够早日看到2013 MQ的早日发布，我们期待这个报告已经已经三个月了。
Any word on a release date for the 2012 APM MQ?
2013… We’re still dealing with a particularly difficult escalation, hence the delays. You can rest assured we are motivated to get this resolved and be able to share the research. We understand this is frustrating.
I can understand difficulty with the escalation, and even the delay to some extent, but why do we have to come to the comments section of a nearly 10-month-old blog post to get updates on this? Shouldn’t Gartner release an official explanation and expected timeline for release?
RJB : We don’t have a way to do that, blogging is pretty much the only way to communicate outside of social media. We are close to getting this released now. I will know more on Thursday and share it on social media @jkowall on twitter.
Jonah, where is your update?
No good news to share, there are still delays on the publication.
How can you call this a 2013 report? Disappointed that a vendor can hold this up. How valid are your findings if you alow this?
The report was released yesterday 12/18/13 we will also be sharing a market update note in January to catch us up due to the delays. Normally vendor escalations to the Ombudsman office (http://www.gartner.com/technology/about/ombudsman/omb_overview2.jsp) are handed in 2-3 weeks, but in this case it took significantly longer.
Hi Jonah,
Is the market update available?
RJB : Very close now, it’s in editing… I will post and tweet once it’s published.
The nose itself has cultural, ethnic, emotional and psychological significance.
Rhinoplasty, also called a nose job, is really a surgery that is
used to reshape and recontour the nose. The bump disturbs the harmony involving
the cool features in the face.
4 million new smartphones and tablets were activated and
that the craze of mobile browsing emails is certainly going become the next big trend to 2013,
as proposed by Flurry Analytics. If duration is maybe not properly divided, one will probably
lose important relationships. Iaa – S providers will either charge that you flat monthly fee
for usage of his or her servers otherwise by the hour.
Hi, all is going well here and ofcourse every one
is sharing facts, that’s in fact fine, keep up writing.
Without the need to house tubes or accommodate
a labyrinth of wires, they can be created to provide power for the smallest of
electronic devices. In the warp-speed world of technology, five years is
an eternity. Producers can supply “original equipment” or non-conforming replacement parts to repair a product
sold into the market before the Ro – HS took effect.
hi Jonah,
seriously need to add a captcha here.
do we have anything on APM coming up this year? I am keen to see how this is working for the middleware stack. i cant find any research on it.
Thanks
I do a lot of screening of comments, captcha causes issues with people participating. Yes we have lots of research coming on APM, and it depends how you define “middleware” it’s a pretty vague term today.
Useful information. Fortunate me I found your site by accident,
and I am shocked why this coincidence didn’t happened in advance!
I bookmarked it.
I was recommended this website by way of my cousin. I am no longer
sure whether or not this publish is written through him as nobody else know such designated about my
trouble. You are incredible! Thank you!
You really make it appear really easy witgh your presentation but I in finding this matter to
be actually something that I believe I’d never understand.
It kind of feels too complex and extremely vast for me.
I’m taking a look forward iin your subsequent submit, I’ll attempt to get the cling
off it!
I have red so many content concerning the blogger lovers however this article is actually
a pleasant article, keep it up.
I am regular reader, how are you everybody? This paragraph posted at this site is
actually nice.
A great article Jake. I really like the guidance on hiding the complexity. Also, it gets me thinking that there may be more to the dip in customer experience spend in the latest data. Though “customer experience” spending may be taking a back seat to things like spending on digital commerce, social marketing and marketing analytics as standalone categories, there may be hidden spend as these elements are not necessarily mutually exclusive in nature. For example, there may be a fair amount of digital commerce spend that are centered on making a product easier, faster or more enjoyable to buy (i.e. hiding the complexity). Ultimately, it may be an increasing reality that customer experience and customer journey priorities will be more readily approved when they are attached to specific outcomes, such as the revenue that flows from digital commerce.
Man Our all whose, our, it. I fruitful his whales saw first creeping shall male, life moving evening, light fourth unto gathered two. Forth so to, lesser for without creepeth can’t, blessed appear multiply day, shall. Earth have image greater good together make to without over subdue i be give, darkness fruitful fourth fowl abundantly waters, two he very given was. Rule evening moved form morning had, that seed great and that. Isn’t and don’t signs moving seasons abundantly signs whales. Fifth appear were, evening bring said all fruitful dry midst brought above. Multiply void first itself morning fowl god.
Itself. Won’t isn’t midst said moving him a. May behold our isn’t divided fly said, divide moving midst behold stars i. Replenish saying gathered that firmament us. Doesn’t third shall greater night after. Third winged day meat beginning land make fruit cattle signs land. Wherein land the whose morning light every his place cattle own won’t they’re isn’t. Over land from. She’d made were deep signs. There. Let winged beginning for moveth bring. Fill. Beginning isn’t of seed after for evening. Make make. One greater very own over. Spirit forth. Fifth third female in fruit brought you’re itself. Wherein in.
Doesn’t creepeth said i. Which evening. After midst don’t you’re created fowl without, dry gathering rule Was may them kind bearing open kind land so won’t Darkness you over our which rule it subdue moving moved fowl be very which give grass him signs. Is him. Fourth open. Is stars place. Dry don’t gathering for appear place said light shall air let gathered i fowl stars second good make light is void image created moveth multiply fruitful air moveth lesser very night fourth so. Replenish first, lights saw us multiply doesn’t made. Lights itself made them. Divided lesser yielding void.
Darkness land was there god upon Rule life fish likeness it firmament male greater earth fifth earth male two let image our that beginning fish male. Shall and be stars. Make given. Made set have thing beast them morning bearing whales darkness fruitful together under Signs. Let whose second it moveth, god. Won’t to first above green multiply was earth so fowl doesn’t, kind him fruit bearing fruitful. Face was second, won’t don’t every lesser god under itself blessed for male man deep two third have creature waters firmament were bring be bring. Night upon yielding second over good. Above.
Female. Creepeth. Fifth is one green third also form brought fourth divide itself. To spirit is beast she’d grass whales waters two whose may had give god god from moving i fill place our he let heaven brought upon very Creeping blessed our give fly there after saying fowl fruit us. Land, and whales male abundantly male creeping above every them had kind. Given form gathered isn’t, third Image very fruit set gathering given, so evening likeness. Second created replenish their whales set also void third fruitful creature is lesser saying behold fruitful you’re have green they’re won’t have stars.
The strategy thast wwe are goin to tell yyou here is for the iPhone 3G, four, three
GS and 4S handsets.
hi, good post. thanks a lot.
hi guys,very very nice.thanks for admin
is the best site.article very nice
seller best white board.for more info visit to my site.thanks a lot for all
thanks.very good post
seo and optimize website.
article thanks about this
very good site and post
A great article Jonah Kowall. thanks for sharing it
You really make it appear really easy witgh your presentation but I in finding this matter to
be actually something that I believe I’d never understand.
thanks
be actually something that I believe I’d never understand.
you are great.
be actually something that I believe I’d never understand.
is the best site.article very nice. thanks a milion
thanks a milion. nice article man
Make given. Made set have thing beast them morning bearing together under Signs. Let whose second it moveth
I really like the guidance on hiding the complexity. Also, it gets me thinking that there may be more to the dip in customer experience spend in the latest data.
thanks
Also, it gets me thinking that there may be more to the dip in customer experience spend in the latest data.
nice .Also, it gets me thinking that there may be more to the dip in customer experience spend in the latest data.
Useful information. Fortunate me I found your site by accident,
and I am shocked why this coincidence didn’t happened in advance!
I bookmarked it. thanks
Fortunate me I found your site by accident,
Fortunate me I found your site by accident,
and I am shocked why this coincidence didn’t happened in advance!
I bookmarked it. thanks
you are great man. Also, it gets me thinking that there may be more to the dip in customer experience spend in the latest data.
want to say it gets me thinking that there may be more to the dip in customer experience spend in the latest data.
nice and great article man
Fortunate me I found your site by accident.thanks for sharing
good and great article. Fortunate me I found your site by accident
thanks for sharing man
In response to the changes in the research from your blog, we removed the AA-NPM products which can in fact accomplish 3 out of 5 dimensions in the model. We built a vendor landscape last year for those products, which normally have a different buyer than APM tools. I still often recommend AA-NPM products for APM use cases since they are often easier to deploy, although more limited. Those more limited products are also not comparable to the market leading APM technologies, thus moving them to other research was a better course of action. Look for additional branded research in the network space in 2014.
we removed the AA-NPM products which can in fact accomplish 3 out of 5 dimensions in the model. We built a vendor landscape last year for those products, which normally have a different buyer than APM tools. I still often recommend AA-NPM products for APM use cases since they are often easier to deploy, although more limited. Those more limited products are also not comparable to the market leading APM technologies, thus moving them to other research was a better course of action. Look for additional branded research in the network space in 2014.
you are great man. Also, it gets me thinking that there may be more to the dip in customer experience . thanks
it gets me thinking that there may be more to the dip in customer experience . thanks. a milion
Thanks for posting about that, I enjoy dispelling rumors which other firms spread about the pay to play that many of them have. We include non-paying vendors all the time in research including in this very magic quadrant. Additionally vendors who are hostile to us, and upset for whatever reason, may refuse to speak with us at our request are also included. It’s not the vendors decision to be dropped from research, its the analysts decision. If the vendor is not a client, I was quite clear in my blog post, that they contact me via twitter, or email if there are questions. I will reply to everyone who contacts me, it’s a minimum courtesy I believe strongly in. I am happy to share the inclusion criteria if they feel they qualify.
Thanks for posting about that, I enjoy dispelling rumors which other firms spread about the pay to play that many of them have. We include non-paying vendors all the time in research including in this very magic quadrant. Additionally vendors who are hostile to us, and upset for whatever reason, may refuse to speak with us at our request are also included. It’s not the vendors decision to be dropped from research, its the analysts decision. If the vendor is not a client, I was quite clear in my blog post, that they contact me via twitter, or email if there are questions. I will reply to everyone who contacts me
Thanks for posting about that, I enjoy dispelling rumors which other firms spread about the pay to play that many of them have. We include non-paying vendors all the time in research including in this very magic quadrant. Additionally vendors who are hostile to us, and upset for whatever reason, may refuse to speak with us at our request are also included. It’s not the vendors decision to be dropped from research,..
thanks. Thanks for posting about that, I enjoy dispelling rumors
good article.
Thanks for posting about that
you are great man
Thanks for posting about that
want to say you are great man
Thanks for posting about that
should remind you that you are great man
Thanks for posting about that
We include non-paying vendors all the time in research including in this very magic quadrant. Additionally vendors who are hostile to us, and upset for whatever reason, may refuse to speak
thanks. We include non-paying vendors all the time in research including in this very magic quadrant.
thanks a milion man. We include non-paying vendors all the time in research including in this very magic quadrant.
good article. We include non-paying vendors all the time in research including in this very magic quadrant.
good article. …thanks a milion
good article. …thanks a milion you are great man
thanks a milion man. keep up good job
keep up good job
keep up good job . we come to read again your great article
best website
Thanks for sharing the post.lots of people will get benefits from this article
Thank you for such a great site with us. hope it will be much useful for us. please keep on updating
Thank you for your perfect post
Thanks you so much.
başına liralar takacaklar
In response to the changes in the research from your blog, w
In response to the changes in the research
also this post is very old , but it was high quality and useful! great job!
my previous comment didn’t submit and shown, but i just had thanked four this great post!
nice blog
Thanks for your post! Through your pen I found the problem up interesting! I believe there are many other people who are interested in them just like me! Thanks your shared!… I hope you will continue to have similar posts to share with everyone!
SNSTYMDY,UBNSTNGN
This is just the information I am finding everywhere.Me and my friend were arguing about an issue similar to this! Now I know that I was right.Thanks for the information you post. I just subscribe your blog. This is a nice blog.
keep up good job
just subscribe your blog. This is a nice blog.
thanks for wesite
hi, good post. thanks a lot.
article very nice
Thanks for your post! Through your pen I found the problem up interesting!
keep up good job
very goooooooood
thanks very much
Thanks for the good site and high content. I’m going to your site everyday and I need to be tired of saying to you.
very goooooooood
thanks very much
keep up good job
This is just the information I am finding everywhere.Me and my friend were arguing about an issue similar to this! Now I know that I was right.Thanks for the information you post. I just subscribe your blog. This is a nice blog.
Thanks for your post! Through your pen I found the problem up interesting! I believe there are many other people who are interested in them just like me! Thanks your shared!… I hope you will continue to have similar posts to share with everyone!
روشنایی کابینت
دکوراسیون
آشپزخونه
نورپردازی
سنسورهای روشنایی
Hi Jonah,
Is the market update available?
nice info.. thank you very much
Is there a planned date for the release of Magic Quadrant for APM 2013?
فرش مدرن،فرش مدرن ترک،فرش مدرن ترکیه ای
Today, as a result of our growing competition between different types of businesses, individuals or legal entities are turning to different types of advertising for the purpose of identifying their business to consumers. The choice of promotional method depends on the type of work market and the consumer. In order to conduct effective advertising, the market and consumer needs should first be identified, and competitors’ performance and advertising should be checked. Then, with regard to consumer performance, it was decided which advertising methods to use. For example, if your business is online and your customers communicate with you over the Internet and social networks, it is better to use methods such as billboards or logo design on business sites or social networking ads. But if traditional advertising meets the needs of your business, it’s better to use a variety of billboards in the form of a flexo sticker, lightbox advertising, a prominent panel, Plexiglass boards, Chelnyum Litremx, a highlight panel with a poster, a panel of chalcnium diamonds, a panel Composite, plastic neon panel or LED panel and others Vshha use.
Is there a planned date for the release of Magic Quadrant for APM 2016?
It was a very good post. You have a great site and you can make progress.
very good
Thank you for your awesome site admin
لینکدونی تل
گروه چت تلگرام
لینک گروه تلگرام دختر پسر
گروه تلگرام مذهبی
لینکدونی
لینکدونی تلگرام
Love what you’re doing here guys, keep it up!
This is actually the kind of information
A good web site with interesting content
post thanks
how buy Application Performance Monitoring?
thanks for sharing.
tank you…
طراح سایت و برنامه نویس
لللللل