Gartner Blog Network


Introducing the Criteria for the 2015 Network Performance Monitoring and Diagnostics (NPMD) Magic Quadrant

by Jonah Kowall  |  August 15, 2014  |  10 Comments

Some changes in the upcoming Q1 2015 delivery of the NPMD Magic Quadrant. Vivek Bhalla will be taking over as the lead author of the research (@vbhalla1) and I’ll be co-authoring along with Colin Fletcher and Gary Spivak. We will be sending vendor surveys out on Monday, if you are a vendor who believes you qualify based on the criteria below and you did not receive a survey on Monday please reach out via email or twitter (firstname.lastname@gartner.com). We regularly include non-clients in research and this research is no different, we strive to build the most relevant research for our large end user client base.

Thank you, and we look forward to this research deliverable.

Market Definition

NPMD tools allow for network engineers to understand the performance of applications and infrastructure components via network instrumentation. Additionally, these tools provide insight into the quality of the end user’s experience. The goal of NPMD products is not only to monitor the network components to facilitate outage and degradation resolution, but also to identify performance optimization opportunities. This is conducted via diagnostics, analytics and debugging capabilities to complement additional monitoring of today’s complex IT environments.

This market is a fast-growing segment of the larger network management space ($1.9 billion in 2013) and overlaps slightly with aspects of the application performance monitoring space ($2.4 billion in 2013). Gartner estimates the size of the NPMD tools market at $1.1 billion.

Inclusion Criteria

Vendors will be required to meet the following criteria to be considered for the 2015 NPMD Magic Quadrant:

  • The ability to monitor, diagnose and generate alerts for:
    • Network endpoints — Servers, virtual machines, storage systems or anything with an IP address by measuring these components directly in combination with a network perspective.
    • Network components — Such as routers, switches and other network devices. This includes SDN and NFV components.
    • Network links — Connectivity between network-attached infrastructure.
  • The ability to monitor, diagnose and generate alerts for dynamic end-to-end network service delivery as it relates to:
    • End-user experience — The capture of data about how end-to-end application availability, latency and quality appear to the end user from a network perspective. This is limited to the network traffic visibility and not within components such as what application performance monitoring is able to accomplish.
    • Business service delivery — The speed and overall quality of network service and/or application delivery to the user in support of key business activities, as defined by the operator of the NPMD product. These definitions may overlap as services and applications are recombined into new applications.
    • Infrastructure component interactions — The focus on infrastructure components as they interact via the network, as well as the network delivery of services or applications.
  • Support for analysis of:
    • Real-time performance and behaviors — Essential for troubleshooting in the current state of the environment. Analysis of data must be done within three minutes under normal network loads and conditions.
    • Historical performance and behaviors — To help understand what occurred or what is trending over time.
    • Predictive behaviors by leveraging IT operations analytics technologies — The ability to distill and create actionable advice from the large dataset collected across the fourth requirement.
  • Leverage the following data sources:
    • Network-device-generated data, including flow-based data sources inclusive of NetFlow and IPFIX.
    • Network device information collected via SNMP.
    • Network packet analysis to identify application types and performance characteristics.
  • The ability to support the following scalability and performance requirements:
    • real-time monitoring of 10 gigabit (10G) Ethernet networks at full line rate via a single instance of the product
    • Ingest sampled flow records at a rate of 75,000 flows per second via a single instance of the product

Non-product Related Criteria

  • A minimum of 10 NPMD customer references must be included at the time of survey submission.
  • Customer references must exclude security-oriented use cases and scenarios.
  • Customer references must be located in at least two of the following geographic locations: North America, South America, EMEA, and/or Asia/Pacific/Japan.
  • Total NPMD product revenue (including new licenses, updates, maintenance, subscriptions, SaaS, hosting and technical support) must have exceeded $7.5 million in 2013, excluding revenue derived from security-related buying centers.
  • The vendor should have at least 75 customers that use its NPMD product actively in a production environment.
  • The product, and the specific version, submitted for evaluation must be shipping to end-user clients for production deployment and designated with general availability by  October 31st 2014.

Critical Capabilities

The 2015 NPMD Critical Capabilities that will be published subsequent to the 2015 NPMD Magic Quadrant and be a complimentary piece of research.

Your survey submission and demo briefing will also be used for the purposes of writing this document in addition to the Magic Quadrant.

The 2015 NPMD Critical Capabilities will be assessed upon the following criteria:

  1. End-point, Component and Link Monitoring
  2. Service Delivery Monitoring
  3. Diagnostics
  4. IT Operations Analytics
  5. Integration

In addition to the above criteria, we will be evaluating each vendor’s ability to cross multiple buying centers, as well as its ability to target specific verticals as validated by reference customers.

Additional Resources

View Free, Relevant Gartner Research

Gartner's research helps you cut through the complexity and deliver the knowledge you need to make the right decisions quickly, and with confidence.

Read Free Gartner Research

Category: it-operations  monitoring  npm  npmd  

Jonah Kowall
Research Vice President
3.5 years with Gartner
20 years IT industry

Jonah Kowall is a research Vice President in Gartner's IT Operations Research group. He focuses on application performance monitoring (APM), Unified Monitoring, Network Performance Monitoring and Diagnostics (NPMD), Infrastructure Performance Monitoring (IPM), IT Operations Analytics (ITOA), and general application and infrastructure availability and performance monitoring technologies. Read Full Bio


Thoughts on Introducing the Criteria for the 2015 Network Performance Monitoring and Diagnostics (NPMD) Magic Quadrant


  1. […] Source: Introducing the Criteria for the 2015 Network Performance Monitoring and Diagnostics (NPMD) Magic Qu… […]

  2. Jonah,

    Keen to see how this one pans out. One area that i think most vendors including Gartner missing out is the “Capacity Management” dimension with regards to Performance Management.

    Most of these tools i.e. APM or NPM generate large amounts of data a lot of which is high relevant (given that the modern tools understand the business context i.e. the actual transaction as it flows through the system) but these tools offer little capability to help manage/predict platform (infra or network) capacity.

    Good stuff. Will be on the look out for the report when it’s published.

    Cheers,
    Trevor
    trevor at practical performance analyst dot com

  3. Jonah Kowall says:

    We have research covering capacity management, and it’s a feature of many offerings today. The issue is each silo of technology is handled disconnected from the others. There are many tools to capacity plan servers, storage, networks, or virtualization. This may change over time as some of the newer APM players expand into new data sources, but keep a consistent model.

    I wrote a research note on this topic with my colleague who covers capacity planning in October 2012 : Using Virtual Server Optimization Tools Requires Careful Network and Storage Architecting

  4. xem phim sex says:

    trevor at practical performance analyst

  5. maintenant présent dans 99 villes et 19 pays. Le 15 mai il s’affranchira du cyberespace pour lancer une offensive majeure en direction des étoiles qui nous entourent bien au-delà du système solaire

  6. maintenant présent dans 99 villes et 19 pays. Le 15 mai il s’affranchira du cyberespace pour lancer une offensive majeure en direction des étoiles qui nous entourent bien au-delà du

  7. maintenant présent dans 99 villes et 19 pays. Le 15 mai il s’affranchira du cyberespace pour lancer une offensive majeure en direction des étoiles qui nous entourent

  8. maintenant présent dans 99 villes et 19 pays. Le 15 mai il s’affranchira du cyberespace pour lancer une offensive majeure en direction

  9. maintenant présent dans 99 villes et 19 pays. Le 15 mai il s’affranchira du cyberespace pour lancer une offensive

  10. maintenant présent dans 99 villes et 19 pays. Le 15 mai il s’affranchira du cyberespace pour lancer une



Leave a Reply

Your email address will not be published. Required fields are marked *

Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.