Introducing the Criteria for the 2015 Network Performance Monitoring and Diagnostics (NPMD) Magic Quadrant
Some changes in the upcoming Q1 2015 delivery of the NPMD Magic Quadrant. Vivek Bhalla will be taking over as the lead author of the research (@vbhalla1) and I’ll be co-authoring along with Colin Fletcher and Gary Spivak. We will be sending vendor surveys out on Monday, if you are a vendor who believes you qualify based on the criteria below and you did not receive a survey on Monday please reach out via email or twitter (firstname.lastname@example.org). We regularly include non-clients in research and this research is no different, we strive to build the most relevant research for our large end user client base.
Thank you, and we look forward to this research deliverable.
NPMD tools allow for network engineers to understand the performance of applications and infrastructure components via network instrumentation. Additionally, these tools provide insight into the quality of the end user’s experience. The goal of NPMD products is not only to monitor the network components to facilitate outage and degradation resolution, but also to identify performance optimization opportunities. This is conducted via diagnostics, analytics and debugging capabilities to complement additional monitoring of today’s complex IT environments.
This market is a fast-growing segment of the larger network management space ($1.9 billion in 2013) and overlaps slightly with aspects of the application performance monitoring space ($2.4 billion in 2013). Gartner estimates the size of the NPMD tools market at $1.1 billion.
Vendors will be required to meet the following criteria to be considered for the 2015 NPMD Magic Quadrant:
- The ability to monitor, diagnose and generate alerts for:
- Network endpoints — Servers, virtual machines, storage systems or anything with an IP address by measuring these components directly in combination with a network perspective.
- Network components — Such as routers, switches and other network devices. This includes SDN and NFV components.
- Network links — Connectivity between network-attached infrastructure.
- The ability to monitor, diagnose and generate alerts for dynamic end-to-end network service delivery as it relates to:
- End-user experience — The capture of data about how end-to-end application availability, latency and quality appear to the end user from a network perspective. This is limited to the network traffic visibility and not within components such as what application performance monitoring is able to accomplish.
- Business service delivery — The speed and overall quality of network service and/or application delivery to the user in support of key business activities, as defined by the operator of the NPMD product. These definitions may overlap as services and applications are recombined into new applications.
- Infrastructure component interactions — The focus on infrastructure components as they interact via the network, as well as the network delivery of services or applications.
- Support for analysis of:
- Real-time performance and behaviors — Essential for troubleshooting in the current state of the environment. Analysis of data must be done within three minutes under normal network loads and conditions.
- Historical performance and behaviors — To help understand what occurred or what is trending over time.
- Predictive behaviors by leveraging IT operations analytics technologies — The ability to distill and create actionable advice from the large dataset collected across the fourth requirement.
- Leverage the following data sources:
- Network-device-generated data, including flow-based data sources inclusive of NetFlow and IPFIX.
- Network device information collected via SNMP.
- Network packet analysis to identify application types and performance characteristics.
- The ability to support the following scalability and performance requirements:
- real-time monitoring of 10 gigabit (10G) Ethernet networks at full line rate via a single instance of the product
- Ingest sampled flow records at a rate of 75,000 flows per second via a single instance of the product
Non-product Related Criteria
- A minimum of 10 NPMD customer references must be included at the time of survey submission.
- Customer references must exclude security-oriented use cases and scenarios.
- Customer references must be located in at least two of the following geographic locations: North America, South America, EMEA, and/or Asia/Pacific/Japan.
- Total NPMD product revenue (including new licenses, updates, maintenance, subscriptions, SaaS, hosting and technical support) must have exceeded $7.5 million in 2013, excluding revenue derived from security-related buying centers.
- The vendor should have at least 75 customers that use its NPMD product actively in a production environment.
- The product, and the specific version, submitted for evaluation must be shipping to end-user clients for production deployment and designated with general availability by October 31st 2014.
The 2015 NPMD Critical Capabilities that will be published subsequent to the 2015 NPMD Magic Quadrant and be a complimentary piece of research.
Your survey submission and demo briefing will also be used for the purposes of writing this document in addition to the Magic Quadrant.
The 2015 NPMD Critical Capabilities will be assessed upon the following criteria:
- End-point, Component and Link Monitoring
- Service Delivery Monitoring
- IT Operations Analytics
In addition to the above criteria, we will be evaluating each vendor’s ability to cross multiple buying centers, as well as its ability to target specific verticals as validated by reference customers.
Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.