Peer Insights Voice of the Customer

 

FAQ Home / Peer Insights Voice of the Customer

Peer Insights Voice of the Customer

About VOC and markets

What is the Gartner Peer Insights ‘Voice of the Customer’?

What will you do to recognize vendors?

Does this replace the Magic Quadrant (MQ) view of a market?

How will this data be used in the MQ? Will receiving the distinction put us in the Leaders’ quadrant?

Publication / schedule related

Will I get this document to review before it publishes on the site (like we do for the MQ)?

Is there a minimum criteria required in order to publish a Voice of the Customer document for a market?

Which markets are/will be covered by the Gartner Peer Insights ‘Voice of the Customer’ report?

How do I access the Roadmap of markets for Voice of the Customer and Customers’ Choice?

Are Voice of the Customer documents published for all markets? How do you determine which markets will go for Voice of the Customer?

Is the Voice of the Customer still an annual document under this updated methodology? Is there any opportunity for a Voice of the Customer document to refresh more often?

How do I know when the 18-month window starts for my markets?

Reprints / Quote requests

Can we leverage this document as a reprint? What is price for the reprinting this document?

If I can get this information from the free Peer Insights site, why should I buy the reprint?

Methodology related (including CCD)

Which VOC methodology is currently used? Will the methodology change from year to year?

What are the inclusion criteria in a VOC?

How and when is market average calculated?

Does the overall market rating on the Y-axis use the same calculations as what we will see with the new site scoring updates?

Is there a limit to the maximum number of vendors that can be listed in a Voice of the Customer document for a market?

What are the inclusion criteria for Category Cuts?

What is User Interest & adoption?

How are vendors/products included in a VOC report?

Are reviews for products that are no longer sold included in the distinction analysis? What about reviews for products that are in beta test?

Why are you excluding reviews from companies that are less than 50M USD in annual revenue?

For how long is the distinction current?

Right now the reviews come sourced by Gartner as well as from vendors’ sourcing links. Aren’t vendor-sourced reviews inherently biased because vendors select their best clients and offer them incentives to write reviews?

Can I see my status for eligibility towards Customers’ Choice in a specific market?

Are vendor ratings rounded/truncated in the VOC?

Are more recent reviews weighted more heavily in VOC calculations and scores?

How is sensitivity to review volume managed?

What if I have more questions?

 

About VOC and markets

Back to Top

 

What is the Gartner Peer Insights ‘Voice of the Customer’?

The Gartner Peer Insights ‘Voice of the Customer’ is a Gartner research document that synthesizes Gartner Peer Insights’ content in a specific market for a specified 18-month period. This peer perspective along with the individual detailed reviews are complementary to expert research and was developed as an additional resource for end-users in their buying process.

Back to Top

 

What will you do to recognize vendors?

We will announce the vendors online on the Gartner Peer Insights platform. We also encourage vendors to drive awareness of their achievement through various marketing channels. We will provide digital marketing collateral and templates to help with these efforts.

Back to Top

 

Does this replace the Magic Quadrant (MQ) view of a market?

No, Gartner Peer Insights complements Magic Quadrant and Critical Capabilities reports by offering perspectives solely about what a vendor’s customers think of its products. Based on end-user feedback, our clients value having a holistic view of Gartner expert opinion and end-user perspective when evaluating vendors and their products in a market.

Back to Top

 

How will this data be used in the MQ? Will receiving the distinction put us in the Leaders’ quadrant?

The raw data from Peer Insights reviews is made available to our analysts, but it is only one factor among many that they consider when creating an MQ.

Publication / schedule related

Back to Top

 

Will I get this document to review before it publishes on the site (like we do for the MQ)?

The data used in the report is entirely based on end-user reviews and ratings that are available on the Peer Insights site. As a courtesy heads-up, we will share a draft directly with the vendors included in the document approximately 2 weeks ahead of report publication.

Back to Top

 

Is there a minimum criteria required in order to publish a Voice of the Customer document for a market?

Gartner reserves the right to selectively publish a Voice of the Customer document based on our determination of the value of that document to our end users. Currently we will only consider a Voice of the Customer document in markets where there is a certain level of market maturity (representing vendors and number of reviews) on the Peer Insights platform, and 5 or more vendors represented in the document. Only vendors with  20 or more reviews during the 18-month submission eligibility period are included in a Voice of the Customer research document. For more details, please go to the Voice of the Customer Methodology page.

Back to Top

 

Which markets are/will be covered by the Gartner Peer Insights ‘Voice of the Customer’ report?

Gartner reserves the right to selectively publish a Voice of the Customer document based on our determination of the value of that document to our end users. Currently we will only consider a Voice of the Customer document in markets where there is a certain level of market maturity (representing vendors and number of reviews) on the Gartner Peer Insights platform. For more information, see the detailed methodology and Voice of the Customer Roadmap.

Back to Top

 

How do I access the Roadmap of markets for Voice of the Customer and Customers’ Choice?

The Roadmap for upcoming Voice of the Customer markets can be found within the Voice of the Customer tile in the Resources tab of the Technology Provider Tools portal. Kindly note that this list and schedule are tentative and subject to change at the discretion of Gartner Peer Insights. It is updated frequently, so be sure to check often.

Back to Top

 

Are Voice of the Customer documents published for all markets? How do you determine which markets will go for Voice of the Customer?

Gartner reserves the right to selectively publish a Voice of the Customer document based on our determination of the value of that document to our end users. Currently we will only consider a Voice of the Customer document in markets where there is a certain level of market maturity (representing vendors and number of reviews) on the Gartner Peer Insights platform, and more than 5 vendors represented in the document. Only vendors with more than 20 reviews during the 18-month submission eligibility period are included in a Voice of the Customer research document. For more information, see the detailed methodology and Voice of the Customer Roadmap.

Back to Top

 

Is the Voice of the Customer still an annual document under this updated methodology? Is there any opportunity for a Voice of the Customer document to refresh more often?

The calendar for the Voice of the Customer document is based on the research publication calendar. After the Magic Quadrant or Market Guide publishes, the Gartner Peer Insights team will determine if the market meets the minimum review requirements for a Voice of the Customer document. Typically, the Voice of the Customer document publishes 5 months after the corresponding Magic Quadrant or Market Guide publication. If the Magic Quadrant or Market Guide publication is delayed, the Voice of the Customer will be delayed accordingly. See the Voice of the Customer Roadmap for a full calendar of upcoming markets.

Back to Top

 

How do I know when the 18-month window starts for my markets?

The start and end dates for upcoming markets are noted within the Voice of the Customer Roadmap. Alternatively, the 18-month period is retrospective from the deadline displayed on the Standings Page dashboard for the market.

Back to Top

Reprints / Quote requests

Can we leverage this document as a reprint? What is price for the reprinting this document?

The Gartner Peer Insights ‘Voice of the Customer’ document is able to be licensed as part of the Gartner reprint program to support your sales enablement, lead generation, and content marketing strategies. This Peer Insights research document reprint follows the same policies and pricing guidelines as any other research note reprints (e.g., MQ, critical capabilities). Existing Reprints clients may use an existing document “slot” for Peer Insights content. Please contact your account executive for more details.

The document provides valuable synthesized insights from our reviews that complement the analyst perspective in a format your clients could easily share with their investment committees.

Back to Top

 

If I can get this information from the free Peer Insights site, why should I buy the reprint?

We developed the PI research note as we heard consistently from end-users that they need a better shortlisting tool in a format they could easily share with their investment committees. The research note synthesizes the key insights from all the information available on the site using our proprietary methodology.

Although the data is available on site, the images that synthesize the information is not available. For example, the User Interest and Adoption axis in the main quadrant (Figure 1) is only available through this document.

It includes only a smaller set of eligible vendors, and shows their ratings over a fixed period of time (last 18 months) vs. the PI site which is continuously changing as reviews come in.

Many vendors who license the reprint of this report, often use it for lead generation. You cannot do that with Peer Insights site.

Purchasing a reprints license gives you access to a dedicated program manager who will handle all of the legwork for quote request approvals and help you to track the reprint impact

Back to Top

Methodology related (including CCD)

Which VOC methodology is currently used? Will the methodology change from year to year?

Our goal is to be analytically sound and transparent. To meet these goals, we expect our methodology will evolve over time as we learn from the process. We are committed to being completely transparent about our criteria for this distinction. View latest methodology and historical list of all methodologies. The new methodology will go into effect for all Voice of the Customer documents published in May 2021 and later.

Back to Top

 

What are the inclusion criteria in a VOC?

To be included in the “Voice of the Customer” report for a Gartner Peer Insights market, a vendor must have a product that aligns to that market as determined by Gartner Peer Insights and have 20 or more eligible reviews during the specified 18-month submission period. Please refer VOC methodology  for full details.

Back to Top

 

How and when is market average calculated?

The average market rating is determined by all eligible reviews submitted in the 18-month review period and therefore can change until the end of the review period as reviews are moderated and published. Vendors can view whether they are above, below, or in-range of market average for both axes on the Standings Page (updated daily). For more information, see the detailed methodology.

Back to Top

 

Does the overall market rating on the Y-axis use the same calculations as what we will see with the new site scoring updates?

Voice of the Customer Y-axis calculations use a specified 18-month time period with a lower weight for the oldest 6 months of that period. The star rating displayed on the Gartner Peer Insights reviews page shows either past 12 months or an all time average, with a lower weight for earlier years. Thus, the time periods for the Voice of the Customer and the Gartner Peer Insights reviews page will typically be different. For more information, see the detailed methodology.

Back to Top

Is there a limit to the maximum number of vendors that can be listed in a Voice of the Customer document for a market?

Yes, there is a limit. The Voice of the Customer document was specifically created to help end-users shortlist vendors in their buying/selection process. Currently, Gartner Peer Insights limits the number of vendors included in the document to 25. If more than 25 vendors meet the inclusion criteria, then 25 vendors with the highest number of eligible published reviews will be included. If two or more qualified vendors with the same number of eligible reviews tie for the 25th position, all vendors in the tie will be included in the document.

For more details, please go to the Voice of the Customer Methodology page.

Back to Top

 

What are the inclusion criteria for Category Cuts?

A vendor’s inclusion in category cuts will remain independent of representation in the overall Voice of the Customer  i.e, in a scenario where a vendor is excluded from ‘Voice of the Customer’ due to the maximum vendor limit, the vendor will continue to exist in category cuts if eligibility criteria for the category are met. See the category distinction methodology here.

Back to Top

 

What is User Interest & adoption?

Please refer to the Voice of the Customer methodology here for full details

Back to Top

 

How are vendors/products included in a VOC report?

A dedicated Peer Insights content team evaluates whether a technology provider’s products and/or services align with the Peer Insights markets based on a series of market guidelines defined by Gartner experts. The Peer Insights markets are periodically reviewed throughout the year to ensure alignment is maintained. For more details, refer to the Peer Insights listing guidelines.

Back to Top

 

Are reviews for products that are no longer sold included in the distinction analysis? What about reviews for products that are in beta test?

Reviews for products that are in production / general availability, along with beta products are included in calculations for the Voice of the Customer. Reviews for legacy products (that are no longer sold by the vendor) are not included in these calculations.

Back to Top

 

Why are you excluding reviews from companies that are less than 50M USD in annual revenue?

Gartner Peer Insights was developed with the global enterprise customer in mind. We define enterprise customers whose company sizes are greater than 50M USD in annual revenue.

Back to Top

 

For how long is the distinction current?

The Voice of the Customer document and Customers’ Choice distinction will be current for 15 months or until the next version of the Voice of the Customer for the market is published. Documents that are no longer current will remain visible on Gartner.com with an “Archived” tag. Our schedule for Voice of the Customer publication is determined based on the publish date of the corresponding MQ/MG and is subject to change based on the research calendar at the discretion of the Peer Insights team in conjunction with Research.

Back to Top

 

Right now the reviews come sourced by Gartner as well as from vendors’ sourcing links. Aren’t vendor-sourced reviews inherently biased because vendors select their best clients and offer them incentives to write reviews?

Our interviews with reviewers suggest that most of them are motivated by a desire to give back to the broader IT community. We’ve decided to include honest vendor-incentivized reviews as part of the relevant data set used to determine the distinctions. Our vetting process for reviews is extensive (see our FAQs for a summary), and we investigate any anomalies to ensure that users can trust the reviews in Gartner Peer Insights.

Back to Top

 

Can I see my status for eligibility towards Customers’ Choice in a specific market?

When a specific Peer Insights market is about 2 months out from a Voice of Customer sourcing deadline, the vendor Dashboard on the Technology Provider Tools portal will update to show eligibility towards inclusion in the Voice of the Customer and Customers’ Choice in that market. This information is dynamic, updating daily. Please note, the information shown in the Dashboard is not final and may change after sourcing periods close as part of our moderation and auditing process.

Back to Top

 

Are vendor ratings rounded/truncated in the VOC?

Yes. The market average Overall Rating is calculated by averaging all eligible vendors’ Overall Ratings. All vendor ratings and the market average Overall Rating are then truncated to the tenths place (e.g., ‘4.512’ becomes ‘4.5’). Vendors whose truncated scores meet or exceed the truncated market average are positioned in the upper-half quadrants, while vendors below the truncated market average are positioned in the bottom-half quadrants. These truncated scores are used to position vendors in the Voice of the Customer quadrants and are listed in Figure 2 in the Voice of the Customer document.

Back to Top

 

Are more recent reviews weighted more heavily in VOC calculations and scores?

Reviews from the first 6 months of the 18-month submission eligibility period will be given 50% weight in all calculations for both axes. This means that one review from the first 6 months will have half the impact of one review from the next 12 months in determining a vendor’s X-axis and Y-axis scores. The 18-month review period allows for a larger sample size of reviews and greater confidence in each vendor’s placement on the quadrant. The 50% weighting for reviews in the first 6 months allows more recent reviews to factor more heavily in determining a vendor’s placement.

Back to Top

 

How is sensitivity to review volume managed?

An asymptotic function is applied to reduce sensitivity to small changes in review count and review market coverage, especially for vendors with a large number of reviews. This means that for a vendor with a low review count (e.g., 20 reviews) who adds 10 more reviews will see a larger increase in review volume and review market coverage than a vendor with a high review count (e.g., 100 reviews).

Back to Top

 

What if I have more questions?

If you have any further questions, send us an email at PeerInsights@gartner.com and we will get back to you as soon as we can.