In talking to clients, we often guide them to ask for reference customers. This is particularly important for emerging technology such as SDN.
However, clients have asked for more detail around what specifically to ask these reference customers. In addition, as analysts we take a lot of reference calls, I probably do 25-50 p/year with early adopters of new technologies and have a pretty standard set of questions, to extract the key value and differentiation a vendor provides.
So here’s a base set of questions (side note for vendors – these are the questions I am asking your reference customers, in all likelihood).
- What was the biggest driver(s) / goal(s) to move towards this solution (i.e., agility, cost, scale/capacity, availability, standard refresh, future-proofing)?
- Did you achieve the goals above? For example, If cost, did you save money and how much? If agility, did you improve provisioning times, and by how much?
- Tell me a little bit about your current environment, specifically:
- What type of apps are running on the infrastructure?
- What is the scale of the current deployment? A metric that is pretty universal is the number of servers (physical and/or virtual).
- Who are your key infrastructure vendors (compute, network, storage, virtualization, security, ADC/WOC, monitoring/mgmt tools)?
- What is the criticality of the deployed environment (i.e.,. Lab, Test, Dev, QA, Staging, Pre-Prod, Prod)?
- What other alternatives (if any) did you consider?
- What were the key differentiators that drove you towards the vendor’s solution versus alternatives? This is really the money question, and the key is whether these differentiators apply to your environment.
- What degree of support have you been provided by the vendor (standard support of white-glove treatment)? Was professional services required? How long did deployment take?
- What has been the best part and/or biggest positive surprise about the deployment?
- What has been the biggest weakness (shortcoming) related to the deployment?
- How did you handle staffing, was re-organization, training or cultural shifts required?
- Related question: What is your primary mechanism for configuration? GUI, CLI, API, Mix, Other?
- On a scale of 1-10, how would you rate the vendor’s solution?
- Would you use this vendor again and/or recommend this vendor to others?
- What is the one thing you wish you’d done differently?
And some related research…
Four Key Questions to Ask Your Data Center Networking Vendor
Ask Your SDN Vendor Seven Key Questions Before You Buy