by Thomas Murphy | May 15, 2013 | Submit a Comment
We’ve begun work on the update to the Magic Quadrant for ALM. We are subtly shifting our terminology for the market from Application Lifecycle Management to Application Development Lifecycle Management. We feel this is a more accurate depiction of what the tools in this space are focused on.
Participants this year all have at least 200 active customer installations, $5M per year in revenue. These vendors are also actively brought up by our clients on calls and thus have created some recognition at the enterprise level. There are many other products in the market that are effective for specific roles or at the project level, our goal is to look at tools that are effective at scale and most of the vendors being covered have installations with 1000 or more users.
We will be using the same criteria as the prior edition of the MQ. We will however, have an additional use case for product development which supports the 2011 Maverick research by Matt Hotle on the shift from Projects to Products.
We will also update several surrounding documents and are working on pieces around the market sub-segments.
Category: Uncategorized Tags:
by Thomas Murphy | April 23, 2013 | Submit a Comment
One of the challenges of requirements management is are we capturing the right information. This has lead to a number of approaches often backed by a plethora of tools: models, prototypes and wireframes, user stories and use cases, formal specifications, and more have graced the marketplace. The challenge is that in some cases we may not know what is “required”. This is especially true when it comes to innovation. We feel the pressure to just deliver but what exactly are we delivering? This is the “what is the right it?” problem. Many organizations are looking at Lean Development approaches but how do you decide to embark on a project in the first place? Or, do we actually know what problem we are solving?
A crowd source “problem solving company” published in the Sept 2012 issue of HBR on the topic of are you solving the right problem and while, like many consultant/provider produced articles there is a bit of fluff, the base concept is good to think on. It opens with an oft stated “quote” of Einstein (that no one seems to have the citation for)
“If I were given one hour to save the planet, I would spend 59 minutes defining the problem and one minute resolving it,” Albert Einstein said.
Good strides are being made in improved requirements tools, better collaboration practices, and agile/lean provides good tools for testing a premise; however, the better you understand the problem you are solving, the less likely you will be shooting arrows in the dark and if you can keep the initial problem definition unhindered from designing a solution, you may really get to that breakthrough that you are looking for.
Category: Requirements Tags:
by Thomas Murphy | April 22, 2013 | Submit a Comment
The Nexus Forces are driving a lot of changes for IT teams but they are also going to drive a lot of disruption for vendors. We will see this as companies work to reposition themselves to “hot terms” and through a burst of acquisitions. We have already seen a number of acquisition as companies are grabbing onto various bits of the DevOps pipeline (most recent IBM acquires UrbanCode) and in the testing market are seeing companies broaden portfolios (most recent TestPlant acquires Facilita) or extend in areas such as APM. I expect that mobile will be a key area of acquisition during this year. Users should thus recognize in these areas that sometimes partners may become competitors (disrupting integrations) as well as competitors becoming a single company, product overlaps will occur, and tools that respond to Nexus Forces will often be tactical purchases. In some cases new players may disrupt the existing market makers but most of the truly innovative ones will be acquired by those that have the cash and vision to make it happen.
Category: DevOps Load/Stress Testing Nexus Tags: Facilita, IBM, TestPlant, UrbanCode
by Thomas Murphy | April 2, 2013 | Submit a Comment
The Nexus Forces, in particular devices and the browser explosion, combined with the “money saving” BYOD movement are putting a tremendous squeeze on software testing organizations. No longer is it good enough to test on a couple browsers or a device or two. Yet at the same time, every combination can not be tested.
Mobile e-commerce only complicates the issue with a diverse set of offers and customer behaviors. Raising questions such as:
- Should I test ‘checkout’ with 5 items in the basket or 1?
- Should I test ‘checkout’ with credit card payments or using gift cards or a combination?
- Can I get insight into genuine customer journeys on our website so I can mimic those across a variety of browsers and devices?
- Do I know the demographics of my customers and understand if the features are useful or confusing for them?
This goes beyond traditional test development where requirements are analyzed, risks assessed an a test plan is developed in a relatively deterministic fashion.
I believe that this is another realm where User Monitoring and Software Testing need to deliver blended solutions (see: Leverage Your Application Performance Monitoring Through the Application Life Cycle ID: 00227165). Yet, tools vendors and platforms aren’t there yet. Most testing providers do not have Real User Monitoring abilities and there are few strong partnerships. Beyond this there is little to no guidance about how to utilize what we know about user patterns to better inform our decisions about technologies to be tested and user behavior patterns. I expect this will change during the next 2 years but for now, you will in general be on your own. I suggest using Gartner Peer Connect and other forums discuss experiences and build a foundation for Analytic Driven Testing, testing must get smarter or it will kill us.
Category: Agile Mobile Quality Tags:
by Thomas Murphy | January 30, 2013 | Submit a Comment
The old adage says you can’t teach an old dog new tricks. Microsoft, in the software world is certainly an old dog, but it seems to be learning “new tricks” in changing the way it defines and ships software. This may not work yet for all of Microsoft, my view is primarily at the Developer Division and the Visual Studio/Team Foundation System set of tools. In particular this behavior is best seen with the Team Foundation group which has transformed itself from a traditional boxed product vendor with a two year release cycle to a full agile, continuous delivery style organization similar to Rally, VersionOne, Atlassian, Collabnet and other agile focused tools.
This hasn’t been a speedy transformation. It is an old dog after all with a strong history in traditional product management, large teams and a broad customer base that often has competing needs. The company as a whole has had pockets of “agile” for at least the last 10 years. So what is different now? The cloud. The move to deliver TFS on Azure has been a transformation point enabling new styles of delivery and requiring a new approach to the definition and delivery of customer value. With TFS Azure, Microsoft can now build minimal viable products, turn the features on selectively, and gain feedback from a broad set of users.
Microsoft certainly has brought in some “new dogs” that have agile experience but the real transformation has been driven by Cloud and the drive that social driven open source development has provided. The key isn’t the new dogs but that the old ones have been able to adapt, to learn new tricks and adapt to new conditions. Remember, survivors are those that can adapt to changing conditions and if Microsoft can evolve, your organization can too. The Nexus of Forces represents an inflection point for survival either you will adapt and thrive or remain stagnant.
Category: Agile Tags:
by Thomas Murphy | January 29, 2013 | 3 Comments
Or why your organization needs to get Agile.
An increasing number of the calls I take are dealing with the challenges of BYOD, the growth in browser diversity and the loss of control over the target environment. The business realizes that there may be an opportunity for lower device costs and happier employees through BYOD (not thinking about the cost to development and test, etc).
So how do you deal with this in test? By getting on top of it as soon as possible. If your application is going to support multiple browsers, multiple devices, multiple user constituencies, you can’t batch all that test work up in a classic waterfall, iterative fashion. Developers and testers need access to resources that will enable them to test continuously on any browser/OS/device. I expect to see a long list of announcements in the mobile testing and cloud space during the next two years as vendors seek to fill-in gaps and respond to the very different nature of continuous delivery required to compete effectively and drive engaged customers and employees. Examples include MobileLabs Inc. release late last year of DeviceConnect making it easy to provision a private device cloud or last week’s announcement by SOASTA and Appcelerator of integration between SOASTA’s mobile testing facilities with Appcelerator’s mobile platform such that apps under development can make use of continuous testing.
If devices and the Cloud are going to truly transform your business, your business must transform its culture and the practices that support it. It won’t be pain free but like a sunny day in Seattle, it can be spectacular.
Category: Uncategorized Tags:
by Thomas Murphy | December 18, 2012 | Submit a Comment
I have been using a Windows 8 tablet for a little over a week now (not for this post though). It is an Acer Iconia W510 and generally it has been a pleasurable experience. This is a full Windows 8 machine with Intel Atom processor, ability to doc to a keyboard/external battery combo to use as a laptop (I don’t have this, I plan to use it with a bluetooth Microsoft Wedge keyboard in the future). I have Office 2013 and VS 2012 loaded on the machine (this is not a giant developer desktop) and they run well. I mainly have used VS to connect to my TFS Azure instance to enter and update tasks. But I like that I can fire up the debugger and just run direct on the device rather than over a connection, etc.
Office 2013 comes with support for tablet (finger) and keyboard/mouse support (changes the spacing of items and sensitivity) and it works great. I like running full Outlook vs. the Windows 8 mail client (though I have run the mail client on my home desktop for a little more than a year). Neither in some ways are as fast for certain things as my Windows Phone (selecting and deleting lots of mail). Utilizing the combo of Office and SkyDrive is clean and simple making it easy to move between my desktop and the tablet keeping work in synch or doing shared edits with others. Note, I am looking at this purely as a personal productivity situation and in comparison to the iPad that I have used in the past. We are a MSFT Office shop so there are a lot of documents, presentation, spreadsheets that get shared and passed around for review and right now this is a “challenge” on an ipad.
A downside is that Windows 8 devices are not “standard” sizes…ie you can’t walk into the local office supply store etc. and find the wall of covers/carry cases, etc that occur with products that have a thinner variety of options. However other elements of the system are generally standard: micro usb, hdmi, microSD slots are all nice. The anomaly here is that the power connector (because it is designed for their docking keyboard) is a non-standard connection.
Stability – still needs work. I would say I “reboot” daily. That means I am essentially cycling power. MSFT is dropping regular updates to Windows update. I can say from an Apps perspective that so far they all work on the tablet where I can’t say the same on my desktop. App vendors need to do a better job of defining support requirements or raising a flag when they fail rather than start and tombstone.
Apps, for me, it is fine but I am not always worried about the latest cool thing and unless the App is really awesome it doesn’t make a lot of sense vs. just using the web site. I think this is more an issue for Phones where real-estate is constrained.
The user experience, I have been using Windows 8 for over a year on my home PC but while I like the Windows 8 experience, there are non-intuitive things and little to guide you to short cuts, gestures, etc. and I think as the number of Apps grows there will need to be work on how you organize and manage them.
Last note, since this is a fun toy, I love the integration of Windows 8 through Xbox Smartglass to my Xbox. It acts as a remote, provides side by side enhanced show information and connects to all my xBox live information.
Category: Windows 8 Tags:
by Thomas Murphy | October 24, 2012 | Submit a Comment
The market has gained a many new products to aid with capturing software requirements through wireframes and prototypes. While this is great, a conversation I had today with Vernalis Systems about their approach to drive business improvement via technology. We got into a discussion about wire framing and the importance in the beginning to keep it simple because you are iterating through concepts to understand business needs and to create effective design. Later in the day I rand across an interesting article in Fast Company by Matthew May discussing the design of the FedEx logo. This iconic logo was created by Lindon Leader and here is the key point: “I strive for two things in design: simplicity and clarity”.
Too often UIs, like “requirements” docs in general get crammed with everything including the kitchen sink. While your organization may not have great human factors specialists or designers, putting this concept of simplicity and clarity at the heart of your design will lead to great foundation for project success and improving the usability of our software. This concepts maps well against the concepts of Pretotyping and Minimal Viable Product. This is not to discount the value of a good designer and it is key that you end up with Viable not “barely good enough”. Take time to iterate through ideas and keep them simple without getting hung up on polish, that will come later.
Category: Agile Requirements Usability Tags:
by Thomas Murphy | October 11, 2012 | Submit a Comment
Susan Cain, a former wall street lawyer shifted her career to match her original goal of being an author deliver a book this year on the power of introverts and delivers a challenging TED talk about how to work better with Introverts and changes we need to consider in education and workspaces that challenges the current push to highly collaborative working. This would include the move to “agile spaces” and the need to balance this with space for solitude. She states that “Solitude is a critical component of creativity.” These concepts are discussed in greater detail in her book which is titled: Quiet: the Power of Introverts in a World That Can’t Stop Talking.
This is a challenging conundrum. My experience would find that many in the technical fields tend more naturally toward introversion rather than extroversion. The current stream of thought around decision making is based on concepts of the wisdom of crowds and collaborative teams. “Way back” in 1995, Jim McCarthy captured a set of rules for managing teams and development that included the rule: Don’t Go Dark. IE don’t let developers go into a cave and wait for software to magically appear after you’ve shoved enough pizza under the door (here is a link to the latest version of The Dynamics of Software Development). I certainly don’t have “the answer” here and as an analyst have the perfect job that mixes working from a home office with occasional forays into public speaking but we need to find ways to balance and it this is especially important for organizations transitioning from a more isolated worker floor plan to open spaces. How do you help introverts feel comfortable in daily stand-ups, pair programming and other out of the comfort zone experiences so that you truly get the wisdom of the crowd, rather than the march of the lemmings.
And introverts, maybe you should take a look at “power posing” and the work of Amy Cuddy from Harvard School of Business. Steel yourselves before the daily battle and let your awesomeness through.
Category: Agile IT Governance Space Planning Tags: @amyjccuddy, @susancain
by Thomas Murphy | October 10, 2012 | 1 Comment
As part of our research for the Integrated Quality Suites Magic Quadrant we have been looking at how people spend time in testing, the types of development processes and team structures used and I thought I would share one slice of that here. We ask what types of tools are being used for capturing various types of requirements.
As can be seen, the survey participants generally rely on generic tools more than application specific requirements tools. While there has been solid growth in the variety of tools and vendors in the market adoption still lags behind other tool categories in the SDLC. This while we still see in Capers Jones’ latest software quality report that Requirements are the largest source of Delivered Defects in an average organization with a rate of 0.23 per function point. The real question is what holds us back? Cost of tools? Usability of tools? We think somehow we are doing better? Maybe it is time for a change.
Category: ALM Quality Requirements Tags: