Like Lilliputians from Gulliver’s Travels, divided over which end of a boiled egg to crack, modern technologists are debating whether big data is a revolution or an evolution. Roughly 60% of the delegates at the last week’s Gartner BI Summit in Europe voted on evolution. It looks more like an evolution to these BI and analytics practitioners, because data is part of their job routine. It is a revolution for the others, who have not dealt with data before, and now they must. Gartner predicts enormous amount of big data jobs, only one third of which will be filled. Those, who voted for the evolution, are already a part of this one third.
Why are we on the brink of data revolution?
- First of all, revolutions disrupt. The signs of data liberation and democratization are everywhere. Organizations are interested in dark data, trapped in dungeons and silos, because they want to free it and use. People type text messages, blog and tweet — they democratize data. Machines talk to machines via data. Cars send information back to the manufacturers — they liberate data (which disrupts the automobile industry). Only non-disruptive effects of big data are evolutionary; the game-changing consequences of data are revolutionary.
- Second, revolutions happen, when the “lower classes” do not want to continue in the old way and the “upper classes” cannot carry on in the old way. Enterprise information management and analytics practitioners do not want to process new and liberated data in the old way — they start using new technologies, sometimes in the cloud closet, but more often, openly. Upper management cannot carry on in the old way: companies have to compete and win in the data-driven economy. They are attracted by the shine of gold, a pure result of data alchemy.
- Finally, as it always happens during revolutions, most people are confused about what is going on. They struggle to understand where, when and how to use data. They have ideas for big data or consider possibilities, but knowing which to pursue is difficult. These people are exactly the majority that usually decides the fate of revolutions.
If you are currently dealing with the dilemma of data revolution vs. evolution, keep in mind a Lilliputian prophet, who has said, “All true believers shall break their eggs at the convenient end.”
Follow Svetlana on Twitter @Sve_Sic