Gartner Blog Network


Big Data Is Entering the Age of Aquarius

by Svetlana Sicular  |  October 23, 2014  |  2 Comments

Suddenly, I realized: fluids are in, animals are out. The big data ecosystem has given up on its elephants, impalas and pigs in favor of aquatics.  Perhaps, the shift started with “data lakes,” or, perhaps, data lakes just reflected the state of big data (pun intended). Or maybe, Cascading was the one that signified the shift: Cascading was the first to enable data application development on Apache Hadoop, leaving developers Driven, Lingual and Scalding. It is now obviously Fluid.

According to Metanautix, navigating data has never been so fluid. Did you notice not just nautix, but also meta in the name? This is for a good reason. Metadata is key to deriving value from big data. Tonight (23 October), I am moderating a panel on enabling Hadoop data, so that a data lake wouldn’t turn into a data marsh. Incidentally, one of the panelists is Waterline Data Science. If you are in the Bay Area, come see the panel in person in Sunnyvale — everyone is welcome.

Big data is flowing through all kinds of data pipelines and is streaming from all things, up to the point of becoming a DataTorrent. It can run freely in its purest state — H2O, or get sublimated into Snowflake in the cloud. If weather permits, data could even pour like FirstRain (a company that trademarked the term Personal Business Analytics!).

You might wonder whether the current big data darling Spark fits into the Age of Aquarius picture. It does — how about a killer app Sparkling Water? The new wave of big data technologies is rising!

Spark-+-H20

 

Follow Svetlana on Twitter @Sve_Sic

Additional Resources

Category: data-scientist  data-and-analytics-strategies  data-paprazzi  hadoop  information-everywhere  

Tags: data-paprazzi  vendors  

Svetlana Sicular
Research VP
6 years at Gartner
23 years IT industry

Svetlana Sicular is passionate about bringing analytics to domain experts and helping organizations successfully compete by applying their business acumen in analytics and data science. She is convinced that domain expertise and high-value data are the greatest assets that companies should monetize in new analytics applications. Read Full Bio


Thoughts on Big Data Is Entering the Age of Aquarius


  1. […] Read the source article at Gartner Blog Network […]

  2. Karsten Scherer says:

    interesting! perhaps this is driven by the increasing recognition that everyone’s drowning in big data or up the the data creek without a paddle 😉 ?

    your angle reminded me of an economist piece last year called ‘big water for big data’

    http://gelookahead.economist.com/big-data-for-big-water/

    enjoyed your maverick piece on PDBs. good stuff!



Comments are closed

Comments or opinions expressed on this blog are those of the individual contributors only, and do not necessarily represent the views of Gartner, Inc. or its management. Readers may copy and redistribute blog postings on other blogs, or otherwise for private, non-commercial or journalistic purposes, with attribution to Gartner. This content may not be used for any other purposes in any other formats or media. The content on this blog is provided on an "as-is" basis. Gartner shall not be liable for any damages whatsoever arising out of the content or use of this blog.