Video Chats

Hadoop, whither goest thou?

June 6, 2014 | 2:00 pm ET | 32:20


Waves pass, though the soft shorelines they sculpt might endure longer than you’d expect. Every new technology platform enters the world as a wave that builds and builds until it’s overtaken by the next wave to come along. That’s the historical perspective expressed by a Forrester “S-curve” or a Gartner “hype cycle.”

However, this is not to imply that successive technology waves necessarily cancel each other out. If the waves are in phase, converging toward a common evolutionary endpoint, they mutually reinforce into an even more powerful wave. That’s definitely the case with big data. In the present era, Hadoop’s wave is still very much on the rise, but we can already see the larger waves that may overtake it as the big data ocean reshapes our planet along smarter contours. Apache Spark, for example, has been widely touted as an up and coming rival to Hadoop going forward.

Are Hadoop's days numbered, or are its best years still ahead? That's what our expert panelists discussed in our June 6 Big Data Bytes: "Hadoop, whither goest thou?" Our featured guest panelist this month was Andrew Oliver, president of Open Software Integrators and author of this recent Hadoop blog on InfoWorld: "Know This Right Now about Hadoop." Follow Andrew on Twitter @acoliver

Hosting this episode of Big Data Bytes was James Kobielus (@jameskobielus), big data evangelist and senior program director at IBM.