Massive parallel processing in cloud big data

Massive parallel processing in cloud big data

Have you ever wondered - How Pyramid of Giza was built? What it takes to run a chip? What's the universe made up of?

Massive parallel processing in cloud big data

  • Posted by: Anand Singh Bhandari
  • 24/12/2018

Have you ever wondered - How Pyramid of Giza was built? What it takes to run a chip? What's the universe made up of?

Let us throw some light on this. The basic fabric of nature is that it is made up of building blocks that needs to be atomic in nature and should be available in plenty. The same applies to our computing world. But there is a certain limit to scaling up, since the cost to overhead maintenance increases simultaneously. This directly impacts the scale up advantage in the first place and is nullified by the corresponding increase in maintenance overhead.

Hence the way forward is nature's path itself, which is the theory of 'Scaling Out'. A concept which states when many atomic computing resources are leveraged in parallel, the impact can be massive. And that's what we call, MPP - Massive Parallel Processing.

Further to this, in a more simplified way it is splitting up simpler but larger tasks into multiple buckets and getting those buckets processed at the same time to gear up the efficiency and the speed which are the incumbent areas to conquer in this competing era.

With each passing day internet infrastructure efficiency is burgeoning in terms of payload and speed. Now this piques the need for MPP in Cloud. Unlimited atomic computing resource availability (literally) on cloud from many vendors, is another thumbs up for MPP in Cloud to become a reality.

To summarize or conclude - MPP in cloud needs 'scale out' architecture paradigm, to be much more effective.

Big Data concept is a reality - "Think Scale Out"

About Author

Anand

Anand Singh Bhandari

Director - Business Analytics

Anand heads the Business Intelligence practice for Espire, playing the lead role in establishing best practices and our roadmap for a robust BI practice. He ensures development and implementation of frameworks for rapid project deployment and capability enhancements in the group.

He is also responsible for establishing knowledge banks, architecture/reviews and documentations related to his practice and sharing them with Delivery, Presales other internal functions. In essence, Anand plays the key role in introducing innovation in the BI practice, to help the Espire team with recommendations for the best and most optimal solution to our clients - in the shortest time possible.

He has over 15 years of experience in the field of Business Intelligence and Data Warehousing, providing Delivery, Sales & Presales with support to help bring large deals onboard. He has considerable experience in implementing BI projects on cloud platforms such as HDFS, YARN, Hive, Impala, PIG and Hue.

He has engaged and provided Fortune 500 Companies such as - DELL, Sears, Sabre, Bloomberg, Sun Country Airlines, SITA, Carnival Corp (United States) and Samsung (South Korea) with is BI expertise. He has in-depth knowledge of business functions in verticals ranging from Insurance, Retail , Health and Aviation.