Big data technology: opportunities and challenges

Abstract

The increasing volume of information captured by enterprises, upsurge of multimedia and social media, and the Internet of Things (IoT) is fueling exponential growth in Big Data analytics. Every day close to With the volume and variety of data expanding exponentially, organizations that are able to capture quintillion bytes of data is being created and according to IDC report on Digital Universe, from now until 2020, the digital universe will about double every two years. Big Data by itself is meaningless, unless it translates to or helps us drive relevant outcomes. With the volume and variety of data expanding exponentially, organizations that are able to capture and analyze it are bound to have a much higher competitive advantage over those that don't. But choosing how to go about using Big Data is a tough puzzle to crack. This paper deals with such opportunities and challenges of big Data. In this paper we have mentioned some open source tools and technologies to create, manipulate, and manage such 'Big Data'.