Senior Marketing Executive
WHISHWORKS IT Consulting
6 million Big Data developers were working worldwide by the end of 2017, adding up to a total of $57 billion market of Big Data (of which $18.3 billion are attributed to the Business Intelligence market). Big Data specialists are expecting to see an exponential growth across industries in 2018, both in terms of available technologies and applied use cases.
To get a better understanding of what’s next in the Big Data space, we asked our own Big Data experts at WHISHWORKS what they see as the most prominent trends for 2018.
According to Vishwanath Voruganti, Big Data Engineer, Big Data in 2018 would be revolving around the aspects of security and audits for IoT devices. “In 2018, companies will look to implement solutions that will help them secure their data in the most efficient way. To this end, we expect Big Data platforms such as Cloudera, Hortonworks and MapR to introduce new and exciting changes to their platforms.”
WHISHWORKS Big Data Engineer, Khyati Sahu, expects to see significant developments in 2 sectors - Healthcare and Retail. According to Khyati, Healthcare Internet of Things (IoT) can offer improved patient care at lower costs, refine the process of monitoring patient behaviour through devices and help in the effective provision of prescriptions. Several healthcare organisations are expected to pilot real-time analytics to identify early warning signs of infections.
For the Retail industry, Khyati believes that we will see an increase in the adoption of IoT applications, with retailers using interactive fitting rooms with smart mirrors, self-checkout scanners and beacons to understand how customers feel about different products and, accordingly, modify their orders, product placement and even send real-time personalised messages and offers.
Vijaya Bhoomireddy, on-site Big Data Architect, goes a little technical while predicting the upcoming trends of 2018. According to him, the focus will be on containerisation where Docker and Kubernetes will play a leading part. As a base processing engine, Spark Core will be the serving layer, while Spark SQL and Spark MLLib will probably give way to more robust SQL and ML libraries.
Big Data Architect, Yasin Mohammed thinks that in 2018 most of the businesses will focus on migrating to hybrid Big Data cloud platforms, involving CEP (Complex Event Processing) and Deep/Active/ Reinforcement Learning, to benefit from more accurate, efficient and fast decision making and problem solving processes.
Kumar Raju Datla, on-site Big Data Engineer, talks about Data Protection and Data Processing as two key upcoming trends for Big Data in 2018. According to him, with the enforcement of GDPR, data needs to be secured and protected at all times, whether in transit or at rest. Because of that, he expects many existing solutions to release updates following enhanced security frameworks. Raju also expects that, especially for data at rest, protection policies such as classification, masking, encoding, encrypting, will gradually become a standard for Big Data platforms.
With respect to Data Processing, Kumar believes that in 2018 a lot of resources will be dedicated in finding ways to achieve ultimate speeds, whilst reducing the costs of processing data with high volume, variety, velocity and/or vulnerability. This need is primarily business driven, and platforms like Spark and Apache Drill are finding increasing acceptance for the achievement of the desired data processing speed at contained costs.
To summarise, Big Data is not expected to slow down anytime soon. In 2018 we see Healthcare becoming a prime user of Big Data. Retailers are also becoming more confident in taking advantage of Big Data to transform the way they operate and are expected to start experimenting with IoT. Finally, on the top of CIOs and CTOs agendas to support the increasing business demands will be migrating into the Cloud or a hybrid alternative, data security and data processing.