Bottom line: Big data is providing supplier networks with greater data accuracy, clarity, and insights, leading to more contextual intelligence shared across supply chains.
Forward-thinking manufacturers are orchestrating 80% or more of their supplier network activity outside their four walls, using big data and cloud-based technologies to get beyond the constraints of legacy Enterprise Resource Planning (ERP) and Supply Chain Management (SCM) systems. For manufacturers whose business models are based on rapid product lifecycles and speed, legacy ERP systems are a bottleneck. Designed for delivering order, shipment and transactional data, these systems aren’t capable of scaling to meet the challenges supply chains face today.
Choosing to compete on accuracy, speed and quality forces supplier networks to get to a level of contextual intelligence not possible with legacy ERP and SCM systems. While many companies today haven’t yet adopted big data into their supply chain operations, these ten factors taken together will be the catalyst that get many moving on their journey.
The ten ways big data is revolutionizing supply chain management include:
Enabling more complex supplier networks that focus on knowledge sharing and collaboration as the value-add over just completing transactions. Big data is revolutionizing how supplier networks form, grow, proliferate into new markets and mature over time. Transactions aren’t the only goal, creating knowledge-sharing networks is, based on the insights gained from big data analytics. The following graphic from Business Ecosystems Come Of Age (Deloitte University Press) (free, no opt-in) illustrates the progression of supply chains from networks or webs, where knowledge sharing becomes a priority.
Big data and advanced analytics are being integrated into optimization tools, demand forecasting, integrated business planning and supplier collaboration & risk analytics at a quickening pace. These are the top four supply chain capabilities that Delotte found are currently in use form their recent study, Supply Chain Talent of the Future Findings from the 3rd Annual Supply Chain Survey (free, no opt-in). Control tower analytics and visualization are also on the roadmaps of supply chain teams currently running big data pilots.
64% of supply chain executives consider big data analytics a disruptive and important technology, setting the foundation for long-term change management in their organizations.SCM World’s latest Chief Supply Chain Officer Report provides a prioritization of the most disruptive technologies for supply chains as defined by the organizations’ members. The following graphic from the report provides insights into how senior supply chain executives are prioritizing big data analytics over other technologies.
Using geoanalytics based on big data to merge and optimize delivery networks. The Boston Consulting Group provides insights into how big data is being put to use in supply chain management in the article Making Big Data Work: Supply Chain Management (free, opt-in). One of the examples provided is how the merger of two delivery networks was orchestrated and optimized using geoanalytics. The following graphic is from the article. Combining geoanalytics and big data sets could drastically reduce cable TV tech wait times and driving up service accuracy, fixing one of the most well-known service challenges of companies in that business.
Greater contextual intelligence of how supply chain tactics, strategies and operations are influencing financial objectives. Supply chain visibility often refers to being able to see multiple supplier layers deep into a supply network. It’s been my experience that being able to track financial outcomes of supply chain decisions back to financial objectives is attainable, and with big data app integration to financial systems, very effective in industries with rapid inventory turns. Source: Turn Big Data Into Big Visibility.
Traceability and recalls are by nature data-intensive, making big data’s contribution potentially significant. Big data has the potential to provide improved traceability performance and reduce the thousands of hours lost just trying to access, integrate and manage product databases that provide data on where products are in the field needing to be recalled or retrofitted.
Increasing supplier quality from supplier audit to inbound inspection and final assembly with big data.IBM has developed a quality early-warning system that detects and then defines a prioritization framework that isolates quality problem faster than more traditional methods, including Statistical Process Control (SPC). The early-warning system is deployed upstream of suppliers and extends out to products in the field.
Salesforce (NYSE:CRM) estimates adding analytics and Business Intelligence (BI) applications will increase their Total Addressable Market (TAM) by $13B in FY2014.
89% of business leaders believe Big Data will revolutionize business operations in the same way the Internet did.
83% have pursued Big Data projects in order to seize a competitive edge.
Despite the varying methodologies used in the studies mentioned in this roundup, many share a common set of conclusions. The high priority in gaining greater insights into customers and their unmet needs, more precise information on how to best manage and simplify sales cycles, and how to streamline service are common themes.
The most successful Big Data uses cases revolve around enterprises’ need to get beyond the constraints that hold them back from being more attentive and responsive to customers.
Presented below is a roundup of recent forecasts and estimates:
Wikibon projects the Big Data market will top $84B in 2026, attaining a 17% Compound Annual Growth Rate (CAGR) for the forecast period 2011 to 2026. The Big Data market reached $27.36B in 2014, up from $19.6B in 2013. These and other insights are from Wikibon’s excellent research of Big Data market adoption and growth. The graphic below provides an overview of their Big Data Market Forecast. Source: Executive Summary: Big Data Vendor Revenue and Market Forecast, 2011-2026.
IBM and SAS are the leaders of the Big Data predictive analytics market according to the latest Forrester Wave™: Big Data Predictive Analytics Solutions, Q2 2015. The latest Forrester Wave is based on an analysis of 13 different big data predictive analytics providers including Alpine Data Labs, Alteryx, Angoss Software, Dell, FICO, IBM, KNIME.com, Microsoft, Oracle, Predixion Software, RapidMiner, SAP, and SAS. Forrester specifically called out Microsoft Azure Learning is an impressive new entrant that shows the potential for Microsoft to be a significant player in this market. Gregory Piatetsky (@KDNuggets) has done an excellent analysis of the Forrester Wave Big Data Predictive Analytics Solutions Q2 2015 report here. Source: Courtesy of Predixion Software: The Forrester Wave™: Big Data Predictive Analytics Solutions, Q2 2015 (free, no opt-in).
IBM, KNIME, RapidMiner and SAS are leading the advanced analytics platform market according to Gartner’s latest Magic Quadrant. Gartner’s latest Magic Quadrant for advanced analytics evaluated 16 leading providers of advanced analytics platforms that are used to building solutions from scratch. The following vendors were included in Gartner’s analysis: Alpine Data Labs, Alteryx, Angoss, Dell, FICO, IBM, KNIME, Microsoft, Predixion, Prognoz, RapidMiner, Revolution Analytics, Salford Systems, SAP, SAS and Tibco Software, Gregory Piatetsky (@KDNuggets) provides excellent insights into shifts in Magic Quadrant for Advanced Platform rankings here. Source: Courtesy of RapidMiner: Magic Quadrant for Advanced Analytics Platforms Published: 19 February 2015 Analyst(s): Gareth Herschel, Alexander Linden, Lisa Kart (reprint; free, no opt-in).
Salesforce estimates adding analytics and Business Intelligence (BI) applications will increase their Total Addressable Market (TAM) by $13B in FY2014. Adding new apps in analytics is projected to increase their TAM to $82B for calendar year (CY) 2018, fueling an 11% CAGR in their total addressable market from CY 2013 to 2018. Source: Building on Fifteen Years of Customer Success Salesforce Analyst Day 2014 Presentation (free, no opt in).
89% of business leaders believe big data will revolutionize business operations in the same way the Internet did. 85% believe that big data will dramatically change the way they do business. 79% agree that ‘companies that do not embrace Big Data will lose their competitive position and may even face extinction.’ 83% have pursued big data projects in order to seize a competitive edge. The top three areas where big data will make an impact in their operations include: impacting customer relationships (37%); redefining product development (26%); and changing the way operations is organized (15%).The following graphic compares the top six areas where big data is projected to have the greatest impact in organizations over the next five years. Source: Accenture, Big Success with Big Data: Executive Summary (free, no opt in).
Customer analytics (48%), operational analytics (21%), and fraud & compliance (21%) are the top three use cases for Big Data. Datameer’s analysis of the market also found that the global Hadoop market will grow from $1.5B in 2012 to $50.2B in 2020, and financial services, technology and telecommunications are the leading industries using big data solutions today. Source: Big Data: A Competitive Weapon for the Enterprise.
37% of Asia Pacific manufacturers are using Big Data and analytics technologies to improve production quality management. IDC found manufacturers in this region are relying on these technologies to reduce costs, increase productivity, and attract new customers. Source: Big Data and Analytics Core to Nex-Gen Manufacturing.
Supply chain visibility (56%), geo-location and mapping data (47%) and product traceability data (42%) are the top three potential areas of Big Data opportunity for supply chain management. Transport management, supply chain planning, & network modeling and optimization are the three most popular applications of Big Data in supply chain initiatives. Source: Supply Chain Report, February 2015.
Finding correlations across multiple disparate data sources (48%), predicting customer behavior (46%) and predicting product or services sales (40%) are the three factors driving interest in Big Data analytics. These and other fascinating findings from InformationWeek’s 2015 Analytics & BI Survey provide a glimpse into how enterprises are selecting analytics applications and platforms. Source: Information Week 2015 Analytics & BI Survey.
Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.
Demand for Computer Systems Analysts with big data expertise increased 89.9% in the last twelve months and 85.40% for Computer and Information Research Scientists.
Demand for Python programming expertise increased 96.9% in big-data related positions in the last twelve months.
These and other key insights are from a recent analysis completed of big data hiring trends using WANTED Analytics, the leading provider of data analytics on the workplace. For purposes of this analysis, the term “big data” is comprised of the four skill sets of data analysis, data acquisition, data mining and data structures. The WANTED Analytics taxonomy references these skill sets when queries are made on the term “big data”.
The company currently maintains a database of more than one billion unique job listings and is collecting hiring trend data from more than 150 countries. WANTED Analytics has never been a client, they provided complimentary access based on my requesting a trial account. Many Forbes readers are interested in staying current on big data hiring trends, which led me to complete this analysis.
Key Take-aways include the following:
Demand for big data expertise across a range of occupations saw significant growth over the last twelve months. There was a 123.60% jump in demand for Information Technology Project Managers with big data expertise, and an 89.8% increase for Computer Systems Analysts. The following table provides an overview of the distribution of open positions by occupation and the percentage growth in job demand over time.
The five leading industries with the most job openings requiring big data expertise include Professional, Scientific and Technical Services (27.14%), Information Technologies (18.89%), Manufacturing (12.35%), Retail Trade (9.62%) and Sustainability, Waste Management & Remediation Services (8.20%). The following graphic shows the distribution of open positions between September 1, 2014 to today, December 29, 2014:
The Hiring Scale is 76 for jobs that require big data skills with 12 candidates per job opening as of December 29, 2014. The higher the Hiring Scale score, the more difficult it is for employers to find the right applicants for open positions. Nationally an average job posting for an IT professional with cloud computing expertise is open just 47 days.
The median salary for professionals with big data expertise is $103,000 a year. Sample jobs in this category include Big Data Solution Architect, Linux Systems and Big Data Engineer, Big Data Platform Engineer, Lead Software Engineer, Big Data (Java, Hadoop, SQL) and others. The distribution of median salaries across all industries shown below:
San Jose – Sunnyvale – Santa Clara, CA, San Francisco – Oakland – Fremont, CA, and Washington – Arlington – Alexandria, DC are the top three U.S. employment markets for big data related jobs as of today. Mapping the distribution of job volume, salary range, candidate supply, posting period and hiring scale by Metropolitan Statistical Area (MSA) or states and counties is supported by WANTED Analytics and shown in the following graphic. A summary of the top twenty employment markets is also shown following the map:
Cisco (NASDAQ:CSCO), IBM (NYSE: IBM) and Oracle (NYSE:ORCL) have the most open big data-related positions today. Cisco, its supplier, partner and support ecosystem companies have 3,613 related big data positions available. The following table shows the top ten big data employers today, the distribution of jobs, and the number of new jobs added over the last year.
Python programming (96.90%), Linux expertise (76.60%) and Structured Query Language (SQL) (76%) are the three most in-demand skills in positions that mention big data as a requirement. The following table provides an overview of the top 10 most in-demand skills:
87% of enterprises believe Big Data analytics will redefine the competitive landscape of their industries within the next three years. 89% believe that companies that do not adopt a Big Data analytics strategy in the next year risk losing market share and momentum.
These and other key findings are from a Accenture and General Electric study published this month on how the combination of Big Data analytics and the Internet of Things (IoT) are redefining the competitive landscape of entire industries. Accenture and GE define the Industrial Internet as the use of sensor, software, machine-to-machine learning and other technologies to gather and analyze data from physical objects or other large data streams, and then use those analyses to manage operations and in some cases to offer new, valued-added services.
Big Data Analytics Now Seen As Essential For Competitive Growth
The study also shows that many enterprises are investing the majority of their time in analysis (36%) and just 13% are using Big Data analytics to predict outcomes, and only 16% using their analytics applications to optimize processes and strategies. Moving beyond analysis to predictive analytics and optimization is the upside potential the majority of the C-level respondents see as essential to staying competitive in their industries in the future.
Key take-aways from the study include the following:
73% of companies are already investing more than 20% of their overall technology budget on Big Data analytics, and just over two in ten are investing more than 30%. 76% of executives expect spending levels to increase. The following graphic illustrates these results:
Big Data analytics has quickly become the highest priority for aviation (61%), wind (45%) and manufacturing (42%) companies. The following graphic provides insights into the relative level of importance of Big Data analytics relative to other priorities in the enterprises interviewed in the study:
74% of enterprises say that their main competitors are already using Big Data analytics to successfully differentiate their competitive strengths with clients, the media, and investors. 93% of enterprises are seeing new competitors in their market using Big Data analytics as a key differentiation strategy. The single greatest risk enterprises see from not implementing a Big Data strategy is that competitors will gain market share at their expense. Please see the following graphic for a comparison of the risks of not implementing Big Data strategy.
65% of enterprises are focused on monitoring assets to identify operating issues for more proactive maintenance. 58% report having capabilities such as connecting equipment to collect operating data and analyzing the data to produce insights. The following graphic provides an overview of Big Data monitoring survey results:
Increasing profitability (60%), gaining a competitive advantage (57%) and improving environmental safety and emissions compliance (55%) are the three highest industry priorities according to the survey. The following table provides an analysis of the top business priorities by industry for the next three years with the shaded areas indicating the highest-ranked priorities by industry:
The top three challenges enterprises face in implementing Big Data initiatives include the following: system barriers between departments prevent collection and correlation of data for maximum impact (36%); security concerns are impacting enterprises’ ability to implement a wide-scale Big Data initiative (35%); and consolidation of disparate data and being able to use the resulting data store (29%), third. The following graphic provides an overview of the top three challenges organizations face in implementing Big Data initiatives: