Skip to content
Advertisements

Posts tagged ‘Big Data’

The State Of Cloud Business Intelligence, 2018

  • Cloud BI adoption is soaring in 2018, nearly doubling 2016 adoption levels.
  • Over 90% of Sales & Marketing teams say that Cloud BI is essential for getting their work done in 2018, leading all categories in the survey.
  • 66% of organizations that consider themselves completely successful with Business Intelligence (BI) initiatives currently use the cloud.
  • Financial Services (62%), Technology (54%), and Education (54%) have the highest Cloud BI adoption rates in 2018.
  • 86% of Cloud BI adopters name Amazon AWS as their first choice, 82% name Microsoft Azure, 66% name Google Cloud, and 36% identify IBM Bluemix as their preferred provider of cloud BI services.

These and other many other fascinating insights are from Dresner Advisory Services 2018 Cloud Computing and Business Intelligence Market Study (client access reqd.) of the Wisdom of Crowds® series of research. The goal of the 7th annual edition of the study seeks to quantify end-user deployment trends and attitudes toward cloud computing and business intelligence (BI), defined as the technologies, tools, and solutions that employ one or more cloud deployment models. Dresner Advisory Services defines the scope of Business Intelligence (BI) tools and technologies to include query and reporting, OLAP (online analytical processing), data mining and advanced analytics, end-user tools for ad hoc query and analysis, and dashboards for performance monitoring. Please see page 10 of the study for the methodology. The study found the primary barriers to greater cloud BI adoption are enterprises’ concerns regarding data privacy and security.

Key takeaways from the study include the following:

  • Cloud BI’s importance continues to accelerate in 2018, with the majority of respondents considering it an important element of their broader analytics strategies. The study found that mean level of sentiment rose from 2.68 to 3.22 (above the level of “important”) between 2017 and 2018, indicating the increased importance of Cloud BI over the last year. By region, Asia-Pacific respondents continue to be the strongest proponents of cloud computing regarding both adjusted mean (4.2 or “very important”) and levels of criticality. The following graphic illustrates Cloud BI’s growing importance between 2012 and 2018.

  • Over 90% of Sales & Marketing teams say Cloud BI apps are important to getting their work done in 2018, leading all respondent categories in the survey. The study found that Cloud BI importance in 2018 is highest among Sales/Marketing and Executive Management respondents. One of the key factors driving this is the fact that both Sales & Marketing and Executive Management are increasingly relying on cloud-based front office applications and services that are integrated with and generate cloud-based data to track progress towards goals.

  • Cloud BI is most critical to Financial Services & Insurance, Technology, and Retail & Wholesale Trade industries. The study recorded its highest-ever levels of Cloud Bi importance in 2018. Financial Services has the highest weighted mean interest in cloud BI (3.8, which approaches “very important” status shown in the figure below). Technology organizations, where half of the respondents say cloud BI is “critical” or “very important,” are the next most interested. Close to 90% of Retail/Wholesale respondents say SaaS/cloud BI is at least “important” to them. As it has been over time, Healthcare remains the industry least open to managed services for data and business intelligence.

  • Cloud BI adoption is soaring in 2018, nearly doubling 2016 adoption levels. The study finds that the percentage of respondents using Cloud BI in 2018 nearly doubled from 25% of enterprise users in 2016. Year over year, current use rose from 31% to 49%. In the same time frame, the percentage of respondents with no plans to use cloud BI dropped by half, from 38% to 19%. This study has been completed for the last seven years, showing a steady progression of Cloud BI awareness and adoption, with 2018 being the first one showing the most significant rise in adoption levels ever.

  • Sales & Marketing leads all departments in current use and planning for Cloud BI applications. Business Intelligence Competency Centers (BICC) are a close second, each with over 60% adoption rates for Cloud BI today. Operations including manufacturing and supply chains and services are the next most likely to use Cloud BI currently. Marketing and BICC lead current adoption and are contributing catalysts of Cloud BI’s soaring growth between 2016 and 2018. Both of these departments often have time-constrained and revenue-driven goals where quantifying contributions to company growth and achievement ad critical.

  • Financial Services (62%), Technology (54%), and Education (54%) industries have the highest Cloud BI adoption rates in 2018. The retail/wholesale industry has the fourth-highest level of Cloud BI adoption and the greatest number of companies who are currently evaluating Cloud BI today. The least likely current or future users are found in manufacturing and security-sensitive healthcare organizations, where 45% respondents report no plans for cloud-based BI/analytics.

  • Dashboards, advanced visualization, ad-hoc query, data integration, and self-service are the most-required Cloud BI features in 2018. Sales & Marketing need real-time feedback on key initiatives, programs, strategies, and progress towards goals. Dashboards and advanced visualization features’ dominance of feature requirements reflect this department’s ongoing need for real-time feedback on the progress of their teams towards goals. Reporting, data discovery, and end-user data blending (data preparation) make up the next tier of importance.

  • Manufacturers have the greatest interest in dashboards, ad-hoc query, production reporting, search interface, location intelligence, and ability to write to transactional applications. Education respondents report the greatest interest in advanced visualization along with data integration, data mining, end-user data blending, data catalog, and collaborative support for group-based analysis. Financial Services respondents are highly interested in advanced visualization and lead all industries in self-serviceHealthcare industry respondents lead interest only in in-memory support. Retail/Wholesale and Healthcare industry respondents are the least feature interested overall.

  • Interest in cloud application connections to Salesforce, NetSuite, and other cloud-based platforms has increased 12% this year. Getting end-to-end visibility across supply chains, manufacturing centers, and distribution channels requires Cloud BI apps be integrated with cloud-based platforms and on-premises applications and data. Expect to see this accelerate in 2019 as Cloud BI apps become more pervasive across Marketing & Sales and Executive Management, in addition to Operations including supply chain management and manufacturing where real-time shop floor monitoring is growing rapidly.

  • Retail/Wholesale, Business Services, Education and Financial Services & Insurance industries are most interested in Google Analytics connectors to obtain data for their Cloud BI apps. Respondents from Technology industries prioritize Salesforce integration and connectors above all others. Education respondents are most interested in MySQL and Google Drive integration and connectors. Manufacturers are most interested in connectors to Google AdWords, SurveyMonkey, and The Healthcare industry respondents prioritize SAP Cloud BI services and also interested in ServiceNow connectors.

Advertisements

Data Scientist Is The Best Job In America According Glassdoor

  • Data Scientist has been named the best job in America for three years running, with a median base salary of $110,000 and 4,524 job openings.
  • DevOps Engineer is the second-best job in 2018, paying a median base salary of $105,000 and 3,369 job openings.
  • There are 29,187 Software Engineering jobs available today, making this job the most popular regarding Glassdoor postings according to the study.

These and many other fascinating insights are from Glassdoor’s 50 Best Jobs In America For 2018. The Glassdoor Report is viewable online here. Glassdoor’s annual report highlights the 50 best jobs based on each job’s overall Glassdoor Job Score.The Glassdoor Job Score is determined by weighing three key factors equally: earning potential based on median annual base salary, job satisfaction rating, and the number of job openings. Glassdoor’s 2018 report lists jobs that excel across all three dimensions of their Job Score metric. For an excellent overview of the study by Karsten Strauss of Forbes, please see his post, The Best Jobs To Apply For In 2018.

LinkedIn’s 2017 U.S. Emerging Jobs Report found that there are 9.8 times more Machine Learning Engineers working today than five years ago with 1,829 open positions listed on their site as of last month. Data science and machine learning are generating more jobs than candidates right now, making these two areas the fastest growing tech employment areas today.

Key takeaways from the study include the following:

  • Six analytics and data science jobs are included in Glassdoor’s 50 best jobs In America for 2018. These include Data Scientist, Analytics Manager, Database Administrator, Data Engineer, Data Analyst and Business Intelligence Developer. The complete list of the top 50 jobs is provided below with the analytics and data science jobs highlighted along with software engineering, which has a record 29,817 open jobs today:

  • Median base salary of the 50 best jobs in America is $91,000 with the average salary of the six analytics and data science jobs being $94,167.
  • Across all six analytics and data science jobs there are 16,702 openings as of today according to Glassdoor.
  • Tech jobs make up 20 of Glassdoor’s 50 Best Jobs in America for 2018, up from 14 jobs in 2017.

Source: Glassdoor Reveals the 50 Best Jobs in America for 2018

53% Of Companies Are Adopting Big Data Analytics

  • Big data adoption reached 53% in 2017 for all companies interviewed, up from 17% in 2015, with telecom and financial services leading early adopters.
  • Reporting, dashboards, advanced visualization end-user “self-service” and data warehousing are the top five technologies and initiatives strategic to business intelligence.
  • Data warehouse optimization remains the top use case for big data, followed by customer/social analysis and predictive maintenance.
  • Among big data distributions, Cloudera is the most popular, followed by Hortonworks, MAP/R, and Amazon EMR.

These and many other insights are from Dresner Advisory Services’ insightful 2017 Big Data Analytics Market Study (94 pp., PDF, client accessed reqd), which is part of their Wisdom of Crowds® series of research. This 3rd annual report examines end-user trends and intentions surrounding big data analytics, defined as systems that enable end-user access to and analysis of data contained and managed within the Hadoop ecosystem. The 2017 Big Data Analytics Market Study represents a cross-section of data that spans geographies, functions, organization size, and vertical industries. Please see page 10 of the study for additional details regarding the methodology.

“Across the three years of our comprehensive study of big data analytics, we see a significant increase in uptake in usage and a large drop of those with no plans to adopt,” said Howard Dresner, founder and chief research officer at Dresner Advisory Services. “In 2017, IT has emerged as the most typical adopter of big data, although all departments – including finance – are considering future use. This is an indication that big data is becoming less an experimental endeavor and more of a practical pursuit within organizations.”

Key takeaways include the following:

  • Reporting, dashboards, advanced visualization end-user “self-service” and data warehousing are the top five technologies and initiatives strategic to business intelligence.  Big Data ranks 20th across 33 key technologies Dresner Advisory Services currently tracks.  Big Data Analytics is of greater strategic importance than the Internet of Things (IoT), natural language analytics, cognitive Business Intelligence (BI) and Location intelligence.

  • 53% of companies are using big data analytics today, up from 17% in 2015 with Telecom and Financial Services industries fueling the fastest adoption. Telecom and financial services are the most active early adopters, with Technology and Healthcare being the third and fourth industries seeing big data analytics Education has the lowest adoption as 2017 comes to a close, with the majority of institutions in that vertical saying they are evaluating big data analytics for the future. North America (55%) narrowly leads EMEA (53%) in their current levels of big data analytics adoption. Asia-Pacific respondents report 44% current adoption and are most likely to say they “may use big data in the future.”

  • Data warehouse optimization is considered the most important big data analytics use case in 2017, followed by customer/social analysis and predictive maintenance. Data warehouse optimization is considered critical or very important by 70% of all respondents. It’s interesting to note and ironic that the Internet of Things (IoT) is among the lowest priority use cases for big data analytics today.

  • Big data analytics use cases vary significantly by industry with data warehouse optimization dominating Financial Services, Healthcare, and Customer/social analysis is the leading use case in Technology-based companies. Fraud detection use cases also dominate Financial Services and Telecommunications. Using big data for clickstream analytics is most popular in Financial Services.

  • Spark, MapReduce, and Yarn are the three most popular software frameworks today. Over 30% of respondents consider Spark critical to their big data analytics strategies. MapReduce and Yarn are “critical” to more than 20 percent of respondents.

  • The big data access methods most preferred by respondents include Spark SQL, Hive, HDFS and Amazon S3. 73% of the respondents consider Spark SQL critical to their analytics strategies. Over 30% of respondents consider Hive and HDFS critical as well. Amazon S3 is critical to one of five respondents for managing big data access. The following graphic shows the distribution of big data access methods.

  • Machine learning continues to gain more industry support and investment plans with Spark Machine Learning Library (MLib) adoption projected to grow by 60% in the next 12 months. In the next 24 months, MLib will dominate machine learning according to the survey results. MLib is accessible from the Sparklyr R Package and many others, which continues to fuel its growth. The following graphic compares projected two-year adoption rates by machine learning libraries and frameworks.

Machine Learning Is The New Proving Ground For Competitive Advantage

  • 50% of organizations are planning to use machine learning to better understand customers in 2017.
  • 48% are planning to use machine learning to gain greater competitive advantage.
  • Top future applications of machine learning include automated agents/bots (42%), predictive planning (41%), sales & marketing targeting (37%), and smart assistants (37%).

These and many other insights are from a recent survey completed by MIT Technology Review Custom and Google Cloud, Machine Learning: The New Proving Ground for Competitive Advantage (PDF, no opt-in, 10 pp.). Three hundred and seventy-five qualified respondents participated in the study, representing a variety of industries, with the majority being from technology-related organizations (43%). Business services (13%) and financial services (10%) respondents are also included in the study.  Please see page 2 of the study for additional details on the methodology.

Key insights include the following:

  • 50% of those adopting machine learning are seeking more extensive data analysis and insights into how they can improve their core businesses. 46% are seeking greater competitive advantage, and 45% are looking for faster data analysis and speed of insight. 44% are looking at how they can use machine learning to gain enhanced R&D capabilities leading to next-generation products.
If your organization is currently using ML, what are you seeking to gain?*

If your organization is currently using ML, what are you seeking to gain?

  • In organizations now using machine learning, 45% have gained more extensive data analysis and insights. Just over a third (35%) have attained faster data analysis and increased the speed of insight, in addition to enhancing R&D capabilities for next-generation products. The following graphic compares the benefits organizations who have adopted machine learning have gained. One of the primary factors enabling machine learning’s full potential is service oriented frameworks that are synchronous by design, consuming data in real-time without having to move data. enosiX is quickly emerging as a leader in this area, specializing in synchronous real-time Salesforce and SAP integration that enables companies to gain greater insights, intelligence, and deliver measurable results.
your organization is currently using machine learning, what have you actually gained?

If your organization is currently using machine learning, what have you actually gained?

  • 26% of organizations adopting machine learning are committing more than 15% of their budgets to initiatives in this area. 79% of all organizations interviewed are investing in machine learning initiatives today. The following graphic shows the distribution of IT budgets allocated to machine learning during the study’s timeframe of late 2016 and 2017 planning.
What part of your IT budget for 2017 is earmarked for machine learning?

What part of your IT budget for 2017 is earmarked for machine learning? 

  • Half of the organizations (50%) planning to use machine learning to better understand customers in 2017. 48% are adopting machine learning to gain a greater competitive advantage, and 45% are looking to gain more extensive data analysis and data insights. The following graphic compares the benefits organizations adopting machine learning are seeking now.
If your organization is planning to use machine learning, what benefits are you seeking?

If your organization is planning to use machine learning, what benefits are you seeking?

  • Natural language processing (NLP) (49%), text classification and mining(47%), emotion/behavior analysis (47%) and image recognition, classification, and tagging (43%) are the top four projects where machine learning is in use today.  Additional projects now underway include recommendations (42%), personalization (41%), data security (40%), risk analysis (41%), online search (41%) and localization and mapping (39%). Top future uses of machine learning include automated agents/bots (42%), predictive planning (41%), sales & marketing targeting (37%), and smart assistants (37%).
  • 60% of respondents have already implemented a machine learning strategy and committed to ongoing investment in initiatives. 18% have planned to implement a machine learning strategy in the next 12 to 24 months. Of the 60% of respondent companies who have implemented machine learning initiatives, 33% are in the early stages of their strategies, testing use cases. 28% consider their machine learning strategies as mature with between one and five use cases or initiatives ongoing today.

Five Strategies For Improving Customer Relationships Using Salesforce Integration

Bottom line: Defining salesforce integration strategies from the customers’ perspective that streamline every aspect of their relationship with your company drives greater revenue, earns trust and creates upsell and cross-sell opportunities in the future.

In the most competitive selling situations the company that has exceptional insights into what matters most to prospects and customers win the most deals. It’s not enough to just have a CRM system that is hard-wired into the core customer-facing processes of a business. To win more sales cycles companies are getting the most from every system they have available. From SAP Enterprise Resource Planning (ERP) systems to legacy pricing, operations, services, pricing, and CRM systems, companies winning more deals today can use Salesforce integration as a catalyst for driving more revenue.

Five Strategies For Improving Customer Relationships Using Salesforce Integration

  1. Making the Configure-Price-Quote (CPQ) process more efficient for customers and prospects by integrating ERP data into every quote. Today speed is a feature every system must have to stay competitive. Being able to create quotes that include the date the proposed configuration will ship and coordinate with services and programs delivery while providing order status from ERP systems is winning deals today. The tighter the ERP system integration, the better the quote accuracy in a CPQ system and the higher the chance of winning a sale. The following table shows the many benefits of having a well-integrated CPQ process.

business-impact-of-an-integrated-cpq-process

  1. Creating an omni-channel experience for customers needs to start with ERP, legacy, 3rd party and Salesforce integration that sets the foundation to exceed customer experiences daily. Providing a unified experience across every channel is challenging yet attainable, with market leaders using a series of integration strategies to provide this level of insight so customers’ expectations are exceeded in every single interaction. Only by integrating CRM systems including Salesforce with SAP ERP systems can any company hope to deliver a consistent, excellent series of experiences across all channels, all the time.
  1. Set up sales teams for exceptional performance with tightly integrated mobile apps that accelerate sales cycles. By using mobile apps that integrate SAP ERP systems, Salesforce CRM, and legacy systems into simplified, highly efficient workflows, sales teams can close more deals without having to come back to their offices.  Senior management teams can get more done using mobile apps that are an extension of their SAP ERP systems as well. Mobile apps are revolutionizing productivity thanks to SAP and Salesforce integration.
  1. Attaining high product quality levels that exceed customer expectations by providing every manufacturing department real-time visibility into quality inspections and inventory control. By integrating inbound inspection, inventory control, and quality management data across manufacturing, Bunn can deliver products that exceed customer expectations. Bunn’s product quality inspectors can perform and record results right at the machines being tested. The warehouse management system can scan and record inventory counts in real time to SAP. Maintaining high levels of product quality are what make Bunn’s beverage equipment machines a market standard globally today.
  1. Making new product launches more successful by having a tightly integrated approach to selling, producing and servicing new products that are in step with customers’ changing needs. From apparel to high-tech and financial services, customers are rapidly redefining which channels they choose to purchase through, how they choose to customize products, and which services they prefer to bundle in.  Integrating Salesforce, e-commerce and ERP systems into a single, unified workflow that is designed to provide customers exactly what they need is essential for enabling new product launches to succeed. With an integrated system across Salesforce, ERP, distribution and pricing systems, new product launches can scale globally quicker and still allow for personalization to customers’ unique preferences.  Salesforce integration is essential for successful new product introductions as the entire launch process gains speed, scale, and simplicity as a result.

Originally published on the enosiX blog, Five Strategies For Improving Customer Relationships Using Salesforce Integration. 

6M Developers Are Creating Big Data And Advanced Analytics Apps Today

  • analytics-development2M developers are working on IoT applications, increasing 34% since the last year.
  • Over 50% of the developers working on IoT applications are writing software that utilizes sensors in some capacity.
  • 4M enterprise developers play decision-making roles when it comes to selecting organizational IT development resources. Another 5.2 million hold decision-making authority for selecting IT deployment resources.
  • 4M developers (26% of all developers globally) are using the cloud as a development environment today
  • The APAC region leads the world with approximately 7.4M developers today, followed by EMEA with 7.2M, North America with 4.4M and Latin American with 1.9M.

These and many other fascinating insights are from the Evans Data Corporation Global Developer Population and Demographic Study 2016 (PDF, client access) published earlier this week. The methodology Evans Data has created to produce this report is the most comprehensive developed for aggregating, analyzing and predicting developer populations globally. The study combines Evans Data’s proprietary global developer population modeling with the current results of their semi-annual global developer survey.

Key takeaways from the study include the following:

  • 6M developers (29% of all developers globally) are involved in a Big Data and Advanced Analytics project today. An additional 25% of developers, or 5.3M, are going to begin Big Data and Advanced Analytics projects within the next six 13% or 2.6M of all developers globally are going to start Big Data and Advanced Analytics projects within the next 7 to 12 months.  The following graphic provides an overview of the involvement of 21M developers in Big Data and Advanced Analytics projects today. Please click on the image to expand for easier viewing.

involvement in big data analytics

  • 4M developers (26% of all developers globally) are using the cloud as a development environment today. Developers creating new apps in the cloud had increased 375% since Evans began measuring developer participation in mobile development in 2009 when just slightly more than 1.2M developers were using the cloud as their development platform. 4.5M developers (21% of all global developers) plan on beginning app development on cloud platforms in the next six months, and 3.9M (18% of all global developers) plan on starting development on the cloud in 7 – 12 months. Please click on the image to expand for easier viewing.

plans for cloud development

  • 8M developers in APAC (24% of all developers in the region) are currently developing on cloud platforms. 29% of APAC developers are planning to start cloud-based development in six months, and 20% in 7 – 12 months. The following graphic compares the number of developers currently using the cloud as a development environment today and the number who plan to in the future. Please click on the image to expand for easier viewing.

plans for cloud development by region

  • 34% of all Commercial Independent Software Vendors (ISVs) globally today (1.8M developers) are using the cloud as a development environment. An additional 1.4M are planning to begin cloud development in the next six months.  28% of developers globally creating apps in the cloud are from custom system integrators (SI) and value-added resellers (VARs).  23% or approximately 1.2M are from enterprises.  The following graphic compares the percent of developers by developer segment who are currently creating new apps in cloud environments. Please click on the image to expand for easier viewing.

Plans for cloud development by developer segment

  • 30% of developers (6.2M developers globally) are currently developing software for connected devices or the Internet of Things today, with an additional 26% planning to begin projects in 6 months. Evans Data found that this increased 34% over the last year. Also, 2.1M developers plan to begin development in this area within the next 7 to 12 months. The following graphic compares the number of developers globally by stage of development for creating software for connected devices or the Internet of Things. Please click on the image to expand for easier viewing.

Plans for Internet of Things Development

  • 41% of global developers creating connected device and IoT software today are from 27% are from North America, 24% are from EMEA and 7% from Latin America.  There are 6,072,048 developers currently working on connected device and IoT software today globally.  The following graphic provides an overview of the distribution of developers creating connected device and IoT software by region today. Please click on the image to expand for easier viewing.

Development for Connected Devices By Region

  • 34% of developers actively creating software for connected devices or the Internet of Things work for custom System Integrators (SI) and VARs today. ISVs are the next largest segment of developers working on IoT projects (30%) followed by enterprises (21%). The following graphic provides an overview of the global base of developers creating software for connected devices and IoT. Evans Data found there are 6.1M developers currently creating apps and solutions in this area alone. Please click on the image to expand for easier viewing.

Development for connected devices by developer segment 2

Roundup Of Analytics, Big Data & BI Forecasts And Market Estimates, 2016

  • World map technologyBig Data & business analytics software worldwide revenues will grow from nearly $122B in 2015 to more than $187B in 2019, an increase of more than 50% over the five-year forecast period.
  • The market for prescriptive analytics software is estimated to grow from approximately $415M in 2014 to $1.1B in 2019, attaining a 22% CAGR.
  • By 2020, predictive and prescriptive analytics will attract 40% of enterprises’ net new investment in business intelligence and analytics.

Making enterprises more customer-centric, sharpening focus on key initiatives that lead to entering new markets and creating new business models, and improving operational performance are three dominant factors driving analytics, Big Data, and business intelligence (BI) investments today. Unleashing the insights hidden in unstructured data is providing enterprises with the potential to compete and improve in areas they had limited visibility into before. Examples of these areas include the complexity of B2B selling and service relationships,  healthcare services, and maintenance, repair, and overhaul (MRO) of complex machinery. All organizations face the daunting task of integrating systems together to enable greater process visibility. enosiX is taking a leadership role in this area, offering real-time integration between SAP and Salesforce systems, giving enterprises the opportunity to be more responsive to suppliers, resellers, partners and most importantly, customers.

Presented below are a roundup of recent analytics and big data forecasts and market estimates:

  • The global big data market will grow from $18.3B in 2014 to $92.2B by 2026, representing a compound annual growth rate of 14.4 percent. Wikibon predicts significant growth in all four sub-segments of big data software through 2026. Data management (14% CAGR), core technologies such as Hadoop, Spark and streaming analytics (24% CAGR), databases (18% CAGR) and big data applications, analytics and tools (23% CAGR) are the four fastest growing sub-segments according to Wikibon. Source: Wikibon forecasts Big Data market to hit $92.2B by 2026.

Wikibon big data forecast 2016

analytics market shares

IDC FutureScape

  • The Total Data market is expected to nearly double in size, growing from $69.6B in revenue in 2015 to $132.3B in 2020. The specific market segments included in 451 Research’s analysis are operational databases, analytic databases, reporting and analytics, data management, performance management, event/stream processing, distributed data grid/cache, Hadoop, and search-based data platforms and analytics. Source: Total Data market expected to reach $132bn by 2020; 451 Research, June 14, 2016.

Worldwide total revenue by segment

overall adoption of big data

  • Improving customer relationships (55%) and making the business more data-focused (53%) are the top two business goals or objectives driving investments in data-driven initiatives today. 78% of enterprises agree that collection and analysis of Big Data have the potential to change fundamentally the way they do business over the next 1 to 3 years. Source: IDG Enterprise 2016 Data & Analytics Research, July 5, 2016.

Data Helps Customer Focused Organizations

  • Venture capital (VC) investment in Big Data accelerated quickly at the beginning of the year with DataDog ($94M), BloomReach ($56M), Qubole ($30M), PlaceIQ ($25M) and others receiving funding. Big Data startups received $6.64B in venture capital investment in 2015, 11% of total tech VC.  M&A activity has remained moderate (FirstMark noted 35 acquisitions since their latest landscape was published last year). Source: Matt Turck’s blog post, Is Big Data Still a Thing? (The 2016 Big Data Landscape).

big data landscape

  • IDC forecasts global spending on cognitive systems will reach nearly $31.3 billion in 2019 with a five-year compound annual growth rate (CAGR) of 55%. More than 40% of all cognitive systems spending throughout the forecast will go to software, which includes both cognitive applications (i.e., text and rich media analytics, tagging, searching, machine learning, categorization, clustering, hypothesis generation, question answering, visualization, filtering, alerting, and navigation). Also included in the forecasts are cognitive software platforms, which enable the development of intelligent, advisory, and cognitively enabled solutions.  Source:  Worldwide Spending on Cognitive Systems Forecast to Soar to More Than $31 Billion in 2019, According to a New IDC Spending Guide.
  • Big Data Analytics & Hadoop Market accounted for $8.48B in 2015 and is expected to reach $99.31B by 2022 growing at a CAGR of 42.1% from 2015 to 2022. The rise of big data analytics and rapid growth in consumer data capture and taxonomy techniques are a few of the many factors fueling market growth. Source: Stratistics Market Research Consulting (PDF, opt-in, payment reqd).

Additional sources of market information: 

Analytics Trends 2016 The Next Evolution, Deloitte.

Big data analytics, Ericsson White Paper Uen 288 23-3211 Rev B | October 2015

Big Data and the Intelligence Economy in Canada Big Data: Big Opportunities to Create Business Value, EMC.

The Forrester Wave™: Big Data Hadoop Distributions, Q1 2016

The Forrester Wave™: Big Data Hadoop Cloud Solutions, Q2 2016

The Forrester Wave™: Big Data Text Analytics Platforms, Q2 2016

The Forrester Wave™: Big Data Streaming Analytics, Q1 2016

The Forrester Wave™: Customer Analytics Solutions, Q1 2016

From Big Data to Better Decisions: The ultimate guide to business intelligence today (Domo)

Gartner Hype Cycle for Business Intelligence and Analytics, 2015

IBM: Extracting business value from the 4 V’s of big data

IDC Worldwide Big Data Technology and Services 2012 – 2015 Forecast

Opportunities in Telecom Sector: Arising from Big Data. Deloitte, November 2015

Who will win as Finance doubles down on analytics?

10 Ways Machine Learning Is Revolutionizing Manufacturing

machine learningBottom line: Every manufacturer has the potential to integrate machine learning into their operations and become more competitive by gaining predictive insights into production.

Machine learning’s core technologies align well with the complex problems manufacturers face daily. From striving to keep supply chains operating efficiently to producing customized, built- to-order products on time, machine learning algorithms have the potential to bring greater predictive accuracy to every phase of production. Many of the algorithms being developed are iterative, designed to learn continually and seek optimized outcomes. These algorithms iterate in milliseconds, enabling manufacturers to seek optimized outcomes in minutes versus months.

The ten ways machine learning is revolutionizing manufacturing include the following:

  • Increasing production capacity up to 20% while lowering material consumption rates by 4%. Smart manufacturing systems designed to capitalize on predictive data analytics and machine learning have the potential to improve yield rates at the machine, production cell, and plant levels. The following graphic from General Electric and cited in a National Institute of Standards (NIST) provides a summary of benefits that are being gained using predictive analytics and machine learning in manufacturing today.

typical production improvemensSource: Focus Group: Big Data Analytics for Smart Manufacturing Systems

  • Providing more relevant data so finance, operations, and supply chain teams can better manage factory and demand-side constraints. In many manufacturing companies, IT systems aren’t integrated, which makes it difficult for cross-functional teams to accomplish shared goals. Machine learning has the potential to bring an entirely new level of insight and intelligence into these teams, making their goals of optimizing production workflows, inventory, Work In Process (WIP), and value chain decisions possible.

factory and demand analytics

Source:  GE Global Research Stifel 2015 Industrials Conference

  • Improving preventative maintenance and Maintenance, Repair and Overhaul (MRO) performance with greater predictive accuracy to the component and part-level. Integrating machine learning databases, apps, and algorithms into cloud platforms are becoming pervasive, as evidenced by announcements from Amazon, Google, and Microsoft. The following graphic illustrates how machine learning is integrated into the Azure platform. Microsoft is enabling Krones to attain their Industrie 4.0 objectives by automating aspects of their manufacturing operations on Microsoft Azure.

Azure IOT Services

Source: Enabling Manufacturing Transformation in a Connected World John Shewchuk Technical Fellow DX, Microsoft

  • Enabling condition monitoring processes that provide manufacturers with the scale to manage Overall Equipment Effectiveness (OEE) at the plant level increasing OEE performance from 65% to 85%. An automotive OEM partnered with Tata Consultancy Services to improve their production processes that had seen Overall Equipment Effectiveness (OEE) of the press line reach a low of 65 percent, with the breakdown time ranging from 17-20 percent.  By integrating sensor data on 15 operating parameters (such as oil pressure, oil temperature, oil viscosity, oil leakage, and air pressure) collected from the equipment every 15 seconds for 12 months. The components of the solution are shown

OEE Graphic

Source: Using Big Data for Machine Learning Analytics in Manufacturing

  • Machine learning is revolutionizing relationship intelligence and Salesforce is quickly emerging as the leader. The series of acquisitions Salesforce is making positions them to be the global leader in machine learning and artificial intelligence (AI). The following table from the Cowen and Company research note, Salesforce: Initiating At Outperform; Growth Engine Is Well Greased published June 23, 2016, summarizes Salesforce’s series of machine learning and AI acquisitions, followed by an analysis of new product releases and estimated revenue contributions. Salesforce’s recent acquisition of e-commerce provider Demandware for $2.8B is analyzed by Alex Konrad is his recent post,     Salesforce Will Acquire Demandware For $2.8 Billion In Move Into Digital Commerce. Cowen & Company predicts Commerce Cloud will contribute $325M in revenue by FY18, with Demandware sales being a significant contributor.

Salesforce AI Acquisitions

Salesforce revenue sources

  • Revolutionizing product and service quality with machine learning algorithms that determine which factors most and least impact quality company-wide. Manufacturers often are challenged with making product and service quality to the workflow level a core part of their companies. Often quality is isolated. Machine learning is revolutionizing product and service quality by determining which internal processes, workflows, and factors contribute most and least to quality objectives being met. Using machine learning manufacturers will be able to attain much greater manufacturing intelligence by predicting how their quality and sourcing decisions contribute to greater Six Sigma performance within the Define, Measure, Analyze, Improve, and Control (DMAIC) framework.
  • Increasing production yields by the optimizing of team, machine, supplier and customer requirements are already happening with machine learning. Machine learning is making a difference on the shop floor daily in aerospace & defense, discrete, industrial and high-tech manufacturers today. Manufacturers are turning to more complex, customized products to use more of their production capacity, and machine learning help to optimize the best possible selection of machines, trained staffs, and suppliers.
  • The vision of Manufacturing-as-a-Service will become a reality thanks to machine learning enabling subscription models for production services. Manufacturers whose production processes are designed to support rapid, highly customized production runs are well positioning to launch new businesses that provide a subscription rate for services and scale globally. Consumer Packaged Goods (CPG), electronics providers and retailers whose manufacturing costs have skyrocketed will have the potential to subscribe to a manufacturing service and invest more in branding, marketing, and selling.
  • Machine learning is ideally suited for optimizing supply chains and creating greater economies of scale.  For many complex manufacturers, over 70% of their products are sourced from suppliers that are making trade-offs of which buyer they will fulfill orders for first. Using machine learning, buyers and suppliers could collaborate more effectively and reduce stock-outs, improve forecast accuracy and met or beat more customer delivery dates.
  • Knowing the right price to charge a given customer at the right time to get the most margin and closed sale will be commonplace with machine learning.   Machine learning is extending what enterprise-level price optimization apps provide today.  One of the most significant differences is going to be just how optimizing pricing along with suggested strategies to close deals accelerate sales cycles.

Additional reading:

Cisco Blog: Deus Ex Machina: Machine Learning Acts to Create New Business Outcomes

Enabling Manufacturing Transformation in a Connected World John Shewchuk Technical Fellow DX, Microsoft 

Focus Group: Big Data Analytics for Smart Manufacturing Systems

GE Predix: The Industrial Internet Platform

IDC Manufacturing Insights reprint courtesy of Cisco: Designing and Implementing the Factory of the Future at Mahindra Vehicle Manufacturers

Machine Learning: What It Is And Why It Matters

McKinsey & Company, An Executive’s Guide to Machine Learning

MIT Sloan Management Review, Sales Gets a Machine-Learning Makeover

Stanford University CS 229 Machine Learning Course Materials
The Economist Feature On Machine Learning

UC Berkeley CS 194-10, Fall 2011: Introduction to Machine Learning
Lecture slides, notes

University of Washington CSE 446 – Machine Learning – Winter 2014

Sources:

Lee, J. H., & Ha, S. H. (2009). Recognizing yield patterns through hybrid applications of machine learning techniques. Information Sciences, 179(6), 844-850.

Mackenzie, A. (2015). The production of prediction: What does machine learning want?. European Journal of Cultural Studies, 18(4-5), 429-445.

Pham, D. T., & Afify, A. A. (2005, July). Applications of machine learning in manufacturing. In Intelligent Production Machines and Systems, 1st I* PROMS Virtual International Conference (pp. 225-230).

Priore, P., de la Fuente, D., Puente, J., & Parreño, J. (2006). A comparison of machine-learning algorithms for dynamic scheduling of flexible manufacturing systems. Engineering Applications of Artificial Intelligence, 19(3), 247-255.

Machine Learning Is Redefining The Enterprise In 2016

machine learning imageBottom line: Machine learning is providing the needed algorithms, applications, and frameworks to bring greater predictive accuracy and value to enterprises’ data, leading to diverse company-wide strategies succeeding faster and more profitably than before.

Industries Where Machine Learning Is Making An Impact  

The good news for businesses is that all the data they have been saving for years can now be turned into a competitive advantage and lead to strategic goals being accomplished. Revenue teams are using machine learning to optimize promotions, compensation and rebates drive the desired behavior across selling channels. Predicting propensity to buy across all channels, making personalized recommendations to customers, forecasting long-term customer loyalty and anticipating potential credit risks of suppliers and buyers are Figure 1 provides an overview of machine learning applications by industry.

machine learning industries

Source: Tata Consultancy Services, Using Big Data for Machine Learning Analytics in Manufacturing – TCS

Machine Learning Is Revolutionizing Sales and Marketing  

Unlike advanced analytics techniques that seek out causality first, machine learning techniques are designed to seek out opportunities to optimize decisions based on the predictive value of large-scale data sets. And increasingly data sets are comprised of structured and unstructured data, with the global proliferation of social networks fueling the growth of the latter type of data.  Machine learning is proving to be efficient at handling predictive tasks including defining which behaviors have the highest propensity to drive desired sales and marketing outcomes. Businesses eager to compete and win more customers are applying machine learning to sales and marketing challenges first.  In the MIT Sloan Management Review article, Sales Gets a Machine-Learning Makeover the Accenture Institute for High Performance shared the results of a recent survey of enterprises with at least $500M in sales that are targeting higher sales growth with machine learning. Key takeaways from their study results include the following:

  • 76% say they are targeting higher sales growth with machine learning. Gaining greater predictive accuracy by creating and optimizing propensity models to guide up-sell and cross-sell is where machine learning is making contributions to omnichannel selling strategies today.
  • At least 40% of companies surveyed are already using machine learning to improve sales and marketing performance. Two out of five companies have already implemented machine learning in sales and marketing.
  • 38% credited machine learning for improvements in sales performance metrics. Metrics the study tracked include new leads, upsells, and sales cycle times by a factor of 2 or more while another 41% created improvements by a factor of 5 or more.
  • Several European banks are increasing new product sales by 10% while reducing churn 20%. A recent McKinsey study found that a dozen European banks are replacing statistical modeling techniques with machine learning. The banks are also increasing customer satisfaction scores and customer lifetime value as well.

Why Machine Learning Adoption Is Accelerating

Machine learning’s ability to scale across the broad spectrum of contract management, customer service, finance, legal, sales, quote-to-cash, quality, pricing and production challenges enterprises face is attributable to its ability to continually learn and improve. Machine learning algorithms are iterative in nature, continually learning and seeking to optimize outcomes.  Every time a miscalculation is made, machine learning algorithms correct the error and begin another iteration of the data analysis. These calculations happen in milliseconds which makes machine learning exceptionally efficient at optimizing decisions and predicting outcomes.
The economics of cloud computing, cloud storage, the proliferation of sensors driving Internet of Things (IoT) connected devices growth, pervasive use of mobile devices that consume gigabytes of data in minutes are a few of the several factors accelerating machine learning adoption. Add to these the many challenges of creating context in search engines and the complicated problems companies face in optimizing operations while predicting most likely outcomes, and the perfect conditions exist for machine learning to proliferate.
The following are the key factors enabling machine learning growth today:

  • Exponential data growth with unstructured data being over 80% of the data an enterprise relies on to make decisions daily. Demand forecasts, CRM and ERP transaction data, transportation costs, barcode and inventory management data, historical pricing, service and support costs and accounting standard costing are just a few of the many sources of structured data enterprises make decisions with today.   The exponential growth of unstructured data that includes social media, e-mail records, call logs, customer service and support records, Internet of Things sensing data, competitor and partner pricing and supply chain tracking data frequently has predictive patterns enterprises are completely missing out on today. Enterprises looking to become competitive leaders are going after the insights in these unstructured data sources and turning them into a competitive advantage with machine learning.
  • The Internet of Things (IoT) networks, embedded systems and devices are generating real-time data that is ideal for further optimizing supply chain networks and increasing demand forecast predictive As IoT platforms, systems, applications and sensors permeate value chains of businesses globally, there is an exponential growth of data generated. The availability and intrinsic value of these large-scale datasets are an impetus further driving machine learning adoption.
  • Generating massive data sets through synthetic means including extrapolation and projection of existing historical data to create realistic simulated data. From weather forecasting to optimizing a supply chain network using advanced simulation techniques that generate terabytes of data, the ability to fine-tune forecasts and attain greater optimizing is also driving machine learning adoption. Simulated data sets of product launch and selling strategies is a nascent application today and one that shows promise in developing propensity models that predict purchase levels.
  • The economics of digital storage and cloud computing are combining to put infrastructure costs into freefall, making machine learning more affordable for all businesses. Online storage and public cloud instances can be purchased literally in minutes online with a credit card. Migrating legacy data off of databases where their accessibility is limited compared to cloud platforms is becoming more commonplace as greatest trust in secure cloud storage increases. For many small businesses who lack IT departments, the Cloud provides a scalable, secure platform for managing their data across diverse geographic locations.

Further reading

Companies Are Reimagining Business Processes with Algorithms. Harvard Business Review. February 8, 2016.  H. James Wilson, Allan Alter, Prashant Shukla. Source: https://hbr.org/2016/02/companies-are-reimagining-business-processes-with-algorithms

Domingos, P. (2012). A Few Useful Things to Know About Machine Learning. Communications Of The ACM, 55(10), 78-87.

Pyle, D., & San José, C. (2015). An executive’s guide to machine learning. Mckinsey Quarterly, (3), 44-53. Link: http://www.mckinsey.com/industries/high-tech/our-insights/an-executives-guide-to-machine-learning

Sales Gets A Machine-Learning Makeover.  MIT Sloan Management Review, May 17, 2016. H. James Wilson, Narendra Mulani, Allan Alter. Source: http://sloanreview.mit.edu/article/sales-gets-a-machine-learning-makeover/Sebag, M. (2014).

The Next Wave Of Enterprise Software Powered By Machine Learning.  TechCrunch, July 27, 2015. http://techcrunch.com/2015/07/27/the-next-wave-of-enterprise-software-powered-by-machine-learning/

What Every Manager Should Know About Machine Learning, Harvard Business Review,  July 7, 2015.  Link: https://hbr.org/2015/07/what-every-manager-should-know-about-machine-learning

What Is Machine Learning? Making The Complex Simple.  Mike Ferguson.  IBM Big Data & Analytics Hub. Link: http://www.ibmbigdatahub.com/blog/what-machine-learning

World Economic Forum White Paper Digital Transformation of Industries: In collaboration with Accenture Digital Enterprise, January 2016. Link: http://reports.weforum.org/digital-transformation-of-industries/wp-content/blogs.dir/94/mp/files/pages/files/digital-enterprise-narrative-final-january-2016.pdf

Yan, J., Zhang, C., Zha, H., Gong, M., Sun, C., Huang, J., & Yang, X. (2015, February). On machine learning towards predictive sales pipeline analytics. In Twenty-Ninth AAAI Conference on Artificial Intelligence.  Link: http://www.aaai.org/ocs/index.php/AAAI/AAAI15/paper/viewFile/9444/9488

Businesses Adopting Big Data, Cloud & Mobility Grow 53% Faster Than Peers

  • London sykline duskOrchestrating big data, cloud and mobility strategies leads to 53% greater growth than peers not adopting these technologies.
  • 73% of midmarket companies say the complexity of their stored data requires big data analytics apps and tools to better gain insights from.
  • 41% of midmarket companies are using big data to better target marketing efforts.
  •  54% of midmarket companies’ security budgets are invested in security plans versus reacting to threats.

These and many other insights are from Dell’s second annual Global Technology Adoption Index (GTAI 2015) released last week in collaboration with TNS Research. The Global Technology Adoption Index surveyed IT and business decision makers of mid-market organizations across 11 countries, interviewing 2,900 IT and business decision makers representing businesses with 100 to 4,999 employees.

The purpose of the index is to understand how business users perceive, plan for and utilize four key technologies: cloud, mobility, security and big data. Dell released the first wave of its results this week and will be publishing several additional chapters throughout 2016. You can download Chapter 1 of the study here (PDF, no opt-in, 18 pp.).

Key take-aways from the study include the following:

  • Orchestrating big data, cloud and mobility strategies leads to 53% greater growth than peers not adopting these technologies. Midmarket organizations adopting big data alone have the potential to grow 50% more than comparable organizations. Effective use of Bring Your Own Device (BYOD) mobility strategies has the potential to increase growth by 53% over laggards or late adopters..

orchestrating tech for greater growth

  • 73% of North American organizations believe the volume and complexity of their data requires big data analytics apps and tools.  This is up from 54% in 2014, indicating midmarket organizations are concentrating on how to get more value from the massive data stores many have accumulated.  This same group of organizations believe they are getting more value out of big data this year (69%) compared to last year (64%).  Top outcomes of using big data include better targeting of marketing efforts (41%), optimization of ad spending (37%), and optimization of social media marketing (37%).

top outcomes

  • 54% of an organization’s security budget is invested in security plans versus reacting to threats. Dell & TNS Research discovered that midmarket organizations both in North America and Western Europe are relying on security to enable new devices or drive competitive advantage.  In North America, taking a more strategic approach to security has increased from 25% in 2014 to 35% today.  In Western Europe, the percentage of companies taking a more strategic view of security has increased from 26% in 2014 to 30% this year.

security strategic

  • IT infrastructure costs to support big data initiatives (29%) and costs related to securing the data (28%) are the two greatest barriers to big data adoption. For cloud adoption, costs and security are the two biggest barriers in midmarket organizations as is shown in the graphic below.

security costs

  • Cloud use by midmarket companies in France increased 12% in the last twelve months, leading all nations in the survey.  Of the 11 countries surveyed, France had the greatest increase in cloud adoption within midmarket companies.  French businesses increased their adoption of cloud applications and platforms from 70% in 2014 to 82% in 2015.

Sources: Dell Study Reveals Companies Investing in Cloud, Mobility, Security and Big Data Are Growing More Than 50 Percent Faster Than Laggards. October 13, 2015

 

%d bloggers like this: