- 82% of enterprises are prioritizing analytics and BI as part of their budgets for new technologies and cloud-based services.
- 54% say AI, Machine Learning and Natural Language Processing (NLP) are also a high investment priority.
- 50% of enterprises say their stronger focus on metrics and Key Performance Indicators (KPIs) company-wide are a major driver of new investment in analytics and BI.
- 43% plan to both build and buy AI and machine learning applications and platforms.
- 42% are seeking to improve user experiences by automating discovery of data insights and 26% are using AI to provide user recommendations.
These and many other fascinating insights are from the recent TDWI Best Practices Report, BI and Analytics in the Age of AI and Big Data. An executive summary of the study is available online here. The entire study is available for download here (39 PP., PDF, free, opt-in). The study found that enterprises are placing a high priority on augmenting existing systems and replacing older technologies and data platforms with new cloud-based BI and predictive analytics ones. Transforming Data with Intelligence (TDWI) is a global community of AI, analytics, data science and machine learning professionals interested in staying current in these and more technology areas as part of their professional development. Please see page 3 of the study for specifics regarding the methodology.
Key takeaways from the study include the following:
- 82% of enterprises are prioritizing analytics and BI applications and platforms as part of their budgets for new technologies and cloud-based services. 78% of enterprises are prioritizing advanced analytics, and 76% data preparation. 54% say AI, machine learning and Natural Language Processing (NLP) are also a high investment priority. The following graphic ranks enterprises’ investment priorities for acquiring or subscribing to new technologies and cloud-based services by analytics and BI initiatives or strategies. Please click on the graphic to expand for easier reading.
- Data warehouse or mart in the cloud (41%), data lake in the cloud (39%) and BI platform in the cloud (38%) are the top three types of technologies enterprises are planning to use. Based on this finding and others in the study, cloud platforms are the new normal in enterprises’ analytics and Bi strategies going into 2019. Cloud data storage (object, file, or block) and data virtualization or federation (both 32%) are the next-most planned for technologies by enterprises when it comes to investing in the analytics and BI initiatives. Please click on the graphic to expand for easier reading.
- The three most important factors in delivering a positive user experience include good query performance (61%), creating and editing visualizations (60%), and personalizing dashboards and reports (also 60%). The three activities that lead to the least amount of satisfaction are using predictive analytics and forecasting tools (27% dissatisfied), “What if” analysis and deriving new data (25%) and searching across data and reports (24%). Please click on the graphic to expand for easier reading.
- 82% of enterprises are looking to broaden the base of analytics and BI platforms they rely on for insights and intelligence, not just stay with the solutions they have in place today. Just 18% of enterprises plan to add more instances of existing platforms and systems. Cloud-native platforms (38%), a new analytics platform (35%) and cloud-based data lakes (31%) are the top three system areas enterprises are planning to augment or replace existing BI, analytics, and data warehousing systems in. Please click on the graphic to expand for easier reading.
- The majority of enterprises plan to both build and buy Artificial Intelligence (AI) and machine learning (ML) solutions so that they can customize them to their specific needs. 43% of enterprises surveyed plan to both build and buy AI and ML applications and platforms, a figure higher than any other recent survey on this aspect of enterprise AI adoption. 13% of responding enterprises say they will exclusively build their own AI and ML applications.
- Capitalizing on machine learning’s innate strengths of applying algorithms to large volumes of data to find actionable new insights (54%) is what’s most important to the majority of enterprises. 47% of enterprises look to AI and machine learning to improve the accuracy and quality of information. And 42% are configuring AI and machine learning applications and platforms to augment user decision making by giving recommendations. Please click on the graphic to expand for easier reading.
- 30% of tech leaders globally predict blockchain will disrupt their businesses by 2021.
- IoT, Artificial Intelligence (AI) and Robotics have the greatest potential to digitally transform businesses, making them more customer-centered and efficient.
- 26% of global tech leaders say e-Commerce apps and platforms will be the most disruptive new business model in their countries by 2021.
- IDC predicts worldwide IoT spending will reach $1.1T by 2021.
These and many other insights are from KPMG’s recent research study Tech Disruptors Outpace The Competition. The study can be downloaded here (PDF, 42 pp., no opt-in.). The methodology is based on interviews with 750 global technology industry leaders, 85% of whom are C-level executives. For additional details on the methodology, please see pages 32 and 33 of the study. The study found that the three main benefits of adopting IoT, AI, and robotics include improved management of personal information, increased personal productivity, and improved customer experience through personalized real-time information. Key insights gained from the study include the following:
- IoT, Artificial Intelligence (AI) and Robotics have the greatest potential to digitally transform businesses, making them more customer-centered and efficient. Tech leaders also see these three core technologies enabling the next indispensable consumer technology and driving the greatest benefit to life, society, and the environment. KPMG’s research team found that tech companies are integrating these three technologies to create growth platforms for new business ventures while digitally transforming existing business processes. Tech leaders in the U.K. (21%), Japan (20%) and the U.S. (16%) lead all other nations in their plans for IoT digitally transforming their businesses by 2021. Please click on the graphic below to expand for easier reading.
- 30% of tech leaders globally predict blockchain will disrupt their businesses by 2021. 50% of Japanese tech leaders predict that blockchain will digitally transform their industries and companies by 2021, leading all nations included in the survey. IoT processes and the rich, real-time data stream sensors and systems are capable of delivering is predicted by tech leaders to be the primary catalyst that will enable blockchain to digitally transform their businesses. 27% of tech leaders globally expect IoT data and applications combined with blockchain to redefine their companies, supply chains and industries. Identity authentication (24%), automated trading (22%) and contracts (14%) are the 2nd through fourth-most disruptive aspects of blockchain by 2021 according to tech leaders. Please click on the graphic below to expand for easier reading.
- 26% of global tech leaders say e-Commerce apps and platforms will be the most disruptive new business model in their countries by 2021. 19% see social media platforms creating the majority of new business models, followed autonomous vehicle platforms (14%) and entertainment platforms (11%). KPMG’s analysis includes a ranking of top business models by country, with e-Commerce dominating four of the five regions included in the survey.
- 50% of tech leaders expect media, transportation, healthcare, and transportation to experience the greatest digital transformation in the next three years. Respondents most mentioned Amazon, Netflix, Alibaba, Uber, Google, and Facebook as examples of companies who will digitally transform their industries by 2021. The following table provides insights into which industries by country will see the greatest digital transformations in the next three years. Entertainment platforms are predicted by tech leaders to have the greatest potential to digitally transform the media industry in the U.S. by 2021.
- Tech leaders predict IoT’s greatest potential for adoption by 2021 is in consumer products, education, services, industrial manufacturing, and telecom. AI’s greatest potential to digitally transform business models is in healthcare and industrial manufacturing (both 11%), consumer products, financial, and services (10% each). As would be expected, Robotics’ adoption and contribution to digitally transforming businesses will be most dominant in industrial manufacturing (15%), followed by healthcare (11%) and consumer, financial and services (10%). Please click on the graphic to expand for easier reading.
- 66% of organizations that consider themselves completely successful with Business Intelligence (BI) initiatives currently use the cloud.
- 86% of Cloud BI adopters name Amazon AWS as their first choice, 82% name Microsoft Azure, 66% name Google Cloud, and 36% identify IBM Bluemix as their preferred provider of cloud BI services.
These and other many other fascinating insights are from Dresner Advisory Services 2018 Cloud Computing and Business Intelligence Market Study (client access reqd.) of the Wisdom of Crowds® series of research. The goal of the 7th annual edition of the study seeks to quantify end-user deployment trends and attitudes toward cloud computing and business intelligence (BI), defined as the technologies, tools, and solutions that employ one or more cloud deployment models. Dresner Advisory Services defines the scope of Business Intelligence (BI) tools and technologies to include query and reporting, OLAP (online analytical processing), data mining and advanced analytics, end-user tools for ad hoc query and analysis, and dashboards for performance monitoring. Please see page 10 of the study for the methodology. The study found the primary barriers to greater cloud BI adoption are enterprises’ concerns regarding data privacy and security.
Key takeaways from the study include the following:
- Cloud BI’s importance continues to accelerate in 2018, with the majority of respondents considering it an important element of their broader analytics strategies. The study found that mean level of sentiment rose from 2.68 to 3.22 (above the level of “important”) between 2017 and 2018, indicating the increased importance of Cloud BI over the last year. By region, Asia-Pacific respondents continue to be the strongest proponents of cloud computing regarding both adjusted mean (4.2 or “very important”) and levels of criticality. The following graphic illustrates Cloud BI’s growing importance between 2012 and 2018.
- Over 90% of Sales & Marketing teams say Cloud BI apps are important to getting their work done in 2018, leading all respondent categories in the survey. The study found that Cloud BI importance in 2018 is highest among Sales/Marketing and Executive Management respondents. One of the key factors driving this is the fact that both Sales & Marketing and Executive Management are increasingly relying on cloud-based front office applications and services that are integrated with and generate cloud-based data to track progress towards goals.
- Cloud BI is most critical to Financial Services & Insurance, Technology, and Retail & Wholesale Trade industries. The study recorded its highest-ever levels of Cloud Bi importance in 2018. Financial Services has the highest weighted mean interest in cloud BI (3.8, which approaches “very important” status shown in the figure below). Technology organizations, where half of the respondents say cloud BI is “critical” or “very important,” are the next most interested. Close to 90% of Retail/Wholesale respondents say SaaS/cloud BI is at least “important” to them. As it has been over time, Healthcare remains the industry least open to managed services for data and business intelligence.
- Cloud BI adoption is soaring in 2018, nearly doubling 2016 adoption levels. The study finds that the percentage of respondents using Cloud BI in 2018 nearly doubled from 25% of enterprise users in 2016. Year over year, current use rose from 31% to 49%. In the same time frame, the percentage of respondents with no plans to use cloud BI dropped by half, from 38% to 19%. This study has been completed for the last seven years, showing a steady progression of Cloud BI awareness and adoption, with 2018 being the first one showing the most significant rise in adoption levels ever.
- Sales & Marketing leads all departments in current use and planning for Cloud BI applications. Business Intelligence Competency Centers (BICC) are a close second, each with over 60% adoption rates for Cloud BI today. Operations including manufacturing and supply chains and services are the next most likely to use Cloud BI currently. Marketing and BICC lead current adoption and are contributing catalysts of Cloud BI’s soaring growth between 2016 and 2018. Both of these departments often have time-constrained and revenue-driven goals where quantifying contributions to company growth and achievement ad critical.
- Financial Services (62%), Technology (54%), and Education (54%) industries have the highest Cloud BI adoption rates in 2018. The retail/wholesale industry has the fourth-highest level of Cloud BI adoption and the greatest number of companies who are currently evaluating Cloud BI today. The least likely current or future users are found in manufacturing and security-sensitive healthcare organizations, where 45% respondents report no plans for cloud-based BI/analytics.
- Dashboards, advanced visualization, ad-hoc query, data integration, and self-service are the most-required Cloud BI features in 2018. Sales & Marketing need real-time feedback on key initiatives, programs, strategies, and progress towards goals. Dashboards and advanced visualization features’ dominance of feature requirements reflect this department’s ongoing need for real-time feedback on the progress of their teams towards goals. Reporting, data discovery, and end-user data blending (data preparation) make up the next tier of importance.
- Manufacturers have the greatest interest in dashboards, ad-hoc query, production reporting, search interface, location intelligence, and ability to write to transactional applications. Education respondents report the greatest interest in advanced visualization along with data integration, data mining, end-user data blending, data catalog, and collaborative support for group-based analysis. Financial Services respondents are highly interested in advanced visualization and lead all industries in self-service. Healthcare industry respondents lead interest only in in-memory support. Retail/Wholesale and Healthcare industry respondents are the least feature interested overall.
- Interest in cloud application connections to Salesforce, NetSuite, and other cloud-based platforms has increased 12% this year. Getting end-to-end visibility across supply chains, manufacturing centers, and distribution channels requires Cloud BI apps be integrated with cloud-based platforms and on-premises applications and data. Expect to see this accelerate in 2019 as Cloud BI apps become more pervasive across Marketing & Sales and Executive Management, in addition to Operations including supply chain management and manufacturing where real-time shop floor monitoring is growing rapidly.
- Retail/Wholesale, Business Services, Education and Financial Services & Insurance industries are most interested in Google Analytics connectors to obtain data for their Cloud BI apps. Respondents from Technology industries prioritize Salesforce integration and connectors above all others. Education respondents are most interested in MySQL and Google Drive integration and connectors. Manufacturers are most interested in connectors to Google AdWords, SurveyMonkey, and The Healthcare industry respondents prioritize SAP Cloud BI services and also interested in ServiceNow connectors.
- 53% of CIOs say machine learning is one of their core priorities as their role expands from traditional IT operations management to business strategists.
- CIOs are struggling to find the skills they need to build their machine learning models today, especially in financial services.
These and many other insights are from the recently published study, Global CIO Point of View. The entire report is downloadable here (PDF, 24 pp., no opt-in). ServiceNow and Oxford Economics collaborated on this survey of 500 CIOs in 11 countries on three continents, spanning 25 industries. In addition to the CIO interviews, leading experts in machine learning and its impact on enterprise performance contributed to the study. For additional details on the methodology, please see page 4 of the study and an online description of the CIO Survey Methodology here.
Digital transformation is a cornerstone of machine learning adoption. 72% of CIOs have responsibility for digital transformation initiatives that drive machine learning adoption. The survey found that the greater the level of digital transformation success, the more likely machine learning-based programs and strategies would succeed. IDC predicts that 40% of digital transformation initiatives will be supported by machine learning and artificial intelligence by 2019.
Key takeaways from the study include the following:
- 90% of CIOs championing machine learning in their organizations today expect improved decision support that drives greater topline revenue growth. CIOs who are early adopters are most likely to pilot, evaluate and integrate machine learning into their enterprises when there is a clear connection to driving business results. Many CIO compensation plans now include business growth and revenue goals, making the revenue potential of new technologies a high priority.
- 89% of CIOs are either planning to use or using machine learning in their organizations today. The majority, 40%, are in the research and planning phases of deployment, with an additional 26% piloting machine learning. 20% are using machine learning in some areas of their business, and 3% have successfully deployed enterprise-wide. The following graphic shows the percentage of respondents by stage of their machine learning journey.
- Machine learning is a key supporting technology leading the majority Finance, Sales & Marketing, and Operations Management decisions today. Human intervention is still required across the spectrum of decision-making areas including Security Operations, Customer Management, Call Center Management, Operations Management, Finance and Sales & Marketing. The study predicts that by 2020, machine learning apps will have automated 70% of Security Operations queries and 30% of Customer Management ones.
- Automation of repetitive tasks (68%), making complex decisions (54%) and recognizing data patterns (40%) are the top three most important capabilities CIOs of machine learning CIOs are most interested in. Establishing links between events and supervised learning (both 32%), making predictions (31%) and assisting in making basic decisions (18%) are additional capabilities CIOs are looking for machine learning to accelerate. In financial services, machine learning apps are reviewing loan documents, sorting applications to broad parameters, and approving loans faster than had been possible before.
- Machine learning adoption and confidence by CIOs varies by region, with North America in the lead (72%) followed by Asia-Pacific (61%). Just over half of European CIOs (58%) expect value from machine learning and decision automation to their company’s overall strategy. North American CIOs are more likely than others to expect value from machine learning and decision automation across a range of business areas, including overall strategy (72%, vs. 61% in Asia Pacific and 58% in Europe). North American CIOs also expect greater results from sales and marketing (63%, vs. 47% Asia-Pacific and 38% in Europe); procurement (50%, vs. 34% in Asia-Pacific and 34% in Europe); and product development (48%, vs. 29% in Asia-Pacific and 29% in Europe).
- CIOs challenging the status quo of their organization’s analytics direction are more likely to rely on roadmaps for defining and selling their vision of machine learning’s revenue contributions. More than 70% of early adopter CIOs have developed a roadmap for future business process changes compared with just 33% of average CIOs. Of the CIOs and senior management teams in financial services, the majority are looking at how machine learning can increase customer satisfaction, lifetime customer value, improving revenue growth. 53% of CIOs from our survey say machine learning is one of their core priorities as their role expands from traditional IT operations to business-wide strategy.
Sources: CIOs Cutting Through the Hype and Delivering Real Value from Machine Learning, Survey Shows
- There are 29,187 Software Engineering jobs available today, making this job the most popular regarding Glassdoor postings according to the study.
These and many other fascinating insights are from Glassdoor’s 50 Best Jobs In America For 2018. The Glassdoor Report is viewable online here. Glassdoor’s annual report highlights the 50 best jobs based on each job’s overall Glassdoor Job Score.The Glassdoor Job Score is determined by weighing three key factors equally: earning potential based on median annual base salary, job satisfaction rating, and the number of job openings. Glassdoor’s 2018 report lists jobs that excel across all three dimensions of their Job Score metric. For an excellent overview of the study by Karsten Strauss of Forbes, please see his post, The Best Jobs To Apply For In 2018.
LinkedIn’s 2017 U.S. Emerging Jobs Report found that there are 9.8 times more Machine Learning Engineers working today than five years ago with 1,829 open positions listed on their site as of last month. Data science and machine learning are generating more jobs than candidates right now, making these two areas the fastest growing tech employment areas today.
Key takeaways from the study include the following:
- Six analytics and data science jobs are included in Glassdoor’s 50 best jobs In America for 2018. These include Data Scientist, Analytics Manager, Database Administrator, Data Engineer, Data Analyst and Business Intelligence Developer. The complete list of the top 50 jobs is provided below with the analytics and data science jobs highlighted along with software engineering, which has a record 29,817 open jobs today:
- Median base salary of the 50 best jobs in America is $91,000 with the average salary of the six analytics and data science jobs being $94,167.
- Tech jobs make up 20 of Glassdoor’s 50 Best Jobs in America for 2018, up from 14 jobs in 2017.
Source: Glassdoor Reveals the 50 Best Jobs in America for 2018
- By 2021, 40% of IT staff will be versatilists, holding multiple roles, most of which will be business, rather than technology-related.
These and many other insights are being presented earlier this month at the Gartner Symposium/ITxpo 2017 being held in Orlando, Florida. Gartner’s predictions and the series of assumptions supporting them illustrate how CIOs must seek out and excel in the role of business strategist first, technologist second. In 2018 and beyond CIOs will be more accountable than ever for revenue generation, value creation, and the development and launch of new business models using proven and emerging technologies. Gartner’s ten predictions point to the future of CIOs as collaborators in new business creation, selectively using technologies to accomplish that goal.
The following are Gartner’s ten predictions for IT organizations for 2018 and beyond:
- By 2021, early adopter brands that redesign their websites to support visual- and voice-search will increase digital commerce revenue by 30%. Gartner has found that voice-based search queries are the fastest growing mobile search type. Voice and visual search are accelerating mobile browser- and mobile app-based transactions and will continue to in 2018 and beyond. Mobile browser and app-based transactions are as much as 50% of all transactions on many e-commerce sites today. Apple, Facebook, Google and Microsoft’s investments in AI and machine learning will be evident in how quickly their visual- and voice-search technologies accelerate in the next two years.
- By 2020, five of the top seven digital giants will willfully “self-disrupt” to create their next leadership opportunity. The top digital giants include Alibaba, Amazon, Apple, Baidu, Facebook, Google, Microsoft, and Tencent. Examples of self-disruption include AWS Lambda versus traditional cloud virtual machines, Alexa versus screen-based e-commerce, and Apple Face ID versus Touch ID.
- By the end of 2020, the banking industry will derive $1B in business value from the use of blockchain-based cryptocurrencies. Gartner estimates that the current combined value of cryptocurrencies in circulation worldwide is $155B (as of October 2017), and this value has been increasing as tokens continue to proliferate and market interest grows. Cryptocurrencies will represent more than half of worldwide blockchain global business value-add through year-end 2023 according to the Gartner predictions study.
- By 2022, most people in mature economies will consume more false information than true information. Gartner warns that while AI is proving to be very effective in creating new information, it is just as effective at distorting data to create false information as well. Gartner predicts that before 2020, untrue information will fuel a major financial fraud made possible through high-quality falsehoods moving the financial markets worldwide. By the same year, no significant internet company will fully succeed in its attempts to mitigate this problem. Within three years a significant country will pass regulations or laws seeking to curb the spread of AI-generated false information.
- By 2020, AI-driven creation of “counterfeit reality,” or fake content, will outpace AI’s ability to detect it, fomenting digital distrust. AI and machine learning systems today can categorize the content of images faster and more consistently accurate than humans. Gartner cautions that by 2018, a counterfeit video used in a satirical context will begin a public debate once accepted as real by one or both sides of the political spectrum. In the next year, there will be a 10-fold increase in commercial projects to detect fake news according to the predictions study.
- By 2021, more than 50% of enterprises will be spending more per annum on bots and chatbot creations than traditional mobile app developments. Gartner is predicting that by 2020, 55% of all large enterprises will have deployed (used in production) at least one bot or chatbot. Rapid advances in natural-language processing (NLP) make today’s chatbots much better at recognizing the user intent than previous generations. According to Gartner’s predictions study, NLP is used to determine the entry point for the decision tree in a chatbot, but a majority of chatbots still use scripted responses in a decision tree.
- By 2021, 40% of IT staff will be versatilists, holding multiple roles, most of which will be business, rather than technology-related. By 2019, IT technical specialist hires will fall by more than 5%. Gartner predicts that 50% of enterprises will formalize IT versatilist profiles and job descriptions. 20% of IT organizations will hire versatilists to scale digital business. IT technical specialist employees will fall to 75% of 2017 levels.
- In 2020, AI will become a positive net job motivator, creating 2.3M jobs while eliminating only 1.8M jobs. By 2020, AI-related job creation will cross into positive territory, reaching 2 million net-new jobs in 2025. Global IT services firms will have massive job churn in 2018, adding 100,000 jobs and dropping 80,000. By 2021 Gartner predicts, AI augmentation will generate $2.9T in business value and recover 6.2B hours of worker productivity.
- By 2020, IoT technology will be in 95% of electronics for new product designs. Gartner predicts IoT-enabled products with smartphone activation emerging at the beginning of 2019.
- Through 2022, half of all security budgets for IoT will go to fault remediation, recalls and safety failures rather than protection. Gartner predicts IoT spending will increase sharply after 2020 following better methods of applying security patterns cross-industry in IoT security architectures, growing at more than 50% compound annual growth rate (CAGR) over current rates.The total IoT security market for products will reach $840.5M by 2020, and a 24% CAGR for IoT security from 2013 through 2020. Combining IoT security services, safety systems, and physical security will lead to a fast-growing global market. Gartner predicts exponential growth in this area, exceeding more than $5B in global spending by year-end 2020.
Gartner has also made an infographic available of the top 10 Strategic Technology Trends for 2018, in addition to an insightful article on Smarter with Gartner. You can find the article here, at Gartner Top 10 Strategic Technology Trends for 2018.
Gartner Reveals Top Predictions for IT Organizations and Users in 2018 and Beyond
Smarter With Gartner, Gartner Top 10 Strategic Technology Trends for 2018
Top Strategic Predictions for 2018 and Beyond: Pace Yourself, for Sanity’s Sake (client access reqd)