Skip to content

Posts tagged ‘Big Data’

Using Search Analytics To See Into Gartner’s $232B Big Data Forecast

By combining search analytics and the latest Gartner forecast on big data published last week, it’s possible to get a glimpse into this areas’ highest growth industry sectors.  Big data is consistently a leading search term on Gartner.com, which is the basis of the twelve months of data used for the analysis.

In addition, data from Gartner’s latest report, Big Data Drives Rapid Changes in Infrastructure and $232 Billion in IT Spending Through 2016 by Mark A. Beyer, John-David Lovelock, Dan Sommer, and Merv Adrian is also used.  These authors have done a great job of explaining how big data is rapidly emerging as a market force, not just a single market unto itself.  This distinction pervades their analysis and the following table showing Total IT Spending Driven by Big Data reflects the composite market approach.  Use cases from enterprise software spending, storage management, IT services, social media and search forecasts are the basis of the Enterprise Software Spending for Specified Sub-Markets Forecast.  Social Media Analytics are the basis of the Social Media Revenue Worldwide forecast.

Additional Take-Aways

  • Enterprise software spending for specified sub-markets will attain a 16.65% compound annual growth rate (CAGR) in revenue from 2011 to 2016.
  • Attaining a 96.77% CAGR from 2011 through 2016, Social Media Revenue Is one of the primary use case catalysts of this latest forecast.
  • Big Data IT Services Spending will attain a 10.20% CAGR from 2011 to 2016.
  • $29B will be spent on big data throughout 2012 by IT departments.  Of this figure, $5.5B will be for software sales and the balance for IT services.
  • Gartner is projecting a 45% per year average growth rate for social media, social network analysis and content analysis from 2011 to 2016.
  • Gartner projects a 20 times ratio of IT Services to Software in the short term, dropping as this market matures and more expertise is available.
  • By 2020, big data functionality will be part of the baseline of enterprise software, with enterprise vendors enhancing the value of their applications with it.
  • Organizations are already replacing early implementations of big data solutions – and Gartner is projecting this will continue through 2020.
  • By 2016 spending on Application Infrastructure and Middleware becomes one of the most dominant for big data in Enterprise Software-Specified Sub Markets.

  • $232B is projected to be sold in total across all categories in the forecast from 2011 to 2016. From $24.4B in 2011 to $43.7B in 2016, this presents a 12.42% CAGR in total market growth.

Search Analytics and Big Data

Big data is continually one of the top terms search on Gartner.com, and over the last twelve months, this trend has accelerated.  The following time series graph shows the weekly number of inquiries Gartner clients have made, with the red line being the logarithmic trend.

Banking (25%), Services (15%) and Manufacturing (15%) are the three most active industries in making inquiries about big data to Gartner over the last twelve months.  The majority of these are large organizations (63%) located in North America (59%) and Europe (19%).

What unifies all of these industries from a big data standpoint is how critical the stability of their customer relationships are to their business models.  Banks have become famous for bad service and according to the American Customer Satisfaction Index (ACSI) have shown anemic growth in customer satisfaction in the latest period measured, 2010 to 2011.  The potential for using big data to becoming more attuned to customer expectations and deliver more effective customer experiences in this and all services industries shows great upside.

Bottom line: Companies struggling with flat or dropping rankings on the ACSI need to consider big data strategies based on structured and unstructured customer data.  In adopting this strategy the potential exists to drastically improve customer satisfaction, loyalty, and ultimately profits.

Roundup of Big Data Forecasts and Market Estimates, 2012

From the best-known companies in enterprise software to start-ups, everyone is jumping on the big data bandwagon.

The potential of big data to bring insights and intelligence into enterprises is a strong motivator, where managers are constantly looking for the competitive edge to win in their chosen  markets.  With so much potential to provide enterprises with enhanced analytics, insights and intelligence, it is understandable why this area has such high expectations – and hype – associated with it.

Given the potential big data has to reorder an enterprise and make it more competitive and profitable, it’s understandable why there are so many forecasts and market analyses being done today.  The following is a roundup of the latest big data forecasts and market estimates recently published:

  • As of last month, Gartner had received 12,000 searches over the last twelve months for the term “big data” with the pace increasing.
  • In Hype Cycle for Big Data, 2012, Gartner states that Column-Store DBMS, Cloud Computing, In-Memory Database Management Systems will be the three most transformational technologies in the next five years.  Gartner goes on to predict that Complex Event Processing, Content Analytics, Context-Enriched Services, Hybrid Cloud Computing, Information Capabilities Framework and Telematics round out the technologies the research firm considers transformational.  The Hype Cycle for Big Data is shown below:

  • Predictive modeling is gaining momentum with property and casualty (P&C) companies who are using them to support claims analysis, CRM, risk management, pricing and actuarial workflows, quoting, and underwriting. Web-based quoting systems and pricing optimization strategies are benefiting from investments in predictive modeling as well.   The Priority Matrix for Big Data, 2012 is shown below:

  • Social content is the fastest growing category of new content in the enterprise and will eventually attain 20% market penetration.   Gartner defines social content as unstructured data created, edited and published on corporate blogs, communication and collaboration platforms, in addition to external platforms including Facebook, LinkedIn, Twitter, YouTube and a myriad of others.
  • Gartner reports that 45% as sales management teams identify sales analytics as a priority to help them understand sales performance, market conditions and opportunities.
  • Over 80% of Web Analytics solutions are delivered via Software-as-a-Service (SaaS).  Gartner goes on to estimate that over 90% of the total available market for Web Analytics are already using some form of tools and that Google reported 10 million registrations for Google Analytics alone.  Google also reports 200,000 active users of their free Analytics application.  Gartner also states that the majority of the customers for these systems use two or more Web analytics applications, and less than 50% use the advanced functions including data warehousing, advanced reporting and higher-end customer segmentation features.
  • In the report Market Trends: Big Data Opportunities in Vertical Industries, the following heat map by industry shows that from a volume of data perspective, Banking and Securities, Communications, Media and Services, Government, and Manufacturing and Natural Resources have the greatest potential opportunity for Big Data.

  • Big data: The next frontier for innovation, competition, and productivity is available for download from the McKinsey Global Institute for free.  This is 156 page document authored by McKinsey researchers is excellent.  While it was published last year (June, 2011), if you’re following big data, download a copy as much of the research is still relevant.  McKinsey includes extensive analysis of how big data can deliver value in a manufacturing value chains for example, which is shown below:

Gartner Search Analytics Shows Spike in Hadoop Inquiries in 2012 – Good News For CRM

Hadoop was one of the most-searched terms on Gartner’s website in 2011 through 2012, spiking to 601.8% over the last twelve months alone.  Additional insights from the Search Analytics on Hadoop include the following:

  • 27% of all inquiries are from banking, finance and insurance industries, followed by manufacturing (14%), government (13%), services (10%) and healthcare (8%).
  • North America (75.9%) and EMEA (13.5%) are the two most dominant geographies in terms of query volume.
  • Here is the trend line from Gartner Search Analytics:

What’s driving Hadoop’s meteoric rise in searches is a combination of industry hype about big data, CIOs getting serious about using Hadoop distributions that minimize time and risk yet deliver value, and the dominant role Amazon is playing in bringing Hadoop into the cloud.  Today Amazon offers Elastic MapReduce as a Web Service that relies on a hosted Hadoop framework running the Elastic Compute Cloud (EC2) in conjunction with Amazon Simple Storage Service (S2).

Microsoft also scored a major hiring win this week announcing that Raghu Ramakrishnan, former chief scientist for three divisions of Yahoo is now with Microsoft. Raghu is now a technical fellow working in the Server and Tools Business (STB).  He’ll focus on big data and integration to STB platforms.  Big Data on Azure will accelerate now with him on-board.

Hadoop’s Potentially Galvanizing Effect on CRM and Social CRM Analytics

The quickening pace of Hadoop adoption in the enterprise is good news for CRM and especially social CRM. Analytics and Business Intelligence (BI) are the “glue” that unify CRM and keep it in context. One of Hadoop’s greatest potential contributions is the analysis, categorization and use of unstructured content.  Marketing and sales won’t have to run three or four systems to gain insights into customer data, they can run a single analytics platform that fuels the entire selling cycle and lifetime customer value chain of their businesses.  Hadoop has the potential to make unstructured content more meaningful while also reporting the impact of customer insights on financial performance, profitability and lifetime customer value.

Translating terabytes of customer, sales, services and partner data into meaningful analytics and business intelligence (BI) is emerging as a priority for CIOs, who are sharing responsibility for driving top-line revenue growth.   Hadoop shows potential to be the “glue” or galvanizing technology base that unifies all CRM and Social CRM strategies.

To get a perspective on how fast Hadoop is being evaluated and adopted it’s useful to look at the Hype Cycle for Data Management, the latest edition published July, 2011.   This is another indicator of how quickly Hadoop and big data are gaining in terms of CIO mindshare.  Big Data and extreme information management are on the technology Trigger area of the hype cycle.  The Hype Cycle for Data Management is shown below:

Bottom line:  CRM and Social CRM will benefit more than any other area of an enterprise as Hadoop’s adoption continues to accelerate.  CIOs are increasingly called upon to be strategists, and with the ability to translate terabytes of data into strategies that deliver dollars, look for Hadoop’s contributions to drive top-line revenue growth.

How Cloud Computing And ERP Mobility Are Reordering Gartner’s Hype Cycle for ERP

A good friend of mine recently became CIO of a financial services firm and was given his first major project last month: make the complete accounting, financial, and loan provider data and applications available 24/7 on any iPad or Android-based tablet from any office, at any time.

The majority of loan provider applications are cloud-based and his company is running NetSuite.  His corporate office is in Asia and cloud-based applications made it possible for the company to launch and operate in California within months.   He’s been given six months to transform this mobile vision into reality.

Another CIO of a major A&D manufacturer I recently visited wants vendors to challenge him more to get greater value from his investments in legacy data and ERP systems. Using ERP to run batch reports alone has nearly caused project schedules to slip, so the focus internally is on real-time system integration of project management and accounting systems.  He’s also been given the task of revamping accounting and financial systems by October, 2012, and they just started late last year.

Gartner’s Hype Cycle for ERP 

Considering these two extremes in the context of the Gartner Hype Cycle for ERP (shown below) and the recent report SaaS and Cloud ERP Trends, Observations, and Performance 2011  (free for download until January 9, 2012) published by Aberdeen last month several take-aways emerge.

  • CIOs are under increasing pressure in 2012 to enhance, modify even replace existing ERP systems while standardizing technology across the enterprise at the same time.  The most risk-averse way around this is to add applications to single instance ERP backbone systems, with analytics and Business Intelligence (BI) being the among the most in demand.
  • Cloud-based ERP in the Enterprise and Small & Medium Businesses (SMB) are accelerating along the Hype Cycle faster than Gartner indicates.  Enterprises are using Cloud-based ERP systems as part of their two-tier ERP system strategies due to the Total Cost of Ownership (TCO) and time-to-deploy advantages, and the flexibility of tailoring everything from user interfaces to workflows to their specific requirements.  Highly specialized Cloud-based ERP suites including those from Plex Systems are gaining traction due to their expertise in specific industries and the compliance-related challenges inherent within them. In SMBs, the cost and time-to-deploy are two major drivers with concerns over security being the biggest impediment to growth.  Gartner reports that they are seeing Cloud-based ERP adoption fastest in companies with fewer than 200 users overall.
  • Cloud-based ERP systems most often considered in industries that have high variable costs, rapid transaction cycles and tend towards higher Return on Invested Capital (ROIC).  Based on the research SaaS and Cloud ERP Trends, Observations, and Performance 2011 the industries who are the most willing to consider Cloud-based ERP versus on-premise are Financial Services (22% SaaS versus 44% on-premise); Healthcare (42% SaaS versus 58% on-premise); and Professional Services (56% SaaS versus 58% on-premise).
  • Large companies (over $500M in annual revenue) using Cloud-based ERP systems are opting for hosted deployments managed by their ERP vendor (10%) or an independent 3rd party (11%), with just 2% relying on a SaaS platform. Aberdeen defined small organizations as those with annual sales under $50M, midsize organizations having annual sales of $50M – $500M. The following is from SaaS and Cloud ERP Trends, Observations, and Performance 2011:
  • ERP mobility will be a dominant force from the shop floor to each sales call where quotes, orders and contracts deliver real-time order and pricing updates.  How a given manufacturer chooses to sell is even more important than what they sell in many industries. Equipping manufacturing, quality assurance, production scheduling, procurement and sales to have immediate data on what’s going on with orders, customers and suppliers is critical.  For the sales and service teams, real-time data is the fuel they run on.  There’s a chronic time shortage in many, many companies right now, and bringing greater ERP mobility from the shop floor to the sales call will increasingly be seen as a means to lessen the time crunch.  2012 is the year where mobility gets real across the enterprise with solid performance numbers being generated as a result.  For companies with large sales forces and service organizations, integrating to key ERP systems to gain real-time data will quickly lead to increased sales and higher gross margins on service and warranty repairs.
  • Gartner predicts that by 2015 enterprises who are successfully using extreme information management strategies (Big Data) will outperform competitors in their industry sectors by 20% in every available financial metric.  The following is the Priority Matrix for ERP, 2011 showing what Gartner believes to be transformational technologies and strategies in ERP.

Follow

Get every new post delivered to your Inbox.

Join 226 other followers

%d bloggers like this: