Skip to content

Posts from the ‘generative AI’ Category

BCG Shares Their Insights On What Sets GenAI’s Top Performers Apart

BCG Shares Their Insights On What Sets GenAI's Top Performers Apart

image created in DALL-E

The top 10% of enterprises have one or more GenAI applications in production at scale across their organizations. 44% of these top-performing organizations are realizing significant value from scaled predictive AI cases. 70% of top performers explicitly tailor their GenAI projects to create measurable value.

Boston Consulting Group (BCG) estimates that an organization with $20 billion in revenue can achieve gains of $500 million to $1 billion in profit using GenAI, with nearly a third of those gains coming in the first 18 months. Their recent analysis of what sets GenAI’s top performers apart, What GenAI’s Top Performers Do Differently, looks at the factors that most differentiate enterprises excelling with GenAI today.

What further differentiates these top performers from others is how they’re looking to use GenAI to redefine the functional areas of their organizations. They’re far more likely to have a solid foundation in predictive AI and four times more likely to increase their investment in AI and digital-first strategies and technologies.

Half of the enterprise leaders BCG interviewed say their organizations are testing GenAI in pilot projects today but have not achieved full-scale implementation. The remaining 40% haven’t taken any action on GenAI yet.

BCG Shares Their Insights On What Sets GenAI's Top Performers Apart

Source: Boston Consulting Group, What GenAI’s Top Performers Do Differently.

What Sets The Top 10% Apart

Two-thirds of GenAI’s top-performing enterprises aren’t digital natives like Amazon or Google but instead leaders in biopharma, energy, and insurance. BCG found that a U.S.-based energy company launched a GenAI-driven conversational platform to assist frontline technicians, increasing productivity by 7%. A biopharma company is reimagining its R&D function with GenAI and reducing drug discovery timelines by 25%.

Top GenAI performers have their greatest lead over peers across five main capabilities. These capabilities include having a clear link to business performance, modern technology infrastructure, strong data capabilities, leadership support, and a grounding in responsible AI. The steep curves shown in the graphic below suggest how these five most differentiated capabilities are essential for successful GenAI adoption at scale.

BCG Shares Their Insights On What Sets GenAI's Top Performers Apart

Source: Boston Consulting Group, What GenAI’s Top Performers Do Differently.

Key takeaways from BCG’s analysis of GenAI top performers 

Top performers excel at creating strong links between GenAI initiatives and business value. Seven in ten enterprises who are high achievers know how to build a business case for their GenAI projects and pilots. They’re focused on measuring results and quantifying value. BCG found that in a typical GenAI portfolio, 60% of the initiatives are focused on reducing costs and 40% on increasing revenue.

An all-in mindset when it comes to maintaining and growing a modern technology infrastructure. GenAI top-performing enterprises are three times more likely to already have a modular, modern IT tech stack and supporting infrastructure in place. They’re focused on being prepared to develop new, GenAI-powered services on their current and future AI models while supporting DevOps. BCG says top performers are 1.5 times more likely to focus on building the GenAI stack internally over the coming three years, underscoring their desire to make the technology a core capability for the organizations.

Are pursuing and advanced data strategy that includes unstructured data. GenAI top performers are two times more likely to have data pipelines and data management practices in place to streamline data sourcing and storage. They’re also more likely to have unstructured data expertise. BCG observes that an advanced data strategy “is a critical element of GenAI, given that models are only as strong as the data on which they’re trained.”  Organizations have found success with less mature skills in these areas, although it may take longer as they need to address infrastructure and data strategy gaps or shortcomings.

Strong leadership support for innovation, including the willingness to champion GenAI. Senior executives’ support and prioritizing an innovative culture are the most differentiating factors in defining GenAI’s high performers. Gen AI high performers who are scaling use cases are three times more likely than no-action companies to have leaders who prioritize innovation and actively support GenAI. BCG notes that these leaders often have a deep understanding of the technology’s potential impact on their industry, and they are publicly committed to ensuring that the organization capitalizes on it in new ways that generate value. “Visible support and commitment from our leadership team has been crucial, as it provided the freedom to experiment and deal with failures along the way,” said the head of data and analytics at a global media company referenced in BCG’s report.

Have responsible AI guidelines, guardrails and processes in place. Top-performing enterprises are more likely to have responsible AI frameworks, guidelines, and guardrails in place. BCG observes that a common trait top-performing enterprises have is ensuring their AI systems and workflows put humans in the loop and use only factual data. “Our research shows that leading companies are far more likely to have developed guardrails, guidelines, and policies to ensure that they follow the principles of responsible AI. In the findings, the share of scaling companies that are cautious about the potential misuse of GenAI and taking proactive measures to address these risks is 20 percentage points higher than the share of companies taking no action in this area,” write BCG’s researchers.

IT And Marketing Show Strongest Interest In Adopting Gen AI First

IT, Marketing Show Strongest Interest In Adopting Gen AI First

  • Currently, 16% of organizations have implemented generative AI in production, while 44% are piloting it for potential applications.
  • Interest in deploying generative AI for production applications saw a fivefold increase from the first to the fourth quarter of 2023.
  • Healthcare, manufacturing, and education are the three industries most actively pursuing generative AI adoption.
  • A majority of organizations, 63%, deem CRM data critical to their generative AI initiatives.

These and many other insights are from Dresner Advisory Services‘ recent Generative AI Report. The advisory firm surveyed its research community of over 8,000 organizations and vendors’ customer communities. The study is global in scope, with 50% of respondents from North America, 26% from EMEA, 19% from Asia/Pacific and 6% from Latin America. Dresner’s report stands out for its in-depth and nuanced analysis of gen AI adoption across global organizations.

News about generative AI has captivated technology leaders. Demand for gen AI-related news and insights dominates many organization leaders’ time. 29% are following gen AI news updates constantly, and 30% say they often check in and see what’s new in gen AI, 24% regularly check the news. Overall, 72% of analytics and business intelligence (BI) professionals have made gen AI news a priority. North American respondents are the most diligent with constantly checking gen AI news, reflecting the region having the highest production use of gen AI.

Key takeaways from the report include the following:

Professionals in IT and marketing report plans to be the first adopters of generative AI, with 44% of IT and 36% of marketing professionals saying adopting gen AI is a primary focus. Operations/ production, sales, and C-level executives also show significant interest in adopting gen AI early. Dresner’s report states that “finance and human resources least often indicate overall interest, exceeding a majority only when aggregating their primary, secondary, and tertiary responses.”

gen ai

63% of organizations consider CRM data as critical or very important to generative AI. Finance and accounting data is considered the next most important, followed by call center and supply chain data. Dresner’s analysis found that respondents least often expect generative AI to leverage workforce (HR) data. Organizations are wary of using HR data due to privacy concerns combined with the stringent standards and safeguards on data security and its use across regulated industries today.

gen ai

Gen AI adoption across organizations accelerated rapidly in 2023. From 1Q23 to 4Q23, production use increased nearly fivefold, experimenting increased by 70%, and planned use in 12 months increased by 157%. Dresner’s research results reflect a major shift in generative AI prioritization last year. The report’s authors contend that implementation activity and funding were primarily from autonomous, decentralized sources, not from C-level mandates or sponsors, as it occurred late in fiscal years and into annual budget cycles.

gen ai

Consumer services lead gen AI production levels at 43%. Technology, business services, and healthcare have the next three highest levels of gen AI production in use today. The education industry reports the highest experimentation rate at 67%, closely followed by healthcare at 62%, while government trails at 50%. The report notes that the government also reports the highest levels for planned use beyond 12 months and no planned use.

gen ai

40% of organizations consider it critical to achieve productivity and efficiency gains from gen AI. One in three (30%) say improving customer experience and personalization is the next most critical priority, followed by improved search quality and decision-making (26%).

gen ai

Data privacy concerns are considered critical to 46% of organizations pursuing gen AI initiatives today. Legal and regulatory compliance, the potential for unintended consequences, and ethics and bias concerns are also significant. Less than half of respondents—46% and 43%, respectively—consider costs and organizational policy important to generative AI adoption.

gen ai

 

Top 10 Insights From Forrester’s State of Generative AI in 2024 Report

Top 10 Insights From Forrester's State of Generative AI in 2024 Report

Created with DALL-E

Over 90% of enterprise AI decision-makers have concrete plans to adopt generative AI (gen AI) for internal and customer-facing use cases. Nearly half, 47%, say productivity gains are the primary goal. Those anticipated gains are closely followed by greater innovation (44%) and cost efficiency (41%). One in three, or 34%, expect AI to deliver greater revenue growth.

Productivity gains are happening faster than enterprises can track because Shadow AI is growing quicker than many IT and security teams anticipated. OpenAI says their enterprise adoption is soaring, with over 80% of Fortune 500 companies’ workers and departments having accounts.

Enterprise workers are achieving a 40% performance boost thanks to ChatGPT based on a recent Harvard study. A second study from MIT discovered that ChatGPT reduced skill inequalities and accelerated document creation times while enabling enterprise workers to be more efficient with their time. Seventy percent haven’t told their bosses about it.

Forrester: A Wave Of Disruption Is Coming

Forrester’s recent report, The State of Generative AI, 2024, warns enterprises not to discount the impact of generative AI on their operations and to start planning for greater experimentation, governance, and security now.

Get ready for the challenges of defining and managing bring your own AI (BYOAI) as workers are inventing and adopting gen AI tools and apps faster than IT or security can keep up. Forrester advises that enterprises need to have forward-thinking governance and security guardrails in place before launching their AI-based apps.

With nearly every enterprise app and platform integrating gen AI into its feature set, it’s up to IT, security, and senior management to have an AI plan that can adapt and flex fast to the fast-growing feature set gen AI is delivering.

Enterprise AI leaders also need to define where they stand on the controversial and complex state of model training data. Forrester says that questions regarding the quality of training data using copyright material, model and data bias, and frequent “hallucinations” by models.

“In 2024, as organizations embrace the generative AI (genAI) imperative, governance and accountability will be a critical component to ensure that AI usage is ethical and does not violate regulatory requirements,” writes Forrester in their cybersecurity predictions late last year. “This will enable organizations to safely transition from experimentation to implementation of new AI-based technologies,” the report continues.

Top 10 Insights From Forrester’s State of Generative AI

The ten most valuable insights from Forrester’s State of Generative AI report provide a comprehensive overview of the current and future landscape of generative AI. Noteworthy for its balance between opportunities and risks, the report explains the hurdles in front of enterprises looking to gain value from gen AI now and in the future.

Here are the top 10 insights from the report:

Gen AI shows strong potential to improve and scale enterprise operations. Forrester is optimistic regarding the potential of gen AI to increase productivity and deliver measurable business value. “Forrester expects that gen AI will add convenience to and remove friction from a variety of experiences, reshape jobs in ways we are only beginning to contemplate and disrupt organizations and industries,” writes Forrester’s research team in the report. The report explains that there are three broad tiers of generative AI suppliers, further supporting the market’s expansion and growth.

Top 10 Insights From Forrester's State of Generative AI in 2024 Report

Source: Forrester, The State of Generative AI, 2024 report. January 26, 2024

 

Large Language Models will continue to dominate the gen AI narrative. Large language models (LLMs), including Anthropic, Google, Meta, and OpenAI’s GPT series, will continue to dominate the gen AI landscape. Forrester notes that significant data and infrastructure requirements make the task of creating and maintaining an LLM difficult for companies considering competing in the market. Open-source LLMs are redefining the market, a point Forrester touches on briefly.

Gen AI is becoming part of planning cycles in enterprises: Forrester found that over 90% of global enterprise AI decision-makers have definite plans to implement generative AI. Internal use cases are dominating the planning cycles of enterprise AI leaders today.

Top 10 Insights From Forrester's State of Generative AI in 2024 Report

Source: Forrester, The State of Generative AI, 2024 report. January 26, 2024

Overcoming technical skills shortages and integration challenges stand in the way of achieving benefits. A third of enterprise AI leaders say that lack of technical skills in their organizations is the single greatest roadblock to their gaining the benefits they’re looking for from gen AI. Twenty-eight percent say they’re having difficulty integrating gen AI into their existing tech stacks and infrastructure. The potential to gain significant benefits from gen AI motivates enterprise AI leaders to look for new ways to overcome technical skills shortages and find new ways to integrate gen AI into their infrastructure.

Top 10 Insights From Forrester's State of Generative AI in 2024 Report

Source: Forrester, The State of Generative AI, 2024 report. January 26, 2024

Ethical and safe gen AI use will require new cybersecurity and governance approaches. Enterprises need to decide how they approach the most challenging and controversial aspects of LLMs, gen AI, and the future of AI at scale in their companies now rather than later. The core message of Forrester’s report is for enterprises not to procrastinate but to start making plans now for their stance on the issues of model bias, data security, regulatory compliance, and ethics of model training.

Weaponized LLMs are a fact of life for every enterprise looking to adopt these technologies today. There’s also the growing threat of intellectual property and confidential data being accidentally shared with LLMs via ChatGPT and comparable chatbots. The intensity cybersecurity providers are putting behind this problem makes it one of the fastest evolving areas in the industry today.

While not mentioned by Forrester in their report, these vendors are defining the state of the art when it comes to protecting confidential data being entered into LLMs. Cisco, Ericom Security by Cradlepoint’s Generative AI isolation, Menlo Security, Nightfall AIWiz, and Zscaler have all developed and launched solutions to reduce the threat of confidential data making it into LLMs via chatbots.

The use of a virtual browser that is separate from an organization’s network environment in the Ericom Cloud distinguishes Ericom’s Generative AI Isolation. Data loss protection, sharing, and access policy controls are applied in the cloud to prevent confidential data, PII, or other sensitive information from being submitted to the LLM and potentially exposed.

“Generative AI websites provide unparalleled productivity enhancements, but organizations must be proactive in addressing the associated risks,” said Gerry Grealish, Vice President of Marketing Ericom Cybersecurity Unit of Cradlepoint. “Our Generative AI Isolation solution empowers businesses to attain the perfect balance, harnessing the potential of generative AI while safeguarding against data loss, malware threats, and legal and compliance challenges.”

Early adopters are implementing gen AI in a wide variety of use cases, ranging from operations to customer engagement and product development. Forrester notes that they’re seeing organizations use knowledge management bots to accelerate workflows, automate tasks, generate new ideas, and drive innovation across a broad base of use cases. Early adopters are also piloting gen AI for diverse use cases across operations, customer engagement, and product development. Forester emphasizes that for external use cases, they’re seeing enterprises adopt a main-in-the-middle workflow to strengthen model training with human intelligence – and avert potential errors in model response.

Top 10 Insights From Forrester's State of Generative AI in 2024 Report

Source: Forrester, The State of Generative AI, 2024 report. January 26, 2024

Internal use cases precede external use cases as enterprises look to gain expertise in controlled environments. Companies will initially focus on internal use cases for generative AI to refine their models before slowly expanding to customer-facing applications, employing heavy human-in-the-loop management. Forrester is seeing gen AI being used internally to drive employee productivity and workflow optimization gains first. The top three use cases of employee productivity, knowledge management, and software development are all focused on internal improvements.

Legal and intellectual property uncertainty will continue to surround gen AI. Forrester implies there’s going to be an increasingly complex, controversial legal landscape regarding the data models are trained on, especially when it comes to copyrighted content.

Privacy and regulatory concerns are going to continue influencing adoption. Forrester is seeing enterprises in heavily regulated industries exercising extreme caution to protect company and customer data, with some even banning tools like ChatGPT over concerns about data protection and regulatory backlash.

Enterprises need to get a sense of urgency about preparing for gen AI governance and experimentation. Having a clear vision of how they’re going to adopt gen AI is essential if enterprises are going to succeed in governing these new technologies at scale. The combination of growing and recruiting in-house skills, having a solid plan for BYOAI, and defining guardrails for internal use cases are all needed to avoid being blindsided by risks.