Top 10 Insights From Forrester’s State of Generative AI in 2024 Report

Created with DALL-E

Over 90% of enterprise AI decision-makers have concrete plans to adopt generative AI (gen AI) for internal and customer-facing use cases. Nearly half, 47%, say productivity gains are the primary goal. Those anticipated gains are closely followed by greater innovation (44%) and cost efficiency (41%). One in three, or 34%, expect AI to deliver greater revenue growth.

Productivity gains are happening faster than enterprises can track because Shadow AI is growing quicker than many IT and security teams anticipated. OpenAI says their enterprise adoption is soaring, with over 80% of Fortune 500 companies’ workers and departments having accounts.

Enterprise workers are achieving a 40% performance boost thanks to ChatGPT based on a recent Harvard study. A second study from MIT discovered that ChatGPT reduced skill inequalities and accelerated document creation times while enabling enterprise workers to be more efficient with their time. Seventy percent haven’t told their bosses about it.

Forrester: A Wave Of Disruption Is Coming

Forrester’s recent report, The State of Generative AI, 2024, warns enterprises not to discount the impact of generative AI on their operations and to start planning for greater experimentation, governance, and security now.

Get ready for the challenges of defining and managing bring your own AI (BYOAI) as workers are inventing and adopting gen AI tools and apps faster than IT or security can keep up. Forrester advises that enterprises need to have forward-thinking governance and security guardrails in place before launching their AI-based apps.

With nearly every enterprise app and platform integrating gen AI into its feature set, it’s up to IT, security, and senior management to have an AI plan that can adapt and flex fast to the fast-growing feature set gen AI is delivering.

Enterprise AI leaders also need to define where they stand on the controversial and complex state of model training data. Forrester says that questions regarding the quality of training data using copyright material, model and data bias, and frequent “hallucinations” by models.

“In 2024, as organizations embrace the generative AI (genAI) imperative, governance and accountability will be a critical component to ensure that AI usage is ethical and does not violate regulatory requirements,” writes Forrester in their cybersecurity predictions late last year. “This will enable organizations to safely transition from experimentation to implementation of new AI-based technologies,” the report continues.

Top 10 Insights From Forrester’s State of Generative AI

The ten most valuable insights from Forrester’s State of Generative AI report provide a comprehensive overview of the current and future landscape of generative AI. Noteworthy for its balance between opportunities and risks, the report explains the hurdles in front of enterprises looking to gain value from gen AI now and in the future.

Here are the top 10 insights from the report:

Gen AI shows strong potential to improve and scale enterprise operations. Forrester is optimistic regarding the potential of gen AI to increase productivity and deliver measurable business value. “Forrester expects that gen AI will add convenience to and remove friction from a variety of experiences, reshape jobs in ways we are only beginning to contemplate and disrupt organizations and industries,” writes Forrester’s research team in the report. The report explains that there are three broad tiers of generative AI suppliers, further supporting the market’s expansion and growth.

Source: Forrester, The State of Generative AI, 2024 report. January 26, 2024

Large Language Models will continue to dominate the gen AI narrative. Large language models (LLMs), including Anthropic, Google, Meta, and OpenAI’s GPT series, will continue to dominate the gen AI landscape. Forrester notes that significant data and infrastructure requirements make the task of creating and maintaining an LLM difficult for companies considering competing in the market. Open-source LLMs are redefining the market, a point Forrester touches on briefly.

Gen AI is becoming part of planning cycles in enterprises: Forrester found that over 90% of global enterprise AI decision-makers have definite plans to implement generative AI. Internal use cases are dominating the planning cycles of enterprise AI leaders today.

Source: Forrester, The State of Generative AI, 2024 report. January 26, 2024

Overcoming technical skills shortages and integration challenges stand in the way of achieving benefits. A third of enterprise AI leaders say that lack of technical skills in their organizations is the single greatest roadblock to their gaining the benefits they’re looking for from gen AI. Twenty-eight percent say they’re having difficulty integrating gen AI into their existing tech stacks and infrastructure. The potential to gain significant benefits from gen AI motivates enterprise AI leaders to look for new ways to overcome technical skills shortages and find new ways to integrate gen AI into their infrastructure.

Source: Forrester, The State of Generative AI, 2024 report. January 26, 2024

Ethical and safe gen AI use will require new cybersecurity and governance approaches. Enterprises need to decide how they approach the most challenging and controversial aspects of LLMs, gen AI, and the future of AI at scale in their companies now rather than later. The core message of Forrester’s report is for enterprises not to procrastinate but to start making plans now for their stance on the issues of model bias, data security, regulatory compliance, and ethics of model training.

Weaponized LLMs are a fact of life for every enterprise looking to adopt these technologies today. There’s also the growing threat of intellectual property and confidential data being accidentally shared with LLMs via ChatGPT and comparable chatbots. The intensity cybersecurity providers are putting behind this problem makes it one of the fastest evolving areas in the industry today.

While not mentioned by Forrester in their report, these vendors are defining the state of the art when it comes to protecting confidential data being entered into LLMs. Cisco, Ericom Security by Cradlepoint’s Generative AI isolation, Menlo Security, Nightfall AI,  Wiz, and Zscaler have all developed and launched solutions to reduce the threat of confidential data making it into LLMs via chatbots.

The use of a virtual browser that is separate from an organization’s network environment in the Ericom Cloud distinguishes Ericom’s Generative AI Isolation. Data loss protection, sharing, and access policy controls are applied in the cloud to prevent confidential data, PII, or other sensitive information from being submitted to the LLM and potentially exposed.

“Generative AI websites provide unparalleled productivity enhancements, but organizations must be proactive in addressing the associated risks,” said Gerry Grealish, Vice President of Marketing Ericom Cybersecurity Unit of Cradlepoint. “Our Generative AI Isolation solution empowers businesses to attain the perfect balance, harnessing the potential of generative AI while safeguarding against data loss, malware threats, and legal and compliance challenges.”

Early adopters are implementing gen AI in a wide variety of use cases, ranging from operations to customer engagement and product development. Forrester notes that they’re seeing organizations use knowledge management bots to accelerate workflows, automate tasks, generate new ideas, and drive innovation across a broad base of use cases. Early adopters are also piloting gen AI for diverse use cases across operations, customer engagement, and product development. Forester emphasizes that for external use cases, they’re seeing enterprises adopt a main-in-the-middle workflow to strengthen model training with human intelligence – and avert potential errors in model response.

Source: Forrester, The State of Generative AI, 2024 report. January 26, 2024

Internal use cases precede external use cases as enterprises look to gain expertise in controlled environments. Companies will initially focus on internal use cases for generative AI to refine their models before slowly expanding to customer-facing applications, employing heavy human-in-the-loop management. Forrester is seeing gen AI being used internally to drive employee productivity and workflow optimization gains first. The top three use cases of employee productivity, knowledge management, and software development are all focused on internal improvements.

Legal and intellectual property uncertainty will continue to surround gen AI. Forrester implies there’s going to be an increasingly complex, controversial legal landscape regarding the data models are trained on, especially when it comes to copyrighted content.

Privacy and regulatory concerns are going to continue influencing adoption. Forrester is seeing enterprises in heavily regulated industries exercising extreme caution to protect company and customer data, with some even banning tools like ChatGPT over concerns about data protection and regulatory backlash.

Enterprises need to get a sense of urgency about preparing for gen AI governance and experimentation. Having a clear vision of how they’re going to adopt gen AI is essential if enterprises are going to succeed in governing these new technologies at scale. The combination of growing and recruiting in-house skills, having a solid plan for BYOAI, and defining guardrails for internal use cases are all needed to avoid being blindsided by risks.