The 2024 CAIO Report

Are Chief Operating Officers Missing GenAI’s Strategic Value?

July 2024

COOs across industries agree that GenAI is critical for their organization’s strategic planning. Despite continual technology advancements, data from 60 COOs reveals that many big companies have yet to fully use AI for strategic purposes. Instead, many big firms use GenAI for data visualizations and customer service chatbots.

70% of COOs agree that implementing AI is critical to their firm’s strategic planning.
Firms using AI strategically are three times more likely to report positive ROI than firms not doing so.
88% of COOs say AI has ushered in a need for more analytically skilled workers.


Register for Unlimited Access
Complete the form below to enjoy free, unlimited access to all our Trackers, Studies and MonitorEdge Reports.

Thank you for registering. Please confirm your email to view all our Trackers.

    yesSubscribe to our daily newsletter, PYMNTS Today
    By completing this form, I have read and acknowledged the terms and conditions.

    Most chief operating officers (COOs) surveyed from firms with at least $1 billion in revenue report that implementing GenAI is a critical part of their firm’s strategic planning. Yet, most firms end up using it for more mundane purposes. These include routine monitoring or compiling information tasks.

    The data reveals, however, that firms implementing AI in the most strategic ways are more likely to benefit. Nearly 3 in 10 firms using AI in highly strategic ways report very positive ROI. Just 8.8% of firms report positive ROI when they use AI for more routine and less impactful tasks.

    GenAI personas



    While COOs are aware of AI’s potential, they may be slow to implement it in actual strategic ways. Instead, they may focus on improving efficiencies with more routine tasks.

    These are just some of the findings detailed in “The Impact Of GenAI on a COO’s Priorities,” the third edition of PYMNTS Intelligence’s2024 CAIO Project.” This series offers a monthly recap of the players and innovators using AI to revolutionize how they manage key parts of their businesses. This edition examines GenAI’s potential and use for COOs and draws on insights from 60 COOs representing U.S. firms that generated at least $1 billion in revenue last year. The survey was conducted from May 7 to May 16.

    The Full Story

    Seven in 10 surveyed COOs say GenAI is important for strategic planning, but implementation is limited.

    Seventy percent of COOs from firms surveyed — all with at least $1 billion in revenue — agree that GenAI is a critical part of strategic planning. Nonetheless, there is a gulf between aspiration and reality. Implementing GenAI is still limited to routine or less complex tasks, such as compiling information or data visualization. Nearly 6 in 10 COOs (58%) say their firms use GenAI for accessing information, while half of the executives say they use it with chatbots for customer service.

    58%

    OF COOs SAY THEIR FIRMS USE GenAI TO ACCESS INFORMATION, BUT ROUGHLY ONE-THIRD CONSIDER GenAI KEY FOR HR MANAGEMENT AND LOGISTICS.

    COOs are less likely to credit GenAI as necessary for production purposes, such as managing inventory or running logistics. Just 35% of COOs say GenAI is highly important for HR management and logistics. This data suggests that enterprises are not yet ready to trust GenAI to make decisions that affect production. That leaves human oversight in logistics and production to remain significant.

    Firms using GenAI strategically are three times more likely to report positive ROI than those using it less strategically.

    The strategic or “high-impact” use of GenAI — for example, generating feedback on a production process or innovating products and services — is linked to a more favorable return on investment (ROI). Data shows that 29% of the firms using the technology in highly impactful and strategic ways report very positive ROI. Just 8.8% of firms using GenAI for more routine and less impactful tasks reported positive ROI. (Less impactful tasks include accessing information or creating summaries.)

    18%

    SHARE OF COOs WHO REPORTED GENERATING CODE WITH GenAI, EVEN THOUGH ALL WHO DID SO SAID IT WAS HIGHLY EFFECTIVE

    The tasks most commonly accomplished by GenAI are not necessarily the most effective ones. For example, generating code is what we classify as a “medium impact” strategic use of GenAI. Although using the technology for code generation was highly effective according to all those who used it, just 18% of COOs reported generating code with GenAI. Conversely, 53% of COOs use the technology to create data visualizations, another medium-impact use. However, 22% did not find GenAI highly effective in creating data visualizations.

    Enterprises expect their GenAI investment to drive efficiencies and cost reduction.

    All executives surveyed so far have implemented GenAI in some form, but how do they see the returns? Executives are most likely to assess their investments in GenAI by looking at its impact on efficiencies. COOs at the 180 enterprise firms we analyzed stated that they used cost-cutting ROI metrics more commonly than measures based on revenue generation or market expansion. Nearly all COOs surveyed, 92%, report using at least one measure of investment return that focuses on cost reduction, such as reduced operational costs, capital expenditures or headcount. On the other hand, 70% of COOs cited at least one measure of increased profits, such as improved profit margins, increased customer base or revenue per customer.

    92%

    OF COOs MEASURE GenAI’S ROI WITH AT LEAST ONE COST REDUCTION METRIC.

    More than seven in 10 COOs agree that the use of GenAI has ushered in a need for more analytical skills rather than reducing the need for lower skills among the workforce.

    While COOs view GenAI as a driver of efficiencies, they also reported certain drawbacks to implementing GenAI. The executives’ chief concern is data security and privacy, which more than 41% of COOs noted as a drawback. The COOs’ perceptions reflect a world of increased cybersecurity threats and consumer awareness of data privacy. Their abilities to assess GenAI also come into play: 38% of COOs report an unfamiliarity with the full capabilities of the technology as a drawback.

    42%

    OF COOs SAY GenAI HAS REDUCED THEIR FIRM’S NEED FOR LOWER-SKILLED WORKERS.


    While the adoption of GenAI aims to streamline operations and reduce overhead costs, the reality tells another story. Instead of diminishing the need for human workers, GenAI has catalyzed a shift in workforce requirements, favoring analytical skills over reducing lower-skilled labor. We asked COOs their views of the shift in workforce needs, and 88% reported that their organization’s need for analytically skilled workers has increased. Conversely, 42% of COOs agree that using GenAI has decreased the company’s need for lower-skilled workers.

    Conclusion

    Most COOs surveyed agreed that implementing GenAI is critical to their firm’s strategic planning. What’s more, firms that use GenAI in strategic ways are three times more likely to report very positive ROI than those that do not. While this is true, many COOs still use AI for more routine purposes. The opportunity is ripe for larger firms to focus their AI use in highly impactful ways and employ more analytically skilled workers to fill the gaps they are currently experiencing.

    Methodology

    The Impact of GenAI on a COO’s Priorities” is based on a survey of U.S. COOs conducted from May 7 to May 17. The report explores how GenAI implementation is affecting COO’s firms. Our sample included interviews with 60 COOs from U.S. firms that generated at least $1 billion in revenue last year.


    Read the previous edition of the 2024 CAIO Report Series “How Simple, Routine GenAI Use Can Remake Enterprise Marketing,” for more.

    About

    PYMNTS INTELLIGENCE

    PYMNTS Intelligence is a leading global data and analytics platform that uses proprietary data and methods to provide actionable insights on what’s now and what’s next in payments, commerce and the digital economy. Its team of data scientists include leading economists, econometricians, survey experts, financial analysts and marketing scientists with deep experience in the application of data to the issues that define the future of the digital transformation of the global economy. This multi-lingual team has conducted original data collection and analysis in more than three dozen global markets for some of the world’s leading publicly traded and privately held firms.

    The PYMNTS Intelligence team that produced this report:
    Scott Murray: SVP and Head of Analytics
    Aitor Ortiz: Managing Director
    Yvonni Markaki, PhD: SVP, Data Products
    Anna Sofia Martin: Senior Writer


    We are interested in your feedback on this report. If you have questions or comments, or if you would like to subscribe to this report, please email us at feedback@pymnts.com.

    Disclaimer

    The 2024 CAIO Report may be updated periodically. While reasonable efforts are made to keep the content accurate and up to date, PYMNTS MAKES NO REPRESENTATIONS OR WARRANTIES OF ANY KIND, EXPRESS OR IMPLIED, REGARDING THE CORRECTNESS, ACCURACY, COMPLETENESS, ADEQUACY, OR RELIABILITY OF OR THE USE OF OR RESULTS THAT MAY BE GENERATED FROM THE USE OF THE INFORMATION OR THAT THE CONTENT WILL SATISFY YOUR REQUIREMENTS OR EXPECTATIONS. THE CONTENT IS PROVIDED “AS IS” AND ON AN “AS AVAILABLE” BASIS. YOU EXPRESSLY AGREE THAT YOUR USE OF THE CONTENT IS AT YOUR SOLE RISK. PYMNTS SHALL HAVE NO LIABILITY FOR ANY INTERRUPTIONS IN THE CONTENT THAT IS PROVIDED AND DISCLAIMS ALL WARRANTIES WITH REGARD TO THE CONTENT, INCLUDING THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE, AND NONINFRINGEMENT AND TITLE. SOME JURISDICTIONS DO NOT ALLOW THE EXCLUSION OF CERTAIN WARRANTIES, AND, IN SUCH CASES, THE STATED EXCLUSIONS DO NOT APPLY. PYMNTS RESERVES THE RIGHT AND SHOULD NOT BE LIABLE SHOULD IT EXERCISE ITS RIGHT TO MODIFY, INTERRUPT, OR DISCONTINUE THE AVAILABILITY OF THE CONTENT OR ANY COMPONENT OF IT WITH OR WITHOUT NOTICE.
    PYMNTS SHALL NOT BE LIABLE FOR ANY DAMAGES WHATSOEVER, AND, IN PARTICULAR, SHALL NOT BE LIABLE FOR ANY SPECIAL, INDIRECT, CONSEQUENTIAL, OR INCIDENTAL DAMAGES, OR DAMAGES FOR LOST PROFITS, LOSS OF REVENUE, OR LOSS OF USE, ARISING OUT OF OR RELATED TO THE CONTENT, WHETHER SUCH DAMAGES ARISE IN CONTRACT, NEGLIGENCE, TORT, UNDER STATUTE, IN EQUITY, AT LAW, OR OTHERWISE, EVEN IF PYMNTS HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
    SOME JURISDICTIONS DO NOT ALLOW FOR THE LIMITATION OR EXCLUSION OF LIABILITY FOR INCIDENTAL OR CONSEQUENTIAL DAMAGES, AND IN SUCH CASES SOME OF THE ABOVE LIMITATIONS DO NOT APPLY. THE ABOVE DISCLAIMERS AND LIMITATIONS ARE PROVIDED BY PYMNTS AND ITS PARENTS, AFFILIATED AND RELATED COMPANIES, CONTRACTORS, AND SPONSORS, AND EACH OF ITS RESPECTIVE DIRECTORS, OFFICERS, MEMBERS, EMPLOYEES, AGENTS, CONTENT COMPONENT PROVIDERS, LICENSORS, AND ADVISERS.
    Components of the content original to and the compilation produced by PYMNTS is the property of PYMNTS and cannot be reproduced without its prior written permission.