Study Reveals Large Language Model’s Limitations in Humor; ChatGPT Struggles to Be the Life of the Party

“Can machines be funny?” That’s a question that has been asked by many researchers exploring the field of computational humor. A recent study by researchers at Stanford University and Google Research set out to find the answer, taking a look at the humor-generating capabilities of ChatGPT, one of the largest language models in the world.

ChatGPT is part of the GPT family of language models that forms the backbone of the OpenAI language model. This model has learned to generate text that bears remarkable similarities to human writing. The study aimed to explore whether ChatGPT could generate funny content like a human.

The researchers tested ChatGPT’s ability to create humor by presenting it with a joke prompt and analyzing the response. They discovered that more than 90% of the time, ChatGPT’s response was a repetition of one of the 25 different jokes provided.

The top four jokes were recycled in more than half of the responses. This result points to an issue highlighted in the study: while ChatGPT can generate a large amount of text, a significant proportion of that text is repetitive and predictable.

ChatGPT’s contribution

Despite these limitations, the study suggests that ChatGPT is a significant step in the direction of creating “funny” machines. Humor has always been seen as too subjective of a field to develop an algorithm that can effectively create it. However, the study shows that despite the limitations, ChatGPT can generate coherent jokes, demonstrating its potential in various natural language tasks.

The researchers also observed that ChatGPT displayed an understanding of wordplay and double meanings. This result suggests that future iterations of the program may lead to significant advancements in this area.

Difficulty confirming beyond training data

However, the study acknowledges that it is challenging to confirm whether the jokes were hard-coded without access to more extensive language model training data. Without expanding the dataset used in the study, it is difficult to say whether ChatGPT learned these jokes through training or whether these jokes were hard-coded into the algorithm.

ChatGPT’s Limitations

While ChatGPT shows potential for advancements in computational humor, the study concludes that the model cannot confidently create intentionally funny original content. ChatGPT can respond to prompts using its vast dataset of pre-existing jokes, but it still struggles to create original humor.

In other instances, the model struggled to make sense of the joke’s setup, which led to a lack of cohesion and became an obstacle to humor. However, it is worth noting that humor often relies on cultural and contextual understandings, which may be difficult for a language model to grasp.

The study highlights the difficulty for large language models to understand and create humor. As of today, machines are no match for human humor. Yet, the study concludes that even though ChatGPT cannot yet generate intentionally funny, original content, it represents a significant leap forward in the design of machines that have a sense of humor. The potential conveyed by ChatGPT could pave the way for subsequent studies that will analyze humor in more detail, bringing us closer to the day when machines will be able to make us laugh.

Explore more

Salesforce Buys Informatica for $8B to Boost Data and AI Strategy

The tech industry frequently witnesses seismic shifts, but few moves carry as much transformative potential as Salesforce’s recent acquisition of Informatica for $8 billion. As companies compete for technological dominance, this strategic purchase underscores Salesforce’s commitment to advancing its data and artificial intelligence strategy. This deal not only highlights Salesforce’s ambition to enhance its data management capabilities but also marks

Which iOS Email Apps Will Transform Marketing in 2025?

The landscape of email marketing is witnessing a profound transformation as businesses globally adapt to the shifting dynamics of digital communication. With iOS devices becoming increasingly integral to daily operations, email marketing apps specifically designed for these platforms have emerged as pivotal tools for enhancing marketing strategies. This shift has prompted companies to explore sophisticated email marketing solutions tailored for

Is Email Marketing the Future of Digital Strategy in 2025?

In a digital age where consumer attention is a scarce commodity, and marketers are continually seeking effective ways to connect with their audience, email marketing stands tall as a crucial component of digital strategies in 2025. With its immense potential for direct engagement and high return on investment, email marketing has sustained its relevance even amid the rise of new

Will AI Investments Transform Financial Institutions?

In recent years, financial institutions have increasingly invested in artificial intelligence (AI) to remain competitive and manage evolving customer expectations, with investments in AI technologies expected to constitute 16% of total tech expenditures. This investment trend is largely driven by the potential for AI to optimize operations and deliver deeper customer insights. Major banks like Bank of America have set

Transform Business Efficiency with Robotic Process Automation

In a world where 60% of jobs are predicted to have at least 30% of their tasks automated, Robotic Process Automation (RPA) stands at the forefront of transforming business efficiency. As companies strive to improve productivity and reduce operational costs, RPA has emerged as a pivotal technology. Driven by software bots, it replicates human actions to complete repetitive, rule-based tasks,