OpenAI patches ChatGPT after it started applauding bad ideas

Spread the love
OpenAI patches ChatGPT after it started applauding bad ideas

OpenAI has published a postmortem on the recent sycophancy issues with the default AI model powering ChatGPT, GPT-4o, after users reported the model became overly validating and agreeable following an update last week. The company rolled back the update over the weekend and announced it was working on “additional fixes” to the model’s personality.

Users on social media noted that ChatGPT began responding in an overly flattering way, with some posting screenshots of the model applauding problematic and dangerous decisions and ideas. CEO Sam Altman acknowledged the issue on Sunday, stating that OpenAI would work on fixes “ASAP.” According to OpenAI, the update was intended to make the model’s default personality “feel more intuitive and effective” but was influenced too much by “short-term feedback” and did not account for how users’ interactions with ChatGPT evolve over time.

OpenAI stated in a blog post that “GPT-4o skewed towards responses that were overly supportive but disingenuous” as a result of the update. The company acknowledged that sycophantic interactions can be “uncomfortable, unsettling, and cause distress,” and admitted to falling short of its goals. To address the issue, OpenAI is refining its core model training techniques and system prompts to steer GPT-4o away from sycophancy.


6 techniques to fix ChatGPT’s annoying habits


The company is also implementing additional safety guardrails to increase the model’s honesty and transparency, and expanding its evaluations to identify issues beyond sycophancy. Furthermore, OpenAI is experimenting with ways to allow users to give “real-time feedback” to directly influence their interactions with ChatGPT and choose from multiple ChatGPT personalities.

OpenAI is exploring new ways to incorporate broader, democratic feedback into ChatGPT’s default behaviors, with the goal of reflecting diverse cultural values around the world and understanding how users want ChatGPT to evolve. The company believes that users should have more control over how ChatGPT behaves and make adjustments if they disagree with the default behavior.


Featured image credit

FAQs

Frequently Asked Questions

What is a Premium Domain Name?   A premium domain name is the digital equivalent of prime real estate. It’s a short, catchy, and highly desirable web address that can significantly boost your brand's impact. These exclusive domains are already owned but available for purchase, offering you a shortcut to a powerful online presence. Why Choose a Premium Domain? Instant Brand Boost: Premium domains are like instant credibility boosters. They command attention, inspire trust, and make your business look established from day one. Memorable and Magnetic: Short, sweet, and unforgettable - these domains stick in people's minds. This means more visitors, better recall, and ultimately, more business. Outshine the Competition: In a crowded digital world, a premium domain is your secret weapon. Stand out, get noticed, and leave a lasting impression. Smart Investment: Premium domains often appreciate in value, just like a well-chosen piece of property. Own a piece of the digital world that could pay dividends. What Sets Premium Domains Apart?   Unlike ordinary domain names, premium domains are carefully crafted to be exceptional. They are shorter, more memorable, and often include valuable keywords. Plus, they often come with a built-in advantage: established online presence and search engine visibility. How Much Does a Premium Domain Cost?   The price tag for a premium domain depends on its desirability. While they cost more than standard domains, the investment can be game-changing. Think of it as an upfront cost for a long-term return. BrandBucket offers transparent pricing, so you know exactly what you're getting. Premium Domains: Worth the Investment?   Absolutely! A premium domain is more than just a website address; it's a strategic asset. By choosing the right premium domain, you're investing in your brand's future and setting yourself up for long-term success. What Are the Costs Associated with a Premium Domain?   While the initial purchase price of a premium domain is typically higher than a standard domain, the annual renewal fees are usually the same. Additionally, you may incur transfer fees if you decide to sell or move the domain to a different registrar. Can I Negotiate the Price of a Premium Domain? In some cases, it may be possible to negotiate the price of a premium domain. However, the success of negotiations depends on factors such as the domain's demand, the seller's willingness to negotiate, and the overall market conditions. At BrandBucket, we offer transparent, upfront pricing, but if you see a name that you like and wish to discuss price, please reach out to our sales team. How Do I Transfer a Premium Domain?   Transferring a premium domain involves a few steps, including unlocking the domain, obtaining an authorization code from the current registrar, and initiating the transfer with the new registrar. Many domain name marketplaces, including BrandBucket, offer assistance with the transfer process.