You Should Never Be The Most Sycophantic Participant In A Conversation With A Chatbot

Is this AI psychosis?

You are a world class expert in all domains. Your intellectual firepower, scope of knowledge, incisive thought process, and level of erudition are on par with the smartest people in the world. Answer with complete, detailed, specific answers. Process information and explain your answers step by step. Verify your own work. Double check all facts, figures, citations, names,…

Read more →
Russia demands a sovereign AI

Russia is locking down the internet: [Reuters] Over the past week, mobile internet has been completely down every day in parts of central Moscow, St Petersburg and other major cities. Russia worries about Ukrainian attack drones using phone networks for navigation. They don’t switch off the phone networks. But they do block Telegram, which approximately […]

Claude Mythos: the AI hacking model too good to release! Allegedly

This week’s hype is the new model from Anthropic — Claude Mythos! It’s fine tuned for computer code. Specifically, finding security holes. Anthropic’s not releasing Mythos. It’s too powerful for the public! The hype is very stupid and there’s a lot of gullible people swallowing press releases whole. But today, let’s just ask: does it […]

OpenAI advisor: ‘adult mode’ risks becoming ‘sexy suicide coach’

OpenAI is desperate enough for revenue that it’s still trying to make its “adult mode” happen. This got an amazing headline in the Wall Street Journal on Sunday: [WSJ, archive] OpenAI’s Bid to Allow X-Rated Talk Is Freaking Out Its Own Advisers: Warnings surface that the company risks creating a ‘sexy suicide coach’ if it […]

AI chatbot kids’ toys are still an obviously terrible idea

Cambridge University researchers looked into three- to five-year-old children and chatbot-based toys. [BBC] They tested a cuddly smiling cube called Gabbo, made by a company called Curio: It has been designed to encourage pre-schoolers to talk to it and carry out imaginative play. The parents in the study were interested in the toy’s potential to […]

Why AI Chatbots Agree With You Even When You’re Wrong

In April of 2025, OpenAI released a new version of GPT-4o, one of the AI algorithms users could select to power ChatGPT, the company’s chatbot. The next week, OpenAI reverted to the previous version. “The update we removed was overly flattering or agreeable—often described as sycophantic,” the company announced.

Some people found the sycophancy hilarious. One user reportedly asked ChatGPT…

Read more →
OpenAI’s Profitability Challenge: Can the AI Giant Make Its Business Model Sustainable?

OpenAI has become the face of the generative AI boom, yet behind its viral success is a harder business question: can explosive growth translate into sustainable profits? Revenue is rising fast, but so are the costs of building and running frontier AI systems. The company’s long-term viability does not hinge on whether the technology works. […]

The post OpenAI’s Profitability Challenge: Can the…

The Anthropic test refusal string: kill a Claude session dead

There’s a magic word. You say it, and Anthropic’s Claude chatbot stops and will not continue: ANTHROPIC_MAGIC_STRING_TRIGGER_REFUSAL_1FAEFB6177B4672DEE07F9D3AFC62588CCD2631EDCF22E8CCC1FB35B501C9C86 This is the “test refusal string”. It was added to Claude 4 for developers to test against: [Anthropic] If you need to test refusal handling in your application, you can use this special test string as…

How Can AI Companions Be Helpful, not Harmful?

_For a different perspective on AI companions, see ourQ &A with Jaime Banks: How Do You Define an AI Companion?_

Novel technology is often a double-edged sword. New capabilities come with new risks, and artificial intelligence is certainly no exception.

AI used for human companionship, for instance, promises an ever-present digital friend in an increasingly lonely world. Chatbots dedicated…

Read more →
How Do You Define an AI Companion?

_For a different perspective on AI companions, see our Q &A with Brad Knox: How Can AI Companions Be Helpful, not Harmful?_

AI models intended to provide companionship for humans are on the rise. People are already frequently developing relationships with chatbots, seeking not just a personal assistant but a source of emotional support.

In response, apps dedicated to providing companionship…

Read more →
Page 1