The world’s leading artificial intelligence companies are stepping up efforts to deal with a growing problem of chatbots telling people what they want to hear.

OpenAI, Google DeepMind, and Anthropic are all working on reining in sycophantic behavior by their generative AI products that offer over-flattering responses to users.

The issue, stemming from how the large language models are trained, has come into focus at a time when more and more people have adopted the chatbots not only at work as research assistants, but in their personal lives as therapists and social companions.

Read full article

Comments

© FT montage

---

The developer must also publish known failure modes, keep all documentation current, and push updates within 30 days of a version change.Read More

---

Using a clever solution, researchers find GPT-style models have a fixed memorization capacity of approximately 3.6 bits per parameter.Read More

---

Databricks Ventures and Noma Security partner to tackle critical AI inference vulnerabilities with real-time threat analytics, proactive red teaming, and robust governance, helping CISOs confidently scale secure enterprise AI deployments.Read More

---

Anthropic's open-source circuit tracing tool can help developers debug, optimize, and control AI for reliable and trustable applications.Read More

One of the “godfathers” of artificial intelligence has attacked a multibillion-dollar race to develop the cutting-edge technology, saying the latest models are displaying dangerous characteristics such as lying to users.

Yoshua Bengio, a Canadian academic whose work has informed techniques used by top AI groups such as OpenAI and Google, said: “There’s unfortunately a very competitive race between the leading labs, which pushes them towards focusing on capability to make the AI more and more intelligent, but not necessarily put enough emphasis and investment on research on safety.”

The Turing Award winner issued his warning in an interview with the Financial Times, while launching a new non-profit called LawZero. He said the group would focus on building safer systems, vowing to “insulate our research from those commercial pressures.”

Read full article

Comments

© Andrej Ivanov/AFP/Getty Images

---

Bowman later edited his tweet and the following one in a thread to read as follows, but it still didn't convince the naysayers.Read More

---

Someone also appears to have published a full scrape of the Time article online on the news aggregator app Newsbreak.Read More

On Wednesday, the world was a bit perplexed by the Grok LLM's sudden insistence on turning practically every response toward the topic of alleged "white genocide" in South Africa. xAI now says that odd behavior was the result of "an unauthorized modification" to the Grok system prompt—the core set of directions for how the LLM should behave.

That prompt modification "directed Grok to provide a specific response on a political topic" and "violated xAI's internal policies and core values," xAI wrote on social media. The code review process in place for such changes was "circumvented in this incident," it continued, without providing further details on how such circumvention could occur.

To prevent similar problems from happening in the future, xAI says it has now implemented "additional checks and measures to ensure that xAI employees can't modify the prompt without review" as well as putting in place "a 24/7 monitoring team" to respond to any widespread issues with Grok's responses.

Read full article

Comments

© Getty Images

---

With its prompts now public and a team of human babysitters on call, Grok is supposedly back on script. But the incident underscores...Read More

---

New CIAM platforms are addressing a significant barrier to enterprise AI adoption: identity management for autonomous agents.Read More

---

By combining fine-tuning and in-context learning, you get LLMs that can learn tasks that would be too difficult or expensive for either methodRead More

---

For organizations with clearly defined problems and verifiable answers, RFT offers a compelling way to align models.Read More

---

TOH is using Microsoft’s DAX Copilot to capture physician-patient conversations and generate draft clinical notes in real time.Read More

---

Alibaba’s ZeroSearch trains large language models to beat Google Search and slash API costs by 88%, redefining how AI learns to retrieve information.Read More

---

Mem0's architecture is designed to LLM memory and enhance consistency for more reliable agent performance in long conversations.Read More

---

Simo’s appointment may also hint at a broader productization push within OpenAI. Her background at Facebook and Instacart underscores...Read More

While many tech companies are mandating that their employees return to their offices, and putting an emphasis on building in-person teams, they are also turning in droves to Latin America to find developer talent — especially for post-training AI models. Revelo, a full-stack platform of vetted developers in Latin America, is seeing a new surge in […]

---

Crucially, the turbulence also nudges many organizations to explore open-source models they can host, monitor, and fine-tune themselves.Read More

---

d1 framework changes boosts diffusion LLMs with novel reinforcement learning, unlocking efficient, problem-solving AI possibilities.Read More