In a debate likely to get louder as AI agent usage grows, some people say Perplexity crawling blocked websites isn't a simple matter.

---

The company’s first-generation chips were fabricated in the U.S. using Intel facilities, with final server assembly and integration.Read More

After Cloudflare started testing new features that would allow websites to block AI crawlers or require payment for scraping, the tech company immediately faced questions over the logistics of the plan.

In particular, website owners and SEO experts wanted to know how Cloudflare planned to block Google's bot from scraping sites to fuel AI overviews without risking blocking the same bot from crawling for valuable search engine placements.

Last week, a travel blogger raised questions about the blocking and so-called pay-per-crawl features and pushed Cloudflare CEO Matthew Prince to respond on X (formerly Twitter):

Read full article

Comments

© Sundry Photography | iStock Editorial / Getty Images Plus

---

Here are the winners of the Women in AI awards at VB Transform, in categories including entrepreneur, research, mentorship and responsibility.Read More

---

Many AI developers started their morning amid a Google Cloud outage affecting many of the tools they use to build products.Read More