鶹ýAV

Skip to content

Shelly Palmer - Cloudflare Announces AI Bot Blocking with One Click

Shelly Palmer has been named LinkedIn’s “Top Voice in Technology,” and writes a popular daily business blog.
aiphone-unsplash
Cloudflare tools allow websites to stop unrestricted AI scraping.

Greetings from NYC. I'm home for a few days, but the AI workshops continue online. Today, I'm leading a two-hour interactive session about post training (talking to your own data using AI). It's a pretty hot topic. If this is something that interests you, please reach out.

In the news: Cloudflare announced new tools that allow websites on its network to stop unrestricted AI scraping while also helping content creators identify which content is most scanned by bots, allowing them to eventually charge for access. Cloudflare is also creating a marketplace for sites to negotiate content deals based on more detailed AI audits. These tools will enable content creators to understand how AI models use their content and decide whether to allow or block access.

The rise of generative AI has complicated the value exchange for content creators. Bots no longer fall clearly into "good" or "bad" categories. AI bots, such as those used by large language models (LLMs), do not drive traffic like good bots, but are not malicious like bad bots, which creates a dilemma for site operators.

Cloudflare's tools allow site operators to block AI bots across their entire site with a single click, or audit which areas are being scraped the most. They can then make decisions about which bots to allow, possibly striking deals with AI model providers. Cloudflare has also created model terms of use that content creators can add to their sites to legally protect against unwanted AI scraping.

Notwithstanding any of the above, blocking bots like Google's could (and most probably will) reduce or remove sites from search engine results pages (SERPs). Cloudflare CEO Matthew Prince acknowledged that Google’s practices may need to change, but what would motivate Google to modify its practices? Regulation? Perhaps. There are some laws pending. As you can imagine, this is only the beginning.

As always your thoughts and comments are both welcome and encouraged. Just reply to this email. -s

P.S. Have you started planning for CES© (Las Vegas, January 7-10, 2025)? Our executive briefings and floor tours are the best way to experience the show. Let us help you get the most out of CES. .


ABOUT SHELLY PALMER

Shelly Palmer is the Professor of Advanced Media in Residence at Syracuse University’s S.I. Newhouse School of Public Communications and CEO of The Palmer Group, a consulting practice that helps Fortune 500 companies with technology, media and marketing. Named  he covers tech and business for , is a regular commentator on CNN and writes a popular . He's a , and the creator of the popular, free online course, . Follow  or visit . 

push icon
Be the first to read breaking stories. Enable push notifications on your device. Disable anytime.
No thanks