🤖 Core Updates: Claude marks AI content and Microsoft Clarity adds scrape-to-referral metric [17 August]


SEO tips and updates from Mark Williams-Cook
Search with Candour hosted by Jack Chambers-Ward

SEO updates you need to know


🏷️

Claude adds watermarks to AI-generated content. This new transparency will be added to all content including text, code and images and is driven by the EU AI Act's Article 50.

🤖

Microsoft Clarity adds a new scrape-to-referral ratio metric. This metric compares the scraping activity from AI crawlers with the referral traffic received from those crawlers.

📈

AI traffic to Shopify sites grew 197% year over year. Despite this significant increase, organic search traffic still accounts for more traffic than all of the AI platforms combined. Organic also increased by 12% year over year.

🤝

Only 1.1% of publisher traffic comes from AI search. The majority of traffic to publishers comes via navigational/direct traffic and traditional organic search. Unsurprisingly, major publishers dominated compared to smaller sites.

▶️

Google reduces the minimum number of followers required for Search Profiles. Previously, the threshold was 100k for all platforms but is now just 35k for YouTube, Instagram and X. The threshold for TikTok remains at 100k.

📍

AI Overviews are citing self-promotional listicles for local searches. Despite Google's recent crackdown on self-promoting listicles, AIOs for local searches will sometimes replicate the listicle, in the exact same order.

⚖️

ChatGPT cites smaller sites at a similar rate to big, partnered sites. This study confirms previous findings that the OpenAI search index covers sites equally, regardless of whether they are licensed partners with OpenAI or not.

Sponsor: SEOFOMO

🚀 Help SEOFOMO reach 50K

The SEOFOMO newsletter is on the road to reach 50,000 subscribers, and to celebrate, they're giving back to the search community helping them get there.

Subscribe to the free SEOFOMO newsletter, share your unique referral link, and each verified new subscriber you refer gives you one additional eligible entry to win:

🎟️ Grand Prize:

A ticket to one eligible SEO conference worldwide, plus SEOFOMO swag and a private SEO / AI Search Q&A session with Aleyda Solis. Conferences to choose from include MozCon, brightonSEO, Search n' Stuff, Women in Tech SEO Fest, SERP Conf, SearchNorwichXL, and more!

🎁 Plus:

5 Community Experience winners will get access to an exclusive virtual SEO & AI Search group Q&A with Aleyda, plus a WTSFest London 2027 Recording Ticket.

The giveaway runs until SEOFOMO reaches 50,000 verified subscribers, or December 31, 2026, whichever comes first.

Search with Candour podcast

SEO, design and brand in the age of AI

Season 4: Episode 84

Candour’s Principal SEO Consultant, Brendan Bennett and Design Lead Mark Salisbury join Search with Candour to discuss the growing overlap between SEO, design, UX, and brand, and how AI/LLMs and emerging agentic experiences affect the way we build and use websites.

The Candour trio also explore what brand means beyond just a logo, how third-party signals like reviews, Reddit, and search results shape perception, and how SEOs measure brand through metrics such as brand search volume, sentiment, and frameworks like Google’s HEART.

The conversation covers trust signals, page clarity, semantic HTML, the tension between brand-led copy and keyword-focused headings, and the risk of AI-generated “slop” versus human differentiation.

Search Evolution Summit - Ticket giveaway

Apply for a FREE Search Evolution Summit ticket

Mark Williams-Cook is speaking at Search Evolution Summit in Romania on 3 September 2026 and is giving away a free ticket for the main conference.

So, if you've seen the amazing line up of speakers and want to visit Romania in September, now is your chance to apply.

Last week's SEO tips

Every click you make

If you're giving recommendations to expand content, such as trying to cover other search terms it has impressions for, it is always a good idea to run a cannibalisation check first ☝️

While some tools offer this, it is possible to setup tooling using the Google Search Console API to dig into this data, which is more accurate.

One of the many internal tools Candour has (which we chain into other tools, such as content audits), allows you to automate this process.

While there are a few different ways to go about it, here is a rough outline of what you would need to do to automate this:

1/ Authorise against Search Console with OAuth, webmasters.readonly scope, tokens stored server-side and refreshed.

2/ Match the URL to a property via sites.list().
Set the window: last 90 days, ending 2 days ago, dataState: "final", type: "web".

3/ Get the page's queries: searchanalytics.query(), dimensions: ["query"], filter page equals

4/ For each of those queries, get its pages: dimensions: ["page"], filter query equals

5/ Normalise URLs before comparing: strip protocol, www., trailing slash and fragment. Keep query strings.

6/ Flag a conflict where a query returns more than one of your URLs.

7/ Filter the noise: a competing URL needs ≥10 impressions and average position ≤50. Never apply those thresholds to the URL being analysed, or it filters itself out.

8/ Score closeness: 100 - |position difference|. Near-identical positions mean the pages are genuinely interchangeable; a wide gap doesn't.

9/ Rank by what's at stake: competing impressions × closeness. Volume alone puts trivial conflicts at the top.

10/ Output a side-by-side of clicks, impressions, CTR and average position per URL, plus CSV.

Caveat: those positions are impression-weighted averages, so a close gap is evidence the pages compete, not proof they appeared on the same SERP simultaneously.

Message in an exploit

The Google exploit we discovered showed Google stores the "last_significant_update" in epoch time (Unix time, a system for tracking time in computers) of the page, this means ⤵️

Just updating your "last modified" date on a page without making substantial changes will make you run into problems with Google

Gary Illyes from Google later confirmed they have a "binary" trust signal as to whether or not they listen to this hint from webmasters.

Keep changing that lastmod without significantly updating the page? Google stops listening to you, much how you would stop listening to someone that proves they lie often...

Don't crawl so close to me

It is estimated that the Common Crawl dataset provides ~75% of the tokens that major models ingest during training. Being in training data is a huge lever for visiblity with AI search.

I saw Michael Curtis post about Common Crawl Checker, a tool which allows you to check the lastest Common Crawl dataset for a specific domain to see if you're in it.

At the moment, I am strongly recommending clients not to Disallow CCBot, as it is the backbone that RAG is happening against.

Walking on the cloud(flare)

If you're using Cloudflare, you can "Register your interest" for their new "AEO" tools under "Agent Readiness". This is something I am watching closely.

Cloudflare has a really good chunk of the web; they can tie together crawl logs and referral data at a scale few other companies can. While I don't necessarily agree with some of their "land grab" type standards they are adding a lot of shine to, the AEO tracking does look very interesting.

Here is the full article which is also a great primer to their AI Gateway, which is super useful if you haven't discovered it yet.

Every little query she does is magic

It's become clear that AI mode/follow up prompts are appearing in Google Search Console query data, you need to segment that noise for more signal ⤵️

Luckily for you, Glenn Gabe has already posted a nice workflow using the Search Console API, Analytics Edge, and Claude Cowork 🎉

Refer subscribers and earn rewards!

If you enjoy reading Core Updates, you can earn £1000's of free access to software and tools by referring your friends to sign up using your personal referral link.

Your referral link: [RH_REFLINK GOES HERE]


Here are the fantastic rewards on offer:

Refer 3 Subscribers:
Get tagged in a LinkedIn post to thank you for your support

Refer 10 Subscribers:
Get included in a Core Updates email as a supporter

Refer 25 Subscribers:
Get 1 month free subscription to Liam Fallen’s MostlyMarketing Slack

Refer 50 Subscribers:
Get 1 month free AlsoAsked Lite subscription

Refer 75 Subscribers:
Get a free copy Majestic’s SEO in 2025 book (20 to give)

Refer 100 Subscribers:
Get 3 months free InLinks Freelancer subscription

Refer 150 Subscribers
Get free access to Kyle McGregor’s Google Analytics 4 course

Refer 200 Subscribers:
Get free access to Mark Williams-Cook’s Complete SEO course

Refer 250 Subscribers:
Get 1 year free subscription to Sitebulb Pro

Refer 300 Subscribers:
Get free access to Mark Rofe’s Digital PR Course

Refer 404 Subscribers:
Get 1 year free subscription to Little Warden Small team

Refer 500 Subscribers:
Get 1 year free AlsoAsked Pro subscription

Your referral link:

[RH_REFLINK GOES HERE]

Facebook Twitter Whatsapp Telegram Linkedin Email

PS: You have referred [RH_TOTREF GOES HERE] people so far

See how many referrals you have

Top Core Updates referrer leaderboard

A big thank you to our top referrers, who have signed up over 10 people to the Core Updates newsletter, go follow them!

🥇 MJ Cachón Yáñez (LinkedIn / Bluesky)

🏅 Nikki Pilkington (LinkedIn / Bluesky)

🏅 Lidia Infante (LinkedIn / Bluesky)

🏅 Saijo George (LinkedIn / Bluesky)

🏅 Alice Rowan (LinkedIn)

🏅 Martijn Jeurissen (LinkedIn)

🏅 Chester Beard (LinkedIn)

Candour, 30-34 Muspole Street, Norwich, Norfolk NR31DJ
Unsubscribe · Preferences

Core Updates SEO Newsletter

The Core Updates newsletter is written by Mark Williams-Cook, a veteran SEO who is Digital Marketing Director at Candour, Founder of AlsoAsked and organiser of SearchNorwich. Over 40,000 SEOs follow Mark's 'Unsolicited #SEO tips' on LinkedIn, which has now been wrapped up into the Core Updates newsletter, along with an overview of weekly news and the current episode of the Search with Candour episode, hosted by Jack Chambers-Ward.

Read more from Core Updates SEO Newsletter

SEO tips and updates from Mark Williams-CookSearch with Candour hosted by Jack Chambers-Ward SEO updates you need to know 📊 Microsoft Clarity introduces branded and non-branded AI query data. Queries will be labelled and can be filtered by branded or non-branded. Share of Authority can also be broken down by branded and non-branded queries. ☁️ Cloudflare adds AEO visibility dashboard to its AEO suite. This new dashboard joins the existing Agent Readiness tool and includes metrics such as...

SEO tips and updates from Mark Williams-CookSearch with Candour hosted by Jack Chambers-Ward SEO updates you need to know 🏷️ AI-generated content must be labelled clearly according to new EU guidelines. The EU is pushing digital transparency that expands outside of just images and includes published text that doesn't receive human review. 📊 Social media properties rollout globally for Google Search Console. These new platform properties were announced a few weeks ago, and users can now...

SEO tips and updates from Mark Williams-CookSearch with Candour hosted by Jack Chambers-Ward SEO updates you need to know ✍️ 5.3% of top-ranking pages are AI-generated. This study dispels some of the beliefs that 100% AI-generated content can't rank on Google. AI-generated content was present in every ranking position across 331k analysed pages. 📊 More than 40% of US searches trigger AI Overviews.This study from Similarweb also shows that Google search length has increased by 5.4% since AI...