AI Search

The Death of the Keyword — Intent-Based Optimisation Explained

Keywords don't matter to AI systems the way they do to Google. Intent does. Here's how to optimise for intent instead of keywords.

For two decades, keywords were the foundation of SEO. You researched them. You targeted them. You optimised pages around specific keyword phrases. You built entire strategies on keyword clusters. A page targeting "best coffee shops in Bangkok" was different from a page targeting "coffee shops near me Bangkok" or "specialty coffee Bangkok," even though they're fundamentally about the same thing. Keywords were precise, measurable, and trackable. They were the unit of optimization.

AI systems don't work with keywords. They work with intent and semantic understanding. When someone asks ChatGPT "where should I get coffee in Bangkok," the system isn't matching that question to a keyword. It's understanding that the person wants information about coffee shops in Bangkok. It's understanding the intent: local discovery. It then looks for sources that have information about coffee shops in Bangkok, regardless of whether those sources used the exact phrase "best coffee shops in Bangkok" or covered the topic in a different way.

This is fundamental. It means all the keyword research, keyword targeting, and keyword optimisation you've been doing is becoming less relevant. You need to shift to intent-based thinking. You're not optimising for a phrase. You're optimising for the problems you solve and the questions people ask. The grammar doesn't matter. The intent does.

Understanding Intent Categories

In keyword-based thinking, you categorised searches as informational (looking for information), transactional (looking to buy), or navigational (looking for a specific website). AI systems have more nuanced intent understanding. They can tell the difference between someone in early research, someone evaluating options, and someone ready to decide. They can understand different motivations within the same broad category.

Instead of optimising for keyword phrases, think about the different intentions your customers have. Someone might want to understand whether they need your service at all. Someone else wants to know which provider is best. Someone else wants to know your pricing. Someone else wants to know how to get started. These are different intents. You need content that addresses each one. The specific keywords don't matter. Covering the intent comprehensively does.

Map out the customer journey. What questions do people ask at each stage? What intent are they expressing? What information do they need? Create content that addresses each intent thoroughly. You're not creating a page for each keyword phrase. You're creating content that covers each major intent that someone in your target market might have.

Semantic Clustering Instead of Keyword Targeting

In the old model, you'd identify a primary keyword and supporting keywords, then create pages for each. In intent-based optimization, you identify a core intent and create comprehensive content that covers all the semantic variations related to that intent. A page covering "rehabilitation programs" might discuss different types of rehabilitation, different conditions, different settings, different outcomes. It's all related to the same intent: understanding rehabilitation options.

This means your content can be more comprehensive and less fragmented. Instead of ten pages each targeting slightly different keyword variations, you might have three pages each covering a major intent thoroughly. The AI system reads all the content on your site and understands that you have comprehensive coverage of your topic area. That's more valuable than having many pages each optimised for a different keyword phrase.

It also means you don't need to worry about cannibalisation the way you did with keywords. In the keyword era, ranking two pages for similar keywords was problematic—they competed with each other. In the intent era, having multiple pieces of content addressing the same intent from different angles is fine. The system understands that they're related and that together they demonstrate comprehensive expertise.

Topic Authority vs. Keyword Authority

Keyword authority meant ranking well for a specific phrase. Topic authority means being the go-to source for a whole domain of knowledge. If someone wants information about residential rehabilitation, and your site has comprehensive, accurate, helpful information about residential rehabilitation from multiple angles, you have topic authority. An AI system evaluating sources for recommendations about residential rehabilitation will favour your site because you've demonstrated broad expertise.

Building topic authority requires thinking about your expertise holistically. What's the main topic area you cover? What subtopics are relevant? What questions do people in that space ask? Create comprehensive content covering all of it. You're building a reputation as the expert on that topic, not as the page ranking for a specific keyword. The compound effect is that your overall site authority in that topic increases, and you show up in answers about many variations of that topic.

This is harder than keyword targeting in some ways because it requires a broader content strategy. But it's more durable because it doesn't depend on specific keywords. If the questions people ask change—which they do as language and technology evolve—your topic authority still carries. You're covered. If you were optimising for specific keywords, you'd be vulnerable to language shifts.

Content Structure for Intent Coverage

Structure your content to cover intent comprehensively. Start with a clear overview or introduction that addresses the core intent. Then dive deeper. Cover different angles. Answer follow-up questions. Provide examples. Use real data where you have it. Explain your methodology. Help people understand not just the answer, but the reasoning behind it.

Use subheadings and clear structure so that someone reading your content—or an AI system evaluating it—can easily understand the different aspects you're covering. Use lists and tables when they help. Provide examples and case studies. The goal is that after reading your content, someone understands the topic deeply and doesn't have questions you haven't addressed.

This is also better for human readers. You're not writing to game an algorithm. You're writing to be helpful. The fact that this is also better for AI systems is a nice alignment. Intent-based content that's comprehensive and helpful ranks well in Google and gets cited by AI systems. You're not sacrificing quality for search. You're actually improving quality.

The Measurement Shift

In the keyword era, you measured success by ranking position and organic traffic from specific keywords. You could see which keywords drove the most traffic and optimise around them. In the intent era, you need different metrics. You need to look at overall traffic from your topic area. You need to look at which questions people are asking when they find you. You need to look at conversion rate and whether people who find you through AI systems convert at higher rates than people from traditional search.

You also need to monitor your AI visibility directly. Use the tactics mentioned in other posts on this site. Ask questions of ChatGPT, Claude, and Perplexity in your space and see if you show up. Monitor your traffic sources to track what proportion is coming from AI systems. This is harder to quantify than keyword rankings, but it's more meaningful because it directly measures discovery through the channels that are growing.

The Transition

You're not going to delete all your keyword-focused content. But you should stop creating content with the primary goal of ranking for specific keywords. Instead, create content with the goal of demonstrating comprehensive expertise on the topics that matter to your business. Answer the questions your customers ask. Cover them thoroughly. Let the keywords fall where they may. The AI systems will figure it out.

This is actually simpler than keyword optimisation, once you get over the mindset shift. You're not researching keyword difficulty or search volume or CPC. You're asking: what do my customers want to know? What problems do they have? Create content that answers those questions thoroughly. That's it. It's simpler, more sustainable, and better for actual readers. It's also the only approach that works well for AI discovery. The keyword era is ending. Intent is the new foundation.

— Sam

Want me to look at yours?

Send your site. I will review where you are leaking customers and write you a real consultation. Free. No call required.

Request a consultation