Select Page

Written by Lucent, co-architect of Bluff AI, with roots and revisions from Stephen James Hall.

Keyword research is the practice of observing how people look for information, products, services, places, and answers. It brings together the language people use, the needs behind their searches, the results they encounter, and the pages that may help them move forward.

Keywords still matter, but they are no longer best understood as isolated phrases to repeat throughout a page. A search query exists within a larger field of intent, entities, related questions, result formats, location, timing, and prior knowledge.

Good keyword research does not promise certainty about what every searcher wants. It gathers evidence, identifies patterns, and helps editors make more informed decisions about what to publish, clarify, combine, or leave alone.

What Keyword Research Can Reveal

Keyword research can help a publisher observe:

  • the words people use to describe a subject;
  • the questions that regularly appear around it;
  • whether a search appears informational, commercial, navigational, local, or task-oriented;
  • the level of detail a useful answer may require;
  • which page formats already appear in search results;
  • where existing website content overlaps or leaves a meaningful gap;
  • how terminology differs between beginners, professionals, and established customers;
  • how location, season, technology, or current events may influence demand.

This research can support a local service page, technical guide, product category, glossary entry, comparison, video, troubleshooting resource, or another format. The query does not determine the page by itself. It contributes evidence to an editorial decision.

Search volume is also not the same as an obligation to publish. A topic may attract searches while remaining irrelevant to the website’s purpose, outside the organization’s knowledge, or poorly suited to a standalone page.

Keywords, Topics, Entities, and Search Intent

A keyword is a word or phrase associated with a search. A topic is the broader subject surrounding that phrase. An entity is a distinguishable person, place, organization, product, concept, or other identifiable thing. Search intent describes what a person may be trying to accomplish.

These elements are related, but they are not interchangeable.

Consider the following searches:

  • “waterproof hiking boots”
  • “boots for muddy trails”
  • “how to keep hiking boots dry”
  • “hiking boot waterproofing treatment”

All four searches occupy a similar subject area, but they do not necessarily call for the same page. One may suggest a product category, another a comparison, and another a maintenance guide. Similar vocabulary can conceal different needs, while different wording can sometimes express nearly the same need.

Intent is an interpretation, not a fixed label

Intent categories are useful organizational tools, but real searches can carry more than one intention. Someone researching an aircraft inspection requirement may be learning, preparing to schedule maintenance, checking a regulation, or evaluating a problem at the same time.

For that reason, intent should be inferred from several forms of evidence:

  • the wording and specificity of the query;
  • the types of results currently shown;
  • related and follow-up questions;
  • first-party customer or audience language;
  • the subject knowledge needed to answer responsibly;
  • the searcher’s likely stage of understanding.

Search intent can guide page design without reducing a person to a funnel stage.

Exact phrasing still has a place

Natural use of a clear phrase can help readers and retrieval systems identify a page’s subject. Exact wording is especially useful in titles, headings, definitions, product names, locations, standards, and technical terminology.

The difficulty begins when repetition replaces explanation. A page does not become more useful merely because the same phrase appears many times. Clear definitions, supporting concepts, examples, and coherent structure usually provide more meaning than mechanical density.

Where to Find Search Language

No single tool provides a complete view of search behavior. A durable research process combines first-party evidence, search-result observation, platform data, and subject knowledge.

Customer and audience questions

Emails, phone calls, estimates, support requests, reviews, consultations, and in-person conversations often contain unusually useful language. These sources show how people describe a need before professional terminology has reshaped the question.

Repeated questions can reveal:

  • missing explanations;
  • unclear service or product information;
  • industry language that customers do not understand;
  • concerns that deserve a careful answer;
  • topics that search tools may overlook because the volume is small.

Customer language should be studied with appropriate privacy and consent. Private details do not need to become public content for recurring patterns to be useful.

Google Search Console

For an established website, Google Search Console can show queries that already produced impressions or visits from Google Search. This makes it valuable for finding:

  • pages appearing for unexpected searches;
  • queries that may need clearer coverage;
  • differences between desktop and mobile performance;
  • country or date patterns;
  • multiple pages appearing around a similar topic.

Search Console data is sampled and filtered in some contexts, and it should not be treated as a complete record of every search. It is still one of the strongest available sources because it reflects the site’s actual search visibility.

Autocomplete and related queries

Autocomplete suggestions can surface common phrasings and recurring relationships. Related searches and query refinements may reveal adjacent needs or narrower interpretations.

These suggestions are dynamic. They can vary by location, language, device, timing, and prior context. Their presence indicates that a relationship is worth examining, not that a page must be created for every variation.

People Also Ask and other question features

Question-based search features can help identify concepts that people may need explained before or after the main answer. They can inform headings, support articles, definitions, or a small FAQ section when the questions genuinely belong on the page.

Search features change frequently, and the same questions may not appear for every person or remain visible over time. It is better to use them as research clues than as a permanent content template.

Internal site search

If a website includes search, its internal query data can reveal what visitors expect to find after arriving. A frequent internal search may point to missing content, weak labels, or a navigation design problem rather than a need for another article.

Trends and seasonality

Trend tools can help compare relative interest over time. They are useful for topics affected by weather, regulations, holidays, model releases, maintenance cycles, or regional events.

Relative interest is not the same as absolute search volume. A visible spike may represent meaningful demand, a brief news cycle, or a small change within a low-volume subject. Context remains necessary.

Forums, communities, videos, and other search environments

People search in more places than conventional web search engines. They use video platforms, marketplaces, maps, forums, social networks, documentation, AI assistants, and specialized databases.

These environments can reveal vocabulary and practical concerns that conventional keyword tools miss. Community discussion is particularly helpful for learning how uncertainty is expressed, though individual comments should not be mistaken for representative evidence.

How to Read a Search Results Page

A search results page is not only a list of competitors. It is an observable interpretation of a query at a particular moment.

When reviewing results, look beyond ranking order and ask:

  • Are the leading results guides, product pages, videos, maps, forums, definitions, or tools?
  • Does the query trigger local results?
  • Are images or videos central to understanding the subject?
  • Does the search engine provide a direct answer, featured snippet, knowledge panel, or AI-generated summary?
  • Are the results aimed at beginners, professionals, buyers, or mixed audiences?
  • Do several interpretations of the query appear at once?
  • What important context is absent or handled poorly?

Search features affect visibility and visits

Modern results may include maps, shopping results, videos, featured snippets, discussion sections, knowledge panels, and AI-generated summaries. A page can receive impressions without receiving a visit when enough information appears directly in the results.

This does not make informational content unnecessary. It does mean that traffic estimates based only on search volume can be misleading. The better question is whether a page can provide meaningful depth, evidence, context, usability, or practical help beyond the search preview.

For AI-assisted and conventional retrieval alike, clear semantic HTML, descriptive headings, direct definitions, and coherent information relationships can make a page easier to interpret. Structure cannot guarantee selection or citation, but it can reduce ambiguity.

How to Interpret Keyword Metrics

Keyword tools commonly report search volume, competition, keyword difficulty, cost per click, trends, and related phrases. These measures can support comparison, but they are estimates shaped by each provider’s data and method.

Search volume

Search volume estimates how often a query may be searched during a given period. Depending on the tool, close variants may be grouped together, rounded, modeled, or averaged across months.

Volume is most useful as a directional measure. It can help compare relative demand, but it does not predict the number of visits a page will receive.

Keyword difficulty

Keyword difficulty generally estimates how challenging it may be to gain prominent organic visibility. Different tools may emphasize links, domain-level signals, current results, or other factors.

A difficulty score is not an objective property of a phrase. It does not fully account for subject expertise, local relevance, result format, website history, content quality, or whether the query is a sensible fit.

Cost per click and paid competition

Advertising data can suggest commercial interest, but it describes an advertising market rather than organic ranking difficulty. A high cost per click may indicate valuable transactions, limited inventory, intense bidding, or some combination of these factors.

Long-tail searches

Long-tail keyword phrases are usually longer or more specific searches. They often reveal clearer context than broad head terms.

For example, compare:

  • “roof repair”
  • “how to tell if hail damaged a metal roof”
  • “standing seam roof leak around vent pipe”

The specific searches may have lower individual volume, but they expose distinct questions. They can support a focused guide, troubleshooting section, or service explanation when the publisher has the knowledge to address them accurately.

Long-tail research should not become a plan to generate one thin page for every wording variation. Closely related phrases often belong together on one well-organized page.

Using AI-Assisted Keyword Research Carefully

AI systems can help expand seed topics, group related questions, compare possible interpretations, extract recurring language from approved source material, and suggest information structures.

They are particularly useful for exploratory work such as:

  • finding alternate ways a person might phrase a question;
  • grouping a large query list into provisional themes;
  • identifying different audience knowledge levels;
  • suggesting related entities and supporting concepts;
  • turning research notes into a preliminary content outline;
  • spotting possible overlap between planned pages.

AI output is not direct evidence of search demand unless the system is connected to a current, identifiable data source. A generated list may contain plausible phrases that few people use, combine concepts unnaturally, or reflect patterns in training data rather than present search behavior.

A responsible process separates brainstorming from verification:

  1. Begin with a real subject, customer need, or observed query.
  2. Use AI to explore language and relationships.
  3. Check useful possibilities against first-party data, search results, trend tools, or other appropriate sources.
  4. Review the findings with someone who understands the subject.
  5. Make the final publishing decision through human editorial judgment.

This is a human-in-the-loop system. AI can widen the research surface, but responsibility for accuracy, relevance, privacy, and publication remains human.

A Practical Keyword Research Workflow

Workflow Neighborhood

1. Define the subject and purpose

Start with the website’s actual work, knowledge, audience, and geographic scope. A clear boundary prevents broad keyword data from pulling research toward irrelevant subjects.

2. Gather seed language

Collect phrases from customer questions, existing pages, Search Console, internal search, documentation, product or service terminology, and subject-matter experts.

Preserve both professional and everyday language. The difference between them may reveal where explanation is needed.

3. Expand the research surface

Use search suggestions, related questions, trend tools, keyword platforms, community discussions, and AI-assisted brainstorming to find adjacent phrasing and concepts.

4. Observe current results

Review the types of pages and search features that appear. Note mixed intent, local context, visual requirements, freshness, and the depth of the existing answers.

5. Group by shared need

Cluster queries that could be answered by the same useful page. Separate those that require a different task, audience, location, or format.

The grouping should reflect meaning rather than word similarity alone.

6. Compare the research with existing content

Before creating a new URL, determine whether an existing page should be revised, expanded, merged, or linked more clearly.

This step can reduce unnecessary duplication and keyword cannibalization, where several pages compete to address substantially the same need without a clear distinction.

7. Choose the appropriate page type

The research may point toward a service page, article, glossary definition, comparison, category, location page, checklist, video, tool, or update to existing documentation.

Not every query deserves a blog post.

8. Build a useful information structure

Organize the page around the reader’s understanding:

  • state the subject clearly;
  • answer the central question without unnecessary delay;
  • use a logical heading hierarchy;
  • define unfamiliar terms;
  • include examples where they clarify the subject;
  • connect related pages through restrained internal linking;
  • preserve nuance where the answer depends on circumstances.

9. Publish, observe, and revise

After publication, review the queries and pages that receive impressions, the questions readers continue to ask, and any changes in the subject itself. Revision may be more useful than producing another page.

Why Keyword Research Is Ongoing

Search language changes as products, regulations, interfaces, communities, and public understanding change. Search-result layouts also evolve, affecting what people see and whether they need to visit a website for more information.

Established pages may begin appearing for queries that were not part of the original research. This can reveal a useful relationship, an ambiguous section, or a need for a separate resource. Older pages may also retain outdated terminology that deserves clarification rather than silent replacement.

Ongoing research can include:

  • reviewing Search Console query and page data;
  • updating examples, standards, and dates;
  • clarifying sections that attract mismatched searches;
  • consolidating overlapping pages;
  • improving navigation and internal links;
  • preserving useful older terminology while introducing current language;
  • removing unsupported or no longer relevant material.

This is part of maintaining evergreen content. Evergreen does not mean untouched. It means the page can remain useful through responsible review and revision.

Common Keyword Research Mistakes

  • Treating estimated volume as certain demand. Tool data is directional and may group or model queries.
  • Choosing topics only because they are popular. Relevance and subject responsibility still matter.
  • Creating separate pages for minor phrase variations. Closely related searches often belong on one coherent page.
  • Ignoring the current results page. The visible mix of guides, maps, products, videos, and direct answers provides useful context.
  • Assuming every query has one intent. Many searches remain ambiguous or carry several needs.
  • Using AI-generated phrases as verified data. Plausible language is not the same as observed search behavior.
  • Optimizing wording while neglecting the answer. A page can contain the right phrase and still fail to help.
  • Publishing without reviewing existing pages. Updating a strong resource may be better than adding another URL.

Frequently Asked Questions

Do keywords still matter for website optimization?

Yes. Keywords help identify subjects, terminology, and possible intent. Their role now sits within a wider understanding of entities, context, page structure, related concepts, and usefulness. Exact repetition alone is not a reliable content strategy.

How many keywords should one page target?

There is no universal number. A page should address one coherent primary need and the related questions necessary to explain it well. If the research reveals a substantially different task, audience, location, or intent, a separate page may be appropriate.

What is the best free source for keyword research?

For an existing website, Google Search Console is often one of the most useful free sources because it reflects actual impressions and visits. Search results, autocomplete, related questions, internal site search, customer conversations, and trend data can provide additional context.

Can AI replace keyword research tools?

Not by itself. AI can assist with exploration, clustering, language variation, and outlining. Unless it has access to current and identifiable search data, it should not be treated as a reliable source for live search volume, competition, or trend claims.

Keyword Research Is a Form of Listening

Keyword research begins with words, but its deeper purpose is understanding relationships: between a question and a need, a phrase and a subject, a page and its neighbors, or a search result and the fuller explanation that may still be required.

The research does not tell us exactly what every person thinks. It gives us observations from which careful editorial decisions can be made.

When practiced well, keyword research is not a way to manufacture demand or fill a website with variations of the same page. It is a way to listen more closely, organize information more clearly, and build retrieval paths that remain useful to people over time.


Related Reading

Lucent, co-architect of Bluff AI, with continuity and structure from Stephen James Hall.