1. Semrush
  2. Blog
  3. Product
  4. Semrush

Update! AI-Driven Insights to Transform Keyword Research

Author:Brenna Kelly

7 min read

May 21, 2024

Keyword research is the foundation of search engine optimization (SEO), and Semrush just elevated it to a whole new level.

Thanks to artificial intelligence (AI), the SEO landscape has quickly evolved, becoming more dynamic and intuitive almost overnight.

At Semrush, we're leading this revolution, weaving AI into our tools to streamline your workflow and roll out some truly groundbreaking features.

With these updates, tasks that once took days now take minutes, making your approach to SEO both smarter and more strategic.

Ready to dive in?

Let’s show you what’s new!

What’s New: Leveraging AI for Smarter Keyword Research in Semrush

Semrush is already known for being the most robust keyword database on the market. Now, we’re upgrading it.

This latest AI-powered update is once again transforming the keyword research process, giving you even more information to make better decisions.

Here's what you can do now:

Semrush Keyword Overview for 'how to create a website' showing volume, difficulty, authority, intent, and trends.

Semrush Keyword Strategy Builder showing topical overview map for 'how to create a website' keyword and related topics.

What’s the magic behind these enhancements?

A sophisticated algorithm powered by large language models (LLMs).

Combining Semrush data and AI technology, this algorithm meticulously assesses the thematic relevance between a target topic and a domain’s core topics.

Analyze Your Personal Keyword Difficulty

with Keyword Overview

Check it Out

In other words, our system uses AI to analyze how closely your domain's main themes align with any potential topics you want to cover on your site.

Here’s a quick rundown of the tools where you’ll see major updates:

  1. Keyword Overview: This is your first stop for a snapshot of keyword performance and potential, now with a personalized feel.
  2. Keyword Magic Tool: Your keyword wizard is now putting out the best keywords with more AI-driven insights specific to your website.
  3. Keyword Strategy Builder (formerly Keyword Manager): Completely redesigned, this tool is your strategy headquarters, helping you craft and implement your keyword strategy through topics and pages.

Excited to see how these updates can revolutionize your strategy?

Let’s dive deeper!

Keyword Overview: More Personal Insights for Your Site

The Keyword Overview tool is your go-to for a quick snapshot of how keywords may perform in your SEO strategy. It analyzes everything from current rankings to potential improvements and competitive standings in the search engine results pages (SERPs).

What’s changed and why?

We’ve transformed the Keyword Overview tool to give you deeper, more actionable insights. By adding a layer of personalization and analytical precision, you can better align with your specific SEO goals.

ZfPo69clwrf5rm6DNStu39CjAGyvJbGzrgXmaJI-p_geaR93aaFIES8Gp2bgxCZ6DpC5iXmB73iRnn3aO2T_5UcnfNf0aIFWMkSLXs5oHVe2svgI0amIu43GCF6OvtgRC2SqhjcboxjaMK_2ApIG_lU

6T9OSxUKEck-H-wIzb5YufUCj9lKS76hOwSwYcc_VXnuV2zyXMkcZhBAoUYrNv3yEtGLqaiE1U3GAh1IpaCZINe1RGzPlKX2k95EuEaeON-1sO-54EKGk8aR4YvoEkq7upGRmtiHnj_kHWtw0F5xR-4

These new features offer you more contextual competitive analysis for specific keywords. This analysis is important for spotting both opportunities and potential challenges, allowing you to refine your SEO strategy to better target areas where you can gain a competitive edge.

Keyword Magic Tool: Check Personal Difficulty Scores for Large Lists of Keywords

The Keyword Magic Tool has long been a favorite for its ability to unearth extensive keyword opportunities. In its latest update, we've made a subtle yet powerful enhancement that significantly boosts its utility.

What’s Changed and Why?

We've enhanced the Keyword Magic tool by adding the Personal Keyword Difficulty (PKD) metric alongside the traditional Keyword Difficulty (KD). This change allows for a more customized approach to keyword evaluation, catering specifically to your domain.

How It’s Better

The Keyword Magic tool now includes dual difficulty metrics: Personal Keyword Difficulty (PKD) and traditional Keyword Difficulty (KD).

This update gives you a clear view of how hard it might be to rank for specific keywords generally and for your particular domain. It helps you quickly spot keywords that are realistically within your reach, streamlining your strategy and decision-making process.

4a7cmS_cb1FLm0E1am5zGI3jOtdNNr-QNSvaEsOOsTZt1tSCVUjuLFBYiZHPCpZcJNH_cGSs40kjB7q1DpWdiZDpJG75m_WXrmUEmCm98oH98yr6UNJRQunfE-oTUUH32VqQCSmiHrGqHV5zRcQOp0g

With these updates, the Keyword Magic tool isn’t just about finding keywords; it’s about finding the right keywords for your situation.

Analyze Personal Keyword Difficulty

with the Keyword Magic Tool

Try for Free

With these personally analyzed keywords, you can take the next step to shape a keyword strategy in the new Keyword Strategy Builder

Keyword Strategy Builder (formerly Keyword Manager): Build a Comprehensive Plan

The Keyword Strategy Builder is Semrush’s revamped Keyword Manager tool that’s all about making your SEO keyword strategy as fast and effective as possible.

What’s Changed and Why?

We've upgraded the old Keyword Manager to do more than manage keywords through clusters and mind maps. Now, Keyword Strategy Builder helps you visualize and build an entire SEO content strategy from the ground up using Topics and Pages. What was once the time-consuming task of creating a keyword strategy is now fully automated with AI.

When you enter your seed keywords, it doesn’t just spit back a list; it creates a clear map of pillar pages and subpages, guiding you on what pages to create for your website and what keywords to use.

How It’s Better

Here's how this tool is changing the game:

With the new Keyword Strategy Builder, you can craft a well-thought-out strategy that will bring clarity and direction to your SEO efforts.

Create Your Keyword Strategy in Minutes

with the Keyword Strategy Builder

Try for Free

Personalized Keyword Research Use Case: Promoting an Online Platform

Imagine you run a digital marketing agency and are tasked with promoting Wix.com as a leading platform for building online stores.

You start by entering "how to make an online shop" into the updated Keyword Magic Tool. Then, you enter the domain name in the AI-powered filter bar to focus the report on finding the best keyword opportunities for Wix.com.

The tool quickly provides a breakdown of related keywords, highlighting which terms Wix.com can rank for effectively, using the new Personal Keyword Difficulty (PKD).

Z5baWGZ2c7uZ8u5iVNl73w0sBA6bPtiNNQikP51RFR4Em5kb3zvVeWPIbDCiNlQMj1kqVo6Id9VvnnckaIQHscvjdfRQcDTnQnEDcOVnS2wD8oucYr0EQT_mDUqlmO-H-vcpRd1CozPubA87TYEX-sw

While keywords like “online shopping website” are moderately competitive, they are still highly relevant and obtainable for promoting Wix.com.

Interestingly, it also reveals that Wix.com ranks first for "how to create a website," a top-ranked keyword in this niche, reinforcing Wix.com’s authority on the topic of website creation.

Using the Keyword Overview tool, you then focus on a single keyword from these suggestions, examining potential SERP positions and the competitive landscape. This tool provides detailed insights into how the keyword fits into the broader clusters around your seed topic, enabling more strategic planning.

LOk3EFOefw9wuxAQEhUHAQ2Y3nEhgG7_8Eda0V_x8DvTJ6YAeE-CCA54_hggoL-M73a7FIbwoI4FCDQ25eTV2RWzfdNeqR1ZEX5mE1tnKYa9eepAa024O6NX4CPfap8YZJufGsv4njxnrNKVE2C9Tq0

Next, you can turn to the Keyword Strategy Builder to structure these keywords into a content plan.

kPppLqe7nfXax2Z0m4YzbOkIhtWgDyjJuREU7OeFjQfU_utcFdBwh_qV94olv7_7xMhNMfUJIbIPGGiaXs5yOkGEUWcgyrEuLhyH8hTv6_3K-lq2UDsGZ53vX6ex_D2a_7z8CthHEUlS1qgbyFbuq0g

The tool suggests drafting pillar pages such as "Best Online Shopping Websites," then outlining several subpages and their target keywords.

pOl_E-CpcBqM_swZQ9cPbe56LUmCi5Jelx9aHXvTtdsBcPbG1VTe3CakwOXHZWM2MtBDKh3bfgBRxKC9lp5AteXJBq2IF2GkoyY5qGP2ba3omPA00f3nI0yZo6Z9XIlyInmfjZIhhh9T9q5SSo6HWbU

Each page and subpage is linked to specific keywords that can be targeted together with a single page to promote the website effectively. With each page, it’s easy to see the total volume and average difficulty of the keywords.

This data-driven strategy ensures that you focus on the most achievable keywords, positioning Wix.com for increased SEO success and traffic growth.

How Are These New Metrics Calculated?

Semrush's Personal Keyword Difficulty is calculated using Large Language Models (LLMs) to analyze any domain's relevance to any specific keyword.

It’s a complex process, but the basic way it works is that we’ve combined Semrush data with LLMs to develop a thematic vector map of every topic and how topics are related to each other. This allows us to measure the “distance” between any two topics.

When determining a domain's main topics and authority, we can measure the distance between that domain and any other topic on the map.

This measurement allows us to determine Topical Authority— the closer the thematic match, the lower the PKD%, showing the keyword is a good fit for your site.

This method ensures that our keyword suggestions are finely tuned to your site’s current standing and potential in search rankings.

Looking Ahead to AI-Backed Keyword Research

Semrush's AI enhancements revolutionize keyword research by tailoring it to your domain's unique strengths with features like PKD and Topical Authority.

These tools are engineered to boost your SEO efficiency, helping you strategically climb search rankings.

And the best part?

These features are included in any paid Semrush subscription.

Ready to elevate your SEO game?

Create Your Keyword Strategy in Minutes

with the Keyword Strategy Builder

Try for Free

Share

Author Photo

Brenna Kelly

Brenna is a Content Writer for Semrush focusing on educational marketing content that empowers readers to unlock and maximize their SEO potential.

Try Semrush
Everything you need to win AI visibility and drive SEO success
Start Free Trial
Unlimited access for 7 days
Boost your digital marketing efforts
Get free trial