by Barbara Coelho | July 10, 2020 | 0 Comments
What SERP features does my competitor have that I don’t?
There are various tools we can use to analyze this, such as SEMrush reports to view each feature at a time, but what if we have to repeat this process every month, or say for multiple competitors?
Pull data programmatically from SEMrush
Slice and dice the data
Export the results to a CSV for further analysis
But why would you want to learn that yourself? Why should SEO’s learn to code other than HTML?
Do more exciting work
Greater job security
What is the minimum Python knowledge you need?
Typically, Hamlet would recommend tutorials and courses such as Coursera or DataCamp. However, from the feedback he’s received, he has learned that these resources are more designed for engineers or someone looking to go into a programming career. For marketers, that’s not usually the case.
In this article, Hamlet focuses on a familiar task for marketers, using spreadsheets. This foundation in Google Sheets can be easily adapted with Python. Hamlet’s approach was to use code from a Python notebook written by John Mueller of Google, which determines what type of content performs better on mobile vs. desktop. Line-by-line, Hamlet walks through the code in detail to explain how everything works, while taking the opportunity to introduce the building blocks of Python.
SERP features 101
Using the Position Tracking tool in SEMrush, you can see a list of SERP features, such as featured snippets, local packs, reviews, sitelinks, etc. that create a useful experience for end-users when completing a search.
Mastering and keeping track of which features are used by your competitors is crucial.
In this example, we can compare the SERP features of AutoZone and Advanced Auto Parts.
After comparing the two reports, we can see that AutoZone has 3,000 more featured snippets, 162,000 more reviews, 34,000 more sitelinks, and performs better for most features except for top stories where they are both tied.
This type of comparison is not a standard report.
You may be able to find capabilities and workflows that you don’t have immediately and turn it into a competitive advantage. If you can figure out a process that no one else knows and automate it with programming, you can create a very valuable asset.
How can we repeat this valuable comparison over time or across different competitors?
Hamlet created a Colab notebook that takes this workflow and puts it all together. Using previous code that he has written, Hamlet makes small modifications until it can successfully perform what he wants it to do.
Here’s an example.
In the notebook, the code is hidden and replaced by a form to make it easier and less complicated for users.
After you input the information and press run, it will go line-by-line through each step to reach the output.
The output is a CSV file that was downloaded to the computer.
The CSV files can then be imported into Google Sheets. Below are the sheets for Advanced Auto Parts and AutoZone.
This workflow can be completed for any number of domains and can even accept a list of domains as well.
The code behind the scenes
Now let’s analyze the code a bit to see how we accomplished this.
You can learn more about the columns from the API documentation.
When we tested the changes made, we found something interesting. The SERP features we get back from the API are not names, but instead numbers that identify each feature.
This code can be adapted for this specific use case. All we have to do is copy a selector from the page that allows us to address an element on it.
Here we have to modify the selector so that it captures the whole column instead of just the single element.
While the page is open, copy and paste the code into the Developers Tools Console and then call the function we created.
As we continue to improve the RankSense app for Cloudflare, we are always working to make the app more intuitive and easy to use. I'm pleased to share that we have made significant changes to our SEO rules interface in the settings tab of our app. It is now easier to publish multiple rules sheets and to see which changes have not yet been published to production.
For the following Ranksense Webinar, we were joined by Antoine Eripret, who works at Liligo as an SEO lead. Liligo.com is a travel search engine which instantly searches all available flight, bus and train prices on an exhaustive number of travel sites such as online travel agencies, major and low-cost airlines and tour-operators. In this...
In this RankSense Webinar, we were joined by Charly Wargnier who is a member of the Streamlit Creators Program. Streamlit is a Python open-source library used to make data apps quickly. Charly takes us on his Python journey from starting out in digital marketing with image editing software like Photoshop all the way to working...