Yoast SEO was responsible for 75% drop in our traffic (and how we fixed)


You would have definitely come across Yoast SEO plugin if you own a blog. Yoast SEO is a widely used plugin in WordPress community. They have a massive user base and have been downloaded more than 1 million times.

Yoast SEO plugin has been used by many big players in the industry like SearchEngineLand, Elegant themes, W3Layouts etc. which shows they have a good reputation in the industry.

So even we were using Yoast SEO plugin to optimize our websites and make it as search engine-friendly as possible. They had a wide range of features which compelled us to use the plugin in all our websites

  • Yoast SEO plugin allows us to add meta title and description for each post and based on the content added, it analyzes your content for the target keyword.
  • You can easily hide or show your preferred content to search engines. Suppose you want to create a landing page and you don’t want that to appear in search results then you can easily hide the page directly from Yoast plugin.
  • Editing your robots and .htaccess is made easy through Yoast plugin. Earlier these files could be accessed only through FTP as they were available in the root directory.
  • Redirect managers to easily set up redirects in your site.

We got hit by Google Penalty and traffic dropped by 75%  

Just when we thought everything was going well, we were in for a big shock when we got hit by Google penalty in the month of March that dropped the traffic of one of our main websites by 75% overnight. To give you the precise numbers the average daily traffic fell from 7000 to 1000 which was huge and the worst part was we had no clue on what exactly happened

During our analysis, we found that it was caused by a wrong setting in Yoast

We spoke to many SEO experts on this issue but no one had any answers which was really frustrating. We later found that, just like us, lots of people saw a drop in their traffic from March 7th to March 20th.

We tried the following things to fix this unknown problem

  1. Removed all the Ads from all the pages.
  2. Removed all the plugins which were not absolutely necessary.
  3. Removed most of the affiliate links (except some links in the review posts).
  4. Fixed 404 errors with proper 301 redirect links.
  5. Updated Robot.txt file.
  6. Enabled AMP on the website.
  7. Un-indexed pages which were not necessary.
  8. Fixed Yoast SEO settings.

Google webmasters should be the first thing that you need to look into when there is a drop in your traffic.

To our surprise when we looked into Google Webmaster, we found that the number of index pages increased to 500+ when we had less than 100 pages on our website.

When we analyzed this issue further, we found out that due to a wrong setting in the Yoast Plugin some of the images were getting indexed as pages.

As a result, lots of images on our website were indexed on Google as separate pages, attracting the Google penalty and ultimately affecting our SEO.

How did we recover our traffic?

When we saw that there were more than 500 indexed pages, we changed our Yoast media and attachment URL setting to YES

But as tons of images were already indexed as pages on Google, we had to submit URL removal manually for all the pages.

You can find that setting under Google Webmaster -> Google Index -> Remove URL

We felt this step was the most effective solution as it helped us recover traffic when we saw the indexed page numbers reduce to 200 from 500. However, we still couldn’t reduce the indexed page number to the original value since actual de-indexing of page takes time and depends on Google

Surprised to know that the wrong setting was due to a bug in Yoast SEO plugin

To give you a brief background on this issue, let’s understand how WordPress works with images. When you upload any image in WordPress, it automatically creates a separate page for every image that you upload on your website.

Since these pages don’t add any value to the user they are considered to be bad for SEO. Yoast SEO plugin has a very cool feature where it lets you redirect these image pages to the post page.

But when you would have updated your Yoast Plugin to Yoast 7.0/Yoast 7.0.2, the settings for redirecting the image pages got affected due to the bug in the plugin. As a result, “Media and attachment url” setting was set to NO.

Now, lot of your image pages were indexed in Google as separate pages which is really bad for your SEO.

Being such a popular and widely used SEO plugin, it was highly irresponsible from Yoast to let this bug slip through their updated version. We expect them to have a better testing process to make sure that the updates don’t have any negative impact on SEO as so many people get affected in terms of their rankings and monetization.

This is what one Yoast user had to say about this issue and how the drop in traffic affected her business

What did Yoast founder have to say about this bug

Yoast accepted their bug and its founder offered a public apology to all the users who were affected by the rankings. This is what Joost De Valk had to say about the issue in his blog post related to yoast SEO bug

What to do if you got hit by the same issue

If you are someone who is affected by this issue then we would advise you to change your Yoast media and attachment URL setting to YES immediately.

Log in to your WordPress website, on the left side of the menu select YOAST SEO icon. From the sub menu items displayed select “Search Appearance”

You will be taken to the dashboard. Click on Media tab and make sure to set your Media & Attachment URLs to “Yes” as shown below. 

The solution provided by Yoast SEO Plugin

Yoast plugin through their blog post have recommend us to first change Media & Attachment URLs to YES which we already discussed in the above section. But the problem with this method is it could take months for Google to crawl those pages and remove those URLs.

Because of this reason you need to download another plugin provided by Yoast known as “Yoast SEO Search Index Purge” and activate the plugin in order to repair the bug completely

Let’s look at what this plugin does….

Yoast SEO Search Index Purge Plugin makes all the attachment URLs or the image pages in your website return to 410 status code, helping you remove these pages out of search results as soon as possible.

Next, XML sitemap will be created containing all the attachment URLs (with recent post modified date). This makes Google crawl all these attachment URLs again.

Yoast believes that after six months the attachment URLs or image pages would be removed from your search results page

Then, you can remove Yoast SEO Search Index Purge Plugin and just keep the redirect setting of the attachment URLs set to “Yes”.

The installation process is very simple. You just need to download and activate the Yoast SEO Search Index Purge  plugin in your WordPress site.

Once the plugin is activated just navigate to Yoast SEO > Search Appearances and verify the media tab displayed. Make sure the following text “These settings are being overridden by the Search Index Purge Plugin” is displayed in Media Tab

Lessons learned from this experience

As we get most of the traffic from SEO, we have decided to be extra careful and monitor our site for any on-page SEO issues after updating our important plugins. Please share your experience in the comments section if you have faced this issue. We would love to know your thoughts

Author: Uddipta Ghosh

Growing https://pluginhackers.com by curating best plugins and themes for WordPress. I collaborate with other bloggers and makers of WordPress tools to help the community.Feel free to say me “Hi” on twitter and I will definitely get back to you.

Uddipta Ghosh

Growing https://pluginhackers.com by curating best plugins and themes for WordPress. I collaborate with other bloggers and makers of WordPress tools to help the community.Feel free to say me "Hi" on twitter and I will definitely get back to you.

Click Here to Leave a Comment Below 46 comments
Rahul das - July 11, 2018

Had same issue and successfully recovered by correcting the setting to yes. Nice article will help many…..

    Uddipta Ghosh - October 22, 2018

    Hi Rahul,Thanks a lot for the feedback.Glad that it helped you.

AVINASH BARAK - August 16, 2018

My website was also hit. I have installed purge plugin. I have some doubts.
1. Should I submit my sitemap to google again??
2. Should I manually remove some attachment pages in google search console that are still showing??

    Danial - August 27, 2018

    I have the same question. As yoast mentioned it takes 6 month for google to remove your indexed pages by the plugin. Is there any way we can make the process faster?

      Uddipta Ghosh - October 23, 2018

      Please follow our process,we have removed most of the indexed pages from google within 2 months.

    Uddipta Ghosh - October 23, 2018

    Hey,sorry to comment you so late.Did your issues got resolved.Let me know if any help is still needed.

      Tanveer - November 25, 2018

      i have same problem . i install Yoast SEO Search Index Purge plugin after few days i saw an error
      Submitted URL not found (404) in webmaster tool .all url errors were with images name.i checked all these error url in google no url was index in google ..thats means all the attachments are removed ? will they index again ?

Natalia - October 17, 2018

I am in the process of manually removing the attachment URLs on Google Search Console – once it’s done can I get rid of the Search Index Purge plugin?

    Uddipta Ghosh - October 23, 2018

    Hi Natalia,please follow our process.You don’t need to install the plugin at the first place.

Situs Bola Terbaik - October 25, 2018

What i don’t understood is actually how you’re no longer actually a lot more smartly-preferred than you might be now.
You are so intelligent. You already know thus considerably relating to this subject, made me individually consider it
from so many numerous angles. Its like women and men don’t seem to be fascinated unless it’s one thing to accomplish with Woman gaga!

Your personal stuffs nice. Always maintain it up!

visit here - October 27, 2018

Deference to website author, some superb information.

click here - October 28, 2018

It’s a pity you don’t have a donate button! I’d without a
doubt donate to this excellent blog! I suppose for now i’ll settle for
book-marking and adding your RSS feed to my Google account.
I look forward to brand new updates and will share this blog with my Facebook group.
Chat soon!

le burgonde - October 30, 2018

I was in that case and fixed all the issues. But now, i’m installing others seo plugins (some ones are better than yoast) on the new websites and playing with diversity to minimize effects of a bug like this one.

click - October 31, 2018

Thanks for finally writing about >Yoast SEO was responsible for 75%
drop in our traffic (and how we fixed) – PluginHackers <Loved it!

8 Best SEO Plugins for Wordpress in 2018 - The Niche Blogger - October 31, 2018

[…] In case your site has been affected checkout the solution provided by Yoast SEO Plugin […]

click - November 6, 2018

Hi there to every , for the reason that I am in fact eager of reading this weblog’s post to be updated on a regular basis.
It consists of pleasant data.

click - November 8, 2018

I got what you mean,saved to favorites, very nice site.

click here - November 14, 2018

What’s up to every , for the reason that I am genuinely keen of reading
this weblog’s post to be updated on a regular basis.
It carries nice stuff.

click here - November 14, 2018

I got what you intend,saved to my bookmarks, very decent internet site.

click here - November 14, 2018

I got what you mean,saved to my bookmarks, very nice site.

visit here - November 17, 2018

Great – I should definitely pronounce, impressed with your website.
I had no trouble navigating through all the tabs as well as
related information ended up being truly simple to do to
access. I recently found what I hoped for before you know it in the least.
Quite unusual. Is likely to appreciate it for those who
add forums or something, web site theme . a tones way for your client to
communicate. Excellent task.

click here - November 17, 2018

It’s really a great and useful piece of information. I am
satisfied that you just shared this useful information with us.
Please stay us informed like this. Thank you for sharing.

click here - November 17, 2018

Actually when someone doesn’t understand then its up to other visitors that they will assist, so here
it occurs.

Tim - November 21, 2018

My primary site was hit hard by the Yoast bug. My analytics look very similar to yours. However, I didn’t implement the Yoast SEO Purge Plugin until far too late, so I am still waiting for Google to drop all of the 404’s from their index.

Two things:

One – Yoast’s response to this issue was pathetic. I communicated with their support via email and they tried to suggest that any issues I was experiencing were likely already there before this bug. They f’ed my traffic and caused a 90%+ drop in revenue.

Two – Do you think requesting the the manual URL removal is FASTER, SLOWER, or the SAME when it comes to getting the 404’s purged from Google’s index? I ask because I installed Yoast’s search purge plugin, but it has already been two months and almost all of the 404’s are still showing up.

Also, you have a lot of spam comments in this thread.

    Jordan - December 19, 2018

    Hi Tim,

    Same here. Hit hard and just now finding out about this Yoast bug. Because of their mess up, I’m hesitant to install that “fix” plugin?? How have your results been so far? Can’t I just use Search Console’s manual remove url tool to remove all the indexed attachment pages?

visit here - December 4, 2018

Nice post. I learn something totally new and challenging
on websites I stumbleupon everyday. It’s always helpful to read content from other writers and practice something from other web sites.

click here - December 20, 2018

Hello.This article was really fascinating, especially since I was
looking for thoughts on this subject last Wednesday.

click here - December 21, 2018

Do you mind if I quote a few of your articles as long as I provide credit and sources back
to your site? My blog site is in the very same area of interest as yours and my users would certainly benefit
from some of the information you present here. Please let me know
if this okay with you. Thanks a lot!

Trendz - February 4, 2019

Did anyone recovered from this traggedy and by the way I think yoast did it on purpose to come up with their new purge plugin to test it, and if it works imagine how much they could make from it ?

Kimberly McCollister - February 4, 2019

Our traffic and sales also were severely damaged by this bug. It has been tragic for our small business that helps children. Would love the opportunity to publish their inexcusable response here, if possible. Reach out to me if you are interested.


Leave a Reply: