Case Study: How We Eliminated 93% Comment Spam

by Ishan · 12 comments

Update: This post has been updated. Find new stuff at bottom of the post

Everyone hates spam.

When we migrated from Blogger to WordPress, one of the first things we noticed was spam. The volume of comment spam made us understand why people love Akismet.

But we had to check regularly for false positives. So we decided to find a good companion for Akismet that would improve spam blocking. Our target was to block spam bots without affecting user experience.

We chose 2 plugins for the study: Yet Another WordPress Anti Spam Plugin (YAWASP) and Bad Behavior.

I started out with YAWASP. And within 4 hours, we got this mail:

Hi there, I tried to comment on one of your posts today and received a message saying " You are a spambot". Is this something wrong with the site or you have blocked me from Commenting on your site? Cheers, Eddie Gear

We can accept anything but blocking reader comments was no solution. So we dropped YAWASP from study.

Next, we left blog with only Akismet enabled. In 3 days, we got 60 spam comments. One spam comment was not caught. So, we got 61 comments as spam in 3 days.

For next threee days, we enabled Bad Behavior, along side Askmet and waited for results. Result was pretty good. Just 5 spam comments. Only 7% of normal spam!

graph-spam-analysisResults are pretty impressive.

We like the approach of this plugin towards blocking spam. It analyzes the header of incoming requests and looks for suspicious information. It also matched the IP address with Project Honeypot database to see if that IP is identified as suspicious. If found suspicious, this plugin does not allow the IP to visit your site. Even if the bot pretends to be something legitimate, it can block them by using their signature.

Which WordPress plugin do you use to combat spam? Tell us through comments.

Update: After questions of some readers about how it can serve others who don't care about Spam and delete it without taking a look at it for good comments, I decided to update the post.

Other Benefits:

1. Bandwidth: Since the suspicious requests are banned, bandwidth use is reduced.

2. Security: Suspicious URL doesn't mean that its a spam bot only. It can be a dangerous script too. So, this plugin also provides additional level of security.

0saves
If you enjoyed this post, please consider leaving a comment or subscribing to the RSS feed to have future articles delivered to your feed reader.
4 Reasons For Subscribing
  • Get Full Posts Delivered Directly To Your Inbox.
  • Get Exclusive Freebies For Subscribers.
  • No "Buy This, Buy That" Mails!
  • 100% Privacy. Your EMail Address Will Never Be Shared With Any Third Party.
About Writer [Blogging With Success]About Author Hi, I am a 18 year old Blogger from India. I am very passionate about blogging and also co-founder of Blogging With Success. I write about general blogging tips and WordPress. You can read other posts by me here.If you need help, feel free to contact anytime!

Leave a Comment

CommentLuv Enabled

{ 11 comments… read them below or add one }

Creative Junkie February 25, 2009 at 6:47 PM

I only use Akismet and so far, it’s been great.

It hasn’t let through any comments that actually are spam.

And of all the comments it designates as spam, I’d say that it’s 99% accurate.

((knocking on all sorts of wood around me))

Reply

Mr. I February 25, 2009 at 8:12 PM

Akismet does a pretty good job for us too. But we still have to check for false positives. Bad Behavior stops bots and saves a lot of time. Give it a try, you will surely find it useful.

Reply

Eddie Gear February 25, 2009 at 10:45 PM

Hi there,

I been using Akismet on my WordPress blog for the last three years and have found it to be very effective. Even though at times I do find some spam comments not being bloced, I does some pretty extensive filtering. I feel it’s safe as it keep you from shoving away potential readers.

Cheers.
Eddie Gear

Reply

iCan't Internet February 27, 2009 at 4:27 PM

I used to use Akismet alone, and it had about 95% accuracy. So, still had to check for false positives indeed.
Now I also installed Bad Behaviour, and it seems to be doing a pretty good job, although, I am a bit scared that it also blocks good comments…

Reply

Mr. I February 27, 2009 at 8:29 PM

Probability of blocking good comments is very low as it matches IP with Project HoneyPot DB and unless your visitors leave a lot of spam, they won’t be blocked.

Reply

Steve, show booths February 27, 2009 at 10:24 PM

hi Mr I,
Interesting study.
1. Are you saying that akismet let through 60 spam comments? I haven’t had that experience, but my blog is new and small.
2. It seems like you are saying the problem with akismet was the “false positives”. Are you able to check what bad behavior dumped to make sure is isn’t doing the same thing, or is the key that it blocks the people altogether and no one has mentioned being blocked?
3. can you run akismet and bad behavior at the same time. I like the idea of blocking spammers in the first place. Steve, show booths

Reply

Mr. I February 28, 2009 at 5:46 AM

Steve, Your answers:

1. No, it caught 60 and let through 1.
2. Well, the chances are very-very low (almost 0). Bad Behavior uses Project Honeypot’s http BL (Black List) to match visitors IP with suspicious ones. If the IP is involved in spamming many sites, it will be blocked.
3. Yes, infact we are running it. Even Bad Behavior is not 100% spam proof. 8-9 comments slip per week(and Akismet hadnles them well) but that is better than 100 spam comments per week.

Reply

Steve, show booths February 28, 2009 at 6:13 AM

hey Mr I,
i think my confusion is that I think a lot of bloggers don’t bother to go through their akismet folder and just let the stuff in it auto dump. But it sounds like you do go through it.
so in the old days with just akismet you would have a hundred to sort through, but now because you have bad behavior running also, it completely blocks about 90 of them, and you then only have about 10 to sort through.
so for people that look through the akismet spam folder, this will make it easier, but for those people that don’t look thorough it, this wouldn’t make any difference. Am I right?
~ steve, show booths

Reply

Mr. I February 28, 2009 at 7:57 AM

Well, yes. If you don’t see spam folder, you will not see the difference in comments.

But the plugin saves bandwidth also as spam bots are blocked right away and don’t get to visit blog.

Reply

ROW March 5, 2009 at 1:41 AM

I am seeing a lot of such posts around the net these days and incidentally I also wrote a similar post some time back.

Seems all bloggers are after spammers now :)

Reply

Carol June 15, 2010 at 1:33 AM

Spam! well before i started blogging i didnt know what it was, what was everyone worried about, in the last two months i have been blogging i have had enough of sapm to last me a life time i use askimet, it catches them but also good comments to. so i am going to have a try with this one, thank you for listing these plugins

Reply

{ 1 trackback }

Previous post:

Next post: