Take Responsibility for Spam Comments on your Blogs

by Dave Atkins Email Tweet This

Comment spammers are relentless. I have not posted to DaveWrites recently, but I spend time every day just deleting the comments that make it through Akismet and other spam filters.

I believe the spam-filtering service Akismet defeats most automated spam, but I suspect there is a class of low-wage human-powered spamming going on based on some internet marketer's idea of link building.

The reason some people post short comments like "Nice job. Keep up good work." or "Good information, thanks for the post!" is because the comment form gives them the opportunity to link to another web site. That link becomes a part of my blog because it is published with the comment. This a legitmate way to build connections between bloggers. When I comment on someone else's blog that has much more traffic than mine, I hope that people will check out my site to see what else I'm writing.

But the reason spammers comment on blogs is to improve search engine rankings. Links from blogs to web sites increase the ranking of those sites, because search engines believe sites with many inbound links are more authoritative and creditable. So a business might pay a marketing firm to go out and comment on all the blogs they can find. Then, they report back to the company: "we've generated 100 inbound links for you!"

The sad thing about such an approach--apart from my annoyance at these bozos--is that it is a fraudulent scam on the companies who are paying the "internet marketing firm." Read Google's opinion of comment spam on their blog. The message from Google is clear:

  • it does not work; they will detect it and ignore it
  • it can hurt you; they will penalize sites that use it

My simplistic description of how inbound links affect search engine ranking is NOT very accurate. Google has spent the last decade refining their algorithms for ranking sites. So it is not as simple as getting some links.

None of this is new. I've been deleting comments like this for years, and I try to avoid even thinking about it because it is a distraction from working on something that might actually generate some revenue for my business. But I think all bloggers should review Google's recommendations on how to fight comment spam just to make sure they are not just hitting the snooze button every day for years. Let's walk through Google's recommendations with some real world practical commentary...

Google RecommendationNotes
Disallow anonymous posting Not practical. I could require people to register before they are allowed to comment, but this creates a participation hoop that most legitimate participants are not going to jump through. I think it can actually increase your problems because it invites "registration spam"--Another blog of mine had no comments, but hundreds of users created by robots who hammered away at the site until they broke the CAPTCHA (see below) and Akismet defenses.
Use CAPTCHAs and other methods to prevent automated comment spamming. CAPTCHA stands for Completely Automated Public Turing test to tell Computers and Humans Apart. Right. It's those boxes with distorted words or letters you have to type before your comment will be accepted. These plugins vary widely in their usability and can be terribly frustrating for users unless you tweak them a bit. For the Drupal platform, I used the standard CAPTCHA module but I uploaded a nice sans-serif font and tweaked the configuration to make it very large and not as distorted as the default. More Drupal resources can be found in the AntiSpam project. I also run Akismet. For Wordpress, the Akismet plugin is easy to set up. This blog (DaveWrites) is running on b2evolution (for now) and has their Akismet plugin only...their CAPTCHA was very ugly and problematic the last time I checked.

Bottom line: do research for your blogging platform and tweak it to make it work to minimize legitimate user's inconvenience.
Turn on comment moderation. Most blogs and CMS products can be configured with a spam threshold so most comments do not require moderation, but the suspicious ones do. That's hard to get right though...these annoying "great job" comments don't look like spam because, well, maybe the person just wanted to say "great job." The other downside to comment moderation is timliness. You cannot have a real-time conversation if you have to approve every single comment.
Use the "nofollow" attribute for links in the comment field. This will prevent search engine robots from following the link. So it will make your site less effective as a referrer. Maybe the spammers will evaluate your site ahead of time and realize it is no worth their trouble. But it also means your site will not be helping legitimate commentors improve their ranking.
Disallow hyperlinks in comments. Most CMS and blog platforms have settings to flag comments for moderation if they contain hyperlinks. Try that first before you shut down legitimate posters.
Block comment pages using robots.txt or meta tags. This is like the "nofollow" approach--it will help make your site less effective at being "used" but it doesn't stop the actual spam comment itself.

I think the CAPTCHA and Akismet approaches are the most worthwhile to pursue. Many of us set up our sites years ago and it's worth a review of the technologies available to update our sites to make sure we are minimizing the amount of predictible spam, then, just delete those bogus comments that slip through.

This post turned into more than a few minutes diversion...feel free to submit your own comments and links to practical ways to fight spam. I'm sure this post will itself create a moderation challenge for me. :)

1 comment

Comment from: Tim Mathews [Visitor] Email · http://www.timmathews.com
Great post. I am using similar techniques on my blog and have reduced spam by 100%. It is a bit of a hinderance for some users, though.
So, it is win and lose.
02/14/10 @ 16:30

Leave a comment


Your email address will not be revealed on this site.

Your URL will be displayed.
(Line breaks become <br />)
(Name, email & website)
(Allow users to contact you through a message form (your email will not be revealed.)