spamnix

Personal survey of anti-spam tools

by Michael Alderete on 1/7/2005 · 12 comments

In the three or four years I’ve been fighting unwanted e-mail messages with better tools than the Delete key I’ve tried almost a dozen different tools. This is a quick (ha!) survey of the ones I’ve used, and why I don’t (or do) still use them.

My very first anti-spam tool was something called Mailfilter. I used it for my personal e-mail on Mac OS X, wrote about it here, and almost immediately afterwards lost a non-spam message to an aggressive keyword match. That was the end of Mailfilter. I can’t even remotely recommend it, as it’s just not intelligent enough (strict, single expression matching), and had zero safety net.

My next attempt at a solution was a utility called SpamFire. Like Mailfilter, it is a “pre-filter,” which means it would run before my e-mail client, download my mail, and skim out the spam. Unlike Mailfilter, it actually saved the trapped messages, so if it made a mistake, I could recover the message. It had plenty of other differences from Mailfilter, which I wrote about previously, and which made it so useful that it became the first anti-spam tool I paid for. But in the end I switched to a different tool because SpamFire was separate from my e-mail client, and that made it cumbersome to use.

Read the rest of this entry (2,185 words) »

{ Comments on this entry are closed }

Eudora 6 with SpamWatch

by Michael Alderete on 9/10/2003

Note: Although still terrific tools, and in the case of SpamWatch free and built-in, I no longer use either Spamnix or Eudora’s SpamWatch, having found more effective tools. See my Personal Survey of Anti-Spam Tools for more details and recommendations.

QUALCOMM’s Eudora has been my e-mail client of choice for nearly 10 years, and last week a major new version shipped, Eudora 6. I’m usually of the “fools rush in” school of thought with regards to software updates, so I waited to see what people were saying about the upgrade (MacInTouch is a great resource for these “reader reports”).

But it’s been a week, and nary a peep. And with the amount of spam I receive continuing to grow, I really wanted to try the new SpamWatch feature. So, after doing multiple backups, I upgraded myself over the weekend.

My primary concern was whether and how my other anti-spam tool, Spamnix, would work with the new version, especially with the new SpamWatch feature. Unlike a lot of other third-party anti-spam tools, Spamnix is a Eudora plug-in, and so runs “in-process” (i.e., inside) with Eudora. [Update: SpamSieve 2 just shipped, and now also includes a Eudora plug-in. Very cool!] This makes it more efficient, but also (in theory) more susceptible to compatibility issues.

I’m happy, nay, thrilled to report that Spamnix works fine with Eudora 6 (for Mac OS X), and that Spamnix + SpamWatch is more effective than either tool alone.

I love the way that SpamWatch and Spamnix tag-team to combat spam. SpamWatch gets first crack, before other filters or plug-ins look at the message, and if the message’s score is over the spam threshold, it will be filtered into the Junk mailbox, with no further processing. (Qualcomm designed SpamWatch to run first, and you can’t change that.)

If a message doesn’t get caught by SpamWatch, then Spamnix takes a look at it, and if Spamnix decides it’s spam, it’ll go into Spamnix’s own spam folder (on my system named “ Spamnix”; note the initial space to influence sort order). These messages, nicely separated and usually all spam, are prime candidates for further training for SpamWatch.

I receive hundreds of spam messages a day, but after two tiers of spam filtering very little spam gets to my Inbox — so far only a couple a day, with very little training of SpamWatch yet. The few that have made it through have gone straight back to SpamWatch for training. :-)

What is fascinating about this process is the progress that SpamWatch has made, in less than 4 days of processing my mail. The first time I downloaded a sizeable batch of e-mail (more than 50 messages), most of the spam got through SpamWatch, and caught by Spamnix. After training SpamWatch with those messages, and then downloading another big batch a few hours later, the ratio went the other way: SpamWatch was now catching most spam before Spamnix got a chance to look at it.

I’m still glad to have both layers. Spamnix was extremely effective at catching my spam, prior to SpamWatch being added to the mix, and it’s still catching spam that SpamWatch is missing. So overall, I am doing better in my personal war against spam (though it’s important to remember that this is defensive action only).

About the only downside of introducing SpamWatch as a new layer of anti-spam defense is that right now it’s relatively untrained, and generating a larger number of false positives (non-spams filed in the Junk folder) than I’m used to. SpamWatch ships “pre-trained”, meaning it already has a database of spam words to run against, but this list is generic, not customized to my own e-mail traffic. So it’s not that surprising that some of Rochelle’s e-mails are getting tagged as spam. My previous experience with Bayesian filtering is that it rapidly adjusts as you correct its mistakes, so I’m confident the false positives will go down in a week or so.

At any rate, I’m quite happy with the new version, especially since I was still in my 12 month support period from my last upgrade, so version 6 was free. Recommended, even if you have to pay for it.

{ Comments on this entry are closed }

Spamnix, my new anti-spam tool

by Michael Alderete on 5/2/2003

Note: Although it remains an excellent tool, I no longer recommend Spamnix, having found more effective tools while Spamnix 3 was in development, and Spamnix 1.2 was not enough. See my Personal Survey of Anti-Spam Tools for more details and recommendations.

Yesterday a new anti-spam tool shipped, Spamnix, which functions as a plug-in to Eudora, on either Mac OS X or Windows. After installing it and using it to check e-mail a couple times, I’ve decided to abandon my old tool, Spamfire.

The reason is pretty simple. Spamfire is fairly effective, but its design means my e-mail is processed twice. First Spamfire downloads and scans my messages, deleting those it considers spam. Then Eudora downloads whatever Spamfire lets through. Spamfire integrates with an e-mail client via the POP3 / SMTP mail server, with AppleScripts to trigger the client’s e-mail check. Overall this works fine, but because Spamfire is a separate application the whole process is slow and cumbersome. It would be better if Spamfire itself was not as slow as molasses, but, well, it is as slow as molasses.

While it’s true that Spamnix can only be used with Eudora, I’ve been using Eudora for so many years the possibility of switching to something else is near zero. So my only consideration is how well it integrates.

Spamnix does that beautifully. My e-mail downloads as normal, but messages are scanned during the download process. Messages which exceed the spam threshold are filtered to a separate mailbox, for later review. The rest go to my Inbox as normal. No two-stage mail downloading and processing, no switching to a separate application to review the caught spam for false positives, no hassle rescuing the few false positives that do turn up.

One of the other selling points for me (and here’s where you can tell I’m a nerd) is that Spamnix is based on SpamAssassin, the extremely well-regarded Open Source spam tagging tool written in Perl. While Spamnix appears to currently be using only the text scanning part of SpamAssassin right now, I am very hopeful and excited that Spamnix may soon support the Bayesian filtering and Vipul’s Razor collaborative spam tracking capabilities of the latest SpamAssassin.

At any rate, if you’re a Eudora user on either Mac OS X or Windows, and it’s worth $30 to you to block most of the spam you’re currently receiving, you should give Spamnix a try. The software is downloadable for free, and functions for 30 days before requiring a license key for further use.

But if you’re like me (I get well over 200 spams every day), it won’t take 30 days to convince you that $30 is a small price to pay. I decided in less than 24 hours!

{ Comments on this entry are closed }