Anti-Spam

Corpus reset

by Michael Alderete on 4/26/2005 · 0 comments

SpamSieve, by far the best anti-spam email tool I’ve used, was updated to version 2.3 yesterday. The biggest change listed was increased accuracy, due to improvements in the tokenizers and parsers. John Gruber reported that the beta versions were running at 99.9% accuracy for him, which is several tenths of a percent above where I’d peaked.

When you get more than one thousand spams a week, you live for improvements of a couple of tenths of a percent. I of course upgraded immediately.

Read the rest of this entry (281 words) »

{ 0 comments }

Anti-virus for Mozilla Thunderbird?

by Michael Alderete on 3/15/2005 · 19 comments

For many years, Rochelle used Netscape Communicator for her email. About a year and a half ago, I switched her to Mozilla Thunderbird, which is the code and user-interface successor to Communicator. For the most part it works very well, but it has one astonishing omission: its anti-virus capabilities are terrible.

This is all the more remarkable given their tagline (“Reclaim Your Inbox”), and the second sentence of their Why Use Thunderbird blurb: “We designed Thunderbird to prevent viruses and to stop junk mail so you can get back to reading your mail.” Thunderbird is positioned as the more user-centric, safer alternative to Microsoft Outlook.

Read the rest of this entry (579 words) »

{ Comments on this entry are closed }

Comment form fakeout

by Michael Alderete on 3/13/2005 · 4 comments

When I converted this site to WordPress, I decided to turn on commenting, and see what happened. I have gotten a fair number of really good comments, and from people I didn’t know, which was cool. I also got a ton of comment spam (most of which never made it online). Not cool.

So I did a few things about it.

Read the rest of this entry (213 words) »

{ 4 comments }

Spam counts for 2004

by Michael Alderete on 2/22/2005 · 0 comments

2004 was a big year for spam, after Congress voted to make it legal at the end of 2003. The result: spam increased sharply in 2004.

But in my own, more personal battles with spam I’ve been more successful at holding back the tide. My stats for 2004:

Filtered Mail
36278 Good Messages
72239 Spam Messages (67%)
197 Spam Messages Per Day

SpamSieve Accuracy
135 False Positives
451 False Negatives (77%)
99.5% Correct

Nearly seventy five thousand spam messages came at me, but thanks to SpamSieve a mere 451 made it into my Inbox. That’s less than two spams a day. Simply amazing.

Read the rest of this entry (226 words) »

{ 0 comments }

How this weblog is run

by Michael Alderete on 1/16/2005 · 2 comments

As I have been working on this site, I’ve visited quite a few other weblogs run by WordPress, and occasionally see something that I’d like to know how to do myself. A little widget here, a list of related posts there, a cool show/hide trick somewhere, etc. Cool things, but nothing that says how to do them. So, if anyone ever has that thought about my site, here’s the info. (This is really of interest to WordPress users only, but hopefully it’ll be useful, and other WordPress users will do the same.)

Read the rest of this entry (689 words) »

{ Comments on this entry are closed }

Done digging for a while

by Michael Alderete on 1/8/2005 · 0 comments

I spent a couple of hours yesterday working on a few last lingering details for this site. The main changes I wanted to make were to upgrade to the latest version of WordPress (a minor security update), make sure I was using the latest version of the Kubrick template (I was), and most importantly, fix the problems I was having with the Kubrick comments form, which is a lot cleaner and nicer than the standard WordPress version.

Read the rest of this entry (308 words) »

{ 0 comments }

Personal survey of anti-spam tools

by Michael Alderete on 1/7/2005 · 12 comments

In the three or four years I’ve been fighting unwanted e-mail messages with better tools than the Delete key I’ve tried almost a dozen different tools. This is a quick (ha!) survey of the ones I’ve used, and why I don’t (or do) still use them.

My very first anti-spam tool was something called Mailfilter. I used it for my personal e-mail on Mac OS X, wrote about it here, and almost immediately afterwards lost a non-spam message to an aggressive keyword match. That was the end of Mailfilter. I can’t even remotely recommend it, as it’s just not intelligent enough (strict, single expression matching), and had zero safety net.

My next attempt at a solution was a utility called SpamFire. Like Mailfilter, it is a “pre-filter,” which means it would run before my e-mail client, download my mail, and skim out the spam. Unlike Mailfilter, it actually saved the trapped messages, so if it made a mistake, I could recover the message. It had plenty of other differences from Mailfilter, which I wrote about previously, and which made it so useful that it became the first anti-spam tool I paid for. But in the end I switched to a different tool because SpamFire was separate from my e-mail client, and that made it cumbersome to use.

Read the rest of this entry (2,185 words) »

{ Comments on this entry are closed }

Spam counts for Q2

by Michael Alderete on 7/1/2004

So, with the end of the first half of the year, I thought break my silence by taking another look at the level of spam flowing into my mailboxes, and how well my tools are coping with it. First, here are the stats for Q2:

Filtered Mail

6674 Good Messages
16976 Spam Messages (72%)

SpamSieve Accuracy

52 False Positives
71 False Negatives (58%)
99.5% Correct

And here are the stats for the first half of the year:

Filtered Mail

20554 Good Messages
39595 Spam Messages (66%)

SpamSieve Accuracy

83 False Positives
270 False Negatives (76%)
99.4% Correct

You can review my previous post for the Q1 details, but the overall trends are:

  • SpamSieve increased its overall accuracy, but the number of false positives (legit messages marked as spam) went up, which is a bit troubling.
  • The actual amount of spam I received was down, but as a percentage of my mail stream, it was up. (This is because my legitimate mail traffic is down 50% after I unsubscribed from some mailing lists.)
  • 75% less spam reached my Inbox (71, vs 270 in Q1).

The overall reduction in spam traffic is encouraging, and proof that the pobox.com mail filters that I enabled at the end of Q1 are doing a tremendous job at rejecting spam coming to my oldest e-mail address.

The one really irritating new trend this past quarter, which doesn’t show up in the stats, is the number of bounces and anti-virus error messages hitting me. The alderete.com and aldosoft.com domains have been spoofed (forged) in a lot of spam and worm traffic, and because I have my domains “wild carded” to accept e-mail for “any-address@alderete.com”, the result is I get a lot of crap in my Inbox that is intended to let “pigxwnslesps@aldosoft.com” know that the crap didn’t go through.

So I’ve been compiling a list of the e-mail aliases I actually use (quite a lot because I use custom addresses with various vendors and web sites, so I can track who sells my address to spammers, turn off specific addresses, etc.), with the intent that I’ll enable those, and disable the wild cards. I hope to do that over the holiday weekend, and expect it to have almost as dramatic effect on crap coming in as the improved pobox.com spam filters.

{ Comments on this entry are closed }

Spam count so far this year

March 29, 2004

With Q1-2004 coming to a close, I thought I’d take a look at my spam situation, which has been escalating out of control. Since 12:01am January 1, 2004 I have received 22,255 spam messages via e-mail. That’s more than 250 a day, every day, for the last 89 days. Earlier in the year, the daily average was lower, which means that in the last couple weeks it’s gone well above 250 per day. In spite of these numbers, I have two things that give me hope.

Read the full article →

Save me from the bounces!

January 31, 2004

I have over the last two years implemented, I think, a dozen different anti-spam technologies to protect my Inbox. (I’ll total them up and summarize my thoughts in another post.) Today I finished implemented yet another, called SPF, or Sender Permitted From.

Read the full article →

Eudora 6 with SpamWatch

September 10, 2003

QUALCOMM’s Eudora has been my e-mail client of choice for nearly 10 years, and last week a major new version shipped, Eudora 6. My primary concern before upgrading was whether and how my other anti-spam tool, Spamnix, would work with the new version, especially with the new SpamWatch feature. I’m thrilled to report that Spamnix works fine with Eudora 6 (for Mac OS X), and that Spamnix + SpamWatch is more effective than either tool alone.

Read the full article →

Pete Wellborn for senator

September 10, 2003

Pete Wellborn is the attorney representing the defendants in a recent nuisance lawsuit filed by a group of spammers against some of the better-known — and more effective — anti-spam resources and groups, such as Spamhaus and SPEWS. His motion to dismiss the case was so effective that the plaintiffs are now trying to back out of the case.

Read the full article →