The difference between Catch Rate and Effectiveness of spam caught by Symantec Messaging Gateway (SMG) and other gateway products is needed/desired.
Spam represents as much as 75% of all email sent across the Internet. The variance of this number is representative of different regions that are impacted more or less by spam senders, as well as the ever-increasing deployment of IP-based solutions to deal with spam before it is allowed to reach a mail transfer agent (MTA). Symantec has been benchmarked at greater than 99% anti-spam effectiveness for all spam. Anti-spam effectiveness is defined by the percentage of spam that is identified as spam by an anti-spam solution. This is separate from the catch rate, which is the measure of the percentage of all mail messages that have been identified as spam.
To illustrate this, consider a typical mail stream of 100 messages:
It is critical that you do not confuse effectiveness and catch rate when considering the performance of Symantec Messaging Gateway solutions.
Over the last few years, there have been several events that changed the spam threat landscape. McColo shutdown (November 2008), Bredolab botnet and Spamit.com shutdown (October 2010), and Rustock botnet shutdown (March 2011) are few examples of major events that resulted in a large drop in overall spam volume. The drop in overall spam volume in turn causes spam effectiveness and catch rate to drop lower as well.
To illustrate this, consider a bot takedown that eliminates 20% of spam. Using the above example of a mail stream as a basis, the new calculation is as follows:
Even though SMG missed 4 spam messages in both examples, spam effectiveness and catch rate are lower in the latter example with a bot takedown. When there are major events that cause a large drop in overall spam volume, both spam effectiveness and catch rate percentages will drop as a result even when there is no actual difference in effectiveness.
In addition to using spam effectiveness and catch rate percentages, there are other metrics that can be helpful in determining true effectiveness of the product: