230 likes | 411 Views
Antivirus Fight Club!. August 8th @ LinuxWorld. Before we begin…. Please submit any viruses for the test at http://virus.untangle.com/. Background - who we are. Untangle provides an open source network gateway platform. We are not an antivirus company We are not a testing company.
E N D
Antivirus Fight Club! August 8th @ LinuxWorld
Before we begin… Please submit any viruses for the test at http://virus.untangle.com/
Background - who we are Untangle provides an open source network gateway platform. We are not an antivirus companyWe are not a testing company
Background - why we are doing this • 2005: Untangle researches antivirus to add to the network gateway platform • after testing we choose clam (open source) and one other vendor • 2006: Untangle seeks Testing Labs for certification (stickers!) • 2006: Testing Lab refused to test AV product, because use of open source • won’t tell us why • won’t provide test results • won’t provide test set Something fishy is going on here…
What is the AV FightClub? A simple test of real-world anti-virus detection by different AV engines • What AV FightClub is not: • Zero-day test • Functionality comparison • Not coverage testing Two important things! • Open - for samples & participation & discussion • Transparent - simple, verify & run at home
The Test Each vendor is subjected to: • Small Set of test viruses (eicar) • Set of ‘in-the-wild’ viruses • Set of user-submitted viruses (minus non-viruses, not ‘in-the-wild’ viruses, and phish) Scored by % of viruses identified and performance if applicable All vendors should catch all these viruses
The Vendors Vendors Engines with linux support (clam, kasperskey, fprot, sophos, globalhauri)Gateway Appliances (sonicwall, fortinet, watchguard)Windows solutions (norton/symance, mcafee)
Questions? predictions?
Lets get started • zip up the test set for windows tests • deposit on web server for gateway appliance tests
Conclusions conclusions • Open Source solution (Clam) doesn’t suck . In fact, its excellent! • Many vendors are poor. Some are selling dead donkeys! outstanding questions • Why hasn’t this been pointed out? • Is there something wrong with the way we test antivirus today?
Thanks for coming! Contact Dirk Morris dmorris@untangle.com Remember Don’t believe me? Try this at home. The test set will be available on http://virus.untangle.com (password on zip file is “a”)