Matousec: Proactive Security Challenge

[Сергей Ильин 1538]

Жестокое избиение вендоров Матюшеком.

Я не пойму, указанные выше вендоры что под фаерволом и HIPS подразумевают?

[Виталий Я. 859]

По давней традиции, подразумевают все то, что назвали "сетевым экраном" и "поведенческим экраном", например. А вы как думали?

[Dmitriy K 603]

2012-11-21:

F-Secure Internet Security 2013 12.71.102 --- 3% --- none

Norman Security Suite PRO 10.00 --- 4% --- none

Norton Internet Security 2013 20.2.0.19 --- 9% --- none

PC Tools Internet Security 2012 9.1.0.2898 --- 6% --- none

Today's results are disapointing, especially in case of Norton Internet Security and PC Tools Internet Security. These two products belong under Symantec Corporation and their results are similarly poor. Since previous versions of both products did achieve better results in the past (in former Proactive Security Challenge on 32-bit Windows XP platform PC Tools once reached almost the perfect score and Norton was once as high as on 67 %) it can be concluded that proactive security features are not of high priority for Symantec anymore. It is funny that the latest version of PC Tools Internet Security implements some kind of protection against permanent malware infection (i.e. autorun techniques) while Norton Internet Security 2013 fails this part completely. And on the other hand, Norton Internet Security offers some self-protection features that PC Tools Internet Security misses. Instead of having two products under development, it might be a good idea for Symantec to have one good product. PC Tools Internet Security finished with 6 % today and Norton Internet Security with 9 %.

F-Secure Internet Security 2013 and Norman Security Suite PRO 10 also scored poorly with 3 % and 4 % respectively.

[Виталий Я. 859]

Я считаю, Матушек даром ест свой хлеб только потому, что о нем никто не знает.

[Сергей Ильин 1538]

Norton Internet Security 2013 20.2.0.19 --- 9% --- none

Печально, кажется еще один вендор забил на HIPS`ы

PC Tools Internet Security 2012 9.1.0.2898 --- 6% --- none

А ведь буквально год назад было так:

Протестировали PC Tools Internet Security 2011 8.0.0.623, прохождение 99 %, оценка: 10+ Excellent

Чего-то я не пойму, что происходит с тестами Матюшека. Жаль нельзя отследить ретроспективу изменения результатов.

[treme 41]

Печально, кажется еще один вендор забил на HIPS`ы

А еще есть люди, которые пользуются классическими хипсами?

[Dmitriy K 603]

Жаль нельзя отследить ретроспективу изменения результатов.

Proactive Security Challenge

Proactive Security Challenge 64

[Сергей Ильин 1538]

Dmitriy K, спасибо за ссылки! Я не видел этого функционала!

Посмотрите как прет BitDefender и как сдал PCTools

[KIS_fan 17]

Посмотрите как прет BitDefender и

и какая у BitDefender'а заточка...

[Виталий Я. 859]

и какая у BitDefender'а заточка...

И да, удивительно, что Давид не поливает румын из водомета при этом

[Сергей Ильин 1538]

и какая у BitDefender'а заточка...

С другой стороны, а что другим то мешает это сделать? Может и мир стал бы немного безопаснее.

[Razboynik 105]

PC Tools Internet Security 2012 9.1.0.2898 --- 6% --- none

А ведь буквально год назад было так:

Протестировали PC Tools Internet Security 2011 8.0.0.623, прохождение 99 %, оценка: 10+ Excellent

Чего-то я не пойму, что происходит с тестами Матюшека. Жаль нельзя отследить ретроспективу изменения результатов.

Посмотрите как прет BitDefender и как сдал PCTools

PCTools - здесь нет ничего удивительного. Простая подгонка. Уже давно обнаружено, что как только изменяются тесты - PCTools в хвосте. Затем в течение года PCTools выбирается в лидеры по данным тестам.

А на следующий год Матушек меняет тесты... И снова PCTools в хвосте. А потом снова в лидерах. И так несколько лет подряд...

И в этот раз Матушек замутил новые тесты...

Но, не нужно волноваться - разработчики PCTools подгонят его и под эти тесты, им не привыкать.

[Dmitriy K 603]

2012-12-18

BullGuard Internet Security 2013 13.0.254 --- 3% --- none

Dr.Web Security Space 8.0.0.12060 --- 11% --- none

Webroot SecureAnywhere Complete 2013 8.0.2.66 --- 11% --- none

ZoneAlarm Free Antivirus + Firewall 11.0.000.020 --- 34% --- Very poor

This was one of the hardest updates we had here in Proactive Security Challenge 64 so far. It was mostly because of BullGuard Internet Security 2013, which by the way scored only 3 %. Even on this level of protection we wanted to be sure the results were correct. Despite that the product was completely terrible just as this one. The problem was that BullGuard's behavior was unpredictable, hardly repeatable, pretty much random. Not only that clicking on the Block button would cause the offending action to succeed just as if you hit the Allow button, but some actions were sometimes randomly detected and sometimes not. It is not unusual that due to several factors the products are inconsistent in their behavior. But never as much as in the case of BullGuard.

ZoneAlarm Free Antivirus + Firewall was exactly the opposite testing experience. Very clean, smooth testing without any problems that confirmed the better than average protection level of this version of ZoneAlarm. 34% score is exactly the same performance as in the case of its previously tested version.

The new Dr.Web Security Space also performed exactly the same as its older version – 11 % and nothing to be proud of. It is really unclear how the vendors develop their products on this field. In Dr.Web, they probably consider Autorun techniques to be potentially dangerous and so they monitor malicious attempts to use them. Then the question is why just some of them. Why not all of them or at least those most used by malware and those that are most dangerous. No, they just picked out some of them.

Webroot SecureAnywhere Complete 2013 is the only one that improved its score compared to its last time. Unfortunately, the improvements are not significant and the final results of 11 % is still not good.

[Виталий Я. 859]

ZoneAlarm - давай техзадание

[Milord 55]

разработчики PCTools подгонят его и под эти тесты, им не привыкать.

напомните, это кто?)

[Dmitriy K 603]

2013-01-18

Comodo Internet Security Premium 6.0.260739.2674

SpyShelter Firewall 1.5

VIPRE Internet Security 2013 6.1.5493

ZoneAlarm Extreme Security 2013 11.0.000.038

After quite a long time we have a new version of Comodo Internet Security here in Proactive Security Challenge 64. Comodo Internet Security confirmed its number one position on the field of Windows proactive security once again. Although it lost 2 % points comparing to its previously tested version, it is still the only product that reached over the 90% bar. 92% score for today for Comodo. Congratulations!

SpyShelter Firewall is new to our challenge. Most of the tested products just failed hardly for the first time. Not SpyShelter Firewall! This was one of the greatest positive surprises we have had here in the last couple of months. SpyShelter scored 79 % and next time it may even go for an excellent score if its vendor fixes several minor weak points that we found. Good job!

The previously tested paid ZoneAlarm Extreme Security performed slightly better than its free alternative ZoneAlarm Free Antivirus + Firewall. However, it seems that a functionality, which was responsible for protecting the browser against various malicious techniques, was removed from ZoneAlarm Extreme Security and so this time it scored just as its free cousin tested last time – 34 %.

With its 2% result, VIPRE Internet Security went to the absolute bottom of the result table.

[Dmitriy K 603]

2013-02-20:

New results have been published for:

ESET Smart Security 6.0.308.0

FortKnox Personal Firewall 9.0.305.0

Jetico Personal Firewall 2.1.0.12.2466

UnThreat Internet Security 2013 6.1.36.15542

The performance of the new version of Jetico Personal Firewall was exactly the same as of its previously tested version – 59% score. No improvements on the field of proactive security in this product. The problems with the "indirect relativeness" feature are still present in Jetico Personal Firewall and so are all its weak points (e.g. no keylogger protection, poor protection against advanced malicious techniques) as well as its strong points (e.g. very good process and file protection, fair autorun protection).

Although new ESET Smart Security 6 scored better than its version 5, the overall result was disappointment for us. We hoped ESET Smart Security could reach much more than 56 %. There are still quite many problems in its protection that could be fixed easily which would lead to significant improvement in its protection.

FortKnox Personal Firewall scored 5 %, UnThreat Internet Security 3 %, neither of these two products offer serious host protection features.

[Umnik 997]

Прям напрашивается "Такие дела"

[mcomodo 17]

Outpost Security Suite Pro 7 почему не восьмёрка?

[Виталий Я. 859]

Outpost Security Suite Pro 7 почему не восьмёрка?

Дату теста видели? В год один вендор имеет право на 2 бесплатных теста.

2012-03-20: New results have been published for:

Dr.Web Security Space 7.0.0.10140

Outpost Security Suite Pro 7.5.2.3939.602.1809

TrustPort Total Protection 2012 12.0.0.4860

ZoneAlarm Extreme Security 2012 10.1.079.000

[Dmitriy K 603]

mcomodo,

тестовый набор находится в открытом доступе на сайте. Можно скачать и проверить самостоятельно, если сильно хочется.

Результат у 8-ки не хуже, чем был у 7.5.2

[b423057 5]

2013-03-20:

New results have been published for:

eScan Internet Security Suite 11.0.1139.1277

K7 TotalSecurity 2013 13.1.0.188

Outpost Security Suite Pro 8.0.4164.639.1856

Total Defense Internet Security Suite 8.0.0.215

Great job Outpost! Outpost Security Suite Pro 8 is again better than its previous version. With today's 90% score, Outpost Security Suite Pro have become the second product to reach the Excellent level of protection in Proactive Security Challenge 64. It is now just 2 % behind the absolute and long-term leader of our challenge – Comodo Internet Security.

Total Defense Internet Security Suite also went up. This time from 21% score to 31 %. Although this is better than most of the tested products, it is still way to far from being considered as at least Good. There are too many holes and also bugs in this product. Quite a lot of work will be needed to make it usable and secure at least on a basic level.

K7 TotalSecurity with its today's 9 % and eScan Internet Security Suite with 5 % belong among products that you should not rely on if a security based on behavior blocking is important for you. Just pick something else.

[mcomodo 17]

Новый продукт немного не дотянул до первого места.

[priv8v 960]

Это потому, что суровые питерские парни не хотят скидываться на новый айфон для Матюшека )))

Интересуют последние места в тесте - у них вообще хуков в системе нет что ли, а все делается опросом в цикле аля бабушкин-стайл ...