Comparing Postini and Leading Messaging Security Solutions

y

An Osterman Research White Paper

sponsored by

Published October 2007

sponsored by Osterman Research, Inc. • P.O. Box 1058 • Black Diamond, Washington 98010-1058 Phone: +1 253 630 5839 • Fax: +1 866 842 3274 • [email protected] • www.ostermanresearch.com

Comparing Postini and Leading Messaging Security Solutions

Executive Summary Osterman Research was commissioned by Postini to undertake a market research survey of organizations that are using Postini’s communications security solutions, as well as solutions offered by nine other leading vendors. The goal of this research was to determine how organizational decision makers perceive the offerings with which they are most familiar, and to determine if there are quantifiable differences between Postini’s solutions and those offered by the other vendors.

Our research found that customer satisfaction with the innovation of Postini’s solutions was higher than the average of its competition on things like the amount of spam captured, virus capture efficiency and the amount of technical support that the solution required.

The data presented in this white paper discusses the results of the research program that was conducted during August and September 2007, focusing on Postini results independently from an aggregate of the other nine vendors’ results. Postini is not compared directly to any particular vendor in this analysis, but instead to the results from all of the other vendors. Our research found that with Postini’s solutions customer satisfaction was higher than the average of its competition on things like the amount of spam captured, virus capture efficiency and the amount of technical support that the solution required. Further, Postini’s results for the amount of IT time required to manage the system was decidely better than the average of the other systems, not surprising given that most of the other solutions are on-premise solutions. In some other areas, Postini and its competition were viewed as roughly similar.

Overview and Methodology Postini commissioned Osterman Research to conduct a study of organizations’ use of various messaging security products, the goal of which was to compare Postini’s antivirus and anti-spam capabilities with those of several of its leading competitors. The goals of this project were several: •

To gather quantitative information on Postini’s offering, as well as those of nine of its leading competitors.



To gather qualitative information on the efficacy of these ten solutions in reducing the impact of spam and viruses on corporate messaging systems and networks.

© 2007 Osterman Research, Inc.

Page 1

Comparing Postini and Leading Messaging Security Solutions



To compare Postini’s solutions versus an amalgam of its leading competitors, not to single out specific solutions for comparison with Postini’s offerings.

The solutions surveyed, as well as the number of surveys completed for each solution, are shown in the following table. Number of Respondents Surveyed per Vendor

The firms surveyed were drawn primarily from the Osterman Research Survey Panel; the individuals surveyed had to be involved in the management of their organizations’ messaging and/or networking systems in order to qualify for participation in the survey.

Vendor Barracuda IronPort MessageLabs Microsoft Forefront MX Logic Postini Secure Computing Symantec Trend Micro Websense (Blackspider)

Number of Surveys Completed 14 13 5 12 4 28 10 24 22 8

Organizations of various sizes in North America and Europe were surveyed for this project, but the median number of employees at the organizations surveyed was 3,100 and the median number of email users was 2,600. The respondent organizations covered a wide range of industries. The Postini-enabled organizations averaged a greater number of employees and email users than the other organizations. The firms surveyed were drawn primarily from the Osterman Research Survey Panel; the individuals surveyed had to be involved in the management of their organizations’ messaging and/or networking systems in order to qualify for participation in the survey. Surveys were conducted between August 21 and September 23, 2007.

Research Findings Ease of Use for End Users is a Key Issue While many organizations do not allow end users to gain access to spam quarantines, the vast majority do. As a result, ease of use for security solutions is a key issue given the potential impact this has on IT management time, help desk, etc. In other words, the easier a system makes it for non-IT staff to manage their own quarantines, the less impact users will have on IT staff. © 2007 Osterman Research, Inc.

Page 2

Comparing Postini and Leading Messaging Security Solutions

As shown in the following figure, twice as many Postinienabled organizations report that their system is ‘extremely easy to use’ for end users, while about the same number report that the system is ‘easy to use’. System Ease of Use for End Users

One of the key Twice as manythe differentiators Postini-enabled research found organizations was in the report that their amount of IT system is management ‘extremely easy time that must be to use’ fortoend devoted the users, while of maintenance aboutsolution. the same each number report Postini-enabled that the system is organizations ‘easy to use’. require significantly less IT management time on a weekly basis relative to non-Postinienabled organizations.

Postini Requires Less Management Time One of the key differentiators the research found was in the amount of IT management time that must be devoted to the maintenance of each solution. As shown in the following figure, Postini-enabled organizations require significantly less IT management time on a weekly basis relative to nonPostini-enabled organizations.

© 2007 Osterman Research, Inc.

Total Hours Spent per Week Per 1,000 Users Managing the System

Page 3

Comparing Postini and Leading Messaging Security Solutions

If we assume that a fully burdened salary for an IT administrator is $80,000 annually, the data in the figure above translates to annual maintenance expenditures of $7.43 per user per year for Postini-enabled organizations and $18.00 per user per year for non-Postini organizations. In an organization of 2,500 users, this would translate to a savings of $27,000 annually for Postini-enabled organizations, or the equivalent of just over 0.3 full-time equivalent (FTE) IT staff members.

In an organization of 2,500 users, this would translate to a savings of nearly $26,000 annually for Postini-enabled organizations, or the equivalent of just over 0.3 fulltime equivalent (FTE) IT staff members.

Because the Postini-enabled organizations surveyed were, on average, larger than non-Postini organizations, we also compared IT time investments only for those organizations with at least 1,000 email users in order to provide more of an ‘apples-to-apples’ comparison. A comparison of Postinienabled and other organizations is shown in the following figure, demonstrating an even more decided advantage for Postini. Total Hours Spent per Week Per 1,000 Users Managing the System (Organizations With 1,000 or More Email Users)

Again, if we assume that a fully burdened salary for an IT administrator is $80,000 each year, the data in the figure above translates to annual maintenance expenditures of $1.11 per user per year for Postini-enabled organizations and $6.15 per user per year for non-Postini organizations. In an organization of 2,500 users, this would translate to a savings of nearly $12,600 annually, or the equivalent of just over 0.16 FTE IT staff members.

© 2007 Osterman Research, Inc.

Page 4

Comparing Postini and Leading Messaging Security Solutions

Postini’s Satisfaction is Very High Overall, Postini fared better than the amalgam of leading competitors in this analysis in terms of customer satisfaction. As shown in the following table, customer satisfaction with Postini’s solutions is significantly higher in terms of the amount of spam captured, the amount of technical support required, the up-front cost of the solution and the flexibility of policy management offered in the solution. Postini fared moderately better in terms of virus capture efficiency, the ongoing cost of the solution and in the quality of the technical support provided. Satisfaction Level on Various Attributes % Responding Satisfied or Very Satisfied Our analysis demonstrated that those involved in managing their organizations’ messaging and/or networking systems view Postini as an excellent solution for stopping spam, viruses and other messagingrelated threats; and that they invest less IT staff time in managing the Postini solution.

Attribute The amount of spam captured Virus capture efficiency The amount of technical support required The amount of your IT effort required The up-front cost of the solution The number of false positives generated The ability to manage policies the way you want The ongoing cost of the solution The quality of the technical support provided The vendor’s addition of new capabilities

Postini 96% 93% 93% 82% 81% 79% 79% 74% 74% 70%

Others 78% 87% 78% 73% 64% 67% 59% 72% 70% 63%

The vendors whose products Postini was compared in this analysis offer very good capabilities and are all worthy of consideration for organizations that seek to provide robust messaging security capabilities. Our analysis demonstrated that those involved in managing their organizations’ messaging and/or networking systems view Postini as an excellent solution for stopping spam, viruses and other messaging-related threats; and that they invest less IT staff time in managing the Postini solution. The August Spam Storm Impacted Postini Customers Less During the period August 7-9, 2007, there was a significant storm of PDF spam. As shown in the following figure, 75% of Postini-enabled customers reported that they saw little or no problem from this particular storm versus only 58% of nonPostini customers that reported seeing this minimal impact from the storm.

© 2007 Osterman Research, Inc.

Page 5

Comparing Postini and Leading Messaging Security Solutions

“During the August 7-9, 2007 storm of PDF spam, did you experience performance degradation?”

96% of Postinienabled organizations report that the system is mostly or always available versus 87% of nonPostini-enabled organizations. Even more telling, however, is the fact nearly three out of five Postini customers report that the system is ‘always available’.

Availability is a Critical Issue Availability of a messaging security solution is a critical issue given the almost continual flow of messages that users receive. As shown in the following figure, 96% of Postinienabled organizations report that the system is mostly or always available versus 87% of non-Postini-enabled organizations. Even more telling, however, is the fact nearly three out of five Postini customers report that the system is ‘always available’. Conversely, while 12% of non-Postini organizations report that system availability is poor or simply acceptable, only 4% of Postini-enabled organizations report this minimal level of availability. System Availability During the Past Three Months

© 2007 Osterman Research, Inc.

Page 6

Comparing Postini and Leading Messaging Security Solutions

Postini Customers Are Less Likely to Switch More than four out of five Postini-enabled organizations report that they are unlikely to switch to another vendor’s offering, while only two-thirds of non-Postini organizations report this level of loyalty, as shown in the following figure. Likelihood of Staying With Vendors Over the Long Term

Vendors’ ability to maintain or improve false positive rates is even better than their spam capture efficiency. Postini has a slight edge in this regard, with a somewhat larger proportion of Postini-enabled organizations reporting that false positive efficiency is improving over time.

False Positive Innovation is Very Good for All Vendors Vendors’ ability to maintain or improve false positive rates is even better than their spam capture efficiency, as shown in the following figure. Postini has a slight edge in this regard, with a somewhat larger proportion of Postini-enabled organizations reporting that false positive efficiency is improving over time; only four percent of Postini and nonPostini customers report that false positive efficiency is getting worse.

© 2007 Osterman Research, Inc.

Page 7

Comparing Postini and Leading Messaging Security Solutions

Changes in Vendors’ Spam False Positive Capabilities Over Time

Vendors’ ability to capture viruses is improving even more than either their innovation in spam capture efficiency or their generation of false positives. Here, too, Postini has a slight edge.

Osterman Research found relatively little difference between Postini and its competition in terms of the vendors’ improvements in their ability to capture spam over time: 36% of Postini customers believe their solution is getting better over time versus 34% for the other vendors. Innovation in Anti-Virus Capabilities Are Even Better Vendors’ ability to capture viruses is improving even more than either their innovation in spam capture efficiency or their generation of false positives, as shown in the following figure. Here, too, Postini has a slight edge, with more Postinienabled organizations reporting that their anti-virus capabilities are getting better over time; virtually no organizations reported that these capabilities are worsening over time.

© 2007 Osterman Research, Inc.

Page 8

Comparing Postini and Leading Messaging Security Solutions

Changes in Vendors’ Anti-Virus Capture Capabilities Over Time

75% of Postinienabled organizations report that they rarely or never experience any sort of performance degradation in their system versus 52% of non-Postinienabled organizations that report this lack of performance problems.

Performance Degradation is Another Key Issue As shown in the following figure, 75% of Postini-enabled organizations report that they rarely or never experience any sort of performance degradation in their system versus 51% of non-Postini-enabled organizations that report this lack of performance problems. Conversely, whereas 11% of Postinienabled organizations report that the system sometimes experiences significant performance degradation, 20% of non-Postini organizations report this level of performance problem. “Overall, during the past six to 12 months, during major spam storms do you experience performance degradation?”

© 2007 Osterman Research, Inc.

Page 9

Comparing Postini and Leading Messaging Security Solutions

Summary and Conclusions This analysis found that all of the products surveyed provide good performance and will adequately protect a messaging infrastructure. However, comparing the aggregated results of Postini’s competitors with Postini’s offerings shows that Postini offers a lower cost of management per user and greater customer satisfaction.

© 2007 Osterman Research, Inc. All rights reserved. No part of this document may be reproduced in any form by any means, nor may it be distributed without the permission of Osterman Research, Inc., nor may it be resold by any entity other than Osterman Research, Inc., without prior written authorization of Osterman Research, Inc. THIS DOCUMENT IS PROVIDED “AS IS”. ALL EXPRESS OR IMPLIED REPRESENTATIONS, CONDITIONS AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY OR FITNESS FOR A PARTICULAR PURPOSE, ARE DISCLAIMED, EXCEPT TO THE EXTENT THAT SUCH DISCLAIMERS ARE DETERMINED TO BE ILLEGAL.

© 2007 Osterman Research, Inc.

Page 10

Comparing Postini and Leading Messaging Security ...

efficiency and the amount of technical support that the solution required. Further, Postini's results for the amount of IT time required to manage the system was decidely better than the average of the other systems, not surprising given that most of the other solutions are on-premise solutions. In some other areas, Postini and ...

648KB Sizes 4 Downloads 248 Views

Recommend Documents

Security Whitepaper: Google Apps Messaging and ... - Cryptome
to quickly recognize, analyze, and remediate information security threats. 3 ... web frontend service would make a remote procedure call to a Gmail backend ..... it simply, Google does not own customer data, and we believe it should stay that way. ..

Comparing Symmetric-key and Public-key based Security Schemes in ...
Comparing Symmetric-key and Public-key based Security Schemes in Sensor Networks: A Case Study of User Access Control. Haodong Wang, Bo Sheng, Chiu ...

Comparing Expert and Non-Expert Security Practices - Usenix
Jul 24, 2015 - Security practices that experts follow and consider good security advice for .... the survey via their social media accounts. About 80% of partic-.

Comparing Expert and Non-Expert Security Practices - Usenix
Jul 24, 2015 - actually be followed and design campaigns to improve security ed- ucation. .... the survey via their social media accounts. About 80% of partic-.

Google acquires Postini Services
Sep 13, 2007 - A. Postini is part of the Google Enterprise Partner program, and has worked with Google to create solutions that augment Google Apps for business users. Postini has a set of offerings that integrate well with Google Apps, and has been

Postini Services Incident Report
May 7, 2013 - Prepared for Postini and Google Apps customers. The following is the ... We thank you for your business and continued support. Sincerely,.

Chat Messaging
To exchange message between server and client using message queue. Algorithm. Server. 1. Decalre a structure mesgq with type and text fields. 2. Initialize key to 2013 (some random value). 3. Create a message queue using msgget with key & IPC_CREAT a

Remind Messaging kure.pdf
Page 1 of 1. Remind Messaging. We will be using the class website www.sciguy.ca and the Remind messaging service to share information with. students and parents. What is remind and why is it safe? Remind is a free, safe, and simple messaging tool tha

messaging sale offering - IAM Market
Subject matter includes, but is not limited to, availability status management. .... for management of on-call messaging ... communications among a largest.

Comparing India and the West
congruent with the insight we have about human beings: when a person .... around asking questions about eating beef, wearing bindi, worshipping the Shiva ...

A Guide to Understanding Hosted and Managed Messaging
The use of native consumer instant messaging clients can put an organization at ... messaging security is the equally important problem of outbound security.

Academic Word List- Comparing and Contrasting - UsingEnglish.com
Importance of hierarchy. - Infrastructure. - Interest in sustainability. - Job security ... Residential care. - Restoration of historical buildings. - Rigid management.

Comparing dichotomous and trichotomous approaches ...
that they have minimal unique predictive validity; however, they are not identical ..... complex models, and is less sensitive to sample size and violations of ...

messaging sale offering - IAM Market
Suggesting a time for live ... initiate an instant messaging session with the user. ... of the group of first users cannot initiate the new instant messaging session.

Comparing dichotomous and trichotomous approaches ...
In view of these benefits, it is important to understand the regulatory ..... In view of these findings, we consider the model fit of TEOSQ as ...... 29, pp.271–360).

Understanding Instant Messaging Traffic Characteristics
stant messaging systems, AOL Instant Messenger (AIM) and ... video and voice chats and file attachments, traffic volume ..... Breakdown of IM message types.

A Guide to Understanding Hosted and Managed Messaging - PMI.it
More Organizations are Considering Hosted and Managed. Services. .... increase, as are Web-based tools for communication and ..... Page 10 ..... best way to.

Comparing India and the West - ASIANetwork
conceptual structure to the European descriptions of India, then such a structure reflects ... How to understand or explain these facts and what do they say about ...

Comparing cyberbullying and school bullying among.pdf ...
123. Page 3 of 16. Comparing cyberbullying and school bullying among.pdf. Comparing cyberbullying and school bullying among.pdf. Open. Extract. Open with.

Comparing microstructural and macrostructural development of the ...
imaging versus cortical gyration. Amy R. deIpolyi, a,b ... Received 21 October 2004; revised 6 February 2005; accepted 8 April 2005. Available online 25 May ...

Comparing Han China and Rome
What a nice guy! ➢ Both empires “defined” themselves in “universal” terms – the Romans spoke of bringing. “almost the entire world” under their control – yeah – but not Flowery Branch…and. China was said to .... Imperial Collaps

Google to Acquire Postini on Jul. 09. 2007 / 12:00PM
Jul 9, 2007 - Some of the comments we make today will include forward-looking statements within the ... risk factors that may affect the outcome of these forward-looking statements. Copies of these ... on-demand or hosted solutions for security and c