application

Evaluating a Vendor product

March 10, 2011

1) Provide a high level overview of what the product is marketed to do.

2) Now, provide the details of what “you” (the buyer) are expecting it to do.

3) Find someplace where the product can be installed and tested.

Before you begin, document what your expectations of how the install will go, and your expectations of what the product is going to provide you (and perform) ON THE BOX THE PRODUCT is being installed on.

4) Compare your expectations to actuality.

5) Now, corrupt the test box by placing Security Deficiencies all over the place.  Make sure each one isdocumented. Re-Run the test.

What did it find ?

Did it report on all deficiencies created ?

Did it provide information beneficial to correcting what it found and reported on ?

6) Now, the acid test.  Find another box on which the product can be installed and evaluated on,
preferably one that most closely resembles a real-world production environment.

Re-Run the test.  How did it do?

7) Now summarize the findings, in writing, and disseminating the results within the internal project team.

Review and develop a consensus of how to proceed.  Brief management on the final report.

www.bestitdocuments.com