Monday, July 22, 2013

Life of a QA Tester....tool evaluation: Sahi Pro


Sahi Pro Evaluation
Released by Tyto Software
Installation of Sahi Pro was easy. I did find it a bit strange that it did not automatically install in the Program Files folder. The program is kicked off by a .bat file which launches the Sahi dashboard.



After choosing the browser that will be used, a front Sahi Pro page displays instructed me how to bring up the Controller.




Although the controller is laid out fairly well, I did find it a bit “clunky”.  I also had some issues running a script that had both a function that had been created through the GUI and another that was created from scratch.

Web testing, including cross browser
I was able to test in IE, Firefox, and Chrome.

Desktop testing
Sahi Pro does not test desktop applications.

Scripting
The language is based on JavaScript.

Documentation and training; (somewhat) short learning curve
The Sahi Pro website contains many pages of training materials.

Maintenance, longevity, reliability and support
Unknown.

Error recovery
I was able to see the logs of the tests run and upon clicking on a log.



After clicking on a test name in the Suite Name column, I was brought to a page where I could see where the script had failed (if applicable). I can then double click on the error, highlighted in red below, and will be taken to the place in the script where the test had failed.


Reporting
Sahi Pro stores its reports in a H2 database by default. Custom reporting is possible, but it may be necessary to store it into a central MySQL or another database. There is a MySQL .jar that can be utilized to create and customize reports. Also, this process requires a manual update, MySQL does not do this automatically.
Cost
$495/user/year

Customizations (future proofness)
Sahi Pro does not have this capability.

Established in market
Sahi Pro is not widely used .

Integration with Rally
Sahi Pro does not have this capability.

Distributed Testing
Sahi Pro can be distributed and run tests on multiple machines as long as the Sahi Pro application is installed on each machine.

Ability to run unit tests outside of environment
Sahi Pro does not have this capability.

Conclusion: We have decided that Sahi Pro is not a strong contender in our search of automated test tools and has been withdrawn from the choices.

7/25/13: Edited title- added "Sahi Pro".

No comments:

Post a Comment