If you are going to do benchmarking, probably Rally will be interesting for you: https://wiki.openstack.org/wiki/Rally
I have been working on the same and so far i have coded over 300 cli calls on different services and have integrated them with tempest. I am planning to do edit them and upload them soon. My calls are not read-only, we have ability to create and destroy internals.
Not exactly answering the question, but I think it might be useful for someone. Here's how you can run the Tempest tests for the Nova CLI tools:
./run_tempest.sh tempest.cli.simple_read_only.test_nova
./run_tempest.sh tempest.cli.simple_read_only.test_nova_manage
Dear boris - tempest is a integaration QA suite for openstack. This covers - API tests CLI tests Scenario tests stress tests ...
As for as talking about CLI tests, it covers only read only CLI tests (for example simple list like tests - i.e. test case for "nova list"). If you need complete testing coverage using CLI tests, you need to write your own framework for CLI testsing coverage as including read only CLI tests and not including write CLI tests in tempest is intentional.
https://github.com/openstack/tempest/
Asked: 2014-02-06 08:14:15 -0500
Seen: 480 times
Last updated: Nov 26 '14
What exactly are you trying to do? I would suggest you to engage into conversations with Nova's developers and contribute your ideas with them.