From patchwork Thu Jan 19 17:48:12 2012 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Paul Larson X-Patchwork-Id: 6304 Return-Path: X-Original-To: patchwork@peony.canonical.com Delivered-To: patchwork@peony.canonical.com Received: from fiordland.canonical.com (fiordland.canonical.com [91.189.94.145]) by peony.canonical.com (Postfix) with ESMTP id A37CB23E0C for ; Thu, 19 Jan 2012 17:48:14 +0000 (UTC) Received: from mail-bk0-f52.google.com (mail-bk0-f52.google.com [209.85.214.52]) by fiordland.canonical.com (Postfix) with ESMTP id 6463FA1848D for ; Thu, 19 Jan 2012 17:48:14 +0000 (UTC) Received: by mail-bk0-f52.google.com with SMTP id zt4so245927bkb.11 for ; Thu, 19 Jan 2012 09:48:14 -0800 (PST) Received: by 10.204.153.27 with SMTP id i27mr10643358bkw.81.1326995294237; Thu, 19 Jan 2012 09:48:14 -0800 (PST) X-Forwarded-To: linaro-patchwork@canonical.com X-Forwarded-For: patch@linaro.org linaro-patchwork@canonical.com Delivered-To: patches@linaro.org Received: by 10.205.82.144 with SMTP id ac16cs18626bkc; Thu, 19 Jan 2012 09:48:13 -0800 (PST) Received: by 10.180.83.231 with SMTP id t7mr45651963wiy.20.1326995292675; Thu, 19 Jan 2012 09:48:12 -0800 (PST) Received: from indium.canonical.com (indium.canonical.com. [91.189.90.7]) by mx.google.com with ESMTPS id t50si119087wec.10.2012.01.19.09.48.12 (version=TLSv1/SSLv3 cipher=OTHER); Thu, 19 Jan 2012 09:48:12 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of bounces@canonical.com designates 91.189.90.7 as permitted sender) client-ip=91.189.90.7; Authentication-Results: mx.google.com; spf=pass (google.com: best guess record for domain of bounces@canonical.com designates 91.189.90.7 as permitted sender) smtp.mail=bounces@canonical.com Received: from ackee.canonical.com ([91.189.89.26]) by indium.canonical.com with esmtp (Exim 4.71 #1 (Debian)) id 1Rnw5s-0006hd-C1 for ; Thu, 19 Jan 2012 17:48:12 +0000 Received: from ackee.canonical.com (localhost [127.0.0.1]) by ackee.canonical.com (Postfix) with ESMTP id 4BC8EE1439 for ; Thu, 19 Jan 2012 17:48:12 +0000 (UTC) MIME-Version: 1.0 X-Launchpad-Project: lava-test X-Launchpad-Branch: ~linaro-validation/lava-test/trunk X-Launchpad-Message-Rationale: Subscriber X-Launchpad-Branch-Revision-Number: 110 X-Launchpad-Notification-Type: branch-revision To: Linaro Patch Tracker From: noreply@launchpad.net Subject: [Branch ~linaro-validation/lava-test/trunk] Rev 110: Start documenting the tests we have Message-Id: <20120119174812.13722.82536.launchpad@ackee.canonical.com> Date: Thu, 19 Jan 2012 17:48:12 -0000 Reply-To: noreply@launchpad.net Sender: bounces@canonical.com Errors-To: bounces@canonical.com Precedence: bulk X-Generated-By: Launchpad (canonical.com); Revision="14692"; Instance="launchpad-lazr.conf" X-Launchpad-Hash: 8dbd3afec989b7bf5345ca2c748ba589346d09af ------------------------------------------------------------ revno: 110 committer: Paul Larson branch nick: doc-lava-test timestamp: Wed 2012-01-18 18:11:33 -0600 message: Start documenting the tests we have added: doc/tests.rst modified: doc/index.rst doc/reference.rst lava_test/test_definitions/bootchart.py lava_test/test_definitions/firefox.py lava_test/test_definitions/glmemperf.py lava_test/test_definitions/gmpbench.py lava_test/test_definitions/gtkperf.py lava_test/test_definitions/insanity.py lava_test/test_definitions/ltp.py lava_test/test_definitions/peacekeeper.py lava_test/test_definitions/xrestop.py --- lp:lava-test https://code.launchpad.net/~linaro-validation/lava-test/trunk You are subscribed to branch lp:lava-test. To unsubscribe from this branch go to https://code.launchpad.net/~linaro-validation/lava-test/trunk/+edit-subscription === modified file 'doc/index.rst' --- doc/index.rst 2011-09-12 09:19:10 +0000 +++ doc/index.rst 2012-01-19 00:11:33 +0000 @@ -12,19 +12,18 @@ .. seealso:: To learn more about LAVA see https://launchpad.net/lava -60 second example -================= - -This example will run on Ubuntu Lucid and beyond:: - - $ sudo add-apt-repository ppa:linaro-validation/ppa - $ sudo apt-get update - $ sudo apt-get install lava-test - $ lava-test install stream - $ lava-test run stream - -.. seealso:: For a more thorough description see :ref:`usage` -.. seealso:: For detailed installation istructions see :ref:`installation` +Indices and tables +================== + +.. toctree:: + :maxdepth: 2 + + installation.rst + usage.rst + tests.rst + reference.rst + changes.rst + todo.rst Features ======== @@ -39,8 +38,19 @@ collections of tests (:class:`~lava_test.api.core.ITestProvider`). * Ever-growing collection of freely available and generic tests and benchmarks -.. seealso:: See what's new in :ref:`version_0_2` - +Quickstart +========== + +This example will run on Ubuntu Lucid and beyond:: + + $ sudo add-apt-repository ppa:linaro-validation/ppa + $ sudo apt-get update + $ sudo apt-get install lava-test + $ lava-test install stream + $ lava-test run stream + +.. seealso:: For a more thorough description see :ref:`usage` +.. seealso:: For detailed installation istructions see :ref:`installation` Latest documentation ==================== @@ -64,18 +74,6 @@ Feel free to drop by to chat and ask questions. -Indices and tables -================== - -.. toctree:: - :maxdepth: 2 - - installation.rst - changes.rst - usage.rst - reference.rst - todo.rst - * :ref:`genindex` * :ref:`modindex` * :ref:`search` === modified file 'doc/reference.rst' --- doc/reference.rst 2011-09-12 09:19:10 +0000 +++ doc/reference.rst 2012-01-19 00:11:33 +0000 @@ -99,9 +99,3 @@ :members: -Abrek compatibility -=================== - -.. automodule:: abrek.testdef - :members: - === added file 'doc/tests.rst' --- doc/tests.rst 1970-01-01 00:00:00 +0000 +++ doc/tests.rst 2012-01-19 00:11:33 +0000 @@ -0,0 +1,89 @@ +.. _test: + +=============== +Supported Tests +=============== + +The following tests are currently supported in LAVA Test: + + * `bootchart`_ + * `firefox`_ + * `glmemperf`_ + * `gmpbench`_ + * `gtkperf`_ + * `insanity`_ + * `ltp`_ + * `peacekeeper`_ + * `perf`_ + * `posixtestsuite`_ + * `pwrmgmt`_ + * `pybench`_ + * `smem`_ + * `stream`_ + * `tiobench`_ + * `x11perf`_ + * `xrestop`_ + +bootchart ++++++++++ +.. automodule:: lava_test.test_definitions.bootchart + +firefox ++++++++ +.. automodule:: lava_test.test_definitions.firefox + +glmemperf ++++++++++ +.. automodule:: lava_test.test_definitions.glmemperf + +gmpbench +++++++++ +.. automodule:: lava_test.test_definitions.gmpbench + +gtkperf ++++++++ +.. automodule:: lava_test.test_definitions.gtkperf + +insanity +++++++++ +.. automodule:: lava_test.test_definitions.insanity + +ltp ++++ +.. automodule:: lava_test.test_definitions.ltp + +peacekeeper ++++++++++++ +.. automodule:: lava_test.test_definitions.peacekeeper + +posixtestsuite +++++++++++++++ +.. automodule:: lava_test.test_definitions.posixtestsuite + +pwrmgmt ++++++++ +.. automodule:: lava_test.test_definitions.pwrmgmt + +pybench ++++++++ +.. automodule:: lava_test.test_definitions.pybench + +smem +++++ +.. automodule:: lava_test.test_definitions.smem + +stream +++++++ +.. automodule:: lava_test.test_definitions.stream + +tiobench +++++++++ +.. automodule:: lava_test.test_definitions.tiobench + +x11perf ++++++++ +.. automodule:: lava_test.test_definitions.x11perf + +xrestop ++++++++ +.. automodule:: lava_test.test_definitions.xrestop === modified file 'lava_test/test_definitions/bootchart.py' --- lava_test/test_definitions/bootchart.py 2011-10-20 12:12:15 +0000 +++ lava_test/test_definitions/bootchart.py 2012-01-19 00:11:33 +0000 @@ -13,6 +13,16 @@ # You should have received a copy of the GNU General Public License # along with this program. If not, see . +""" +Bootchart is a benchmark for measuring the time it takes to boot the system +to a point where it hands over control to the user. + +**URL:** http://bootchart.org + +**Default options:** None +""" + + from lava_test.core.installers import TestInstaller from lava_test.core.parsers import TestParser from lava_test.core.runners import TestRunner === modified file 'lava_test/test_definitions/firefox.py' --- lava_test/test_definitions/firefox.py 2011-10-20 12:12:15 +0000 +++ lava_test/test_definitions/firefox.py 2012-01-19 00:11:33 +0000 @@ -13,6 +13,13 @@ # You should have received a copy of the GNU General Public License # along with this program. If not, see . +""" +The firefox benchmark measure the startup time for the firefox browser. + +**URL:** https://github.com/janimo/firefox-startup-timing + +**Default Options:** None +""" from lava_test.core.installers import TestInstaller from lava_test.core.parsers import TestParser === modified file 'lava_test/test_definitions/glmemperf.py' --- lava_test/test_definitions/glmemperf.py 2011-10-20 12:12:15 +0000 +++ lava_test/test_definitions/glmemperf.py 2012-01-19 00:11:33 +0000 @@ -13,6 +13,18 @@ # You should have received a copy of the GNU General Public License # along with this program. If not, see . +""" +GLMemPerf is an OpenGL ES 2.0 performance estimation tool that aims to +measure the memory bandwidth characteristics of a graphics implementation. +It performs a number of blit style renders using different texture formats, +sizes, orientations and fragment shaders. The results are given as frames +per second numbers. + +**URL:** http://gitorious.org/meego-graphics/glmemperf + +**Default Options:** -e shimage +""" + from lava_test.core.installers import TestInstaller from lava_test.core.parsers import TestParser === modified file 'lava_test/test_definitions/gmpbench.py' --- lava_test/test_definitions/gmpbench.py 2011-10-20 12:12:15 +0000 +++ lava_test/test_definitions/gmpbench.py 2012-01-19 00:11:33 +0000 @@ -14,10 +14,14 @@ # along with this program. If not, see . # """ - This script automates the automate installation, execution, and - results parsing for the GMPbench test suite. - The GMPbench test Suite is an open source test suite with the goal of - comparing different processors performance against eachother. +This script automates the automate installation, execution, and +results parsing for the GMPbench test suite. +The GMPbench test Suite is an open source test suite with the goal of +comparing different processors performance against eachother. + +**URL:** http://gmplib.org/gmpbench.html + +**Default Options:** None """ === modified file 'lava_test/test_definitions/gtkperf.py' --- lava_test/test_definitions/gtkperf.py 2011-10-20 12:12:15 +0000 +++ lava_test/test_definitions/gtkperf.py 2012-01-19 00:11:33 +0000 @@ -13,6 +13,14 @@ # You should have received a copy of the GNU General Public License # along with this program. If not, see . +""" +GtkPerf is an application designed to test GTK+ performance using predefined GTK+ widgets. + +**URL:** http://gtkperf.sourceforge.net/ + +**Default options:** -a -c 500 +""" + import re from lava_test.core.installers import TestInstaller === modified file 'lava_test/test_definitions/insanity.py' --- lava_test/test_definitions/insanity.py 2011-10-13 10:20:52 +0000 +++ lava_test/test_definitions/insanity.py 2012-01-19 00:11:33 +0000 @@ -14,6 +14,14 @@ # along with this program. If not, see . # +""" +GStreamer QA system + +**URL:** http://git.collabora.co.uk/?p=user/edward/gst-qa-system;a=summary + +**Default options:** None +""" + import os import re import subprocess === modified file 'lava_test/test_definitions/ltp.py' --- lava_test/test_definitions/ltp.py 2012-01-11 19:49:35 +0000 +++ lava_test/test_definitions/ltp.py 2012-01-19 00:11:33 +0000 @@ -13,6 +13,15 @@ # You should have received a copy of the GNU General Public License # along with this program. If not, see . +""" +The Linux Test Project is a collection of tools for testing Linux with a +focus on the kernel. + +**URL:** http://ltp.sourceforge.net + +**Default options:** -f syscalls -p -q +""" + import re === modified file 'lava_test/test_definitions/peacekeeper.py' --- lava_test/test_definitions/peacekeeper.py 2011-10-20 12:12:15 +0000 +++ lava_test/test_definitions/peacekeeper.py 2012-01-19 00:11:33 +0000 @@ -14,10 +14,12 @@ # along with this program. If not, see . """ - This script automates the automate installation, execution, and - results parsing for the Peacekeeper browser benchmark. - - http://clients.futuremark.com/peacekeeper/index.action +This script automates the automate installation, execution, and +results parsing for the Peacekeeper browser benchmark. + +**URL:** http://clients.futuremark.com/peacekeeper/index.action + +**Default options:** firefox """ === modified file 'lava_test/test_definitions/xrestop.py' --- lava_test/test_definitions/xrestop.py 2011-10-20 12:12:15 +0000 +++ lava_test/test_definitions/xrestop.py 2012-01-19 00:11:33 +0000 @@ -13,6 +13,14 @@ # You should have received a copy of the GNU General Public License # along with this program. If not, see . +""" +xrestop - test for X11 server resource usage monitor +^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ + +Default options: + None +""" + from lava_test.core.installers import TestInstaller from lava_test.core.parsers import TestParser from lava_test.core.runners import TestRunner