From patchwork Wed Jun 20 13:20:28 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 139338 Delivered-To: patch@linaro.org Received: by 2002:a2e:970d:0:0:0:0:0 with SMTP id r13-v6csp792005lji; Wed, 20 Jun 2018 06:26:53 -0700 (PDT) X-Google-Smtp-Source: ADUXVKIfTE3dcUW+a2Sx8OcGimkYsXN3Ro3hfi5PzjE6iy6duwVyErjLG0FnL30sVY/IdrZpUbMB X-Received: by 2002:a37:5e46:: with SMTP id s67-v6mr17258894qkb.202.1529501213882; Wed, 20 Jun 2018 06:26:53 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1529501213; cv=none; d=google.com; s=arc-20160816; b=Z8nqbN7Ax9QZnbWfvRqtbV8mtbAJDP0GKRg6f2eKL0FFuLccAPyrnvn1v0at6Tq8cu KTevPHyUPDvJziA3LI9jeT7trWVMh78K5C8tnk9qmP9PDmsrhRghFSCJBVGYXBZ3Nl6i N1dULSyix9NqTTZ+s8Fa3xnnsnJLNdw5/7bqPyQLYIDT1ms6ArNS4dL9OuUIjgRaakqF KyeNc2kcnnp9oTbnTx/FbN+Zwvq6qPjmlqvRxvXAKT8Z08SGHfNBSpqCK9ppMwtHdBa9 m/gSDlvVaUWqbkGXPB/CjtVcXOR+DbvraXGzx4iQk3wymtjOHAjIx4OniR9zsUj1yQjK x+jQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:subject :content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:arc-authentication-results; bh=wN6XNRgedUtJrvEhyG6whnN3+CYpPICCDRGCe6ZVR1A=; b=T7X4xeJPygX/H+BMeRyLbiErK233eRcxWc30Ia8iD0HF0vCD6pqcMlAqbkD4+uddvc 2xenFHOrFeN4ftpeqaf082L2V9YZ8oM3Ebnq6QJJ4f6S7RZW+koPj/2FWbymZbaW71HX 02Mtvu61HrBf0cehcAvARvCc8SerARCeaGnELiPA2+QdF0oZexaHUuxQKYjYXKWlQByJ M1Df/L9Ih+ZNQGQMTtcCTNS+3JW9GJk353foI90XMMSjoMNN9W4QRhXjfeRuqlYwmQYk 9lluzJ3gOSUynGaGUe5UlASpyjEPEraqXdOB1afmzHrjpJgYgH4l3Aq2PZuCeP2EqsCU YmCA== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b="KjVd/1Cm"; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [2001:4830:134:3::11]) by mx.google.com with ESMTPS id y48-v6si2407430qta.177.2018.06.20.06.26.53 for (version=TLS1 cipher=AES128-SHA bits=128/128); Wed, 20 Jun 2018 06:26:53 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) client-ip=2001:4830:134:3::11; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b="KjVd/1Cm"; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:49668 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVd8P-0004Tm-AH for patch@linaro.org; Wed, 20 Jun 2018 09:26:53 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:54992) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVd2N-0007yA-Dy for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:41 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fVd2K-0002kD-1s for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:39 -0400 Received: from mail-wm0-x244.google.com ([2a00:1450:400c:c09::244]:50499) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1fVd2J-0002jy-Pz for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:35 -0400 Received: by mail-wm0-x244.google.com with SMTP id e16-v6so5981715wmd.0 for ; Wed, 20 Jun 2018 06:20:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=wN6XNRgedUtJrvEhyG6whnN3+CYpPICCDRGCe6ZVR1A=; b=KjVd/1CmetSEHqdlwRg4woAfBqUMlaoTFbp8h8iQFxs90J7qCizN2TPq5SrsDkuy8U NvcdvBg7D4NmkTTFMVNhrLXzKzPDW/X+2cGcaCD2mNJ9EGhUgQuBnL8OVoTb9Zoq3ts6 2XZ0exQ4D9GkvKQTNxXM+XX/gh9na1h4UNrTo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=wN6XNRgedUtJrvEhyG6whnN3+CYpPICCDRGCe6ZVR1A=; b=CPwDNqkFsJ3ngoPbi9K2GZfLwFz5A+Dj23D4PMTJ4ag19zS/eZ3ZSJALrNJ0+KbxKK CQUDClA64Gzkr500PpgChoCRVYFGcQKQSBu+OdzjGgKAG10Jjg7Sp4tpJBI3bjyvvxFC nSmPmD0JxSZpXBwl/PBUjLeQP6PqKspDc4flZEqhufX95MCW82c79PjMIUJs8psLoOsN 32ARZI0ybHEPwF2qByQV7lZ3NWwbbbld8PNLF4STKqD1ZfGhlRgtyJCEARPJExdmjgyw KxMZE7y1kXTsQBGn8monZ/75Mpe6HT2pkP79UCDfLfW2TgSbvKLKRl7wviLCtVV+v4Ao mxSg== X-Gm-Message-State: APt69E3dJ3Nmfw6hVa2fg+pisWVLV/NrcUZCr0pAGLqky5M+4DnraiCm os12SPZd/zzazlsKheGprYtheg== X-Received: by 2002:a1c:9bd0:: with SMTP id d199-v6mr1780948wme.16.1529500834754; Wed, 20 Jun 2018 06:20:34 -0700 (PDT) Received: from zen.linaro.local ([81.128.185.34]) by smtp.gmail.com with ESMTPSA id b8-v6sm3103443wrp.50.2018.06.20.06.20.33 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 20 Jun 2018 06:20:34 -0700 (PDT) Received: from zen.linaroharston (localhost [127.0.0.1]) by zen.linaro.local (Postfix) with ESMTP id F0DF63E00A7; Wed, 20 Jun 2018 14:20:32 +0100 (BST) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: cota@braap.org, famz@redhat.com, berrange@redhat.com, f4bug@amsat.org, richard.henderson@linaro.org, balrogg@gmail.com, aurelien@aurel32.net, agraf@suse.de Date: Wed, 20 Jun 2018 14:20:28 +0100 Message-Id: <20180620132032.12952-2-alex.bennee@linaro.org> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20180620132032.12952-1-alex.bennee@linaro.org> References: <20180620132032.12952-1-alex.bennee@linaro.org> MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:400c:c09::244 Subject: [Qemu-devel] [RFC PATCH 1/5] build-system: remove per-test GCOV reporting X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?utf-8?q?Alex_Benn=C3=A9e?= , qemu-devel@nongnu.org Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" I'm not entirely sure who's using this information and certainly in a CI environment it just washes over as additional noise. Later patches will provide new reporting options so a user who wants to analyse individual tests will be able to use that to get the information. Signed-off-by: Alex Bennée --- docs/devel/testing.rst | 11 +++++------ tests/Makefile.include | 10 ---------- 2 files changed, 5 insertions(+), 16 deletions(-) -- 2.17.1 Reviewed-by: Philippe Mathieu-Daudé Tested-by: Philippe Mathieu-Daudé diff --git a/docs/devel/testing.rst b/docs/devel/testing.rst index f33e5a8423..66ef219f69 100644 --- a/docs/devel/testing.rst +++ b/docs/devel/testing.rst @@ -158,12 +158,11 @@ rarely used. See "QEMU iotests" section below for more information. GCC gcov support ---------------- -``gcov`` is a GCC tool to analyze the testing coverage by instrumenting the -tested code. To use it, configure QEMU with ``--enable-gcov`` option and build. -Then run ``make check`` as usual. There will be additional ``gcov`` output as -the testing goes on, showing the test coverage percentage numbers per analyzed -source file. More detailed reports can be obtained by running ``gcov`` command -on the output files under ``$build_dir/tests/``, please read the ``gcov`` +``gcov`` is a GCC tool to analyze the testing coverage by +instrumenting the tested code. To use it, configure QEMU with +``--enable-gcov`` option and build. Then run ``make check`` as usual. +Reports can be obtained by running ``gcov`` command on the output +files under ``$build_dir/tests/``, please read the ``gcov`` documentation for more information. QEMU iotests diff --git a/tests/Makefile.include b/tests/Makefile.include index ca91da26cb..55d54bd180 100644 --- a/tests/Makefile.include +++ b/tests/Makefile.include @@ -891,26 +891,16 @@ GCOV_OPTIONS = -n $(if $(V),-f,) .PHONY: $(patsubst %, check-qtest-%, $(QTEST_TARGETS)) $(patsubst %, check-qtest-%, $(QTEST_TARGETS)): check-qtest-%: subdir-%-softmmu $(check-qtest-y) - $(if $(CONFIG_GCOV),@rm -f *.gcda */*.gcda */*/*.gcda */*/*/*.gcda,) $(call quiet-command,QTEST_QEMU_BINARY=$*-softmmu/qemu-system-$* \ QTEST_QEMU_IMG=qemu-img$(EXESUF) \ MALLOC_PERTURB_=$${MALLOC_PERTURB_:-$$(( $${RANDOM:-0} % 255 + 1))} \ gtester $(GTESTER_OPTIONS) -m=$(SPEED) $(check-qtest-$*-y) $(check-qtest-generic-y),"GTESTER","$@") - $(if $(CONFIG_GCOV),@for f in $(gcov-files-$*-y) $(gcov-files-generic-y); do \ - echo Gcov report for $$f:;\ - $(GCOV) $(GCOV_OPTIONS) $$f -o `dirname $$f`; \ - done,) .PHONY: $(patsubst %, check-%, $(check-unit-y) $(check-speed-y)) $(patsubst %, check-%, $(check-unit-y) $(check-speed-y)): check-%: % - $(if $(CONFIG_GCOV),@rm -f *.gcda */*.gcda */*/*.gcda */*/*/*.gcda,) $(call quiet-command, \ MALLOC_PERTURB_=$${MALLOC_PERTURB_:-$$(( $${RANDOM:-0} % 255 + 1))} \ gtester $(GTESTER_OPTIONS) -m=$(SPEED) $*,"GTESTER","$*") - $(if $(CONFIG_GCOV),@for f in $(gcov-files-$(subst tests/,,$*)-y) $(gcov-files-generic-y); do \ - echo Gcov report for $$f:;\ - $(GCOV) $(GCOV_OPTIONS) $$f -o `dirname $$f`; \ - done,) # gtester tests with XML output From patchwork Wed Jun 20 13:20:29 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 139336 Delivered-To: patch@linaro.org Received: by 2002:a2e:970d:0:0:0:0:0 with SMTP id r13-v6csp788741lji; Wed, 20 Jun 2018 06:23:38 -0700 (PDT) X-Google-Smtp-Source: ADUXVKJ0wFid5ADZVgr8PxmDZn3C5Y21GlbNdWWe3TyMJ5KZ+eEDUcKo3aUE5/4ewjGerLFdGYXc X-Received: by 2002:ac8:1745:: with SMTP id u5-v6mr19152470qtk.50.1529501018137; Wed, 20 Jun 2018 06:23:38 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1529501018; cv=none; d=google.com; s=arc-20160816; b=kfkA68lDQsPpNLgD7+aWW9Cn4PBKzESkwzp/08jmJiRFPAchzKAP1k6Buyr+zjXz6E l3qxwFX5NcO8hYg48eMzC7LBH3JEMTEkBAOb7y8MnbdBGH0NAWdGDM0KHJI+/PNiIUiR JI6KlnjZTU8B1hgmpfo0OK7r758RYwYIic5fmeOuCH0B92TPTennLliMRZlrn2SQ9kn8 cLAGA+iV4PrAHR41rXsxlXIbp7EkX+QKPA3SKsGyjGT9hVZIpU0ONUo1v9p6i87ogIP4 /SyPbbnQDz83xqig5sqpCPUOd39qycF7N9LaA69Ym+T11mDYgOydTtcJliKKV+9eR+34 Y0YQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:subject :content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:arc-authentication-results; bh=ccjdWaqoluWFkOn2xFKw3BI4GzIQoWCqGahi56R6ic8=; b=D6zKCEDs+PVK7eQLj+Se2OEvrxUXOlCsoAlo280XWw+8YaRp5Vewd8NeFX1iRW1qOm NjZGagbznjOn9y6YmvJt2wSLRUMKV2IMHwu0S9fRGnd1Seof7hZCfs8FsVK/4DXxGZtG FdbTvGC6nrerXf2uw2J3fUEesYkHp3nBvrE/zWJx+6Ednokl6SkTNV9GLThxEW9ygGnB iZyXF5INPUuocoXWIg0iDBQHwFHXgYh3tDTAqFoNIZ4NnN9Dfavg5Fndn2kAoDP/VOqv 0EgVXuvGjEYwUtmTNuPNrw4BSp3pBCGFFK5H4W4Rqadg9fJ2QCASaD/ZCHJXY91GOdwp 1pXA== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=f1lyPuDS; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [2001:4830:134:3::11]) by mx.google.com with ESMTPS id y2-v6si2139357qvk.215.2018.06.20.06.23.37 for (version=TLS1 cipher=AES128-SHA bits=128/128); Wed, 20 Jun 2018 06:23:38 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) client-ip=2001:4830:134:3::11; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=f1lyPuDS; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:49633 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVd5F-0000nz-JR for patch@linaro.org; Wed, 20 Jun 2018 09:23:37 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:54991) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVd2N-0007y9-DR for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:40 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fVd2K-0002kU-Qa for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:39 -0400 Received: from mail-wm0-x241.google.com ([2a00:1450:400c:c09::241]:52981) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1fVd2K-0002k8-K8 for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:36 -0400 Received: by mail-wm0-x241.google.com with SMTP id p126-v6so5990738wmb.2 for ; Wed, 20 Jun 2018 06:20:36 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=ccjdWaqoluWFkOn2xFKw3BI4GzIQoWCqGahi56R6ic8=; b=f1lyPuDSZZnH27jI36niojCOeoZH1OSQALnvIaZSATL57nTljW+ktyf20qQ3o9Amf8 phED64G85fI3KkvVidUx1w+NjOLBwOevJ93Uu40pLr/k+EOGEhSGfPkHhWsZda5FkbCD rD1eKBQSc5AsWKmjbbDQSMiEXnwndnZ5w/ZFA= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=ccjdWaqoluWFkOn2xFKw3BI4GzIQoWCqGahi56R6ic8=; b=V3cyc4QLfLkNvVcmnnq++ItWeirlfSxe2uDJWmjgBEjZWWy+KOAv4C6rH3bmTENjJ+ jNzHOqgUuRHpymW2Ij/bkNEGiXi2USAPp14CyNuIkAi4UmS2rz40HLce4Tpmh7gU8vEy Uvp4gqnV7HI+XqBgyHOdEkq3zk489u5AGAzQVm0sUV7Aw6E8svC4EY3ETTu/URI3nIib z1vkkxXOWwdZNfr+9HYLwe2q5/1l5jNbcFTmnE5iH9oDAcqBk2Ff+5CZb729hmo4DHzj +oz1o292BwD550ptempbrXUiDbrtxB00DsBx9tefsd0OQR2ILXY1kRhWn6unygTCDy87 R0xg== X-Gm-Message-State: APt69E1i+Am+e2Hc8jdVF1H+qTUycVLF+lDaV1K1+1uY2SRTjkPnTpkC nhYX0NHmLdc9D7yq0OHIYoWmPQ== X-Received: by 2002:a1c:f415:: with SMTP id z21-v6mr1666367wma.80.1529500835581; Wed, 20 Jun 2018 06:20:35 -0700 (PDT) Received: from zen.linaro.local ([81.128.185.34]) by smtp.gmail.com with ESMTPSA id b204-v6sm2595773wmh.22.2018.06.20.06.20.33 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 20 Jun 2018 06:20:34 -0700 (PDT) Received: from zen.linaroharston (localhost [127.0.0.1]) by zen.linaro.local (Postfix) with ESMTP id 24D173E00D2; Wed, 20 Jun 2018 14:20:33 +0100 (BST) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: cota@braap.org, famz@redhat.com, berrange@redhat.com, f4bug@amsat.org, richard.henderson@linaro.org, balrogg@gmail.com, aurelien@aurel32.net, agraf@suse.de Date: Wed, 20 Jun 2018 14:20:29 +0100 Message-Id: <20180620132032.12952-3-alex.bennee@linaro.org> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20180620132032.12952-1-alex.bennee@linaro.org> References: <20180620132032.12952-1-alex.bennee@linaro.org> MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:400c:c09::241 Subject: [Qemu-devel] [RFC PATCH 2/5] .gitignore: add .gcov files X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?utf-8?q?Alex_Benn=C3=A9e?= , qemu-devel@nongnu.org Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" These are temporary files generated on gcov runs and shouldn't be included in the source tree. Signed-off-by: Alex Bennée --- .gitignore | 1 + 1 file changed, 1 insertion(+) -- 2.17.1 Reviewed-by: Philippe Mathieu-Daudé Tested-by: Philippe Mathieu-Daudé diff --git a/.gitignore b/.gitignore index 9da3b3e626..5668d02782 100644 --- a/.gitignore +++ b/.gitignore @@ -155,6 +155,7 @@ .sdk *.gcda *.gcno +*.gcov /pc-bios/bios-pq/status /pc-bios/vgabios-pq/status /pc-bios/optionrom/linuxboot.asm From patchwork Wed Jun 20 13:20:30 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 139341 Delivered-To: patch@linaro.org Received: by 2002:a2e:970d:0:0:0:0:0 with SMTP id r13-v6csp795901lji; Wed, 20 Jun 2018 06:30:30 -0700 (PDT) X-Google-Smtp-Source: ADUXVKI1vBzTbvow5m14TWXYWJIrbwXel5CDkUDruh7m4+No7B3VwdwdVjMlhIcdfaF/AquqZRcc X-Received: by 2002:ac8:1a13:: with SMTP id v19-v6mr18114776qtj.99.1529501430724; Wed, 20 Jun 2018 06:30:30 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1529501430; cv=none; d=google.com; s=arc-20160816; b=au+4M5ZD3+zbjCm1i30s8loS8W9ByAwcbqfyaOCU1X+xgJpFlnlKFUHbpVGt6+cxT3 cFOEtk7XrznMrF+cpzNKrAs6Cx2ALf0/RA8m/uaRarJU4ZQT94XOAdCfW7DBnM393Wfg Qg/SBGixYcZu/BekPioZaDd2QJZYyw9wPhqwcKpCgXlPdPA31yscU7j82Lku7i7kU2pn 05pZfSbB8lasmDe+KEQtdU+YsLe5Yb8C2Tyo7txg3YkyHtJ3n5119bS+ULwt2kRb216H DC1eQto7M59k1/j7cmiHAqJt2xfaRP3sZtI1hmbfN6R7twQvPYnZ1jc+mpDguuRhjGJM CIZw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:subject :content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:arc-authentication-results; bh=gIgbUK2fBQGW7ekPtBlXAL4um1NhJ9HA4ZfsnksaiAs=; b=NUAPiSph0aBMYAPeSjkumCUvSnHH0LSfjD2QsWCZseIliI/QOicOLtVBkRHIvR6TNc SGi/OnXW/KYRAlDIITmeHrCY3vPqt1Axo9V9vOyRCyHrUQWU9vFxbub5fHLTMqssR9MO 3/6lF/97bqON3PljZ3xIswsE+oJFrtjxnCHoe/bHd2J2jnAskti6vgwyvNEHXrRkmRdP /b9aLZMFjKMJ64JreV+xBZ2Fck6IVH3uCyM6FJWgTmrRiztnQhsmVHR31P/EJoY7Z/Hb sYPKN24EplFhbhKRf6PCOFPThuMbdUOaCplTkwAM/NNtnxOQL5nWSQXTvmBdp4PVuU2f 3P0w== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b="WNAJ/dmc"; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [2001:4830:134:3::11]) by mx.google.com with ESMTPS id m6-v6si2462336qtf.50.2018.06.20.06.30.30 for (version=TLS1 cipher=AES128-SHA bits=128/128); Wed, 20 Jun 2018 06:30:30 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) client-ip=2001:4830:134:3::11; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b="WNAJ/dmc"; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:49685 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVdBu-00080O-2I for patch@linaro.org; Wed, 20 Jun 2018 09:30:30 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:54993) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVd2N-0007yB-Dw for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:40 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fVd2L-0002kw-NE for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:39 -0400 Received: from mail-wm0-x22f.google.com ([2a00:1450:400c:c09::22f]:37754) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1fVd2L-0002kS-Fb for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:37 -0400 Received: by mail-wm0-x22f.google.com with SMTP id r125-v6so6890114wmg.2 for ; Wed, 20 Jun 2018 06:20:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=gIgbUK2fBQGW7ekPtBlXAL4um1NhJ9HA4ZfsnksaiAs=; b=WNAJ/dmcl1p0/E9TegAVb+m7IIQH/CKHpavZjlhYeGEIWpL8Omy41UczKMzf1RawOt //OPfPEcno4jEBiU8GQD4vSIy7MopCwITIKejTECL4e6uvAuou+e2uWUMFyLQ72BHPsb 2pSgMwBHywdaLyHeP7EOHFqWitUorJF5e/ChM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=gIgbUK2fBQGW7ekPtBlXAL4um1NhJ9HA4ZfsnksaiAs=; b=GoVgA2vzN28H9rlPdQg7pRmRQ702JpqUuzS9+JdE78tBFxuc7pvsVtYMWdPzeT5Zjw OIzXYpqJ+PtrA/oJBP8U4YUrWhAID2rXAAw4csdRIwmHVAcY0V+Ub/ohmdYe9hB79zMG 3QK6JwVClFpw/nBAps3itHeiuG9Rjo+OLrFCH9OQNSTY6o7/5+WKqvRfGxTCY+ofnhDR 5glLyeMKt1SLNpApGik3hnBOH0zcRSErw+NQNXZYd5xqNHZDY0YC9HBRuDvT6uWRr5b1 yhGEgaRopLC0MAC/1KU1MJPa1m10dYYx1TdpGf+lbXozuXL0swo9qF0oKN4BlyHI0eqk YgIA== X-Gm-Message-State: APt69E0TyMQ52u/Rpv9C6DVe9qFPIGboKLYeX0WP0QsZlOBr2p2Fju1P mwlWiNmNQ5RII0Knsbl6vcpYRw== X-Received: by 2002:a1c:3504:: with SMTP id c4-v6mr1628433wma.59.1529500836388; Wed, 20 Jun 2018 06:20:36 -0700 (PDT) Received: from zen.linaro.local ([81.128.185.34]) by smtp.gmail.com with ESMTPSA id c201-v6sm4080836wmh.18.2018.06.20.06.20.33 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 20 Jun 2018 06:20:34 -0700 (PDT) Received: from zen.linaroharston (localhost [127.0.0.1]) by zen.linaro.local (Postfix) with ESMTP id 48D283E08C1; Wed, 20 Jun 2018 14:20:33 +0100 (BST) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: cota@braap.org, famz@redhat.com, berrange@redhat.com, f4bug@amsat.org, richard.henderson@linaro.org, balrogg@gmail.com, aurelien@aurel32.net, agraf@suse.de Date: Wed, 20 Jun 2018 14:20:30 +0100 Message-Id: <20180620132032.12952-4-alex.bennee@linaro.org> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20180620132032.12952-1-alex.bennee@linaro.org> References: <20180620132032.12952-1-alex.bennee@linaro.org> MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:400c:c09::22f Subject: [Qemu-devel] [RFC PATCH 3/5] .travis.yml: add gcovr summary for GCOV build X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?utf-8?q?Alex_Benn=C3=A9e?= , qemu-devel@nongnu.org Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" This gives a more useful summary, sorted by descending % coverage, after the tests have run. The final numbers will give an idea if our coverage is getting better or worse. As quite a lot of lines don't get covered at all we filter out all the 0% lines. If the file doesn't appear it is not being exercised. Signed-off-by: Alex Bennée --- .travis.yml | 3 +++ 1 file changed, 3 insertions(+) -- 2.17.1 Reviewed-by: Philippe Mathieu-Daudé Tested-by: Philippe Mathieu-Daudé diff --git a/.travis.yml b/.travis.yml index fabfe9ec34..83e0577464 100644 --- a/.travis.yml +++ b/.travis.yml @@ -38,6 +38,7 @@ addons: - libvte-2.90-dev - sparse - uuid-dev + - gcovr # The channel name "irc.oftc.net#qemu" is encrypted against qemu/qemu # to prevent IRC notifications from forks. This was created using: @@ -81,6 +82,8 @@ matrix: compiler: clang # gprof/gcov are GCC features - env: CONFIG="--enable-gprof --enable-gcov --disable-pie --target-list=aarch64-softmmu,arm-softmmu,i386-softmmu,mips-softmmu,mips64-softmmu,ppc64-softmmu,riscv64-softmmu,s390x-softmmu,x86_64-softmmu" + after_success: + - gcovr -p | grep -v "0%" | sed s/[0-9]\*[,-]//g compiler: gcc # We manually include builds which we disable "make check" for - env: CONFIG="--enable-debug --enable-tcg-interpreter" From patchwork Wed Jun 20 13:20:31 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 139339 Delivered-To: patch@linaro.org Received: by 2002:a2e:970d:0:0:0:0:0 with SMTP id r13-v6csp793588lji; Wed, 20 Jun 2018 06:28:25 -0700 (PDT) X-Google-Smtp-Source: ADUXVKKTvJzQOiIKxcqfLGSUaK31JAPfPLtmjjkO4OtufmgXFVD6ew+b64jKcRvEb4Y3XVkAEXPc X-Received: by 2002:a37:19e3:: with SMTP id 96-v6mr17814141qkz.427.1529501305160; Wed, 20 Jun 2018 06:28:25 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1529501305; cv=none; d=google.com; s=arc-20160816; b=a9qZxLkEgEymUjXktME4DFMFd0AyJxjt/4/+Pd3d+f+BeeHFdBIp9/TJd1Zg7Lspra jrrLwIOMZoak+Ew0Xe6nmB3NWguYVLtCRr4G8kaRe0O02+C+gSxXiardKNx0xo01MRMa OSx2tLjeRE3p7wI7tZkk80go0rL3sEm/ezA4vgx8gFeEQwz08NsRxTWH8mf16JyKfERr 8SzX9yLF6BEP065Ey4BtWRwQQMaDQlIPgSzde9Q7TKs5WWCSOhBRAhkiwlXtJIq371Cp lsiy7qtYkLJ1HWr0PmxzwsmOW5Fp0YbrvcRPq34SXa1KIJCVsMRLDTGE3r9UDn9hwkxe q/Ww== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:subject :content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:arc-authentication-results; bh=OVAp7QMxQs2WEQyoZm93Y02LjcKymtDnW4R825/T0iQ=; b=GqZDHIy4z/c7us1lorj+IdQAWc4u/nT9LK03EbZaoFTV8F3/gSCLG3RJygbCCVqUdj edEiDNRKJHTOWAZ4wm6HH2XF3RFtIXbRCxE1dLVo3DQkH/GrCLsD4/JzrclzAKupRT61 AsfugxDnDYH1JSKNIeMspZiNS2XUpfTr9HmeNUJhe/KcqMAo7zv/JmEy4wrMxwEjXn6T zFfDvhRSp15wCBgzgzAkt90QTy1EtN95l+wGbvgR/KnOdOmoPuxZXcc7aKzTQBHg47A7 xGtzakHJJ4h/sEu2prmKL+QX3GgPWbIsyVGqPukcPTQj7D5SEuZAwEQhqonNbTKcHyud egNw== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=bxdnKNtm; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [2001:4830:134:3::11]) by mx.google.com with ESMTPS id 47-v6si206047qvj.156.2018.06.20.06.28.24 for (version=TLS1 cipher=AES128-SHA bits=128/128); Wed, 20 Jun 2018 06:28:25 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) client-ip=2001:4830:134:3::11; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=bxdnKNtm; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:49673 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVd9s-0005LO-Kv for patch@linaro.org; Wed, 20 Jun 2018 09:28:24 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:54996) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVd2N-0007yD-Ds for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:41 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fVd2M-0002lJ-88 for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:39 -0400 Received: from mail-wm0-x244.google.com ([2a00:1450:400c:c09::244]:40168) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1fVd2M-0002kq-22 for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:38 -0400 Received: by mail-wm0-x244.google.com with SMTP id n5-v6so6850999wmc.5 for ; Wed, 20 Jun 2018 06:20:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=OVAp7QMxQs2WEQyoZm93Y02LjcKymtDnW4R825/T0iQ=; b=bxdnKNtm0ttbSyP/oUG+k+EnoYPTJrEj2Rv2/OvGIvTxBckCMGrzpxzdtCSWjgV3DK G+ilxJ4OW8vzJoFQ1Nv3HAr1uOvwOJl+xuuJL8PygXsqHpsaFn6R/D9hKUfRsbUsiJbf 5jxICekqfnUPIc+55u+9LMRB4OejaxjzUNyrs= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=OVAp7QMxQs2WEQyoZm93Y02LjcKymtDnW4R825/T0iQ=; b=OWU+C7yjDEjqYvvzJ06J21oZhydUPkdy5rMnEAFFFnTOpUkNwn0WH4HpPWjZNpSPFb xfuEKcmQltGCBLaTtsjRe7uyf1L7daAnABgXAnaLRGhnuJGDDckvIHV2RmIBH5uV3Ryh R/lbo2vjWCNj6DLyaZFY255IPdTV6TTMRvWczq/YNK5O1Rvd7ZkUbxGMFcJzDdWg2M/y VXmu3lYPMpEZLvmh9NcfthhzsnK79ZiHQrJUhPbZnI3w4c+rTvuO8kHFeJ1j4hx3ZxvN xbssqC2WG66Etu1hH+x0BU2zNQV022kpm7v7TK+r93UBL4wkqMdist232F8iGfmYBIAG ewOQ== X-Gm-Message-State: APt69E2Hf8GwS/RHcBKMTmHxzeSjCviO62mnZaPrM9JIVYTcZ0ZqmPZn fZfH8vfR0q2g3DOztcdlQg3Ftg== X-Received: by 2002:a1c:e846:: with SMTP id f67-v6mr1706778wmh.63.1529500837096; Wed, 20 Jun 2018 06:20:37 -0700 (PDT) Received: from zen.linaro.local ([81.128.185.34]) by smtp.gmail.com with ESMTPSA id d3-v6sm3430119wri.24.2018.06.20.06.20.33 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 20 Jun 2018 06:20:34 -0700 (PDT) Received: from zen.linaroharston (localhost [127.0.0.1]) by zen.linaro.local (Postfix) with ESMTP id 7E01E3E08E5; Wed, 20 Jun 2018 14:20:33 +0100 (BST) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: cota@braap.org, famz@redhat.com, berrange@redhat.com, f4bug@amsat.org, richard.henderson@linaro.org, balrogg@gmail.com, aurelien@aurel32.net, agraf@suse.de Date: Wed, 20 Jun 2018 14:20:31 +0100 Message-Id: <20180620132032.12952-5-alex.bennee@linaro.org> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20180620132032.12952-1-alex.bennee@linaro.org> References: <20180620132032.12952-1-alex.bennee@linaro.org> MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:400c:c09::244 Subject: [Qemu-devel] [RFC PATCH 4/5] build-system: add clean-coverage target X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?utf-8?q?Alex_Benn=C3=A9e?= , qemu-devel@nongnu.org Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" This can be used to remove any stale coverage data before any particular test run. This is useful for analysing individual tests. Signed-off-by: Alex Bennée --- Makefile | 11 +++++++++++ docs/devel/testing.rst | 11 ++++++++--- 2 files changed, 19 insertions(+), 3 deletions(-) -- 2.17.1 Tested-by: Philippe Mathieu-Daudé Reviewed-by: Philippe Mathieu-Daudé diff --git a/Makefile b/Makefile index e46f2b625a..cb4af8bf80 100644 --- a/Makefile +++ b/Makefile @@ -725,6 +725,14 @@ module_block.h: $(SRC_PATH)/scripts/modules/module_block.py config-host.mak $(addprefix $(SRC_PATH)/,$(patsubst %.mo,%.c,$(block-obj-m))), \ "GEN","$@") +ifdef CONFIG_GCOV +.PHONY: clean-coverage +clean-coverage: + $(call quiet-command, \ + find . \( -name '*.gcda' -o -name '*.gcov' \) -type f -exec rm {} +, \ + "CLEAN", "coverage files") +endif + clean: # avoid old build problems by removing potentially incorrect old files rm -f config.mak op-i386.h opc-i386.h gen-op-i386.h op-arm.h opc-arm.h gen-op-arm.h @@ -1075,6 +1083,9 @@ endif echo '') @echo 'Cleaning targets:' @echo ' clean - Remove most generated files but keep the config' +ifdef CONFIG_GCOV + @echo ' clean-coverage - Remove coverage files' +endif @echo ' distclean - Remove all generated files' @echo ' dist - Build a distributable tarball' @echo '' diff --git a/docs/devel/testing.rst b/docs/devel/testing.rst index 66ef219f69..a3652aea14 100644 --- a/docs/devel/testing.rst +++ b/docs/devel/testing.rst @@ -161,9 +161,14 @@ GCC gcov support ``gcov`` is a GCC tool to analyze the testing coverage by instrumenting the tested code. To use it, configure QEMU with ``--enable-gcov`` option and build. Then run ``make check`` as usual. -Reports can be obtained by running ``gcov`` command on the output -files under ``$build_dir/tests/``, please read the ``gcov`` -documentation for more information. + +If you want to gather coverage information on a single test the ``make +clean-coverage`` target can be used to any existing coverage +information before running a single test. + +Reports can be obtained by running ``gcov`` command +on the output files under ``$build_dir/tests/``, please read the +``gcov`` documentation for more information. QEMU iotests ============ From patchwork Wed Jun 20 13:20:32 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 139342 Delivered-To: patch@linaro.org Received: by 2002:a2e:970d:0:0:0:0:0 with SMTP id r13-v6csp796453lji; Wed, 20 Jun 2018 06:30:56 -0700 (PDT) X-Google-Smtp-Source: ADUXVKJ6D4GB0LHWNnYbqQGGeOYZKPFBK3++Xd41Mt8jyYYGI8+ZeWQHqXstgArkbMcKuGFu4Ie4 X-Received: by 2002:a0c:964e:: with SMTP id 14-v6mr18347227qvy.98.1529501456296; Wed, 20 Jun 2018 06:30:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1529501456; cv=none; d=google.com; s=arc-20160816; b=Ky6U55bKt4w2hXpfvWUXFf4apr88EAOxUZhwQVYkAoW+uzApLFozR4U3PYvqR8YJPz nzo1P1s8pQo5SeRgbU+bPP3SAGqxDWVJt0Md3iBbwVV67XTcT+fIx8MiMA1BsK7fmRNz HnIszMjQv20bSVL2kWpy5x/T48PBb+GQmyZ1WQgVYwboxF0aiPcZyzhWu6g3t9sr/9gK 1nfCE+UTyQ/d6UJt6YDprXZRtwlqalZmC2C9KAy01bzpmMHfBTcrtZWTI3ZpZQjGQyso XS9gpTZcwMYGLw5KY5jsEKZZbAhgBVTtBad6pKpTFrfywM0HsJRlWddBJafT2LCiRDw2 ulTw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:subject :content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:to:from:dkim-signature:arc-authentication-results; bh=pAwjhM+QKaOn/D5Q7G6m80xibAAi7GmM7LxpKJMtf9Y=; b=gn2neIxJfnBUJajtAT49whVlEn/z3qBn5InXPNsSbRE6m1pGqRV5VugE5eOgQNiW5x tDLwtPF9gd5PLH4nsFbuJZ7u32mhBNLZiiCZHch4AlJ8Z+9NDIYEe7nxIzD4SzbYowOn 7Rt7NSEsNVhy3bYCTFt03gmC5BHnYRVuLJxNX9VkYSYm1PL0snipDxHH4P1SluziVXEl E92ldzvNYKe/BfVjz0RxYBsWd8bmOMAEUxusi25Zon/sUqc33yoxthwOVK479R/Emu0y VywAoG+GG+HnkoBLfr6Mufm5xapcrfTk3Xzj/Fp8dYD9hzZeN8rx9lRrtgTlXQiDUDCW s+ew== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=Ai3D1Rgh; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [2001:4830:134:3::11]) by mx.google.com with ESMTPS id p6-v6si2425431qvk.246.2018.06.20.06.30.56 for (version=TLS1 cipher=AES128-SHA bits=128/128); Wed, 20 Jun 2018 06:30:56 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) client-ip=2001:4830:134:3::11; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=Ai3D1Rgh; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 2001:4830:134:3::11 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:49688 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVdCJ-0008Sp-PO for patch@linaro.org; Wed, 20 Jun 2018 09:30:55 -0400 Received: from eggs.gnu.org ([2001:4830:134:3::10]:55063) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fVd2P-000809-A2 for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:42 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fVd2N-0002mI-GY for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:41 -0400 Received: from mail-wr0-x244.google.com ([2a00:1450:400c:c0c::244]:34551) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1fVd2N-0002ld-4w for qemu-devel@nongnu.org; Wed, 20 Jun 2018 09:20:39 -0400 Received: by mail-wr0-x244.google.com with SMTP id a12-v6so3306000wro.1 for ; Wed, 20 Jun 2018 06:20:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=pAwjhM+QKaOn/D5Q7G6m80xibAAi7GmM7LxpKJMtf9Y=; b=Ai3D1Rghi7dRZNwQNJAwN+tgrdqVV6anoE17mDbc9UFETb476D5LdAE0QXwA9k93J+ brIcnOd0oBj/eoVeWbrB0mOKn9L4gHPAQzs4NrX7kNPp+/gevnU6n5lpUtAwC5Q5zkyI Pm6AYa7v3x4sNM84JNWPDd/k3xPYRR7e5l1og= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=pAwjhM+QKaOn/D5Q7G6m80xibAAi7GmM7LxpKJMtf9Y=; b=Mc00fWYqXPAZsuHquot0Tt1pv4rD5NXoh5e68CLIr+3N/WlWiQynivMw7j1M02rRIW 7zbCSYqOMJJbp+p19FVNa4h5DyyfkLk0630kk4959Eu9K+njeDgQab9oOxeKVzvmq4S/ RtY92rvjcLde0jk4v4SBZrhwgvienxhhtacxUvGrkpOiLJBxwAROXmniugu3pWEeADKu DWH3qtgVYDpm0OcBWGxBAeds6kT0XfDLyI+8Cmlg5lRzGVvns1UxPqjElLu0bumZKcsm 8vg43aTvMgaZobawhvBpPiSZOf31LmbfyN+WJMuMiwh7ifvpb1jteclnPMBv34tqq8Nv LMvQ== X-Gm-Message-State: APt69E1sjtZES83bXcJhczgwfFNXFfX1tmUlfMCwPr/QBgGXcCkDsS/p p6IFpABFAX1CBDxDf06fKFgtxg== X-Received: by 2002:adf:a35b:: with SMTP id d27-v6mr1763804wrb.189.1529500838179; Wed, 20 Jun 2018 06:20:38 -0700 (PDT) Received: from zen.linaro.local ([81.128.185.34]) by smtp.gmail.com with ESMTPSA id w24-v6sm1970475wmc.15.2018.06.20.06.20.34 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 20 Jun 2018 06:20:37 -0700 (PDT) Received: from zen.linaroharston (localhost [127.0.0.1]) by zen.linaro.local (Postfix) with ESMTP id A4A8C3E08E8; Wed, 20 Jun 2018 14:20:33 +0100 (BST) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: cota@braap.org, famz@redhat.com, berrange@redhat.com, f4bug@amsat.org, richard.henderson@linaro.org, balrogg@gmail.com, aurelien@aurel32.net, agraf@suse.de Date: Wed, 20 Jun 2018 14:20:32 +0100 Message-Id: <20180620132032.12952-6-alex.bennee@linaro.org> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20180620132032.12952-1-alex.bennee@linaro.org> References: <20180620132032.12952-1-alex.bennee@linaro.org> MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:400c:c0c::244 Subject: [Qemu-devel] [RFC PATCH 5/5] build-system: add coverage-report target X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?utf-8?q?Alex_Benn=C3=A9e?= , qemu-devel@nongnu.org Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" This will build a coverage report under the current directory in reports/coverage. At the users option a report can be generated by directly invoking something like: make foo/bar/coverage-report.html Signed-off-by: Alex Bennée --- Makefile | 13 +++++++++++++ docs/devel/testing.rst | 11 ++++++++--- 2 files changed, 21 insertions(+), 3 deletions(-) -- 2.17.1 Reviewed-by: Philippe Mathieu-Daudé Tested-by: Philippe Mathieu-Daudé diff --git a/Makefile b/Makefile index cb4af8bf80..7450e0b7b5 100644 --- a/Makefile +++ b/Makefile @@ -988,6 +988,16 @@ docs/interop/qemu-qmp-ref.dvi docs/interop/qemu-qmp-ref.html \ docs/interop/qemu-qmp-ref.txt docs/interop/qemu-qmp-ref.7: \ docs/interop/qemu-qmp-ref.texi docs/interop/qemu-qmp-qapi.texi +# Reports/Analysis + +%/coverage-report.html: + @mkdir -p $* + $(call quiet-command,\ + gcovr -p --html --html-details -o $@, \ + "GEN", "coverage-report.html") + +.PHONY: coverage-report +coverage-report: $(CURDIR)/reports/coverage/coverage-report.html ifdef CONFIG_WIN32 @@ -1097,6 +1107,9 @@ endif @echo 'Documentation targets:' @echo ' html info pdf txt' @echo ' - Build documentation in specified format' +ifdef CONFIG_GCOV + @echo ' coverage-report - Create code coverage report' +endif @echo '' ifdef CONFIG_WIN32 @echo 'Windows targets:' diff --git a/docs/devel/testing.rst b/docs/devel/testing.rst index a3652aea14..9dcdd19260 100644 --- a/docs/devel/testing.rst +++ b/docs/devel/testing.rst @@ -166,9 +166,14 @@ If you want to gather coverage information on a single test the ``make clean-coverage`` target can be used to any existing coverage information before running a single test. -Reports can be obtained by running ``gcov`` command -on the output files under ``$build_dir/tests/``, please read the -``gcov`` documentation for more information. +You can generate a HTML coverage report by executing ``make +coverage-report`` which will generate into +./reports/coverage/coverage-report.html. If you want to generate it +elsewhere simply execute ``make /foo/bar/baz/coverage-report.html``. + +Further analysis can be conducted by running the ``gcov`` command +directly on the various .gcda output files. Please read the ``gcov`` +documentation for more information. QEMU iotests ============