From patchwork Thu Jul 12 08:41:05 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Christophe Lyon X-Patchwork-Id: 141808 Delivered-To: patch@linaro.org Received: by 2002:a2e:9754:0:0:0:0:0 with SMTP id f20-v6csp1243655ljj; Thu, 12 Jul 2018 01:42:11 -0700 (PDT) X-Google-Smtp-Source: AAOMgpc9AxCgLT5qjPduTQVaNMNaTqrDRIzYTv4f0U0QOod9PWscQ0vIKYE438Vw88eukYEPfa8U X-Received: by 2002:a17:902:8486:: with SMTP id c6-v6mr1252150plo.283.1531384931541; Thu, 12 Jul 2018 01:42:11 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1531384931; cv=none; d=google.com; s=arc-20160816; b=rIdzTOFZPmcyrzYc5PXQV7REvPTdx6HWol5NGdrC02Urz6N2EKr/aM/+oMEBWkIA3v S8pceXQLwmL4O3gOKxXtGFXu+7mJ3IdmXTSYhxAi3G8xACCt+nRw8mzYjzvob/tq+MY7 lA1LT2bL3vrnqahaZ7lDcpJbb8IS9lcA7s5btc/gnE3HyuwHl/vKKLz9gXbHAQbVgkY2 8qVsnYSpjz8QIHOCFo2SOZaoseMl61EIO8Iw0zCrVwmooxFucAmGMEG5qgpVPIP0zHQS s95q/7djDIx4YAgUfOH830oDDCEYOUeY4yMG8WDovF1m49dXpQeg62TIQQAfOhOkmZqQ lTUA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=to:subject:message-id:date:from:mime-version:dkim-signature :delivered-to:sender:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:mailing-list:dkim-signature :domainkey-signature:arc-authentication-results; bh=YhnwnjOZtGYOY8nL54MtWA707sRwXNqEqy9Tgwtof4Q=; b=gLE9OxeIrZLFL8zIk1kY0TdnVnsstFJJI1eDiVw9CjJ0i5zeSB07LtGOt0d3w+vvex Cr2MSOK5ce++NDKcoXOpcCgu3SmnUMy7jA1aTdh5M9u4jFcKDy8sWDXbXH7Y3bc3UHND KPa+SVdKYlPpOmq2X54W1Lq4AHhr9/UwQoeNUF/HUCpMINYBmAWsoMYg1uSvN7ZSSDlj R+Zf+zzK8pitdth6MjyUMGNIpCi86UlML2RtfMo8EYwWRAJwSQjkHc/s4BB79u98r5A0 4Xpje5ENDBVKwGM+HyVHFL5rVlXaC2wC7behdiYVD8R5N5LVEqXShnkGCTWz+o2btMrq RLEw== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@gcc.gnu.org header.s=default header.b=Gj7maEU4; dkim=neutral (body hash did not verify) header.i=@linaro.org header.s=google header.b=CoAfSDE+; spf=pass (google.com: domain of gcc-patches-return-481407-patch=linaro.org@gcc.gnu.org designates 209.132.180.131 as permitted sender) smtp.mailfrom="gcc-patches-return-481407-patch=linaro.org@gcc.gnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from sourceware.org (server1.sourceware.org. [209.132.180.131]) by mx.google.com with ESMTPS id e21-v6si20935839pgb.131.2018.07.12.01.42.11 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 12 Jul 2018 01:42:11 -0700 (PDT) Received-SPF: pass (google.com: domain of gcc-patches-return-481407-patch=linaro.org@gcc.gnu.org designates 209.132.180.131 as permitted sender) client-ip=209.132.180.131; Authentication-Results: mx.google.com; dkim=pass header.i=@gcc.gnu.org header.s=default header.b=Gj7maEU4; dkim=neutral (body hash did not verify) header.i=@linaro.org header.s=google header.b=CoAfSDE+; spf=pass (google.com: domain of gcc-patches-return-481407-patch=linaro.org@gcc.gnu.org designates 209.132.180.131 as permitted sender) smtp.mailfrom="gcc-patches-return-481407-patch=linaro.org@gcc.gnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org DomainKey-Signature: a=rsa-sha1; c=nofws; d=gcc.gnu.org; h=list-id :list-unsubscribe:list-archive:list-post:list-help:sender :mime-version:from:date:message-id:subject:to:content-type; q= dns; s=default; b=HdPjBCouzwHovjuDK/ga79G4FZbNsTzJ59H7NRLPhLznRO yStaMVoirc/hfKyGmN/Dfsk3XEhvaskEk4VyF4+eOcSqZbGmnLWIrkHKGVdnWbNd 7izvbVKPSYLAojAUqWYe5WseXfePyPCJj7yEOWB5vDWiw6GxOycK+JZF4WobI= DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=gcc.gnu.org; h=list-id :list-unsubscribe:list-archive:list-post:list-help:sender :mime-version:from:date:message-id:subject:to:content-type; s= default; bh=6qMQ4lwa5/spwVDU4ZK0gZASsx4=; b=Gj7maEU4nbCUKcKs0p0U zmzH5v8pDJTRtP6filEQN4XX57Itc+v47hvFpoFW14dhXIZPKaNkby6k9si4GOlB fzPC8dnQzbO9ozkSEo8ii+bY0MEJZUkTIbyWYF9NEV4LFeevHzPYld0f6JFq2JNR Nwn5FiqeONjlqHx+WxqXxHk= Received: (qmail 36349 invoked by alias); 12 Jul 2018 08:41:55 -0000 Mailing-List: contact gcc-patches-help@gcc.gnu.org; run by ezmlm Precedence: bulk List-Id: List-Unsubscribe: List-Archive: List-Post: List-Help: Sender: gcc-patches-owner@gcc.gnu.org Delivered-To: mailing list gcc-patches@gcc.gnu.org Received: (qmail 36132 invoked by uid 89); 12 Jul 2018 08:41:20 -0000 Authentication-Results: sourceware.org; auth=none X-Spam-SWARE-Status: No, score=-25.2 required=5.0 tests=AWL, BAYES_00, GIT_PATCH_0, GIT_PATCH_1, GIT_PATCH_2, GIT_PATCH_3, RCVD_IN_DNSWL_NONE, SPF_PASS autolearn=ham version=3.3.2 spammy= X-HELO: mail-ua0-f173.google.com Received: from mail-ua0-f173.google.com (HELO mail-ua0-f173.google.com) (209.85.217.173) by sourceware.org (qpsmtpd/0.93/v0.84-503-g423c35a) with ESMTP; Thu, 12 Jul 2018 08:41:19 +0000 Received: by mail-ua0-f173.google.com with SMTP id x18-v6so17925429uaj.9 for ; Thu, 12 Jul 2018 01:41:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=mime-version:from:date:message-id:subject:to; bh=Rkt8BCBheyxoWSYh7jQlDFp/rfuyWDYdxW/2NPdRj+s=; b=CoAfSDE+fqcwEnRLWS47wnH3HP3wg3+2LZr2H8pTACpCYXWoLwxxPevooEw7/VijZD ffaACu++rX+6ALpC1ogGKKVQ5xpwB0pQkJh2qBcseSg4GCdpP1cshUAtOp4IPTfmOlpH BCeYZP2jdlIyxvLryrtnus0LowtsgFm8JMkI4= MIME-Version: 1.0 From: Christophe Lyon Date: Thu, 12 Jul 2018 10:41:05 +0200 Message-ID: Subject: [contrib] compare_tests: Print number of tests To: gcc Patches X-IsSubscribed: yes Hi, It can be useful to print the number of tests in each category, eg: Tests that now work, but didn't before (65 tests): instead of Tests that now work, but didn't before: This small patch does that. OK? Thanks, Christophe contrib/ChangeLog: 2018-07-12 Christophe Lyon * compare_tests: Print number of tests in each category. diff --git a/contrib/compare_tests b/contrib/compare_tests index 51a3719..2dfa864 100755 --- a/contrib/compare_tests +++ b/contrib/compare_tests @@ -129,7 +129,8 @@ grep '^PASS' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -12 $tmp1 - >$tmp2 grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "Tests that now fail, but worked before:" + num=`cat $tmp2 | wc -l` + echo "Tests that now fail, but worked before ($num tests):" echo cat $tmp2 echo @@ -141,7 +142,8 @@ grep '^FAIL' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -12 $tmp1 - >$tmp2 grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "Tests that now work, but didn't before:" + num=`cat $tmp2 | wc -l` + echo "Tests that now work, but didn't before ($num tests):" echo cat $tmp2 [ -n "$strict" ] && echo "Strict test fails" && exit_status=1 @@ -153,7 +155,8 @@ grep '^[PF]A[SI][SL]' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -23 $tmp1 - >$t grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "New tests that FAIL:" + num=`cat $tmp2 | wc -l` + echo "New tests that FAIL ($num tests):" echo cat $tmp2 echo @@ -165,7 +168,8 @@ grep '^[PF]A[SI][SL]' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -23 $tmp1 - >$t grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "New tests that PASS:" + num=`cat $tmp2 | wc -l` + echo "New tests that PASS ($num tests):" echo cat $tmp2 [ -n "$strict" ] && echo "Strict test fails" && exit_status=1 @@ -177,7 +181,8 @@ grep '^PASS' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -13 $tmp1 - >$tmp2 grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "Old tests that passed, that have disappeared: (Eeek!)" + num=`cat $tmp2 | wc -l` + echo "Old tests that passed, that have disappeared ($num tests): (Eeek!)" echo cat $tmp2 [ -n "$strict" ] && echo "Strict test fails" && exit_status=1 @@ -189,7 +194,8 @@ grep '^FAIL' "$before_s" | sed 's/^[^:]*:[ ]//' | comm -13 $tmp1 - >$tmp2 grep -s . $tmp2 >/dev/null if [ $? = 0 ]; then - echo "Old tests that failed, that have disappeared: (Eeek!)" + num=`cat $tmp2 | wc -l` + echo "Old tests that failed, that have disappeared ($num tests): (Eeek!)" echo cat $tmp2 [ -n "$strict" ] && echo "Strict test fails" && exit_status=1