From patchwork Wed Nov 13 14:21:01 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 179308 Delivered-To: patch@linaro.org Received: by 2002:a92:38d5:0:0:0:0:0 with SMTP id g82csp9666513ilf; Wed, 13 Nov 2019 06:22:31 -0800 (PST) X-Google-Smtp-Source: APXvYqwbaOotZAugLK11Tn7ppSp9lJWmEdEaeC171mFJNHvz1Ea4RNhf9v4b6Kcw7J+aMXLZ9egC X-Received: by 2002:a37:4ccb:: with SMTP id z194mr2621094qka.128.1573654951321; Wed, 13 Nov 2019 06:22:31 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1573654951; cv=none; d=google.com; s=arc-20160816; b=Cf+Sex1CxI9PCosadf6vLXX0BWzR91iPfMrbqH/CCCEWdSbpakvfKGL8bZIgFp/a5e 2ZjwqB1O5dXUtCEX41H7FGxAgLEznepCy6uk/SWZt4UD7nnpZZY4jW41yRqUGBkPl0aR BlV2PRhHHTjFSrUK7wVF8Ex4Rl3JOJmd6U93KnY2/V+8FXbQTC78uUUyPb+Vnmdagpvd 7n9drHVuI42vGCXe1v0VYqVk467NJhXclJ+OY33Yhe4H9BIn6fVcUS/jRsoU6u9nhZ/d ii/jY7BaIDxmBp0BWi5on0SJFq3W53xOCZOC2eR7HolPaHlPsnWzuXs8swQRmee3Wr/R JS1w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:to:from:dkim-signature; bh=0Ynf0kKSMAZy2MsOiephMWqYKhqXXsF///fo2m5tGYc=; b=uBXYHBs6HXjw2MaV0LIaKSUs0KNthvMvhcnlyz+JTUlICzkN1+bTxqkCh+U3OkMh5D 2VCPA82DSAf7vrekIdLwsIc3TaVa+GbrEsrypH/7c4CuxT4HdYoj8xvbXQ+usX0REJmA lefmULWUWzs+R2YGZyM2yco+C2sezcL6Y39t0VAi9WWIhxGD+jH5r/EOHrYQZ0ANsNG6 XCDJSPs+F3WIO7gm8SRTExCpFps96y+rt6fH1kLEpMjtRZUMytKwZhtAAHH0+/s1PFgn lYFo91xBZ8spwCnfPYMQsWo8DYl99lpucBmT+FaWxeJUby+SHMjHwgvzSSfCgOjZAnWB MbVw== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b="dN0/+Cty"; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id q25si1328921qtl.279.2019.11.13.06.22.31 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 13 Nov 2019 06:22:31 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b="dN0/+Cty"; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:45536 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iUtXS-00019q-PW for patch@linaro.org; Wed, 13 Nov 2019 09:22:30 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:52448) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iUtWE-00008L-LM for qemu-devel@nongnu.org; Wed, 13 Nov 2019 09:21:15 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1iUtWD-0001El-An for qemu-devel@nongnu.org; Wed, 13 Nov 2019 09:21:14 -0500 Received: from mail-wr1-x442.google.com ([2a00:1450:4864:20::442]:39648) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1iUtWD-0001Dj-4Z for qemu-devel@nongnu.org; Wed, 13 Nov 2019 09:21:13 -0500 Received: by mail-wr1-x442.google.com with SMTP id l7so2569796wrp.6 for ; Wed, 13 Nov 2019 06:21:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=0Ynf0kKSMAZy2MsOiephMWqYKhqXXsF///fo2m5tGYc=; b=dN0/+CtyV2mkTsLup/inayU5jXzjaHsb/AQ2GCGgGVizpown3F+RvfXU59XsfeNbiW gHwTvBIQW1ho01fm783jRkxa+DsDZ03gpFA9xN3FEBe4EzrY7hRDhzSpbuhfWEYToziC Fx2H880WjGV2Vukg8PBnwrJJpbn5NMh6Nnxv0HIPAoiMnt5aWucwzzwH249DLDT2do4s E3X69UEHftBFqHTMwg+Pa8hkxN3LNSKIi1geiClVEAAWXp6Pd5955cz/Og1EFA3+EvdD QuMAr2nnQj5kSLgHfnHONy041W79VEmCJC4OxiOx3+5yDTUiF/HzrEslKbqFtLWCGv2t 3Hww== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=0Ynf0kKSMAZy2MsOiephMWqYKhqXXsF///fo2m5tGYc=; b=dUApquyQk8Pt0GR225FTbhvf8vtaPNjQvaFUQ8nMBpR6dRJi+XXZtyoZaBS698d2CX U7C9xDADfhkTEI6SSQTKImZ0W8YdyLaHbu45TupUQMkcTXklfZUgdEnSPFexuETE0FY5 l5JUPtaehlZD4Fa3OPK34gqMhmvFBr/V0fkBOD9sG2Vd8SwuFDSVecRuYK7S4rM0ZjWt ZGDLepLrX5ncU+dfKf8dPW8xg+Rqs/0F8UrH90dui6oVzfjiPXxP3tVLrPRIuDWpq+rD ekgOJQJ5q0ePtDiUKqQvbr5owFUmJoLAVdP8mSYZdqYswrJ1rq05CW9ogE1hDSc5PSmD nEPQ== X-Gm-Message-State: APjAAAUadfLdcHA0CoqR6fayUXV3acFaLNoWbYaji7t7Jps17qpHW3mg 0v5QpSLKMP1tT0jDCbqR6i34Tw== X-Received: by 2002:adf:e3c6:: with SMTP id k6mr2945171wrm.135.1573654871404; Wed, 13 Nov 2019 06:21:11 -0800 (PST) Received: from zen.linaroharston ([51.148.130.216]) by smtp.gmail.com with ESMTPSA id y6sm3070510wrw.6.2019.11.13.06.21.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 13 Nov 2019 06:21:09 -0800 (PST) Received: from zen.lan (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id BAFAC1FF87; Wed, 13 Nov 2019 14:21:08 +0000 (GMT) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: pbonzini@redhat.com Subject: [RFC PATCH] scripts/tap-driver: report "slow" tests (HACK) Date: Wed, 13 Nov 2019 14:21:01 +0000 Message-Id: <20191113142101.30280-1-alex.bennee@linaro.org> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:4864:20::442 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?utf-8?q?Alex_Benn=C3=A9e?= , qemu-devel@nongnu.org Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" Some tests seem to run slower on CI systems but we don't really get visibility of which it is unless we happen to hang the test at the end of a run. This hacky change exposes "slow" tests in the tap output. [AJB: my perl is rusty, I'm sure this could be more idiomatic] Signed-off-by: Alex Bennée --- scripts/tap-driver.pl | 18 +++++++++++++++--- 1 file changed, 15 insertions(+), 3 deletions(-) -- 2.20.1 Tested-by: Wainer dos Santos Moschetta diff --git a/scripts/tap-driver.pl b/scripts/tap-driver.pl index 6621a5cd671..0fe748d5de6 100755 --- a/scripts/tap-driver.pl +++ b/scripts/tap-driver.pl @@ -29,6 +29,7 @@ use strict; use Getopt::Long (); use TAP::Parser; use Term::ANSIColor qw(:constants); +use Time::HiRes qw( time ); my $ME = "tap-driver.pl"; my $VERSION = "2018-11-30"; @@ -111,7 +112,7 @@ sub decorate_result ($); sub extract_tap_comment ($); sub handle_tap_bailout ($); sub handle_tap_plan ($); -sub handle_tap_result ($); +sub handle_tap_result ($$); sub is_null_string ($); sub main (); sub report ($;$); @@ -220,12 +221,18 @@ sub testsuite_error ($) report "ERROR", "- $_[0]"; } -sub handle_tap_result ($) +sub handle_tap_result ($$) { $testno++; my $result_obj = shift; + my $time = shift; my $test_result = stringify_result_obj $result_obj; + + if ($time > 1.0) { + $test_result = $test_result . sprintf(" (%0.1fs)", $time); + } + my $string = $result_obj->number; my $description = $result_obj->description; @@ -312,6 +319,9 @@ sub main () { my $iterator = TAP::Parser::Iterator::Stream->new(\*STDIN); my $parser = TAP::Parser->new ({iterator => $iterator }); + my ($start, $end); + + $start = time(); STDOUT->autoflush(1); while (defined (my $cur = $parser->next)) @@ -325,7 +335,9 @@ sub main () } elsif ($cur->is_test) { - handle_tap_result ($cur); + $end = time(); + handle_tap_result ($cur, $end - $start); + $start = time(); } elsif ($cur->is_bailout) {