From patchwork Wed Jan 8 22:49:52 2020 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Patchwork-Submitter: =?utf-8?q?Alex_Benn=C3=A9e?= X-Patchwork-Id: 182792 Delivered-To: patch@linaro.org Received: by 2002:a92:1f12:0:0:0:0:0 with SMTP id i18csp3204219ile; Sun, 12 Jan 2020 09:45:25 -0800 (PST) X-Google-Smtp-Source: APXvYqxyUBT0y6lC6/u9jng7d4RTGbz1wxz/Y3k8D7jvs+CNkAbRXxCjXqMlvLaYvg9V5ZE6bXsA X-Received: by 2002:aa7:ce87:: with SMTP id y7mr12963346edv.82.1578844990854; Sun, 12 Jan 2020 08:03:10 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1578844990; cv=none; d=google.com; s=arc-20160816; b=FOPl7+a7KvVTiTPFfj/oveWPZIFI9I+M2NH0USfoNZUJeZ69EanNAEYFifvfYWrUbB dSKherc9SU+RqcLMgVmm0sO7Ur001JBnFqJMVHcW5hft8SeLkKwkr4avyN6Dfp85q3Ll fLOSDLf0B25qBP7BCRChAFN/xH3CIfWob3GAmBnbxQXaF6liKU9kkjPyzG8bw2pSlg8O xywhyXfcZf0aHE+tIVCtutH78GnNPf6ToWaL3u44cSpOFg4zNUX2TFPd4ICRxJoEOsZ0 bc+vLJrweQtn888S6A+brNps3ziXLbRtC2t03Liao2qhCPovEDmIv+aa1r5ZoUYAw1GQ jNvQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:content-transfer-encoding :mime-version:message-id:date:subject:to:from:dkim-signature; bh=juWdlFfCQgG7NNhvtKKXUAUEZcw1xkA/MgzcDE7RTAk=; b=RB0oIkqPZ/hwMSf8piWIWtScChTdGj2hE2GCtxSwfGcyHdhwKs5llbPAivWwrRAbrd rgo49l75npH6zAK0NK5XTtOuQIQfKum15b7mCv0WsVPNRmcLH7be72ZO+9rYOxzF8QdV E0bIfjm2PztUoLgrcpmfwZP91PV5R27IJACXjb81yhYTtZ/BfqaoEwyxlU26nOuLpR83 td0ynwCnhhVvD8dJIMLvx2D0FkBcjwCxMLpdPcAPkyKnlknxHN9GgOF5Fp5DN41cXpg/ YdWkVpyuqRJy/KjZTbAMjKWdqUa+pbxWK18TASjNROdmEdxCM0FezdbduWlM7oEzOlW9 o4Iw== ARC-Authentication-Results: i=1; mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=HYDgFLID; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id f13si5075994edq.71.2020.01.12.08.03.10 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Sun, 12 Jan 2020 08:03:10 -0800 (PST) Received-SPF: pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; dkim=fail header.i=@linaro.org header.s=google header.b=HYDgFLID; spf=pass (google.com: domain of qemu-devel-bounces+patch=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+patch=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: from localhost ([::1]:50158 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipKAa-0003oW-58 for patch@linaro.org; Wed, 08 Jan 2020 17:51:20 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:36116) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipK9N-0002eg-GA for qemu-devel@nongnu.org; Wed, 08 Jan 2020 17:50:07 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ipK9L-00067Q-JW for qemu-devel@nongnu.org; Wed, 08 Jan 2020 17:50:05 -0500 Received: from mail-wr1-x442.google.com ([2a00:1450:4864:20::442]:46848) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1ipK9L-00065W-BD for qemu-devel@nongnu.org; Wed, 08 Jan 2020 17:50:03 -0500 Received: by mail-wr1-x442.google.com with SMTP id z7so5168776wrl.13 for ; Wed, 08 Jan 2020 14:50:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=juWdlFfCQgG7NNhvtKKXUAUEZcw1xkA/MgzcDE7RTAk=; b=HYDgFLIDUDXKgOP07UDaydZIbNTBp6QgOJOSYg75Er5ZkkVO5AaRKPfSNTGVLfAGVt M3DTLE7OOxrjfaaXWMH/p/7Vc/bKKCBoQdi0ZzFxbFg6xtBZ4XYCmIhi97g6n0Y4fK+O PUrjvq165UwomTUZdf7fUax8BW9ItjaYR7ptvHld5DJ5RlmVLvCJGs6Zax0TtGm4vGst lRH+WkaPr4UGMVeyRAccz+xkA5In5YESyjoFCr0c4443/tepj0vZ9SNt623InEnPUST9 KOBFS+yPqrziJOxRoDZnl07GjRQm3Ryi3rXT2FRpcWlth+30jMtuiEJ6jswpNjj/EhLn IPhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=juWdlFfCQgG7NNhvtKKXUAUEZcw1xkA/MgzcDE7RTAk=; b=RhsHOPTaKs+U8MlrcsOBzywBWkCa889LCKxVWinSjfRW43YdjXy8JREoLEXSDL60jn eUK/v+pPCRQqQm0R1hZv7QwA7cHdpE9H1vmzzpB9ubgOTGmS/itBYVPF3iqTZ3RI6k10 /6OHYXRjb0Qdms+Laxfw5ZVXXhWtI+Ajq/z3LFsoMzd6+F0ManPhL6Iv94No0Mc6BSO5 yxAPTtQ+g0iDEHv0nspI6qfLA4bTH4MjUB1GWodEEEiduHrN52J2SryD7439TfHv1QTZ qQeCJsLAbJNBgKd0qisx5PlmrsnZRiuxSrH2y97XRQ9EIPvV9yxQ4U/apathW1WscFdN oePQ== X-Gm-Message-State: APjAAAVrGuWg1zxaTHOZkk/W2w7YmPfPPPTIHmu1hkKH5QmxQA8AQCz1 u/Q9HAGSPBDL59rTvxaqHwv6Yw== X-Received: by 2002:a5d:494b:: with SMTP id r11mr7218190wrs.184.1578523801559; Wed, 08 Jan 2020 14:50:01 -0800 (PST) Received: from zen.linaroharston ([51.148.130.216]) by smtp.gmail.com with ESMTPSA id z21sm654697wml.5.2020.01.08.14.50.00 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 08 Jan 2020 14:50:00 -0800 (PST) Received: from zen.lan (localhost [127.0.0.1]) by zen.linaroharston (Postfix) with ESMTP id 6CA3A1FF87; Wed, 8 Jan 2020 22:49:59 +0000 (GMT) From: =?utf-8?q?Alex_Benn=C3=A9e?= To: qemu-devel@nongnu.org Subject: [RFC PATCH] travis.yml: split into build stages Date: Wed, 8 Jan 2020 22:49:52 +0000 Message-Id: <20200108224952.17988-1-alex.bennee@linaro.org> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-Received-From: 2a00:1450:4864:20::442 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Fam Zheng , =?utf-8?q?Philippe_Mathieu-Daud=C3=A9?= , =?utf-8?q?Alex_Benn=C3=A9e?= Errors-To: qemu-devel-bounces+patch=linaro.org@nongnu.org Sender: "Qemu-devel" The idea of this is split the build across stages so any failure in one stage will save time running later stages. So far I have have arbitrarily chosen: canary: up-front quick to build and run platforms: common build configurations rest: everything else The ideal should be canary and platforms catch the most common and frequent build breakages and the "rest" aims for completeness. Signed-off-by: Alex Bennée --- .travis.yml | 37 +++++++++++++++++++++++++++++++++++-- 1 file changed, 35 insertions(+), 2 deletions(-) -- 2.20.1 diff --git a/.travis.yml b/.travis.yml index 6c1038a0f1a..648c523ce59 100644 --- a/.travis.yml +++ b/.travis.yml @@ -17,8 +17,12 @@ cache: pip: true directories: - $HOME/avocado/data/cache +stages: + - canary + - platforms + - rest - + addons: apt: packages: @@ -97,17 +101,20 @@ matrix: - env: - CONFIG="--disable-system --static" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-default" + stage: canary # we split the system builds as it takes a while to build them all - env: - CONFIG="--disable-user --target-list=${MAIN_SOFTMMU_TARGETS}" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-default" + stage: canary - env: - CONFIG="--disable-user --target-list-exclude=${MAIN_SOFTMMU_TARGETS}" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-default" + stage: canary # Just build tools and run minimal unit and softfloat checks @@ -116,28 +123,33 @@ matrix: - CONFIG="--disable-user --disable-system" - TEST_CMD="make check-unit check-softfloat -j3" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-default" + stage: canary # --enable-debug implies --enable-debug-tcg, also runs quite a bit slower - env: - CONFIG="--enable-debug --target-list=${MAIN_SOFTMMU_TARGETS}" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-debug" + stage: rest # TCG debug can be run just on its own and is mostly agnostic to user/softmmu distinctions - env: - CONFIG="--enable-debug-tcg --disable-system" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-debug-tcg" + stage: rest - + - env: - CONFIG="--disable-linux-aio --disable-cap-ng --disable-attr --disable-brlapi --disable-libusb --disable-replication --target-list=${MAIN_SOFTMMU_TARGETS}" + stage: rest # Module builds are mostly of interest to major distros - env: - CONFIG="--enable-modules --target-list=${MAIN_SOFTMMU_TARGETS}" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-default" + stage: rest # Alternate coroutines implementations are only really of interest to KVM users @@ -145,11 +157,13 @@ matrix: - env: - CONFIG="--with-coroutine=ucontext --disable-tcg" - TEST_CMD="make check-unit -j3 V=1" + stage: rest - env: - CONFIG="--with-coroutine=sigaltstack --disable-tcg" - TEST_CMD="make check-unit -j3 V=1" + stage: rest # Check we can build docs and tools (out of tree) @@ -158,6 +172,7 @@ matrix: - BASE_CONFIG="--enable-tools --enable-docs" - CONFIG="--target-list=x86_64-softmmu,aarch64-linux-user" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-default" + stage: rest addons: apt: packages: @@ -171,11 +186,13 @@ matrix: - CONFIG="--disable-system" - CACHE_NAME="${TRAVIS_BRANCH}-linux-clang-default" compiler: clang + stage: platforms - env: - CONFIG="--target-list=${MAIN_SOFTMMU_TARGETS} " - CACHE_NAME="${TRAVIS_BRANCH}-linux-clang-sanitize" + stage: platforms compiler: clang before_script: - mkdir -p ${BUILD_DIR} && cd ${BUILD_DIR} @@ -185,12 +202,14 @@ matrix: - env: - CONFIG="--disable-user --target-list-exclude=${MAIN_SOFTMMU_TARGETS}" - CACHE_NAME="${TRAVIS_BRANCH}-linux-clang-default" + stage: platforms compiler: clang # gprof/gcov are GCC features - env: - CONFIG="--enable-gprof --enable-gcov --disable-pie --target-list=${MAIN_SOFTMMU_TARGETS}" + stage: rest after_success: - ${SRC_DIR}/scripts/travis/coverage-summary.sh @@ -200,6 +219,7 @@ matrix: - CONFIG="--without-default-devices --disable-user" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-default" - TEST_CMD="" + stage: rest # Check the TCG interpreter (TCI) @@ -207,22 +227,26 @@ matrix: - CONFIG="--enable-debug-tcg --enable-tcg-interpreter --disable-kvm --disable-containers --target-list=alpha-softmmu,arm-softmmu,hppa-softmmu,m68k-softmmu,microblaze-softmmu,moxie-softmmu,ppc-softmmu,s390x-softmmu,x86_64-softmmu" - TEST_CMD="make check-qtest check-tcg V=1" + stage: rest # We don't need to exercise every backend with every front-end - env: - CONFIG="--enable-trace-backends=log,simple,syslog --disable-system" - TEST_CMD="" + stage: rest - env: - CONFIG="--enable-trace-backends=ftrace --target-list=x86_64-softmmu" - TEST_CMD="" + stage: rest - env: - CONFIG="--enable-trace-backends=ust --target-list=x86_64-softmmu" - TEST_CMD="" + stage: rest # MacOSX builds - cirrus.yml also tests some MacOS builds including latest Xcode @@ -232,6 +256,7 @@ matrix: os: osx osx_image: xcode10.3 compiler: clang + stage: platforms addons: homebrew: packages: @@ -256,6 +281,7 @@ matrix: language: python python: - "3.5" + stage: platforms - env: @@ -264,6 +290,7 @@ matrix: language: python python: - "3.6" + stage: platforms # Acceptance (Functional) tests @@ -272,6 +299,7 @@ matrix: - TEST_CMD="make check-acceptance" after_script: - python3 -c 'import json; r = json.load(open("tests/results/latest/results.json")); [print(t["logfile"]) for t in r["tests"] if t["status"] not in ("PASS", "SKIP")]' | xargs cat + stage: rest addons: apt: packages: @@ -321,6 +349,7 @@ matrix: - uuid-dev language: generic compiler: none + stage: platforms env: - COMPILER_NAME=gcc CXX=g++-9 CC=gcc-9 - CONFIG="--cc=gcc-9 --cxx=g++-9 --disable-pie --disable-linux-user" @@ -343,6 +372,7 @@ matrix: - CONFIG="--disable-system --enable-plugins --enable-debug-tcg --target-list-exclude=sparc64-linux-user" - TEST_CMD="make -j3 check-tcg V=1" - CACHE_NAME="${TRAVIS_BRANCH}-linux-gcc-debug-tcg" + stage: rest # Run check-tcg against softmmu targets @@ -383,6 +413,7 @@ matrix: - libusb-1.0-0-dev - libvdeplug-dev - libvte-2.91-dev + stage: platforms env: - TEST_CMD="make check check-tcg V=1" - CONFIG="--disable-containers --target-list=${MAIN_SOFTMMU_TARGETS}" @@ -412,6 +443,7 @@ matrix: - libusb-1.0-0-dev - libvdeplug-dev - libvte-2.91-dev + stage: platforms env: - TEST_CMD="make check check-tcg V=1" - CONFIG="--disable-containers --target-list=${MAIN_SOFTMMU_TARGETS},ppc64le-linux-user" @@ -441,6 +473,7 @@ matrix: - libusb-1.0-0-dev - libvdeplug-dev - libvte-2.91-dev + stage: platforms env: - TEST_CMD="make check check-tcg V=1" - CONFIG="--disable-containers --target-list=${MAIN_SOFTMMU_TARGETS},s390x-linux-user"