From patchwork Mon May 19 11:09:08 2014 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Ian Campbell X-Patchwork-Id: 30373 Return-Path: X-Original-To: linaro@patches.linaro.org Delivered-To: linaro@patches.linaro.org Received: from mail-ve0-f197.google.com (mail-ve0-f197.google.com [209.85.128.197]) by ip-10-151-82-157.ec2.internal (Postfix) with ESMTPS id 46C09202FE for ; Mon, 19 May 2014 11:11:12 +0000 (UTC) Received: by mail-ve0-f197.google.com with SMTP id db11sf23093668veb.8 for ; Mon, 19 May 2014 04:11:12 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:delivered-to:from:to:date:message-id :mime-version:cc:subject:precedence:list-id:list-unsubscribe :list-post:list-help:list-subscribe:sender:errors-to :x-original-sender:x-original-authentication-results:mailing-list :list-archive:content-type:content-transfer-encoding; bh=mDvP1qx/6ngiQVmFPnna8W2G/lys0liHSQewRO4lldI=; b=WlNLXdUrIitdIE6N2CQTU2CzookvC7MGOhGQuKYbeB8ImgYVzQ5k7dbrcVEI14tgM7 zZ0qorEjfqLiQtuGgRQfN+pCv627oXVR3w4+NZBHAvZWl0Zrf7+RAxDZ1Megu3TPtRvk xFzHAYfE0yLgQShgaDwyL5jNvMnx6MqYweCTsP1nGyGBRwYsGVc3mAbuXsfsOAUsyxLJ tO8oOfADVdkJ9udKC47gUEeG3L5z/X+KIVRVkKJN6pN77tEzv3UX1pg2QC6kTskBsA+r 83J98SpiOzVE3Xts+JQun9xdnHmp730kuI8gvb3qAIZ75QGujvdUzt7vmffaDhJFGGPL SjgA== X-Gm-Message-State: ALoCoQmt26E8Ky9vbJuHznwRh6a5ufS0wyMbUmJVSKd83sfdk40h8/1CLSIMtQAWBrAu7j2w39gg X-Received: by 10.58.94.163 with SMTP id dd3mr8479788veb.29.1400497872000; Mon, 19 May 2014 04:11:12 -0700 (PDT) X-BeenThere: patchwork-forward@linaro.org Received: by 10.140.32.203 with SMTP id h69ls1579117qgh.56.gmail; Mon, 19 May 2014 04:11:11 -0700 (PDT) X-Received: by 10.140.101.99 with SMTP id t90mr3102444qge.115.1400497871903; Mon, 19 May 2014 04:11:11 -0700 (PDT) Received: from mail-qc0-f174.google.com (mail-qc0-f174.google.com [209.85.216.174]) by mx.google.com with ESMTPS id j63si8492884qgd.115.2014.05.19.04.11.11 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 19 May 2014 04:11:11 -0700 (PDT) Received-SPF: pass (google.com: domain of patch+caf_=patchwork-forward=linaro.org@linaro.org designates 209.85.216.174 as permitted sender) client-ip=209.85.216.174; Received: by mail-qc0-f174.google.com with SMTP id x13so8483806qcv.19 for ; Mon, 19 May 2014 04:11:11 -0700 (PDT) X-Received: by 10.224.25.133 with SMTP id z5mr46260382qab.97.1400497871787; Mon, 19 May 2014 04:11:11 -0700 (PDT) X-Forwarded-To: patchwork-forward@linaro.org X-Forwarded-For: patch@linaro.org patchwork-forward@linaro.org Delivered-To: patch@linaro.org Received: by 10.96.8.167 with SMTP id s7csp218977qda; Mon, 19 May 2014 04:11:11 -0700 (PDT) X-Received: by 10.50.50.197 with SMTP id e5mr15948130igo.46.1400497871060; Mon, 19 May 2014 04:11:11 -0700 (PDT) Received: from lists.xen.org (lists.xen.org. [50.57.142.19]) by mx.google.com with ESMTPS id r8si11872393ige.0.2014.05.19.04.11.10 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Mon, 19 May 2014 04:11:11 -0700 (PDT) Received-SPF: none (google.com: xen-devel-bounces@lists.xen.org does not designate permitted sender hosts) client-ip=50.57.142.19; Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1WmLRU-00057Q-42; Mon, 19 May 2014 11:09:16 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1WmLRS-00057E-Hy for xen-devel@lists.xen.org; Mon, 19 May 2014 11:09:14 +0000 Received: from [85.158.139.211:3945] by server-6.bemta-5.messagelabs.com id 0F/45-19576-956E9735; Mon, 19 May 2014 11:09:13 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-10.tower-206.messagelabs.com!1400497751!5061679!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.11.3; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11035 invoked from network); 19 May 2014 11:09:12 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-10.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 19 May 2014 11:09:12 -0000 X-IronPort-AV: E=Sophos;i="4.98,866,1392163200"; d="scan'208";a="133072903" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 19 May 2014 11:09:10 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.3.181.6; Mon, 19 May 2014 07:09:10 -0400 Received: from kazak.uk.xensource.com ([10.80.2.80] helo=zakaz.uk.xensource.com) by ukmail1.uk.xensource.com with smtp (Exim 4.69) (envelope-from ) id 1WmLRM-0005z5-SR; Mon, 19 May 2014 12:09:09 +0100 Received: by zakaz.uk.xensource.com (sSMTP sendmail emulation); Mon, 19 May 2014 12:09:08 +0100 From: Ian Campbell To: , Date: Mon, 19 May 2014 12:09:08 +0100 Message-ID: <1400497748-31858-1-git-send-email-ian.campbell@citrix.com> X-Mailer: git-send-email 1.9.0 MIME-Version: 1.0 X-DLP: MIA1 Cc: Ian Campbell Subject: [Xen-devel] [PATCH OSSTEST] Add my developer/deployment notes as README.dev X-BeenThere: xen-devel@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: List-Unsubscribe: , List-Post: , List-Help: , List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org X-Removed-Original-Auth: Dkim didn't pass. X-Original-Sender: ian.campbell@citrix.com X-Original-Authentication-Results: mx.google.com; spf=pass (google.com: domain of patch+caf_=patchwork-forward=linaro.org@linaro.org designates 209.85.216.174 as permitted sender) smtp.mail=patch+caf_=patchwork-forward=linaro.org@linaro.org Mailing-list: list patchwork-forward@linaro.org; contact patchwork-forward+owners@linaro.org X-Google-Group-Id: 836684582541 List-Archive: These are mostly targetted at people setting up things on the production infra. Signed-off-by: Ian Campbell Acked-by: Ian Jackson --- README.dev | 120 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 120 insertions(+) create mode 100644 README.dev diff --git a/README.dev b/README.dev new file mode 100644 index 0000000..68fbe67 --- /dev/null +++ b/README.dev @@ -0,0 +1,120 @@ +Database access +=============== +$ cat ~/.xen-osstest/db-password +$ psql -d osstestdb -h osstestdb.db.cam.xci-test.com + + +Borrowing a machine +=================== + +You need a task, create with: +$ ./mg-hosts manual-task-create `whoami`@`uname -n` +e.g. +$ ./mg-hosts manual-task-create ianc@kazak + +Borrow, estimating 1 day duration (for the planner): +$ ./mg-allocate -U 1d marilith-n5 + +Return (not automatic, even with an estimate given): +$ ./mg-allocate \!marilith-n5 + +Removing machines for servicing/outage +====================================== + +mg-blockage + +Commisioning a new machine +========================== + +Base it on an existing machine: + +$ mg-hosts create-like marilith-n5 marilith-n4 + +Set up the props and flags +$ mg-hosts setprops ... +$ mg-hosts setflags ... + +$ mg-hosts setprops marilith-n4 -- dhcp-watch-method 'leases dhcp3 dns-cam1.uk.xensource.com:5556' +Handles multiple hosts: +$ mg-hosts setprops HOSTA HOSTB -- "PROP" "VALUE" + +Create a flight: +$ FLIGHT=`OSSTEST_CONFIG=production-config ./cs-flight-create commission xen-unstable` +$ echo $FLIGHT +20974 + +Clone an existing flight, e.g. 20855 was previous successful flight +$ OSSTEST_CONFIG=production-config ./cs-adjust-flight $FLIGHT copy 20855 + +Run it: +OSSTEST_CONFIG=production-config ./mg-execute-flight -Bcommission -Eian.campbell@citrix.com -f20855 $FLIGHT + +Shutting down +============= + +crontab -r (remove) +crontab < crontab (restore afterwards) + +you can create a file "stop" in ~osstest/testing.git or +~osstest/for-blah/something.git to cause that cron job to not start +any new things. Put a note in the stop file to say why... (in the +former case, disables everything; in the latter, just that "branch") + +Creating a new branch +===================== + +As osstest@osstest: + +$ cd branches + +($branch sort of matching ap-fetch-version modulo wildcards and must +match cron invocation) + +$ git clone ../testing.git for-$branch.git +$ chmod g+w for-$branch.git +# (chmod to workaround umask settings) + +If you want to bisect then: +$ cd ../bisects +$ git clone ../testing.git for-$branch.git +$ chmod g+w for-$branch.git + +Back to branches +$ ln -s /export/home/osstest/bisects/for-$branch.git for-$branch.git/tree-bisect + +$ mkdir for-$branch.git/tmp +# For manual playing only, probably. + +Now can play in here. Can push random stuff and run +"cr-daily-branch --real $branch" as osstest@osstest. e.g. + $ OSSTEST_EMAIL_HEADER=/home/ianc/osstest-email-ijc \ + OSSTEST_CONFIG=production-config ./cr-daily-branch --real $branch + +Note: Push to incoming and git reset --hard incoming +Note2: +$ cat ~/osstest-email-ijc +To: ian.campbell@citrix.com + +Do not run cr-for-branches -- it will try to update all sorts trees +etc. + +Need to create any xenbits trees which are referenced: + +As xen@xenbits do mkdir and git init --bare, but this might confuse +cr-daily-branches so you would want to push something there +(e.g. current master, easiest to do as osstest@osstest). Or "git clone +--bare" but might create all sorts of unwanted refs. + +Use ap-push to populate tree, in order to test ap-push, after using +ap-fetch-version to populate the local repo. e.g. +OSSTEST_CONFIG=production-config ./ap-fetch-version $branch +OSSTEST_CONFIG=production-config ./ap-push $branch $revision + +NOTE: $revision must be a revision *not* a tag. If you want to start +with a known baseline then git rev-parse FOO~0 it first. +NOTE2: ap-push should use refs/heads/foo explicitly so that this +initial push works + +When pushing the patches, be sure to make sure that the +for-$branch.git repo can fast forward to the pushed version (perhaps +by resetting it).