From patchwork Tue Feb 12 05:47:52 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Khem Raj X-Patchwork-Id: 158094 Delivered-To: patch@linaro.org Received: by 2002:a02:48:0:0:0:0:0 with SMTP id 69csp3445187jaa; Mon, 11 Feb 2019 21:48:06 -0800 (PST) X-Google-Smtp-Source: AHgI3IYTLRqXaTQmJC52dhHrvX//0dGiNFJzPJrHI6ypL+TrSMPvQ0lkUxds9AtL0pFFi9DzEUNb X-Received: by 2002:a17:902:28aa:: with SMTP id f39mr2251024plb.297.1549950486792; Mon, 11 Feb 2019 21:48:06 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1549950486; cv=none; d=google.com; s=arc-20160816; b=mVcxXWcKVIOJWzpN6mahBRV+g4+qk33gwq6cCGQFOJqK/ygloG6KuFttJKAPLDK00H i5UFWER6r/SO8GEG8jM/xjHwJn+y/umNlyLws4RFN9r7D+s2qADF7b6FcTByW3TJq5d0 kKy7eFWcSSZzKeujAz7XVthQcrlVSEK2fXO5mnYemY2AIrWguvVeB6QgknNT0fERw/iJ Yb1PsUAboXVjrmwRaTjcI9vFlvFNalIAYTQyO6ca0kT8wJAhffx/0ylptOAatbq7UJ0B BfRwFhNE6kULhv3yanqGydikZ8A6N0dejql2WtUKELzCIxeAWjC4mZrHUSnALJx8ozsm 8osg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=errors-to:sender:content-transfer-encoding:list-subscribe:list-help :list-post:list-archive:list-unsubscribe:list-id:precedence:subject :mime-version:message-id:date:to:from:dkim-signature:delivered-to; bh=YDc2zAgy9ZJpPhw6ytNr+XIYwSMcC8/mIqlEGZ5DCfU=; b=xnCdacIcmfTebToVL8OjHzbo8PdzuP8I0fElVws+ExvLJa7+jALrbW4JMagYmUu0M6 0xA4vn+k0av2cQ+xLIoF2TqGnfxerejQEderOrV98jtBkv5mSP3w9Qtbt7I2Isk9riTv m11OnDLYT+46P/BZo+t0whxBJg6Kjl7TosZ2ZkfOFsbDz4QiZPGmbQwmbVdge+5Iy/S8 x/QbKQasNOD6iKbgpooNW5pLhA20QVsYZahI1q7CcE7NxP6tunpw+FYHCkLsoZg4K8Pj r2kDCjWTipKoTS8kVIA7FIJTlLVhDbzG6uNMy6s5VHODTsChsJv9cYooFe1U/MA4G4sH 9jew== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20161025 header.b=bOxHOnGA; spf=pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) smtp.mailfrom=openembedded-core-bounces@lists.openembedded.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from mail.openembedded.org (mail.openembedded.org. [140.211.169.62]) by mx.google.com with ESMTP id k26si402692pgb.72.2019.02.11.21.48.05; Mon, 11 Feb 2019 21:48:06 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) client-ip=140.211.169.62; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20161025 header.b=bOxHOnGA; spf=pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) smtp.mailfrom=openembedded-core-bounces@lists.openembedded.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from ec2-34-214-78-129.us-west-2.compute.amazonaws.com (localhost [127.0.0.1]) by mail.openembedded.org (Postfix) with ESMTP id 0CFF87C445; Tue, 12 Feb 2019 05:48:02 +0000 (UTC) X-Original-To: openembedded-core@lists.openembedded.org Delivered-To: openembedded-core@lists.openembedded.org Received: from mail-pf1-f196.google.com (mail-pf1-f196.google.com [209.85.210.196]) by mail.openembedded.org (Postfix) with ESMTP id 6CAE66BF38 for ; Tue, 12 Feb 2019 05:48:00 +0000 (UTC) Received: by mail-pf1-f196.google.com with SMTP id j3so740179pfi.12 for ; Mon, 11 Feb 2019 21:48:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=ruBwcjZ5zTzzi1F5VCR1GX7kidmeH+th+wTq9hqp8Iw=; b=bOxHOnGASaDgW/5TeTWlUs4aVBpw4kdcmSBrazteI5M7pobmgAGPbZjPzQYhux0Ql6 JHjY3LFntjhu+jfM6OmuZaYXYJAjllM/bGMQUw7VuVBll/QxhIc/5fNZfXalZfiTS0Fx XGl+K4V55kv1KAuC+AF5DGVte6ZpPsULBos8RiCmSKs2+5bfGiiBb41jD2bbJYfv7JbA RACeG6kJTkji1KjoxZJEqV469H2jMfNQyGJ0mmL52j08K+rTkpKDNH3vgaQ++zSOpHzT xAeerRWWRVEiMGNacmyL0ELQ+gQHFrMUAtVPmEyqMtq9O+mnscEuJU3IKqORU2DMz1XO lcJw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:mime-version :content-transfer-encoding; bh=ruBwcjZ5zTzzi1F5VCR1GX7kidmeH+th+wTq9hqp8Iw=; b=jnIjsJh8/rfSnefzsXMbuNp2Fdd2FXFo+Scmgvz4ps1uEMbyV/uMOrcWLFJp9NzbGT akfbmINlhZNfboEmxVLy4+m7WfJysxDHTD3HJxGhJ++0HONshjkr4lz/yryLgiO2yYMw jmz310mPBYiy++puKV3qE6I3edcV/z4SV2Oaah7Rn47FNQbaBj0NvswO8MVQ78qOWvOM 1+fyJsHFlUpBCGtHBsGQJPtjjw4RTX/wAt0J2u9j+YPjhh987Ir71k8/j+gh1p7R4gXE T349nOY5gxHk13uIMqnycWwdj6Xvw5ckqqbphsq+5qas7ICaILS5L6BtuBrjGu8Z/Vxi iE/g== X-Gm-Message-State: AHQUAuZFff8O7904jg7iwKBoZz+7d5Vx6FuLGqUsQmfgZqBpqsZ5NAm5 vMPbVeDUxp1kfudAmwWhG606A3mh X-Received: by 2002:a62:3241:: with SMTP id y62mr2257292pfy.178.1549950481049; Mon, 11 Feb 2019 21:48:01 -0800 (PST) Received: from apollo.hsd1.ca.comcast.net ([2601:646:8500:6bc6::dc44]) by smtp.gmail.com with ESMTPSA id b15sm2020017pfj.44.2019.02.11.21.48.00 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 11 Feb 2019 21:48:00 -0800 (PST) From: Khem Raj To: openembedded-core@lists.openembedded.org Date: Mon, 11 Feb 2019 21:47:52 -0800 Message-Id: <20190212054754.2801-1-raj.khem@gmail.com> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Subject: [OE-core] [PATCH 1/3] busybox: Remove PN from rdeps of PN-dev X-BeenThere: openembedded-core@lists.openembedded.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Patches and discussions about the oe-core layer List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: openembedded-core-bounces@lists.openembedded.org Errors-To: openembedded-core-bounces@lists.openembedded.org PN-dev is empty and causes dependency loops during SDK build Signed-off-by: Khem Raj --- meta/recipes-core/busybox/busybox.inc | 1 + 1 file changed, 1 insertion(+) -- 2.20.1 -- _______________________________________________ Openembedded-core mailing list Openembedded-core@lists.openembedded.org http://lists.openembedded.org/mailman/listinfo/openembedded-core diff --git a/meta/recipes-core/busybox/busybox.inc b/meta/recipes-core/busybox/busybox.inc index 24c15e4aee..2444afabd5 100644 --- a/meta/recipes-core/busybox/busybox.inc +++ b/meta/recipes-core/busybox/busybox.inc @@ -21,6 +21,7 @@ export EXTRA_LDFLAGS = "${LDFLAGS}" EXTRA_OEMAKE = "CC='${CC}' LD='${CCLD}' V=1 ARCH=${TARGET_ARCH} CROSS_COMPILE=${TARGET_PREFIX} SKIP_STRIP=y HOSTCC='${BUILD_CC}' HOSTCPP='${BUILD_CPP}'" PACKAGES =+ "${PN}-httpd ${PN}-udhcpd ${PN}-udhcpc ${PN}-syslog ${PN}-mdev ${PN}-hwclock" +RDEPENDS_${PN}-dev = "" FILES_${PN}-httpd = "${sysconfdir}/init.d/busybox-httpd /srv/www" FILES_${PN}-syslog = "${sysconfdir}/init.d/syslog* ${sysconfdir}/syslog-startup.conf* ${sysconfdir}/syslog.conf* ${systemd_unitdir}/system/syslog.service ${sysconfdir}/default/busybox-syslog" From patchwork Tue Feb 12 05:47:53 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Khem Raj X-Patchwork-Id: 158095 Delivered-To: patch@linaro.org Received: by 2002:a02:48:0:0:0:0:0 with SMTP id 69csp3445351jaa; Mon, 11 Feb 2019 21:48:20 -0800 (PST) X-Google-Smtp-Source: AHgI3Iaoy32YExDkis8LboZ6hq7elSFEG+Wl8Bd9nlERGf11BvnNVU49X7HONvmd+DtrQDHpnGak X-Received: by 2002:a63:125a:: with SMTP id 26mr2090611pgs.314.1549950500801; Mon, 11 Feb 2019 21:48:20 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1549950500; cv=none; d=google.com; s=arc-20160816; b=F0Z+FKXtBbO9jjah9eYBhg7tBo5SrmBI42+alv365upam9em80khKvqXMzHxIo4a+a FnmQ0k0oRrEcj2O4PYqSWMD76SVSMPjq6edcr38w86Oqpiq1DLbN0USlbotsYSTCnlZu 1l0RpdfghgfslSyIWGrSkcagp06orZWSb+myl1dlt9YWkJw86+oKzNskQvrLlkKBs9J7 /pNy1LP1czQwL0A9DWe5+nr+BzfYFCDCN0RxjHGoKnZKfE72g5mNDUJFZAFqGgbkaseJ 5MaGmiQPAX6iAquSTTNF+TmOV71JidCm3HLSk7t5dZiTjPI9Ri9jkG62tePtHuDq79YC 2mMw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=errors-to:sender:content-transfer-encoding:list-subscribe:list-help :list-post:list-archive:list-unsubscribe:list-id:precedence:subject :mime-version:references:in-reply-to:message-id:date:to:from :dkim-signature:delivered-to; bh=UdIRcz5LF1JDHUbBndXZFqcNEc4wWMK+o1xMGBmYV+8=; b=bSNjXzeNS7fihjNH0zGddHCKyO/uw51z3oPFWQyVis22p6e2B4cQ5aBdmwaY81R0qD iBFpX3U+CD2/DlFeKCMMjT6J2H3MQYy4hOHF2nZW7j5zh2RGjyfhXCsCzMJiup3vBsPW S+m33F/5TCpyUNdYlwLALB/YVAu9prRSqLi1o4iRMitPZTnttW1dQdymxbYNTtIubOpY dnNHWBERqtYe2ew9xy7aD/cN7BXtVINKXQZ0KzlaYDDUUWCZs/mNOycjveRqZtQJUGKr qRwlzFHvKCmFSauX7SJtKagU/OeNsTZOfjfnLRZHIN8WfRNJNAQfPfrIxXQ4mUYRpZyL Bs/g== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20161025 header.b=LZPXsB3T; spf=pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) smtp.mailfrom=openembedded-core-bounces@lists.openembedded.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from mail.openembedded.org (mail.openembedded.org. [140.211.169.62]) by mx.google.com with ESMTP id p1si12306741plk.260.2019.02.11.21.48.20; Mon, 11 Feb 2019 21:48:20 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) client-ip=140.211.169.62; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20161025 header.b=LZPXsB3T; spf=pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) smtp.mailfrom=openembedded-core-bounces@lists.openembedded.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from ec2-34-214-78-129.us-west-2.compute.amazonaws.com (localhost [127.0.0.1]) by mail.openembedded.org (Postfix) with ESMTP id 2D6317C48F; Tue, 12 Feb 2019 05:48:18 +0000 (UTC) X-Original-To: openembedded-core@lists.openembedded.org Delivered-To: openembedded-core@lists.openembedded.org Received: from mail-pg1-f194.google.com (mail-pg1-f194.google.com [209.85.215.194]) by mail.openembedded.org (Postfix) with ESMTP id 2BB646BF38 for ; Tue, 12 Feb 2019 05:48:00 +0000 (UTC) Received: by mail-pg1-f194.google.com with SMTP id g189so726797pgc.5 for ; Mon, 11 Feb 2019 21:48:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=pPrWUhqEw4CtFMdMUz8OR0TgIP8L0gTgO7rzpuEuAwg=; b=LZPXsB3Tgo79YlDnjmkiFkhg0q+jLdzQ0KAVvMUYMKyYBMhKnaC9trR8uNhL5SaTxU z83ms8870llD21j9Ebh/QDVJia44AaKuMIA7UsHw+FkJwbqUd4LryuLG7r2gzbDRIres ZznWPifW0sXNxNMzP9Yeb3Vnj0M1DMddh9zFyfeDy3r0k9hLNh+48pLkqw5qsZu7TSzf CKd93+bhey+Epm6I4x5CVYfrkWUSVsxv647nPaicCey8iqP1mpgMNWFoRjuWyvP/aCW5 8pMlwzPcgZ5RUwSJinthdbGqHU2fuT+tuAausgxdlTnHAbG+t+g+hJiv7CkAxVqUCo0+ 4zVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=pPrWUhqEw4CtFMdMUz8OR0TgIP8L0gTgO7rzpuEuAwg=; b=Io5KRRwrO1y1Oqja9GQFO1k+JKFQZGNkZ68Wx6hqIvGMHPY0845XoESp6Ex6o7Mb5C hrY9ykekfdt7zEtyHV/pvZikq+eUyFvhFOfhHmrl5nWHRFMK/AUIFE0YG8AYeUjibE7w yyu2mpeb7oP6ib2NQjmgGAuWdHQGBacECCvgJYTG4HqtGfXw3PadoJp1lHOFfGA9Fiox bklzCV/hkhJiwq2Mr/R7NLhYmacf3PwKyicGERhJm5PHwhnXADbgd+WiwdieiyBcMeQ3 VHfBEqMelorzA66Pl/+D3lXBPjhck0BYCAjqOZPTyzEiNq1jEqGbb4CkJ7dFgw0cf9Jo KLaA== X-Gm-Message-State: AHQUAua4SmLu9rl5zqIn0HBmTbV5lQlMtAtIGM6iIykT9QpGu5d4rHP4 6F9iXABQEHi2PvBZcedIaq7jCCc3 X-Received: by 2002:a65:6497:: with SMTP id e23mr2045643pgv.89.1549950481696; Mon, 11 Feb 2019 21:48:01 -0800 (PST) Received: from apollo.hsd1.ca.comcast.net ([2601:646:8500:6bc6::dc44]) by smtp.gmail.com with ESMTPSA id b15sm2020017pfj.44.2019.02.11.21.48.01 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 11 Feb 2019 21:48:01 -0800 (PST) From: Khem Raj To: openembedded-core@lists.openembedded.org Date: Mon, 11 Feb 2019 21:47:53 -0800 Message-Id: <20190212054754.2801-2-raj.khem@gmail.com> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20190212054754.2801-1-raj.khem@gmail.com> References: <20190212054754.2801-1-raj.khem@gmail.com> MIME-Version: 1.0 Subject: [OE-core] [PATCH 2/3] libc-package.bbclass: Use install utility to create directories with right permissions X-BeenThere: openembedded-core@lists.openembedded.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Patches and discussions about the oe-core layer List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: openembedded-core-bounces@lists.openembedded.org Errors-To: openembedded-core-bounces@lists.openembedded.org Could fix issues where dirs with wrong permission is created with mkdir -p Signed-off-by: Khem Raj --- meta/classes/libc-package.bbclass | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- 2.20.1 -- _______________________________________________ Openembedded-core mailing list Openembedded-core@lists.openembedded.org http://lists.openembedded.org/mailman/listinfo/openembedded-core diff --git a/meta/classes/libc-package.bbclass b/meta/classes/libc-package.bbclass index 0b4c666a74..34025635ce 100644 --- a/meta/classes/libc-package.bbclass +++ b/meta/classes/libc-package.bbclass @@ -61,7 +61,7 @@ LOCALETREESRC ?= "${PKGD}" do_prep_locale_tree() { treedir=${WORKDIR}/locale-tree rm -rf $treedir - mkdir -p $treedir/${base_bindir} $treedir/${base_libdir} $treedir/${datadir} $treedir/${localedir} + install -d $treedir/${base_bindir} $treedir/${base_libdir} $treedir/${datadir} $treedir/${localedir} tar -cf - -C ${LOCALETREESRC}${datadir} -p i18n | tar -xf - -C $treedir/${datadir} # unzip to avoid parsing errors for i in $treedir/${datadir}/i18n/charmaps/*gz; do From patchwork Tue Feb 12 05:47:54 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Khem Raj X-Patchwork-Id: 158096 Delivered-To: patch@linaro.org Received: by 2002:a02:48:0:0:0:0:0 with SMTP id 69csp3445408jaa; Mon, 11 Feb 2019 21:48:25 -0800 (PST) X-Google-Smtp-Source: AHgI3IYUe7GMNE5w4Nz/4+uOwsooluKZfbBps9SvGigmg3cHarYqhfaVvDajTF4A0z7R7r28z8kW X-Received: by 2002:a63:6506:: with SMTP id z6mr2085386pgb.334.1549950505849; Mon, 11 Feb 2019 21:48:25 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1549950505; cv=none; d=google.com; s=arc-20160816; b=CKKCbzELIA8uEYf5G3k8+ExAaS2XSAlj6QVfoSte1GpkchyPpwYYjl15ggqm+fW+Zu E4DT6PblgFCSHmtExkd2aAno2cBbBAtbiZ0jCxypCT2rZ1nwGBXXD6x8XsvGrrIU9zv6 ILkB3YnmMQwH+t2KoovDcAfebegWL4wqWNe9OOslZCmyuASXvOcK8pI5XRYqb2hknMe+ oo63DKLH0iopS+j+GWsMB4MFwxnmGWIcZXsThPhvjOE9p4W4QxJ5wDm+GbEmUqIl5vJl 4AM1EvNlSWx5qxsDwcOrlyHSHgM+TPIlLhAXFv71IukRj+8pfedi//SksUiyMXljqp/5 H5fw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=errors-to:sender:content-transfer-encoding:list-subscribe:list-help :list-post:list-archive:list-unsubscribe:list-id:precedence:subject :mime-version:references:in-reply-to:message-id:date:to:from :dkim-signature:delivered-to; bh=GFJeSzxkecJlIr+JE7AW5ZrQe6V/DFHWsuNHrHv475g=; b=rUqTxXyVSMn+VmosBuLKzL8T78OP8Ew8cvmbi5ZS/RDb8nJyHQfTq0M8i3R0XjI2JC QdHBWO2KISxYoOqNArP5HESC2xwTAKdE2uzALmAq94rIu0gxe2Nlrz6VlMJLsY4lPor2 YKsc3cOlT5Dgv/vAmwx/XZ1VIA2xNyGYu8JbmEtmWhG6N//pTN0KVMhOvrpuB3ONuerv J9qNq4FhZz8AvwnC7ecix28y5/8P7bpIxsmpc2I3r7qO+iEfVAa4VDagMU97FKpFub7T erdFMNKIiPXDtXR6+UaQd2hXLmdzsFUtVRxRCbjZE1MJtCEwS3VjTDBvOMUZxhQ7IwMP x2oA== ARC-Authentication-Results: i=1; mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20161025 header.b=QYIsAUyi; spf=pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) smtp.mailfrom=openembedded-core-bounces@lists.openembedded.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from mail.openembedded.org (mail.openembedded.org. [140.211.169.62]) by mx.google.com with ESMTP id 16si3001337pgt.548.2019.02.11.21.48.25; Mon, 11 Feb 2019 21:48:25 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) client-ip=140.211.169.62; Authentication-Results: mx.google.com; dkim=neutral (body hash did not verify) header.i=@gmail.com header.s=20161025 header.b=QYIsAUyi; spf=pass (google.com: best guess record for domain of openembedded-core-bounces@lists.openembedded.org designates 140.211.169.62 as permitted sender) smtp.mailfrom=openembedded-core-bounces@lists.openembedded.org; dmarc=fail (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: from ec2-34-214-78-129.us-west-2.compute.amazonaws.com (localhost [127.0.0.1]) by mail.openembedded.org (Postfix) with ESMTP id 727397C4A3; Tue, 12 Feb 2019 05:48:19 +0000 (UTC) X-Original-To: openembedded-core@lists.openembedded.org Delivered-To: openembedded-core@lists.openembedded.org Received: from mail-pf1-f195.google.com (mail-pf1-f195.google.com [209.85.210.195]) by mail.openembedded.org (Postfix) with ESMTP id BD11F7C445 for ; Tue, 12 Feb 2019 05:48:01 +0000 (UTC) Received: by mail-pf1-f195.google.com with SMTP id h1so751084pfo.7 for ; Mon, 11 Feb 2019 21:48:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=s8Of4ant40YGob0kjeYQ1/kt/nJgfkUNFQrF74QlVU4=; b=QYIsAUyiAGhLkcGUu0ojHo8GYnj5cTqs5aKUM1AcXQAeskfUpDA1HCPBhbZSPuaE/R X/ZLo011nrE42u3mGqtO8f3uryeZqOAr6bXEx97POT+cIiyVkFh2uTChPRZDnJgB1rNh JZvGu/EU8XuZepeZXeSLuDYzZKaJ6VZv9NOWY6JbcfkKVxOZyNVIts1f+zS73WA/62u8 gYvm6eHqulXoPnq7B2g+RR0Mou+cpOOusiuQwfpA3gNLM2xulwPANatxDpD9LSLFje2f /XckMWuzzZVlKsiTNQfh5u8IC532tmniTk4N3iCxO7LyzGn8mea1JsOIAlyzRIwuQwdE 7RoQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=s8Of4ant40YGob0kjeYQ1/kt/nJgfkUNFQrF74QlVU4=; b=Rj9cmy8jGtIa02xy/RcPfebsQhmqACGpkNjyDBja6+vOebJJVti8achgtgLjhynF/3 5cmOU6p2oRpIpX5CAr2V62qWhxUH8TxS7rrds8XgP0hVKFTj+b69zbg4JdiruKdC5xZA Eh53u0KOSmpEmFq2caRwz7HrtuOY45A5pEhk0m2ZtEelqUU5uW4zi+pyky5Rv2o3m0YP Es4O1Jn7qSoIV+eAh/qm8C63waW9OcDZ4tkMFanbSJArusLCS1a4nIHLFgVXES3rTlFH jnJaywCk1P3Q2kgnLg3J3vMb8r0yPmZAJbIHP4N5wdmMq9HSD+aFRvHzY8jQSqsQ1JZj l74g== X-Gm-Message-State: AHQUAuazRhyc9wSndA3vNenYSPNpG1jTcbYKTQZvXIIEnGTO4ZMcUqrG yLd469BlX6vnlX/sCJUZFWxZq1XY X-Received: by 2002:a62:a1a:: with SMTP id s26mr2253366pfi.31.1549950482422; Mon, 11 Feb 2019 21:48:02 -0800 (PST) Received: from apollo.hsd1.ca.comcast.net ([2601:646:8500:6bc6::dc44]) by smtp.gmail.com with ESMTPSA id b15sm2020017pfj.44.2019.02.11.21.48.01 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 11 Feb 2019 21:48:01 -0800 (PST) From: Khem Raj To: openembedded-core@lists.openembedded.org Date: Mon, 11 Feb 2019 21:47:54 -0800 Message-Id: <20190212054754.2801-3-raj.khem@gmail.com> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20190212054754.2801-1-raj.khem@gmail.com> References: <20190212054754.2801-1-raj.khem@gmail.com> MIME-Version: 1.0 Subject: [OE-core] [PATCH v3 3/3] image_types.bbclass: Set memory usage limit and CPU threads for xz X-BeenThere: openembedded-core@lists.openembedded.org X-Mailman-Version: 2.1.12 Precedence: list List-Id: Patches and discussions about the oe-core layer List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: openembedded-core-bounces@lists.openembedded.org Errors-To: openembedded-core-bounces@lists.openembedded.org when building with opkg backend and huge packages e.g. chromium/llvm all going in parallel, memory pressure causes xz to catapult with do_package_write_ipk: Failed to create package, opkg-build failed with: xz: (stdin): Cannot allocate memory since there are many tasks going on in parallel, xz adds to memory pressure and it wants it all, put an upper limit for memory xz can use We add a variable XZ_MAXRAM with 30% of RAM limit and can be customized if builders have more memory one can set it like XZ_DEFAULTS = "-M 0 -T 0" Signed-off-by: Khem Raj --- V2: Consider all locations of xz use v3: Use ${@oe.utils.cpu_count()} in place of BB_NUMBER_THREADS meta/classes/image_types.bbclass | 9 ++++----- meta/classes/package_ipk.bbclass | 2 +- meta/classes/populate_sdk_base.bbclass | 2 +- meta/conf/bitbake.conf | 3 +++ 4 files changed, 9 insertions(+), 7 deletions(-) -- 2.20.1 -- _______________________________________________ Openembedded-core mailing list Openembedded-core@lists.openembedded.org http://lists.openembedded.org/mailman/listinfo/openembedded-core diff --git a/meta/classes/image_types.bbclass b/meta/classes/image_types.bbclass index ddca5b624e..f9890581b3 100644 --- a/meta/classes/image_types.bbclass +++ b/meta/classes/image_types.bbclass @@ -56,7 +56,6 @@ def imagetypes_getdepends(d): XZ_COMPRESSION_LEVEL ?= "-3" XZ_INTEGRITY_CHECK ?= "crc32" -XZ_THREADS ?= "-T 0" ZIP_COMPRESSION_LEVEL ?= "-9" @@ -152,12 +151,12 @@ UBI_VOLNAME ?= "${MACHINE}-rootfs" multiubi_mkfs() { local mkubifs_args="$1" local ubinize_args="$2" - + # Added prompt error message for ubi and ubifs image creation. if [ -z "$mkubifs_args" ] || [ -z "$ubinize_args" ]; then bbfatal "MKUBIFS_ARGS and UBINIZE_ARGS have to be set, see http://www.linux-mtd.infradead.org/faq/ubifs.html for details" fi - + if [ -z "$3" ]; then local vname="" else @@ -284,7 +283,7 @@ CONVERSIONTYPES = "gz bz2 lzma xz lz4 lzo zip sum md5sum sha1sum sha224sum sha25 CONVERSION_CMD_lzma = "lzma -k -f -7 ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}" CONVERSION_CMD_gz = "pigz -f -9 -n -c ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type} > ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}.gz" CONVERSION_CMD_bz2 = "pbzip2 -f -k ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}" -CONVERSION_CMD_xz = "xz -f -k -c ${XZ_COMPRESSION_LEVEL} ${XZ_THREADS} --check=${XZ_INTEGRITY_CHECK} ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type} > ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}.xz" +CONVERSION_CMD_xz = "xz -f -k -c ${XZ_COMPRESSION_LEVEL} ${XZ_DEFAULTS} --check=${XZ_INTEGRITY_CHECK} ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type} > ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}.xz" CONVERSION_CMD_lz4 = "lz4 -9 -z -l ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type} ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}.lz4" CONVERSION_CMD_lzo = "lzop -9 ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}" CONVERSION_CMD_zip = "zip ${ZIP_COMPRESSION_LEVEL} ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}.zip ${IMAGE_NAME}${IMAGE_NAME_SUFFIX}.${type}" @@ -319,7 +318,7 @@ CONVERSION_DEPENDS_base64 = "coreutils-native" RUNNABLE_IMAGE_TYPES ?= "ext2 ext3 ext4" RUNNABLE_MACHINE_PATTERNS ?= "qemu" -DEPLOYABLE_IMAGE_TYPES ?= "hddimg iso" +DEPLOYABLE_IMAGE_TYPES ?= "hddimg iso" # The IMAGE_TYPES_MASKED variable will be used to mask out from the IMAGE_FSTYPES, # images that will not be built at do_rootfs time: vmdk, vdi, qcow2, hdddirect, hddimg, iso, etc. diff --git a/meta/classes/package_ipk.bbclass b/meta/classes/package_ipk.bbclass index 508b7dcaff..d1b317b42b 100644 --- a/meta/classes/package_ipk.bbclass +++ b/meta/classes/package_ipk.bbclass @@ -8,7 +8,7 @@ IPKGCONF_SDK = "${WORKDIR}/opkg-sdk.conf" PKGWRITEDIRIPK = "${WORKDIR}/deploy-ipks" # Program to be used to build opkg packages -OPKGBUILDCMD ??= 'opkg-build -Z xz -a "--threads 0"' +OPKGBUILDCMD ??= 'opkg-build -Z xz -a "${XZ_DEFAULTS}"' OPKG_ARGS += "--force_postinstall --prefer-arch-to-version" OPKG_ARGS += "${@['', '--no-install-recommends'][d.getVar("NO_RECOMMENDATIONS") == "1"]}" diff --git a/meta/classes/populate_sdk_base.bbclass b/meta/classes/populate_sdk_base.bbclass index 80fa443e4c..ebc30d39b3 100644 --- a/meta/classes/populate_sdk_base.bbclass +++ b/meta/classes/populate_sdk_base.bbclass @@ -226,7 +226,7 @@ fakeroot tar_sdk() { # Package it up mkdir -p ${SDKDEPLOYDIR} cd ${SDK_OUTPUT}/${SDKPATH} - tar ${SDKTAROPTS} -cf - . | xz -T 0 > ${SDKDEPLOYDIR}/${TOOLCHAIN_OUTPUTNAME}.tar.xz + tar ${SDKTAROPTS} -cf - . | xz ${XZ_DEFAULTS} > ${SDKDEPLOYDIR}/${TOOLCHAIN_OUTPUTNAME}.tar.xz } TOOLCHAIN_SHAR_EXT_TMPL ?= "${COREBASE}/meta/files/toolchain-shar-extract.sh" diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf index 21fd93e58d..6e063dc14d 100644 --- a/meta/conf/bitbake.conf +++ b/meta/conf/bitbake.conf @@ -791,6 +791,9 @@ BB_NUMBER_THREADS ?= "${@oe.utils.cpu_count()}" # Default to setting automatically based on cpu count PARALLEL_MAKE ?= "-j ${@oe.utils.cpu_count()}" +# Default parallelism and resource usage for xz +XZ_DEFAULTS ?= "--memlimit=50% --threads=${@oe.utils.cpu_count()}" + ################################################################## # Magic Cookie for SANITY CHECK ##################################################################