From patchwork Fri Apr 13 05:06:17 2018 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Masahiro Yamada X-Patchwork-Id: 133311 Delivered-To: patch@linaro.org Received: by 10.46.84.18 with SMTP id i18csp344176ljb; Thu, 12 Apr 2018 22:08:26 -0700 (PDT) X-Google-Smtp-Source: AIpwx48DEKQxlk6HifAOG/DrWiegt4rt8DLnKCzozWwOAYcE2E0u38cCZtO+a9+OTI+fUQDqeIEV X-Received: by 2002:a17:902:3181:: with SMTP id x1-v6mr3851060plb.2.1523596106614; Thu, 12 Apr 2018 22:08:26 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1523596106; cv=none; d=google.com; s=arc-20160816; b=ItVCjEDp57ZBV2dfC/rbI91nTVKQXLNYIKdtZnDjruhQaj/iM7pQT16w0B5RDdZT9j wNEchFLY+3g84l7vYqZSueWUFh20xRX7HrI15Wyxe102H1UCOLeTbzfKZsu8vqH0X3RM WCKkTlek10UjX06GR5mdXfk9no3MzybeUsP2haxzgucju1Yxt9sqQ0SySr5ZDKtuTf8u rOr2NgsmFfB8KoTp+rVBBH6y5S5kppKDcGQutfPk+IRk63F21b0rSn1/XcVs+xjCC4U+ JC2oa4xElftKt4hbNRTi+sdxMzOZBoDo4BHNM/184VBw7KRYQ2zUK0vR/dBwk0dsVLhr evag== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:message-id:date :subject:cc:to:from:dkim-signature:dkim-filter :arc-authentication-results; bh=32/sc7ha9TNkBMv72TwSV+Q2kKXWYKuYHYguU7Q1mOM=; b=ddaCohMlSwWndWD7i5enzQ4bzD7eVPl2gwLy8lBQSjuqy/wL9Q0x1f6ThoJLnaEAL7 PG2K2NCv5NudmfXCtdEEMe5Cf0SoXtQ6ow2zq84+VqXWhG6ikhBPMttimW29QwW1sNyG +zfMSUX7UjvBxgXmmt6rBPMtZD3QeNxkimuR3hX4qpLhLHE6hfPoiHCC5M7M9vzYpRIP Dt7NRbt4BOpIKIKRL23fs+xe+0yR9MAosolPxdB0auzLWvcZHLOPsl+UYXpclzuRIAA1 EKbxqQkd56FAeoNcHnhQyqDO0/AOqCQGLdbPx/VBrfNilheHcgz/CRBqLlv0oEzqBOPE bfSQ== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@nifty.com header.s=dec2015msa header.b=Q6UTAjYg; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id y7-v6si4722599plt.287.2018.04.12.22.08.25; Thu, 12 Apr 2018 22:08:26 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@nifty.com header.s=dec2015msa header.b=Q6UTAjYg; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1751380AbeDMFIR (ORCPT + 29 others); Fri, 13 Apr 2018 01:08:17 -0400 Received: from conuserg-07.nifty.com ([210.131.2.74]:54456 "EHLO conuserg-07.nifty.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1750859AbeDMFIP (ORCPT ); Fri, 13 Apr 2018 01:08:15 -0400 Received: from pug.e01.socionext.com (p14092-ipngnfx01kyoto.kyoto.ocn.ne.jp [153.142.97.92]) (authenticated) by conuserg-07.nifty.com with ESMTP id w3D56lg2029209; Fri, 13 Apr 2018 14:06:54 +0900 DKIM-Filter: OpenDKIM Filter v2.10.3 conuserg-07.nifty.com w3D56lg2029209 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nifty.com; s=dec2015msa; t=1523596015; bh=32/sc7ha9TNkBMv72TwSV+Q2kKXWYKuYHYguU7Q1mOM=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=Q6UTAjYgxPjecSrW1d/CFBJS+Khgp33JuedFP2Y5x8yfK1EkR+Tds+5BBS4Jy8d+p wEiHY79H1Ewh9K5S87a1AJbPeAHyJl0PBETKaBpXd9rf/OvheRvZfzjiX6yJLEjEp5 xDW025N0m3j42UB1bdLVd2kNb/s4RiolUDV07Vuvtn/OcFIRZ3Q9qxNsmtxXJU2DlC Hk6rG5Z1AhncPsXqXkrbqXPM1vigvIN5/c9zvi3TSEWm5yxAEZQAOUoCQBMepkA0MS db7a+obJjIzgSGoQy5jbLq+gQRJDuqQ19pxlgiCpUxxXhPBmRCd6vG1IkQDldxjSh5 W365Vhzhc+WFA== X-Nifty-SrcIP: [153.142.97.92] From: Masahiro Yamada To: linux-kbuild@vger.kernel.org Cc: Linus Torvalds , Sam Ravnborg , Ulf Magnusson , Nicholas Piggin , Kees Cook , Emese Revfy , x86@kernel.org, Masahiro Yamada , linux-kernel@vger.kernel.org Subject: [PATCH 08/30] kconfig: add built-in function support Date: Fri, 13 Apr 2018 14:06:17 +0900 Message-Id: <1523595999-27433-9-git-send-email-yamada.masahiro@socionext.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1523595999-27433-1-git-send-email-yamada.masahiro@socionext.com> References: <1523595999-27433-1-git-send-email-yamada.masahiro@socionext.com> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org This commit adds a new concept 'function' to do more text processing in Kconfig. A function call looks like this: $(function arg1, arg2, arg3, ...) This commit adds the basic infrastructure to expand functions. Change the text expansion helpers to take arguments. Signed-off-by: Masahiro Yamada --- Changes in v3: - Split base infrastructure and 'shell' function into separate patches. Changes in v2: - Use 'shell' for getting stdout from the comment. It was 'shell-stdout' in the previous version. - Symplify the implementation since the expansion has been moved to lexer. scripts/kconfig/preprocess.c | 142 +++++++++++++++++++++++++++++++++++++++---- 1 file changed, 130 insertions(+), 12 deletions(-) -- 2.7.4 diff --git a/scripts/kconfig/preprocess.c b/scripts/kconfig/preprocess.c index fa4abc8..e77cf7c 100644 --- a/scripts/kconfig/preprocess.c +++ b/scripts/kconfig/preprocess.c @@ -8,6 +8,10 @@ #include "list.h" +#define ARRAY_SIZE(arr) (sizeof(arr) / sizeof((arr)[0])) + +static char *expand_string_with_args(const char *in, int argc, char *argv[]); + /* * Environment variables */ @@ -74,9 +78,47 @@ void env_write_dep(FILE *f, const char *autoconfig_name) } } -static char *eval_clause(const char *in) +/* + * Built-in Functions + */ +struct function { + char *name; + char *(*func)(int argc, char *argv[]); +}; + +static const struct function function_table[] = { +}; + +static char *function_call(const char *name, int argc, char *argv[]) { - char *res, *name; + const struct function *f; + int i; + + for (i = 0; i < ARRAY_SIZE(function_table); i++) { + f = &function_table[i]; + if (!strcmp(f->name, name)) + return f->func(argc, argv); + } + + return NULL; +} + +#define FUNCTION_MAX_ARGS 16 + +/* + * Evaluate a clause with arguments. argc/argv are arguments from the upper + * function call. + * + * Returned string must be freed when done + */ +static char *eval_clause(const char *in, int argc, char *argv[]) +{ + char *tmp, *prev, *p, *res, *name; + char delim = ' '; + int new_argc = 0; + char *new_argv[FUNCTION_MAX_ARGS]; + int nest = 0; + int i; /* * Returns an empty string because '$()' should be evaluated @@ -85,10 +127,73 @@ static char *eval_clause(const char *in) if (!*in) return xstrdup(""); - name = expand_string(in); + tmp = xstrdup(in); + + prev = p = tmp; - res = env_expand(name); + /* + * Split into tokens + * The function name and the first argument are separated by a space. + * Arguments are separated by a comma. + * For example, if the function call is like this: + * $(foo abc,$(x),$(y)) + * + * The input string for this helper should be: + * foo abc,$(x),$(y) + * + * and split into: + * new_argv[0]: foo + * new_argv[1]: abc + * new_argv[2]: $(x) + * new_argv[3]: $(y) + */ + while (*p) { + if (nest == 0 && *p == delim) { + *p = 0; + new_argv[new_argc++] = prev; + prev = p + 1; + delim = ','; + } else if (*p == '(') { + nest++; + } else if (*p == ')') { + nest--; + } + + p++; + } + new_argv[new_argc++] = prev; + + /* + * Shift arguments + * new_argv[0] represents a function name or a variable name. Put it + * into 'name', then shift the rest of the arguments. This simplifies + * 'const' handling. + */ + name = expand_string_with_args(new_argv[0], argc, argv); + new_argc--; + for (i = 0; i < new_argc; i++) + new_argv[i] = expand_string_with_args(new_argv[i + 1], + argc, argv); + + free(tmp); + + /* Look for built-in functions */ + res = function_call(name, new_argc, new_argv); + if (res) + goto out; + + /* Last, try environment variable */ + if (new_argc == 0) { + res = env_expand(name); + if (res) + goto out; + } + + res = xstrdup(""); +out: free(name); + for (i = 0; i < new_argc; i++) + free(new_argv[i]); return res; } @@ -115,7 +220,7 @@ static char *eval_clause(const char *in) * This is because $ABC is equivalent to $(A)BC. (Like Make, you can omit * parentheses if the variable name consists of a single character. */ -char *expand_dollar(const char **str) +static char *expand_dollar_with_args(const char **str, int argc, char *argv[]) { const char *p = *str; const char *q; @@ -124,6 +229,9 @@ char *expand_dollar(const char **str) /* * A standalone '$' at the end of a token is treated as-is. + * For example, the '$' before the comma in $(foo $,A) and the '$' + * before the closing parenthesis in $(shell echo $) lose the special + * meaning. This is the behavior of Make 4.2 or newer. */ if (!*p) return xstrdup("$"); @@ -140,15 +248,15 @@ char *expand_dollar(const char **str) tmp[0] = *p; tmp[1] = 0; *str = p + 1; - out = eval_clause(tmp); + out = eval_clause(tmp, argc, argv); free(tmp); return out; } /* - * Variables that consist of multiple letters + * Variables that consist of multiple letters, and function calls * must be surrounded with parentheses. - * For example, $(FOO) + * For example, $(FOO), $(shell echo helloworld) */ p++; q = p; @@ -163,7 +271,7 @@ char *expand_dollar(const char **str) memcpy(tmp, p, q - p); tmp[q - p] = 0; *str = q + 1; - out = eval_clause(tmp); + out = eval_clause(tmp, argc, argv); free(tmp); return out; } @@ -179,11 +287,11 @@ char *expand_dollar(const char **str) } /* - * Expand variables in the given string. Undefined variables + * Expand variables, functions, etc. in the given string. Undefined variables * expand to an empty string. * The returned string must be freed when done. */ -char *expand_string(const char *in) +static char *expand_string_with_args(const char *in, int argc, char *argv[]) { const char *prev_in, *p; char *new, *out; @@ -195,7 +303,7 @@ char *expand_string(const char *in) while ((p = strchr(in, '$'))) { prev_in = in; in = p + 1; - new = expand_dollar(&in); + new = expand_dollar_with_args(&in, argc, argv); outlen = strlen(out) + (p - prev_in) + strlen(new) + 1; out = xrealloc(out, outlen); strncat(out, prev_in, p - prev_in); @@ -210,6 +318,16 @@ char *expand_string(const char *in) return out; } +char *expand_string(const char *in) +{ + return expand_string_with_args(in, 0, NULL); +} + +char *expand_dollar(const char **str) +{ + return expand_dollar_with_args(str, 0, NULL); +} + /* * Expand variables in a token. The parsing stops when a token separater * (in most cases, it is a whitespace) is encountered. 'str' is updated to