From patchwork Mon Apr 14 18:31:04 2025 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Frank Li X-Patchwork-Id: 881128 Received: from DUZPR83CU001.outbound.protection.outlook.com (mail-northeuropeazon11013042.outbound.protection.outlook.com [52.101.67.42]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 3884929292F; Mon, 14 Apr 2025 18:32:18 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=fail smtp.client-ip=52.101.67.42 ARC-Seal: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1744655541; cv=fail; b=uLhQykht8ah/dd7do/NPRFFxjqSil+znRP4vKZ37heDJYegsQorHB9bg74w6Be0ZPGbI3Mt5RJ9STjnh9EA7VW0QbyhpOIorxUf4r6uEYZifqUO11dy/iZGx7cVIt+l+qKHxrOwwy4AKrFGciusv3SV6TjciltDPi7SXAaWsZ+s= ARC-Message-Signature: i=2; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1744655541; c=relaxed/simple; bh=GZxnLuC67KA9+f1ZFFupamn6BH671XQaImre37vE7/Q=; h=From:Date:Subject:Content-Type:Message-Id:References:In-Reply-To: To:Cc:MIME-Version; b=L5ayKbhEic8H1s1qpQZd3krQT1IwFP/4ZrA7xokXG+GIqO/Mc4TL9SwRbcocpNAHPPG5N7ut481nUOGVgP9T4Eno8PRLKHg5I/8C2125xQMhWYxdRgmTiv7NYnKMZb7ejqDNXd8uJDFsKQVxm510tsffwxo1FxrbrMvqoDv61Lg= ARC-Authentication-Results: i=2; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=nxp.com; spf=pass smtp.mailfrom=nxp.com; dkim=pass (2048-bit key) header.d=nxp.com header.i=@nxp.com header.b=ZVNfE0U3; arc=fail smtp.client-ip=52.101.67.42 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=nxp.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=nxp.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=nxp.com header.i=@nxp.com header.b="ZVNfE0U3" ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=g1D098SAsDarngZrX0kAesxNpjvD/SzSryfGaJOEa5cmydUXoF+6P9idkNFG0Y7mAc4B+kd5iMF0MNe1Ioqwe21zqR5I4h7NKgvmZfmxl2UGnZcm1MG9/qgdxjqXtoH3bKASKtpQE30wNSasjwgEEOnr3cWYOzuWa3zTEMKGXm+Z1Iq3fJCsKw3dXtQuRODQbHrWOhJ81DyoSxKfsVzzRRJIUZInwUF/6LFwpeQjEfIwjyLt4c3ZzD9ulVULs6+XcqzrQGkmwoZHtkvH1ZlHC2aqDWqVRUqN1H+CjWaagSNQqwDJVzLfc7smTogHPeVp771u7dY+lijfZWX6THOs6A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=kKlGqegoRweF1++Jqh2S5594pr64Kj2EekHsAJSq3y8=; b=zWXbyBBQkwPT97d2WWIX46Cdak1+EJqBb1KaiLLYqPrfTd+AgnaPUMjKUTQWhU+ncY1d63K1p1CMkIogRDtYpXraaH4TgsQwierRBxmm6A9fUOLGXoBLWuXwfXp/fzwe44wcOGAxIanawaJfPgx1ohlB4p4FTrKRmm6hexucbseG86J2Air/phJWt4GG+oQenXsF5syhzdjZz2zOJOckcFGYNX2ogAF1j1CDD4UDynT8aqYqQC+WkUANK9qvZGiSfLAmtySAYhfHZRBhggdAR5mspDEbNwyEjFYNz2Y+hahDmnbbkNPjvOWxxx5DzCgiw5VnkddLwCKCEvMiYrHDKw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nxp.com; dmarc=pass action=none header.from=nxp.com; dkim=pass header.d=nxp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nxp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=kKlGqegoRweF1++Jqh2S5594pr64Kj2EekHsAJSq3y8=; b=ZVNfE0U3wDpNdHaXTFvaCw6qpa0tZtH+8IcXkaftBrKKdf7CMjRVauaHD3pj6CU0VTaXK36AqYi+zfYTnSbEajg+umGqMiF3Kvfm1QN8/SpTNqQn6jRpNo2orB4TPEO7WOI7O6vRlGFTH+VecJR0SZde0MCqIc1pbkPYysLm8BAWnMUs5j3475yA2JNApwOLbRk7w07daQRTh2QnVZgSva82F75eDJr+8Fo/uZVMUeg5X1DzwIH45B3yoHgF8sUpodiETGc1CelRHmDNWIct1Pdhwly4hFmnslxv7Gglv4APTDJRf4g1cRZfX87GSdtAMStveXTb/csaq4H6FDYHCg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=nxp.com; Received: from PAXPR04MB9642.eurprd04.prod.outlook.com (2603:10a6:102:240::14) by GVXPR04MB10245.eurprd04.prod.outlook.com (2603:10a6:150:1bb::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8632.33; Mon, 14 Apr 2025 18:32:16 +0000 Received: from PAXPR04MB9642.eurprd04.prod.outlook.com ([fe80::9126:a61e:341d:4b06]) by PAXPR04MB9642.eurprd04.prod.outlook.com ([fe80::9126:a61e:341d:4b06%2]) with mapi id 15.20.8632.030; Mon, 14 Apr 2025 18:32:16 +0000 From: Frank Li Date: Mon, 14 Apr 2025 14:31:04 -0400 Subject: [PATCH v18 10/15] PCI: endpoint: pci-epf-test: Add doorbell test support Message-Id: <20250414-ep-msi-v18-10-f69b49917464@nxp.com> References: <20250414-ep-msi-v18-0-f69b49917464@nxp.com> In-Reply-To: <20250414-ep-msi-v18-0-f69b49917464@nxp.com> To: Kishon Vijay Abraham I , "Rafael J. Wysocki" , Thomas Gleixner , Anup Patel , Kishon Vijay Abraham I , Marc Zyngier , Greg Kroah-Hartman , "Rafael J. Wysocki" , Danilo Krummrich , Manivannan Sadhasivam , =?utf-8?q?Krzysz?= =?utf-8?q?tof_Wilczy=C5=84ski?= , Kishon Vijay Abraham I , Bjorn Helgaas , Arnd Bergmann , Shuah Khan , Richard Zhu , Lucas Stach , Lorenzo Pieralisi , Rob Herring , Shawn Guo , Sascha Hauer , Pengutronix Kernel Team , Fabio Estevam , Krzysztof Kozlowski , Conor Dooley Cc: Niklas Cassel , dlemoal@kernel.org, jdmason@kudzu.us, linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org, linux-pci@vger.kernel.org, linux-kselftest@vger.kernel.org, imx@lists.linux.dev, devicetree@vger.kernel.org, Frank Li X-Mailer: b4 0.13-dev-e586c X-Developer-Signature: v=1; a=ed25519-sha256; t=1744655465; l=8739; i=Frank.Li@nxp.com; s=20240130; h=from:subject:message-id; bh=GZxnLuC67KA9+f1ZFFupamn6BH671XQaImre37vE7/Q=; b=WA1OAWYCnqei22MVeDwGjCnpnVfO0FJuK6HZFsm7mP++4OGJXz23fcWBa++hGzQhZ0W6pbP3R XOmQzKwC39ZA+n5pSREs/MFVL+aFofhBMp7eAtXNgDDssjK0p+EbL8M X-Developer-Key: i=Frank.Li@nxp.com; a=ed25519; pk=I0L1sDUfPxpAkRvPKy7MdauTuSENRq+DnA+G4qcS94Q= X-ClientProxiedBy: PH7PR17CA0021.namprd17.prod.outlook.com (2603:10b6:510:324::27) To PAXPR04MB9642.eurprd04.prod.outlook.com (2603:10a6:102:240::14) Precedence: bulk X-Mailing-List: linux-kselftest@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PAXPR04MB9642:EE_|GVXPR04MB10245:EE_ X-MS-Office365-Filtering-Correlation-Id: 49cc0544-fdfe-4f0d-55db-08dd7b82ae98 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; ARA:13230040|7416014|376014|52116014|1800799024|366016|38350700014|921020; X-Microsoft-Antispam-Message-Info: =?utf-8?q?8iS9hPSPOr3+kjUiwQYsSzIjVgUistq?= =?utf-8?q?F+QY3hOeNhbwYpH0AfYUpteMTwfjjOnP5LdW8Up2lPt9HSQAQUq/Ty+Xz5scFJqOG?= =?utf-8?q?Rqmjitj4j5ZYDD/L51TC8k92QZ0jDOlJTl/Q/K6lVBm9OsGFcS0wBkHfYrf7VcjgK?= =?utf-8?q?7MGXZKMrWY/yjh4679ps1uKng2IwliU+j8SLK21PTpumf43cWO699N3UJNyR6tftD?= =?utf-8?q?yDPWTGqPs4gNVDP6KPxSlajUl7YxWNI73aW/ILvnVR6C1t5EtB8Mn+jekxzNADVQO?= =?utf-8?q?4BTwK4tK2uMoqo2cAAFD7f+q1HyinFXE1fnCNGhWVEYRswlUXx2AZXhg1Eoen9IPl?= =?utf-8?q?kuAbzlfblwDko8xreqfNqs5heKC+NRwEkkKQ5d/OpByz1V1i7zzTbVjMYUvjYKozu?= =?utf-8?q?y72nKBPR5Io8eu98U8ZfTLGifudt5c2OeJGJ6fHM0OMlNK/om+yr0ETMP0a/5Ux2/?= =?utf-8?q?HhwmeNiS7DjNoWJq6FlYa2wYApVwTs7hHPnna7rnt1z4ejQ6lyIrMPzwVI0zaxt6V?= =?utf-8?q?axUQErD4KLOPVQDQsD8BX7kNIoPcXX5wmEJO28rpSjuVI0OG9VOqhiU63nzaLfu3H?= =?utf-8?q?z0KsGHqJwWhlQTdkt94fo48k1JCZBRFu7iywpPSfWM4/DkisEqUefphir2VTSeGCL?= =?utf-8?q?CjeibbD1b1AlIF/5dIL3KMuKJyt4pbObO4xZOyhDb+6MIg8oBGDpQA+GJB+RYk2r8?= =?utf-8?q?UrrYZQGd2ZYhv0lcT2ADqE9Xq+fx9Tgoys8sqEFDSElOXzAgRqwSBqOzx+5RKlZPX?= =?utf-8?q?cacpe7xBGqLh0cQRp8AAcUHvAQcdaZyh6ZOB480fJNe6zlImrj1Xff/OrZut5KXMV?= =?utf-8?q?lnkqlZOuZva5i+Cf318cgDYGMJsw5EamIkuw6lPLJtQe8HlSlkCBH+Vw0ZmUAQWTY?= =?utf-8?q?Q3lK8EaJXamTf5AyvDFfTxuBpQLznvCS92hS8eGJBB/vdnimLMCtia9EwLyKlwUzC?= =?utf-8?q?fesXgCiAmqa6gIAqVTF3syF4ilhJ9QV9jZsthx83OHjzNG4HKVMCmtpYHtuaOQY+r?= =?utf-8?q?l85omdy2gG0WzjVxMtvezSbnR+KhxRLFDdezg5eB4qPobWHJWKrfwvrVIoVruBfwa?= =?utf-8?q?wh0qbaAYfTJLwnX/8QNsLcITtvB0S2shTsBAgh92Y5oBjO0/i5fCkXM0Ni8FfIgQ+?= =?utf-8?q?cqSN9+OvmlNj2xQsQEb2jlKGUvM5jIzLAQYq8tifHXRNFVijx5ePDaxz77Jiep23Z?= =?utf-8?q?oXbjlRMRD92LoC8ISf5weQzXUqdneYq/K1MiXZnSf6R1B2rQU0wwQ111l0gmNw3f0?= =?utf-8?q?bxoCsAxXIoXpBabE+VrYJ/xSvgcRzWIUnkzRuyxrgkRsjGHuOmj1uCVTCz3mTEnMs?= =?utf-8?q?wjuRAJEr3+rZA6ZU77zxdvmxKZ10q3ZLxY5ExyVNad88TiUxs9YB6DgRoR91USSnW?= =?utf-8?q?JqD83ZSoY10a8qjyp3eZD7dPGwZS/qEiaX4+9g+qdkSyR2OrHgPCvw=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PAXPR04MB9642.eurprd04.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230040)(7416014)(376014)(52116014)(1800799024)(366016)(38350700014)(921020); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?q?b2V3E8kAUaLGuft6Bk8C6OUiY70U?= =?utf-8?q?UGm6hmKadgck+9LYk9aO9ptjkJShIDZybAoQwHsL4BCiAHl4/UdUrG4QyZc5Odfey?= =?utf-8?q?dV2f0WalULJcNdCq1D72hIRa1E9zOZ6YM0mPhVRXexV4EcFqq3r+q10KU8J5OodWe?= =?utf-8?q?XJzYtCfSBQimMEOhtcNVG/50FDPKMUiDqgIQMJNQHKUKvFeIi48e21sg3bInpUUEg?= =?utf-8?q?wlBXvjVjn6oEBBwMYi7Bg3IWM5hB1qHkL2Da1JwrERKYjRD3epPAprHbD/Dk7VcfT?= =?utf-8?q?3eOPea+pX4smmJFdGZonVetrSpswDebF6AYZyFP731hHoZgGH8X4tTqwn6NYch4MT?= =?utf-8?q?LGd7IVCm0ikeiXDenPtRvZMCch3mh3cAAKwG3CquZ4gr6q+FdH4PQuQTByps3VwT7?= =?utf-8?q?XDEmnOYioxkok9PcMrNq/D4VvQTMSB3y1VdzXmwZlMNX/QVyUwB5YG93CAYSTYsPM?= =?utf-8?q?i1sDaJ3++Un3onTpSkcJJ2aeLLBVHoc8Li46lVIQi1vcsrG+fokfLnNvWp/aU6hj2?= =?utf-8?q?ozRVVtUoie61vSvGFtASfcHVA94eWcWyfCpRLuDTEe3vdebj0fb0n/YfpM97C4ssJ?= =?utf-8?q?LAyvKpyMVHlSpWSGGdJB7AajnLX/yLX4UC4tyoGL4FGZKICmnB+WPxersF5yloGg4?= =?utf-8?q?Fel3QFETE4afOh346AUWiDgULcHOfXuLs5y518sURVzB7PMbOCjnyXxmwO5fy0eSO?= =?utf-8?q?UEbbkd7INerKA8cevHK8SoJ9cXLI/QFxZ60Poi3qMwQenydqKLd2o77yMk0MR5PnP?= =?utf-8?q?JJ0JWng4mxz/So8O+uFYWVTIfzbQXdcknc0Ng/dwUApzEScOMCWyoNE0mnUxdwBVH?= =?utf-8?q?vsOTjlm5Gi0VuPAbzM5wJNW3Lcw8HjFpdH+xCK7VZ7Sy9iN2mFxEfZkK5t0JRTAAr?= =?utf-8?q?qzfJqEmH1HKt6giGoPtZH2KCH1jom+Hvn5z/di/v8nI8Y4yavz51L3WfadMIXRDwl?= =?utf-8?q?ryg3HDNBo292H1xnwLW4U39i3La/bYP5c4dBx6tDdm164VFZb5y/A8mwS6DkSEKv1?= =?utf-8?q?PKfdA3g3yVka8eVMWCb38zRWrKQl8CBWcFviIAiY8dJ/shWGXOOKGi1PcNJTYA254?= =?utf-8?q?QxlHZZB9gBmeRdeiLEWWafYBpZQ0Lfvcjf1dpA2ruA7jACu/4XBYzHzejW4EJlLBL?= =?utf-8?q?/mFxgkjIXvcYN2yfOCSc82wPyb0yP8+CEMlpS09ZJuW+xQkbuuQh5+7I5Ph1hdGD1?= =?utf-8?q?nUzG/irZZRlFlOYiGqKPK85UQm6hv64kn7MnD/708+Z3uprrdjCSTT5Bmplb9en1y?= =?utf-8?q?iGD0WGXs1WZl6cxXxoaug9fZr+SyivwzHS2X5Xhh4fXy0tv262eF1y5K6feG+zJFU?= =?utf-8?q?JbN6f1BaZ6hI7rx9y7VYwZEXZ0sMdfRp4ExODOr9z4hZCvxWzJYSYftexqyOs+lFF?= =?utf-8?q?dPI8pyAutx1B9WwWz2N/QUDIiHjxrTmJxZpEuJRnXzwTh73SNXK4eX7lCsNIADqLC?= =?utf-8?q?+AjtK4MNhuwNUctS8I21ZFG9vCEQvVKKwdUnf3B7UUAkQoyWmU8N5xI0=3D?= X-OriginatorOrg: nxp.com X-MS-Exchange-CrossTenant-Network-Message-Id: 49cc0544-fdfe-4f0d-55db-08dd7b82ae98 X-MS-Exchange-CrossTenant-AuthSource: PAXPR04MB9642.eurprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 14 Apr 2025 18:32:16.3405 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: HNZ7N21q5MYd5sLtvbWtrB0yo9qX9R8JWDxOf3F34Uqah41A8iwDEWVF4fx8dUNT+Qa2+run7XiuskpVhY0k/Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: GVXPR04MB10245 Add three registers: doorbell_bar, doorbell_addr, and doorbell_data. Use pci_epf_alloc_doorbell() to allocate a doorbell address space. Enable the Root Complex (RC) side driver to trigger pci-epc-test's doorbell callback handler by writing doorbell_data to the mapped doorbell_bar's address space. Set STATUS_DOORBELL_SUCCESS in the doorbell callback to indicate completion. Avoid breaking compatibility between host and endpoint, add new command COMMAND_ENABLE_DOORBELL and COMMAND_DISABLE_DOORBELL. Host side need send COMMAND_ENABLE_DOORBELL to map one bar's inbound address to MSI space. the command COMMAND_DISABLE_DOORBELL to recovery original inbound address mapping. Host side new driver Host side old driver EP: new driver S F EP: old driver F F S: If EP side support MSI, 'pci_endpoint_test -f pcie_ep_doorbell' return success. If EP side doesn't support MSI, the same to 'F'. F: 'pci_endpoint_test -f pcie_ep_doorbell' return failure, other case as usual. Tested-by: Niklas Cassel Signed-off-by: Frank Li --- change from v15 to v16 - use le32 for doorbell_* register and use cpu_to_le32() and le32_to_cpu() when use it. change from v14 to v15 - none Change from v9 to v14 - update commit message by use pci_endpoint_test -f pcie_ep_doorbell Change from v8 to v9 - move pci_epf_alloc_doorbell() into pci_epf_{enable/disable}_doorbell(). - remove doorbell_done in commit message. - rename pci_epf_{enable/disable}_doorbell() to pci_epf_test_{enable/disable}_doorbell() to align corrent code style. Change from v7 to v8 - rename to pci_epf_align_inbound_addr_lo_hi() Change from v6 to v7 - use help function pci_epf_align_addr_lo_hi() Change from v5 to v6 - rename doorbell_addr to doorbell_offset Chagne from v4 to v5 - Add doorbell free at unbind function. - Move msi irq handler to here to more complex user case, such as differece doorbell can use difference handler function. - Add Niklas's code to handle fixed bar's case. If need add your signed-off tag or co-developer tag, please let me know. change from v3 to v4 - remove revid requirement - Add command COMMAND_ENABLE_DOORBELL and COMMAND_DISABLE_DOORBELL. - call pci_epc_set_bar() to map inbound address to MSI space only at COMMAND_ENABLE_DOORBELL. --- drivers/pci/endpoint/functions/pci-epf-test.c | 142 ++++++++++++++++++++++++++ 1 file changed, 142 insertions(+) diff --git a/drivers/pci/endpoint/functions/pci-epf-test.c b/drivers/pci/endpoint/functions/pci-epf-test.c index 50eb4106369f4..b9cb1ab218f2b 100644 --- a/drivers/pci/endpoint/functions/pci-epf-test.c +++ b/drivers/pci/endpoint/functions/pci-epf-test.c @@ -11,12 +11,14 @@ #include #include #include +#include #include #include #include #include #include +#include #include #define IRQ_TYPE_INTX 0 @@ -29,6 +31,8 @@ #define COMMAND_READ BIT(3) #define COMMAND_WRITE BIT(4) #define COMMAND_COPY BIT(5) +#define COMMAND_ENABLE_DOORBELL BIT(6) +#define COMMAND_DISABLE_DOORBELL BIT(7) #define STATUS_READ_SUCCESS BIT(0) #define STATUS_READ_FAIL BIT(1) @@ -39,6 +43,11 @@ #define STATUS_IRQ_RAISED BIT(6) #define STATUS_SRC_ADDR_INVALID BIT(7) #define STATUS_DST_ADDR_INVALID BIT(8) +#define STATUS_DOORBELL_SUCCESS BIT(9) +#define STATUS_DOORBELL_ENABLE_SUCCESS BIT(10) +#define STATUS_DOORBELL_ENABLE_FAIL BIT(11) +#define STATUS_DOORBELL_DISABLE_SUCCESS BIT(12) +#define STATUS_DOORBELL_DISABLE_FAIL BIT(13) #define FLAG_USE_DMA BIT(0) @@ -66,6 +75,7 @@ struct pci_epf_test { bool dma_supported; bool dma_private; const struct pci_epc_features *epc_features; + struct pci_epf_bar db_bar; }; struct pci_epf_test_reg { @@ -80,6 +90,9 @@ struct pci_epf_test_reg { __le32 irq_number; __le32 flags; __le32 caps; + __le32 doorbell_bar; + __le32 doorbell_offset; + __le32 doorbell_data; } __packed; static struct pci_epf_header test_header = { @@ -667,6 +680,126 @@ static void pci_epf_test_raise_irq(struct pci_epf_test *epf_test, } } +static irqreturn_t pci_epf_test_doorbell_handler(int irq, void *data) +{ + struct pci_epf_test *epf_test = data; + enum pci_barno test_reg_bar = epf_test->test_reg_bar; + struct pci_epf_test_reg *reg = epf_test->reg[test_reg_bar]; + u32 status = le32_to_cpu(reg->status); + + status |= STATUS_DOORBELL_SUCCESS; + reg->status = cpu_to_le32(status); + pci_epf_test_raise_irq(epf_test, reg); + + return IRQ_HANDLED; +} + +static void pci_epf_test_doorbell_cleanup(struct pci_epf_test *epf_test) +{ + struct pci_epf_test_reg *reg = epf_test->reg[epf_test->test_reg_bar]; + struct pci_epf *epf = epf_test->epf; + + if (le32_to_cpu(reg->doorbell_bar) > 0) { + free_irq(epf->db_msg[0].virq, epf_test); + reg->doorbell_bar = cpu_to_le32(NO_BAR); + } + + if (epf->db_msg) + pci_epf_free_doorbell(epf); +} + +static void pci_epf_test_enable_doorbell(struct pci_epf_test *epf_test, + struct pci_epf_test_reg *reg) +{ + u32 status = le32_to_cpu(reg->status); + struct pci_epf *epf = epf_test->epf; + struct pci_epc *epc = epf->epc; + struct msi_msg *msg; + enum pci_barno bar; + size_t offset; + int ret; + + ret = pci_epf_alloc_doorbell(epf, 1); + if (ret) { + status |= STATUS_DOORBELL_ENABLE_FAIL; + goto set_status; + } + + msg = &epf->db_msg[0].msg; + bar = pci_epc_get_next_free_bar(epf_test->epc_features, epf_test->test_reg_bar + 1); + if (bar < BAR_0 || bar == epf_test->test_reg_bar || !epf->db_msg) { + status |= STATUS_DOORBELL_ENABLE_FAIL; + goto set_status; + } + + ret = request_irq(epf->db_msg[0].virq, pci_epf_test_doorbell_handler, 0, + "pci-test-doorbell", epf_test); + if (ret) { + dev_err(&epf->dev, + "Failed to request irq %d, doorbell feature is not supported\n", + epf->db_msg[0].virq); + status |= STATUS_DOORBELL_ENABLE_FAIL; + pci_epf_test_doorbell_cleanup(epf_test); + goto set_status; + } + + reg->doorbell_data = cpu_to_le32(msg->data); + reg->doorbell_bar = cpu_to_le32(bar); + + msg = &epf->db_msg[0].msg; + ret = pci_epf_align_inbound_addr(epf, bar, ((u64)msg->address_hi << 32) | msg->address_lo, + &epf_test->db_bar.phys_addr, &offset); + + if (ret) { + status |= STATUS_DOORBELL_ENABLE_FAIL; + pci_epf_test_doorbell_cleanup(epf_test); + goto set_status; + } + + reg->doorbell_offset = cpu_to_le32(offset); + + epf_test->db_bar.barno = bar; + epf_test->db_bar.size = epf->bar[bar].size; + epf_test->db_bar.flags = epf->bar[bar].flags; + + ret = pci_epc_set_bar(epc, epf->func_no, epf->vfunc_no, &epf_test->db_bar); + if (ret) { + status |= STATUS_DOORBELL_ENABLE_FAIL; + pci_epf_test_doorbell_cleanup(epf_test); + } else { + status |= STATUS_DOORBELL_ENABLE_SUCCESS; + } + +set_status: + reg->status = cpu_to_le32(status); +} + +static void pci_epf_test_disable_doorbell(struct pci_epf_test *epf_test, + struct pci_epf_test_reg *reg) +{ + enum pci_barno bar = le32_to_cpu(reg->doorbell_bar); + u32 status = le32_to_cpu(reg->status); + struct pci_epf *epf = epf_test->epf; + struct pci_epc *epc = epf->epc; + int ret; + + if (bar < BAR_0 || bar == epf_test->test_reg_bar || !epf->db_msg) { + status |= STATUS_DOORBELL_DISABLE_FAIL; + goto set_status; + } + + ret = pci_epc_set_bar(epc, epf->func_no, epf->vfunc_no, &epf->bar[bar]); + if (ret) + status |= STATUS_DOORBELL_DISABLE_FAIL; + else + status |= STATUS_DOORBELL_DISABLE_SUCCESS; + + pci_epf_test_doorbell_cleanup(epf_test); + +set_status: + reg->status = cpu_to_le32(status); +} + static void pci_epf_test_cmd_handler(struct work_struct *work) { u32 command; @@ -714,6 +847,14 @@ static void pci_epf_test_cmd_handler(struct work_struct *work) pci_epf_test_copy(epf_test, reg); pci_epf_test_raise_irq(epf_test, reg); break; + case COMMAND_ENABLE_DOORBELL: + pci_epf_test_enable_doorbell(epf_test, reg); + pci_epf_test_raise_irq(epf_test, reg); + break; + case COMMAND_DISABLE_DOORBELL: + pci_epf_test_disable_doorbell(epf_test, reg); + pci_epf_test_raise_irq(epf_test, reg); + break; default: dev_err(dev, "Invalid command 0x%x\n", command); break; @@ -987,6 +1128,7 @@ static void pci_epf_test_unbind(struct pci_epf *epf) pci_epf_test_clean_dma_chan(epf_test); pci_epf_test_clear_bar(epf); } + pci_epf_test_doorbell_cleanup(epf_test); pci_epf_test_free_space(epf); }