From patchwork Wed Oct 16 08:34:30 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Zhangfei Gao X-Patchwork-Id: 176441 Delivered-To: patch@linaro.org Received: by 2002:a92:7e96:0:0:0:0:0 with SMTP id q22csp7049747ill; Wed, 16 Oct 2019 01:34:56 -0700 (PDT) X-Google-Smtp-Source: APXvYqwM2TFJJ3J3K4emqAmo6Fu7CkYjlMUAgx3ZUtT9MAZwZwV2f0vi73JIxTt5Hi3D/Hkz4psK X-Received: by 2002:a17:906:e89:: with SMTP id p9mr38110943ejf.95.1571214896228; Wed, 16 Oct 2019 01:34:56 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1571214896; cv=none; d=google.com; s=arc-20160816; b=PTS0/+JA4KZUvfsS9lmlNNsjZgSs3hLtG2yZTpTcG3tmMZNCQYv7wM6M6Z8XOT1sRd 5OfRBEfVK8bfB5Yc5J1DGKaQYM1lG8uJ8mHBfRDC7XeKp4r02D8j16pjQQ1UK2zS4wnf VTz6jYNM0bKsLPAceISw4IuVa/i26BbIoKhO8QvkG8RjvOwki9t7inZwghICdsORRQQW N6KEcv6yr21OvVbgq/Cs0zM5JiBqiTGWj+i0k9nlcJV5Wd2AgZPPxqQfGw/moVUGjUpT ulnVfKVf/Cmvro0gfnJA7dUpvqV+ZUYCHFLo1tKDe7jvjocrAOCDx/KbqlPIx6war3Mo USdg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:message-id:date:subject:cc:to:from :dkim-signature; bh=yPciJhjBGijA5Tk8kPbmBpHq770aimEFdMTnh8bKlZU=; b=j8PuAg2U7D2ub3T5+n5vAgyre2ee8mU3/d1c0zBKE9Wrfm9mK3dsRN1XsvfiqXKUFz Vu9Dxfcq30GWQZP48X19naW6Z7QOE+HzPwaUDJ4pT7vTxGFd1u7LMKRfbVwPD6TpiL4t 6/OsJ5hj3BxEp9grzl1UO25pCf1E/1tz1Epbusy/8NdMXNykgHz11+jIdYF7uEbfNSam gi94qyf4cd3js/8eZ88+hZ/l63BTqRm7bRkNDMrhiMy0RD5bK8FU/+hHkyxlA4L2gasN +LraYWTx9IykwZRW8tb7zTeizmziXe6+bow0YD/1a20Pq01PGKKJ3zDPbMbcMaBzKwdP +07g== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=KoFI9lql; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id o14si14364298ejc.405.2019.10.16.01.34.56; Wed, 16 Oct 2019 01:34:56 -0700 (PDT) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=KoFI9lql; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2388927AbfJPIex (ORCPT + 26 others); Wed, 16 Oct 2019 04:34:53 -0400 Received: from mail-pf1-f194.google.com ([209.85.210.194]:45276 "EHLO mail-pf1-f194.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728113AbfJPIew (ORCPT ); Wed, 16 Oct 2019 04:34:52 -0400 Received: by mail-pf1-f194.google.com with SMTP id y72so14236353pfb.12 for ; Wed, 16 Oct 2019 01:34:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id; bh=yPciJhjBGijA5Tk8kPbmBpHq770aimEFdMTnh8bKlZU=; b=KoFI9lqlUvhU9OQRdZAKtFP9dcAQvGmc7M3nTu6kBY33kj24/RvQBWfK5E/CQsvo5e ZCjKxFA1mqwg1vskJPK9Rlgb/OTgVcsk9ZDDgOEiz/Q5BAR6I8orL4yUgKJPaCylJ/aL xy7R+jjL74WP16nrCB+x4iQ01spNwBiDCh8ytqomJnqnqZ8SIMHawpi3H1rBzPfIU7RN 3RGyHnCNym4fErAJccqxP5BtLygIb8L0zFunOPKfLMUm6i7py5srYeuIspT1KIZZXvBH XjXzE/PE5SCr2er6dvUKV8C0Gcv6SbdL1MqhUGoO+Wk+IpF3t9YK2LzqFqWxObwTVso3 TWow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id; bh=yPciJhjBGijA5Tk8kPbmBpHq770aimEFdMTnh8bKlZU=; b=kiUjZcCf62bWTWRw+QgV6czyXcaYgxKN0rgJv61saBGmNa34nRDL7/iF1ZynhX7W9Q OJl9tSmxBPfI30RxACc8lc3w6LHmxvvolDVCZg6VI0I8+ok46r8EiD1h5qQ5XiwoSktu Fygoe6ivuZA0eCvQci7akVg7pMLfYNA8KDFGMYd5GeBc5IR04bU/qIQ4MFiZjs7PQE+b fyRsmBKuTOQt9DR+Dg8YwpMAynwy4whIdQ5Z5MHSSyIb/8ATJ7r6frtlr1SNzukhJHBQ U+y+m5tDSJuzdqDccD/R6ju9t52kIUJQdTaSEMGsVQ5kiZEe9QwoehAns/LHQpG49066 l3/w== X-Gm-Message-State: APjAAAV/visXHM+vaR+lqCounEQmkPCsPCXOgQbqxC8hR3lfd383V9Ws xD2m8U9RwYYojiHhWN+bf7vYOQ== X-Received: by 2002:a65:434c:: with SMTP id k12mr44313645pgq.141.1571214891878; Wed, 16 Oct 2019 01:34:51 -0700 (PDT) Received: from localhost.localdomain ([85.203.47.199]) by smtp.gmail.com with ESMTPSA id d19sm1745960pjz.5.2019.10.16.01.34.44 (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Wed, 16 Oct 2019 01:34:50 -0700 (PDT) From: Zhangfei Gao To: Greg Kroah-Hartman , Arnd Bergmann , Herbert Xu , jonathan.cameron@huawei.com, grant.likely@arm.com, jean-philippe , ilias.apalodimas@linaro.org, francois.ozog@linaro.org, kenneth-lee-2012@foxmail.com, Wangzhou , "haojian . zhuang" Cc: linux-accelerators@lists.ozlabs.org, linux-kernel@vger.kernel.org, linux-crypto@vger.kernel.org, Zhangfei Gao Subject: [PATCH v6 0/3] Add uacce module for Accelerator Date: Wed, 16 Oct 2019 16:34:30 +0800 Message-Id: <1571214873-27359-1-git-send-email-zhangfei.gao@linaro.org> X-Mailer: git-send-email 2.7.4 Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Uacce (Unified/User-space-access-intended Accelerator Framework) targets to provide Shared Virtual Addressing (SVA) between accelerators and processes. So accelerator can access any data structure of the main cpu. This differs from the data sharing between cpu and io device, which share data content rather than address. Because of unified address, hardware and user space of process can share the same virtual address in the communication. Uacce is intended to be used with Jean Philippe Brucker's SVA patchset[1], which enables IO side page fault and PASID support. We have keep verifying with Jean's sva/current [2] We also keep verifying with Eric's SMMUv3 Nested Stage patch [3] This series and related zip & qm driver https://github.com/Linaro/linux-kernel-warpdrive/tree/5.4-rc1-uacce-v6 The library and user application: https://github.com/Linaro/warpdrive/tree/wdprd-v1-upstream References: [1] http://jpbrucker.net/sva/ [2] http://www.linux-arm.org/git?p=linux-jpb.git;a=shortlog;h=refs/heads/sva/current [3] https://github.com/eauger/linux/tree/v5.3.0-rc0-2stage-v9 Change History: v6: Change sys qfrs_size to different file, suggested by Jonathan Fix crypto daily build issue and based on crypto code base, also 5.4-rc1. v5: Add an example patch using the uacce interface, suggested by Greg 0003-crypto-hisilicon-register-zip-engine-to-uacce.patch v4: Based on 5.4-rc1 Considering other driver integrating uacce, if uacce not compiled, uacce_register return error and uacce_unregister is empty. Simplify uacce flag: UACCE_DEV_SVA. Address Greg's comments: Fix state machine, remove potential syslog triggered from user space etc. v3: Recommended by Greg, use sturct uacce_device instead of struct uacce, and use struct *cdev in struct uacce_device, as a result, cdev can be released by itself when refcount decreased to 0. So the two structures are decoupled and self-maintained by themsleves. Also add dev.release for put_device. v2: Address comments from Greg and Jonathan Modify interface uacce_register Drop noiommu mode first v1: 1. Rebase to 5.3-rc1 2. Build on iommu interface 3. Verifying with Jean's sva and Eric's nested mode iommu. 4. User library has developed a lot: support zlib, openssl etc. 5. Move to misc first RFC3: https://lkml.org/lkml/2018/11/12/1951 RFC2: https://lwn.net/Articles/763990/ Background of why Uacce: Von Neumann processor is not good at general data manipulation. It is designed for control-bound rather than data-bound application. The latter need less control path facility and more/specific ALUs. So there are more and more heterogeneous processors, such as encryption/decryption accelerators, TPUs, or EDGE (Explicated Data Graph Execution) processors, introduced to gain better performance or power efficiency for particular applications these days. There are generally two ways to make use of these heterogeneous processors: The first is to make them co-processors, just like FPU. This is good for some application but it has its own cons: It changes the ISA set permanently. You must save all state elements when the process is switched out. But most data-bound processors have a huge set of state elements. It makes the kernel scheduler more complex. The second is Accelerator. It is taken as a IO device from the CPU's point of view (but it need not to be physically). The process, running on CPU, hold a context of the accelerator and send instructions to it as if it calls a function or thread running with FPU. The context is bound with the processor itself. So the state elements remain in the hardware context until the context is released. We believe this is the core feature of an "Accelerator" vs. Co-processor or other heterogeneous processors. The intention of Uacce is to provide the basic facility to backup this scenario. Its first step is to make sure the accelerator and process can share the same address space. So the accelerator ISA can directly address any data structure of the main CPU. This differs from the data sharing between CPU and IO device, which share data content rather than address. So it is different comparing to the other DMA libraries. In the future, we may add more facility to support linking accelerator library to the main application, or managing the accelerator context as special thread. But no matter how, this can be a solid start point for new processor to be used as an "accelerator" as this is the essential requirement. Kenneth Lee (2): uacce: Add documents for uacce uacce: add uacce driver Zhangfei Gao (1): crypto: hisilicon - register zip engine to uacce Documentation/ABI/testing/sysfs-driver-uacce | 65 ++ Documentation/misc-devices/uacce.rst | 297 ++++++++ drivers/crypto/hisilicon/qm.c | 254 ++++++- drivers/crypto/hisilicon/qm.h | 13 +- drivers/crypto/hisilicon/zip/zip_main.c | 39 +- drivers/misc/Kconfig | 1 + drivers/misc/Makefile | 1 + drivers/misc/uacce/Kconfig | 13 + drivers/misc/uacce/Makefile | 2 + drivers/misc/uacce/uacce.c | 995 +++++++++++++++++++++++++++ include/linux/uacce.h | 168 +++++ include/uapi/misc/uacce/qm.h | 22 + include/uapi/misc/uacce/uacce.h | 41 ++ 13 files changed, 1875 insertions(+), 36 deletions(-) create mode 100644 Documentation/ABI/testing/sysfs-driver-uacce create mode 100644 Documentation/misc-devices/uacce.rst create mode 100644 drivers/misc/uacce/Kconfig create mode 100644 drivers/misc/uacce/Makefile create mode 100644 drivers/misc/uacce/uacce.c create mode 100644 include/linux/uacce.h create mode 100644 include/uapi/misc/uacce/qm.h create mode 100644 include/uapi/misc/uacce/uacce.h -- 2.7.4