From patchwork Tue Jan 15 13:46:51 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "\(Exiting\) Baolin Wang" X-Patchwork-Id: 155670 Delivered-To: patch@linaro.org Received: by 2002:a02:48:0:0:0:0:0 with SMTP id 69csp4910644jaa; Tue, 15 Jan 2019 05:47:39 -0800 (PST) X-Google-Smtp-Source: ALg8bN6neBY2EASr+aRAPITMfmrIqQb308TuUKcEzie3916zg/vmbdm4LnM91XIPeDaCHIjMKSji X-Received: by 2002:a62:62c5:: with SMTP id w188mr4169045pfb.160.1547560059195; Tue, 15 Jan 2019 05:47:39 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1547560059; cv=none; d=google.com; s=arc-20160816; b=hIVFMqUBQ7YFWG6q0IOJKVG0dt37cNM3Zo/uz2GcztzaaCUuPFi+KOPo5kAm83W9WB wpFcMTZoxzoakU9k4lHx6O6+PnVDfichHxTxj1E5ZIa+6ewQS3hdQlrrRIAu3LxoXolZ taiHfmM5iE9pQ78WxEWIo5CNkFg7XYsgCAKe5zaXA2vxHSCLlLVPJl+rGVOsyLdCCqbp VXrstp4s2SBQI+ohCf4zork4xu3oQXPqsuX6wW3TKaPRoU/pnHIcK8AB/WnukLhb5Vqv h8o8bUXN+Mq1pEs38FlnyTkE9yfeCRr0uoGdGIv5SY4IYTEQQdp9LdXEXTcR85NziacB clNQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=GIat+m7TznQx8UqrqhXybGFDW6VxagwmUZvqdNg8Le4=; b=KYnIqVY1O03U6TSrxtfnwrVINBFUFSycX0qHNKCvbItdiVOji36ITvvot7wdyAORaK riUDTPduuJlrCUc0Mq2Al1mJFlVqzIHfN7Jw6E+xQBeO9bBu3Z+oeZ/nv5D81/wo4cAa yx1Zdv1MS7QbgLqfSbubPOFD0Jibm8/adCPTz0UtyIauSJF70Y9AeHNKWn4dJfab621Y k9fKNk7/ZjpJjNnneVxNx7VzyMdPFzJWZRStlpaR/LfIkt0c89Z4rKgWH5TkgTQCoWdl N/6yfr6+ZrHq6/2F2ySWCbVYtzuLx1KoMaSkALDIUZBQqI0vZ3pQTpMxvp1DG+YtVIGJ n5eg== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=QbwL7OIu; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id g83si3455036pfb.278.2019.01.15.05.47.38; Tue, 15 Jan 2019 05:47:39 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=QbwL7OIu; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729593AbfAONri (ORCPT + 31 others); Tue, 15 Jan 2019 08:47:38 -0500 Received: from mail-pl1-f193.google.com ([209.85.214.193]:44207 "EHLO mail-pl1-f193.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727931AbfAONrh (ORCPT ); Tue, 15 Jan 2019 08:47:37 -0500 Received: by mail-pl1-f193.google.com with SMTP id e11so1309755plt.11 for ; Tue, 15 Jan 2019 05:47:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :in-reply-to:references; bh=GIat+m7TznQx8UqrqhXybGFDW6VxagwmUZvqdNg8Le4=; b=QbwL7OIuq4ceJmrG67XvLj+83iRkmvqiwrpIqGlTOJMgyzpbVQ0RIfI5ClhQBjFYy4 mxXhT8GypbIpFBQnojSCxf+HgWsTnyvcFMBKGgM0cIrhVNH6rYmtZygDSL/QWGQDFW4v ndaScbK8r3kkDsYP6QOmcYlYpB6lIfgU2R4F4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:in-reply-to:references; bh=GIat+m7TznQx8UqrqhXybGFDW6VxagwmUZvqdNg8Le4=; b=EMKRrjIrp/TFZ8/34YdhJPS3ZKG/RT903b4eUIAATtGKMAcszkThZ4gE1GreNmYime Q37w6p9uoxoTZWgFqmmu0Bb02tAqhMDolDhW3rRQNF12esRECVrC+0L+v7j3A7uXyb68 PsVv0+j2vFtaBybF6rK8lz7ILuJUkK9H5lr5o0sPgGdGXUAfcvSMBmK4p/WxvrjCOCiu uOpOlMZR0g4RLtgpSD6l94e5WQhWBQ8U8eY9x9u8td8Q0qgQtxh+CHitYMnVgqmHWeh4 9cjdrIk/JVaDJ7SknTCChfNbB3FS9hDnqvV+Vri7RKzIpkafcHrFmU7F40ozCu6uZ+KQ b7VA== X-Gm-Message-State: AJcUukc1+LOxSzN/8YHpppDvf+7I81sCpFOj8b9giQMQZf0NHIG4DDaw cntTQpdBvqmnoUCJfPZtc8aq/w== X-Received: by 2002:a17:902:2a89:: with SMTP id j9mr4261570plb.296.1547560056264; Tue, 15 Jan 2019 05:47:36 -0800 (PST) Received: from baolinwangubtpc.spreadtrum.com ([117.18.48.102]) by smtp.gmail.com with ESMTPSA id y71sm5979422pfi.123.2019.01.15.05.47.32 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 15 Jan 2019 05:47:35 -0800 (PST) From: Baolin Wang To: broonie@kernel.org, robh+dt@kernel.org, mark.rutland@arm.com Cc: orsonzhai@gmail.com, zhang.lyra@gmail.com, lanqing.liu@unisoc.com, baolin.wang@linaro.org, linux-spi@vger.kernel.org, devicetree@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [PATCH 2/4] spi: sprd: Add the SPI irq function for the SPI DMA mode Date: Tue, 15 Jan 2019 21:46:51 +0800 Message-Id: X-Mailer: git-send-email 1.7.9.5 In-Reply-To: References: In-Reply-To: References: Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Lanqing Liu The SPI irq event will use to complete the SPI work in the SPI DMA mode, so this patch is a preparation for the following DMA mode support. Signed-off-by: Lanqing Liu Signed-off-by: Baolin Wang --- drivers/spi/spi-sprd.c | 46 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 46 insertions(+) -- 1.7.9.5 diff --git a/drivers/spi/spi-sprd.c b/drivers/spi/spi-sprd.c index fa324ce..bfba30b 100644 --- a/drivers/spi/spi-sprd.c +++ b/drivers/spi/spi-sprd.c @@ -133,6 +133,7 @@ struct sprd_spi { void __iomem *base; struct device *dev; struct clk *clk; + int irq; u32 src_clk; u32 hw_mode; u32 trans_len; @@ -141,6 +142,7 @@ struct sprd_spi { u32 hw_speed_hz; u32 len; int status; + struct completion xfer_completion; const void *tx_buf; void *rx_buf; int (*read_bufs)(struct sprd_spi *ss, u32 len); @@ -575,6 +577,45 @@ static int sprd_spi_transfer_one(struct spi_controller *sctlr, return ret; } +static irqreturn_t sprd_spi_handle_irq(int irq, void *data) +{ + struct sprd_spi *ss = (struct sprd_spi *)data; + u32 val = readl_relaxed(ss->base + SPRD_SPI_INT_MASK_STS); + + if (val & SPRD_SPI_MASK_TX_END) { + writel_relaxed(SPRD_SPI_TX_END_CLR, ss->base + SPRD_SPI_INT_CLR); + if (!(ss->trans_mode & SPRD_SPI_RX_MODE)) + complete(&ss->xfer_completion); + return IRQ_HANDLED; + } + + if (val & SPRD_SPI_MASK_RX_END) { + writel_relaxed(SPRD_SPI_RX_END_CLR, ss->base + SPRD_SPI_INT_CLR); + complete(&ss->xfer_completion); + } + + return IRQ_HANDLED; +} + +static int sprd_spi_irq_init(struct platform_device *pdev, struct sprd_spi *ss) +{ + int ret; + + ss->irq = platform_get_irq(pdev, 0); + if (ss->irq < 0) { + dev_err(&pdev->dev, "failed to get irq resource\n"); + return ss->irq; + } + + ret = devm_request_irq(&pdev->dev, ss->irq, sprd_spi_handle_irq, + 0, pdev->name, ss); + if (ret) + dev_err(&pdev->dev, "failed to request spi irq %d, ret = %d\n", + ss->irq, ret); + + return ret; +} + static int sprd_spi_clk_init(struct platform_device *pdev, struct sprd_spi *ss) { struct clk *clk_spi, *clk_parent; @@ -635,11 +676,16 @@ static int sprd_spi_probe(struct platform_device *pdev) sctlr->max_speed_hz = min_t(u32, ss->src_clk >> 1, SPRD_SPI_MAX_SPEED_HZ); + init_completion(&ss->xfer_completion); platform_set_drvdata(pdev, sctlr); ret = sprd_spi_clk_init(pdev, ss); if (ret) goto free_controller; + ret = sprd_spi_irq_init(pdev, ss); + if (ret) + goto free_controller; + ret = clk_prepare_enable(ss->clk); if (ret) goto free_controller; From patchwork Tue Jan 15 13:46:53 2019 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: "\(Exiting\) Baolin Wang" X-Patchwork-Id: 155672 Delivered-To: patch@linaro.org Received: by 2002:a02:48:0:0:0:0:0 with SMTP id 69csp4910783jaa; Tue, 15 Jan 2019 05:47:47 -0800 (PST) X-Google-Smtp-Source: ALg8bN5khgHAd6Zu4rHuukDgziUoAI5rM6sGb3JrwH40hNSS0gpQkR3BI4USvWKl187RCeuvGdjH X-Received: by 2002:a63:f141:: with SMTP id o1mr4028675pgk.134.1547560067469; Tue, 15 Jan 2019 05:47:47 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1547560067; cv=none; d=google.com; s=arc-20160816; b=XpEAyLKK1y7UdrCq0guh01jQb/pBF4NQfmfD+6Zex8vOzDtgJhpipNQkTfc9BTrrr9 AlulteoTMa1E0mP7pFvCD2U0OnnCgDmLTSzp/PsY937EdW2fQK8O+BXNc7w5fjwXa7Pw dp2Y/D/QARsJxO3+OqMm+tyVUPSUqiP7HiYbbSLnsrWQlc/4n2Zt5+NE9lt7Bw17N9AS XNNVa+FDwJEPFqrLkMMUczqJKt/ybLPF/snMzLLbaVqHGL8CLhDW7hTHMmrCN1+XL1aO Eb9N7iUaYFY2yy8fNcv+z80XcTT1zQgP7QUf8mArmLW+pSbNDqW6Jkdj9viWaNREDhjm ZWOQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-id:precedence:sender:references:in-reply-to:references :in-reply-to:message-id:date:subject:cc:to:from:dkim-signature; bh=dbzOVZDGQl/FC/IQTupoI7ZxR0RmoF09wTPEga6fMlo=; b=ydyCihC8Y1jfTh1HwntUJGn7h6uq+YcUh2C6/Cof/HJ3wyvbfLO9NvoraFf1K6acmd rXKYvVNNHbd+fOAEl1KcR1IGBM8yZGeZEaHQog68TLL1BF+Zb1LN9eRHj+C7bgq6o6nR QPvnEG8Uo5vwduwCgwci6K/qbvQJCaYGOK1cvlDDkuNkyo9Zg1FGRPjOb4YEIhNUSyoG 9zhY2RLyLXU5BhGB5Vhn7z1bn3Ls7OlZo4/Q4WnWIzrAMJByVngFlQO5tXVEET8h+XGC nFj7uxm4PZaMd0edjPxD65+BgXjghT5agTpe9ZEBYv4JVy83xEDzfLkBIfVoOtgfMSho 3KxA== ARC-Authentication-Results: i=1; mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=AuxBg8UM; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id bd3si3375879plb.286.2019.01.15.05.47.47; Tue, 15 Jan 2019 05:47:47 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org header.s=google header.b=AuxBg8UM; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730037AbfAONrq (ORCPT + 31 others); Tue, 15 Jan 2019 08:47:46 -0500 Received: from mail-pf1-f195.google.com ([209.85.210.195]:42252 "EHLO mail-pf1-f195.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1729451AbfAONro (ORCPT ); Tue, 15 Jan 2019 08:47:44 -0500 Received: by mail-pf1-f195.google.com with SMTP id 64so1336007pfr.9 for ; Tue, 15 Jan 2019 05:47:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :in-reply-to:references; bh=dbzOVZDGQl/FC/IQTupoI7ZxR0RmoF09wTPEga6fMlo=; b=AuxBg8UMYXIuPLEyl9uEkiLk1j2tUM9/wjEJ49zHPKYGG+3tKRLUi3k+V8Br3MsS0c FFF88SnlUt5ubo7obzNMIQdGADKiMHdfwBL4DiRBmrPmBmQbG5raNW1vecH+FV9u1B6O /YNwIHvVhS0We6v9WeYlgJJ7ry4sRTalDHYoY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:in-reply-to:references; bh=dbzOVZDGQl/FC/IQTupoI7ZxR0RmoF09wTPEga6fMlo=; b=kSqFi3R1onEp/82Cc37j/yioF4bhLx4RO/wT2WfVgAeAJmRFIA/PPVTWz2UIGwIkNd e6b310C8wKrfPiLGkkng7DVhaUhj2Se9ewfFK5VQeqoAEwlb7dpMFKCUINscZgEnyMBo ijKdfoeqPCZZVX9Pto20hhU8O+aP0tLi3kg74hUxIcyA2Ub3ON9u/V4B92Z23ojsqjqQ E8l4k9+Om0P546QjesHF58pBn8DchWbF3Knc6Zh38p3p1K9noYGJMelwNLudn2grlpId gEDCmiBtlIbDvcWEIknQvCNVwQm27IMQr9CwWzFV3zLxR/gQtwQd2I5j/27YOLd1aKM6 zanA== X-Gm-Message-State: AJcUukcA9wiA2g4rb3sxwQHpCKhu+BARfkUv5LviTRiwl3tEnCqM+J9d cFw637aXYws+RE8Wjx4Rj6NsAA== X-Received: by 2002:a62:b15:: with SMTP id t21mr4272645pfi.136.1547560063127; Tue, 15 Jan 2019 05:47:43 -0800 (PST) Received: from baolinwangubtpc.spreadtrum.com ([117.18.48.102]) by smtp.gmail.com with ESMTPSA id y71sm5979422pfi.123.2019.01.15.05.47.40 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 15 Jan 2019 05:47:42 -0800 (PST) From: Baolin Wang To: broonie@kernel.org, robh+dt@kernel.org, mark.rutland@arm.com Cc: orsonzhai@gmail.com, zhang.lyra@gmail.com, lanqing.liu@unisoc.com, baolin.wang@linaro.org, linux-spi@vger.kernel.org, devicetree@vger.kernel.org, linux-kernel@vger.kernel.org Subject: [PATCH 4/4] spi: sprd: Add DMA mode support Date: Tue, 15 Jan 2019 21:46:53 +0800 Message-Id: <324f3106dbff2f28baae098b05219f1384fda97a.1547559542.git.baolin.wang@linaro.org> X-Mailer: git-send-email 1.7.9.5 In-Reply-To: References: In-Reply-To: References: Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org From: Lanqing Liu Add DMA mode support for the Spreadtrum SPI controller, and we will enable SPI interrupt to help to complete the SPI transfer work in DMA mode. Signed-off-by: Lanqing Liu Signed-off-by: Baolin Wang --- drivers/spi/spi-sprd.c | 291 +++++++++++++++++++++++++++++++++++++++++++++++- 1 file changed, 288 insertions(+), 3 deletions(-) -- 1.7.9.5 diff --git a/drivers/spi/spi-sprd.c b/drivers/spi/spi-sprd.c index bfba30b..da93016 100644 --- a/drivers/spi/spi-sprd.c +++ b/drivers/spi/spi-sprd.c @@ -2,6 +2,9 @@ // Copyright (C) 2018 Spreadtrum Communications Inc. #include +#include +#include +#include #include #include #include @@ -9,6 +12,7 @@ #include #include #include +#include #include #include #include @@ -128,9 +132,26 @@ #define SPRD_SPI_DEFAULT_SOURCE 26000000 #define SPRD_SPI_MAX_SPEED_HZ 48000000 #define SPRD_SPI_AUTOSUSPEND_DELAY 100 +#define SPRD_SPI_DMA_STEP 8 + +enum sprd_spi_dma_channel { + SPI_RX, + SPI_TX, + SPI_MAX, +}; + +struct sprd_spi_dma { + bool enable; + struct dma_chan *dma_chan[SPI_MAX]; + u32 slave_id[SPI_MAX]; + enum dma_slave_buswidth width; + u32 fragmens_len; + u32 rx_len; +}; struct sprd_spi { void __iomem *base; + phys_addr_t phy_base; struct device *dev; struct clk *clk; int irq; @@ -142,6 +163,7 @@ struct sprd_spi { u32 hw_speed_hz; u32 len; int status; + struct sprd_spi_dma dma; struct completion xfer_completion; const void *tx_buf; void *rx_buf; @@ -433,6 +455,186 @@ static int sprd_spi_txrx_bufs(struct spi_device *sdev, struct spi_transfer *t) return ret; } +static void sprd_spi_dma_enable(struct sprd_spi *ss, bool enable) +{ + u32 val = readl_relaxed(ss->base + SPRD_SPI_CTL2); + + if (enable) + val |= SPRD_SPI_DMA_EN; + else + val &= ~SPRD_SPI_DMA_EN; + + writel_relaxed(val, ss->base + SPRD_SPI_CTL2); +} + +static int sprd_spi_dma_submit(struct dma_chan *dma_chan, + struct dma_slave_config *c, + struct sg_table *sg, + enum dma_transfer_direction dir) +{ + struct dma_async_tx_descriptor *desc; + dma_cookie_t cookie; + unsigned long flags; + int ret; + + ret = dmaengine_slave_config(dma_chan, c); + if (ret < 0) + return ret; + + flags = SPRD_DMA_FLAGS(SPRD_DMA_CHN_MODE_NONE, SPRD_DMA_NO_TRG, + SPRD_DMA_FRAG_REQ, SPRD_DMA_TRANS_INT); + desc = dmaengine_prep_slave_sg(dma_chan, sg->sgl, sg->nents, dir, flags); + if (!desc) + return -ENODEV; + + cookie = dmaengine_submit(desc); + if (dma_submit_error(cookie)) + return dma_submit_error(cookie); + + dma_async_issue_pending(dma_chan); + + return 0; +} + +static int sprd_spi_dma_rx_config(struct sprd_spi *ss, struct spi_transfer *t) +{ + struct dma_chan *dma_chan = ss->dma.dma_chan[SPI_RX]; + struct dma_slave_config config = { + .src_addr = ss->phy_base, + .src_addr_width = ss->dma.width, + .dst_addr_width = ss->dma.width, + .dst_maxburst = ss->dma.fragmens_len, + .slave_id = ss->dma.slave_id[SPI_RX], + }; + int ret; + + ret = sprd_spi_dma_submit(dma_chan, &config, &t->rx_sg, DMA_DEV_TO_MEM); + if (ret) + return ret; + + return ss->dma.rx_len; +} + +static int sprd_spi_dma_tx_config(struct sprd_spi *ss, struct spi_transfer *t) +{ + struct dma_chan *dma_chan = ss->dma.dma_chan[SPI_TX]; + struct dma_slave_config config = { + .dst_addr = ss->phy_base, + .src_addr_width = ss->dma.width, + .dst_addr_width = ss->dma.width, + .src_maxburst = ss->dma.fragmens_len, + .slave_id = ss->dma.slave_id[SPI_TX], + }; + int ret; + + ret = sprd_spi_dma_submit(dma_chan, &config, &t->tx_sg, DMA_MEM_TO_DEV); + if (ret) + return ret; + + return t->len; +} + +static int sprd_spi_dma_request(struct sprd_spi *ss) +{ + ss->dma.dma_chan[SPI_RX] = dma_request_chan(ss->dev, "rx_chn"); + if (IS_ERR_OR_NULL(ss->dma.dma_chan[SPI_RX])) { + if (PTR_ERR(ss->dma.dma_chan[SPI_RX]) == -EPROBE_DEFER) + return PTR_ERR(ss->dma.dma_chan[SPI_RX]); + + dev_err(ss->dev, "request RX DMA channel failed!\n"); + return PTR_ERR(ss->dma.dma_chan[SPI_RX]); + } + + ss->dma.dma_chan[SPI_TX] = dma_request_chan(ss->dev, "tx_chn"); + if (IS_ERR_OR_NULL(ss->dma.dma_chan[SPI_TX])) { + if (PTR_ERR(ss->dma.dma_chan[SPI_TX]) == -EPROBE_DEFER) + return PTR_ERR(ss->dma.dma_chan[SPI_TX]); + + dev_err(ss->dev, "request TX DMA channel failed!\n"); + dma_release_channel(ss->dma.dma_chan[SPI_RX]); + return PTR_ERR(ss->dma.dma_chan[SPI_TX]); + } + + return 0; +} + +static void sprd_spi_dma_release(struct sprd_spi *ss) +{ + dma_release_channel(ss->dma.dma_chan[SPI_RX]); + dma_release_channel(ss->dma.dma_chan[SPI_TX]); +} + +static int sprd_spi_dma_txrx_bufs(struct spi_device *sdev, + struct spi_transfer *t) +{ + struct sprd_spi *ss = spi_master_get_devdata(sdev->master); + u32 trans_len = ss->trans_len; + int ret, write_size = 0; + + reinit_completion(&ss->xfer_completion); + if (ss->trans_mode & SPRD_SPI_TX_MODE) { + write_size = sprd_spi_dma_tx_config(ss, t); + sprd_spi_set_tx_length(ss, trans_len); + + /* + * For our 3 wires mode or dual TX line mode, we need + * to request the controller to transfer. + */ + if (ss->hw_mode & SPI_3WIRE || ss->hw_mode & SPI_TX_DUAL) + sprd_spi_tx_req(ss); + } else { + sprd_spi_set_rx_length(ss, trans_len); + + /* + * For our 3 wires mode or dual TX line mode, we need + * to request the controller to read. + */ + if (ss->hw_mode & SPI_3WIRE || ss->hw_mode & SPI_TX_DUAL) + sprd_spi_rx_req(ss); + else + write_size = ss->write_bufs(ss, trans_len); + } + + if (write_size < 0) { + ret = write_size; + dev_err(ss->dev, "failed to write, ret = %d\n", ret); + goto trans_complete; + } + + if (ss->trans_mode & SPRD_SPI_RX_MODE) { + /* + * Set up the DMA receive data length, which must be an + * integral multiple of fragment length. But when the length + * of received data is less than fragment length, DMA can be + * configured to receive data according to the actual length + * of received data. + */ + ss->dma.rx_len = t->len > ss->dma.fragmens_len ? + (t->len - t->len % ss->dma.fragmens_len) : + t->len; + ret = sprd_spi_dma_rx_config(ss, t); + if (ret < 0) { + dev_err(&sdev->dev, + "failed to configure rx DMA, ret = %d\n", ret); + goto trans_complete; + } + } + + sprd_spi_dma_enable(ss, true); + wait_for_completion(&(ss->xfer_completion)); + + if (ss->trans_mode & SPRD_SPI_TX_MODE) + ret = write_size; + else + ret = ss->dma.rx_len; + +trans_complete: + sprd_spi_dma_enable(ss, false); + sprd_spi_enter_idle(ss); + + return ret; +} + static void sprd_spi_set_speed(struct sprd_spi *ss, u32 speed_hz) { /* @@ -488,6 +690,18 @@ static void sprd_spi_init_hw(struct sprd_spi *ss, struct spi_transfer *t) val &= ~SPRD_SPI_DATA_LINE2_EN; writel_relaxed(val, ss->base + SPRD_SPI_CTL7); + + if (ss->dma.enable) { + /* Clear interrupt status before enabling interrupt. */ + writel_relaxed(SPRD_SPI_TX_END_CLR | SPRD_SPI_RX_END_CLR, + ss->base + SPRD_SPI_INT_CLR); + + /* Enable SPI interrupt only in DMA mode. */ + val = readl_relaxed(ss->base + SPRD_SPI_INT_EN); + writel_relaxed(val | SPRD_SPI_TX_END_INT_EN | + SPRD_SPI_RX_END_INT_EN, + ss->base + SPRD_SPI_INT_EN); + } } static int sprd_spi_setup_transfer(struct spi_device *sdev, @@ -518,16 +732,22 @@ static int sprd_spi_setup_transfer(struct spi_device *sdev, ss->trans_len = t->len; ss->read_bufs = sprd_spi_read_bufs_u8; ss->write_bufs = sprd_spi_write_bufs_u8; + ss->dma.width = DMA_SLAVE_BUSWIDTH_1_BYTE; + ss->dma.fragmens_len = SPRD_SPI_DMA_STEP; break; case 16: ss->trans_len = t->len >> 1; ss->read_bufs = sprd_spi_read_bufs_u16; ss->write_bufs = sprd_spi_write_bufs_u16; + ss->dma.width = DMA_SLAVE_BUSWIDTH_2_BYTES; + ss->dma.fragmens_len = SPRD_SPI_DMA_STEP << 1; break; case 32: ss->trans_len = t->len >> 2; ss->read_bufs = sprd_spi_read_bufs_u32; ss->write_bufs = sprd_spi_write_bufs_u32; + ss->dma.width = DMA_SLAVE_BUSWIDTH_4_BYTES; + ss->dma.fragmens_len = SPRD_SPI_DMA_STEP << 2; break; default: return -EINVAL; @@ -559,13 +779,18 @@ static int sprd_spi_transfer_one(struct spi_controller *sctlr, struct spi_device *sdev, struct spi_transfer *t) { + struct sprd_spi *ss = spi_controller_get_devdata(sctlr); int ret; ret = sprd_spi_setup_transfer(sdev, t); if (ret) goto setup_err; - ret = sprd_spi_txrx_bufs(sdev, t); + if (ss->dma.enable) + ret = sprd_spi_dma_txrx_bufs(sdev, t); + else + ret = sprd_spi_txrx_bufs(sdev, t); + if (ret == t->len) ret = 0; else if (ret >= 0) @@ -591,6 +816,11 @@ static irqreturn_t sprd_spi_handle_irq(int irq, void *data) if (val & SPRD_SPI_MASK_RX_END) { writel_relaxed(SPRD_SPI_RX_END_CLR, ss->base + SPRD_SPI_INT_CLR); + if (ss->dma.rx_len < ss->len) { + ss->rx_buf += ss->dma.rx_len; + ss->dma.rx_len += + ss->read_bufs(ss, ss->len - ss->dma.rx_len); + } complete(&ss->xfer_completion); } @@ -646,6 +876,43 @@ static int sprd_spi_clk_init(struct platform_device *pdev, struct sprd_spi *ss) return 0; } +static bool sprd_spi_can_dma(struct spi_controller *sctlr, + struct spi_device *spi, struct spi_transfer *t) +{ + struct sprd_spi *ss = spi_controller_get_devdata(sctlr); + + return ss->dma.enable; +} + +static int sprd_spi_dma_init(struct platform_device *pdev, struct sprd_spi *ss) +{ + struct device_node *np = pdev->dev.of_node; + int ret; + + ret = sprd_spi_dma_request(ss); + if (ret) { + if (ret == -EPROBE_DEFER) + return ret; + + dev_warn(&pdev->dev, + "failed to request dma, enter no dma mode, ret = %d\n", + ret); + + return 0; + } + + if (of_property_read_u32_array(np, "sprd,dma-slave-ids", + ss->dma.slave_id, SPI_MAX)) { + dev_warn(&pdev->dev, + "failed to request dma slave id, enter no dma mode\n"); + return 0; + } + + ss->dma.enable = true; + + return 0; +} + static int sprd_spi_probe(struct platform_device *pdev) { struct spi_controller *sctlr; @@ -666,12 +933,14 @@ static int sprd_spi_probe(struct platform_device *pdev) goto free_controller; } + ss->phy_base = res->start; ss->dev = &pdev->dev; sctlr->dev.of_node = pdev->dev.of_node; sctlr->mode_bits = SPI_CPOL | SPI_CPHA | SPI_3WIRE | SPI_TX_DUAL; sctlr->bus_num = pdev->id; sctlr->set_cs = sprd_spi_chipselect; sctlr->transfer_one = sprd_spi_transfer_one; + sctlr->can_dma = sprd_spi_can_dma; sctlr->auto_runtime_pm = true; sctlr->max_speed_hz = min_t(u32, ss->src_clk >> 1, SPRD_SPI_MAX_SPEED_HZ); @@ -686,10 +955,14 @@ static int sprd_spi_probe(struct platform_device *pdev) if (ret) goto free_controller; - ret = clk_prepare_enable(ss->clk); + ret = sprd_spi_dma_init(pdev, ss); if (ret) goto free_controller; + ret = clk_prepare_enable(ss->clk); + if (ret) + goto release_dma; + ret = pm_runtime_set_active(&pdev->dev); if (ret < 0) goto disable_clk; @@ -718,6 +991,8 @@ static int sprd_spi_probe(struct platform_device *pdev) pm_runtime_disable(&pdev->dev); disable_clk: clk_disable_unprepare(ss->clk); +release_dma: + sprd_spi_dma_release(ss); free_controller: spi_controller_put(sctlr); @@ -748,6 +1023,9 @@ static int __maybe_unused sprd_spi_runtime_suspend(struct device *dev) struct spi_controller *sctlr = dev_get_drvdata(dev); struct sprd_spi *ss = spi_controller_get_devdata(sctlr); + if (ss->dma.enable) + sprd_spi_dma_release(ss); + clk_disable_unprepare(ss->clk); return 0; @@ -763,7 +1041,14 @@ static int __maybe_unused sprd_spi_runtime_resume(struct device *dev) if (ret) return ret; - return 0; + if (!ss->dma.enable) + return 0; + + ret = sprd_spi_dma_request(ss); + if (ret) + clk_disable_unprepare(ss->clk); + + return ret; } static const struct dev_pm_ops sprd_spi_pm_ops = {