From patchwork Sun Nov 8 20:42:10 2015 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Bill Fischofer X-Patchwork-Id: 56165 Delivered-To: patch@linaro.org Received: by 10.112.1.169 with SMTP id 9csp127908lbn; Sun, 8 Nov 2015 12:46:53 -0800 (PST) X-Received: by 10.140.242.141 with SMTP id n135mr1323075qhc.59.1447015613848; Sun, 08 Nov 2015 12:46:53 -0800 (PST) Return-Path: Received: from lists.linaro.org (lists.linaro.org. [54.225.227.206]) by mx.google.com with ESMTP id g131si8584244qkb.102.2015.11.08.12.46.53; Sun, 08 Nov 2015 12:46:53 -0800 (PST) Received-SPF: pass (google.com: domain of lng-odp-bounces@lists.linaro.org designates 54.225.227.206 as permitted sender) client-ip=54.225.227.206; Authentication-Results: mx.google.com; spf=pass (google.com: domain of lng-odp-bounces@lists.linaro.org designates 54.225.227.206 as permitted sender) smtp.mailfrom=lng-odp-bounces@lists.linaro.org; dkim=neutral (body hash did not verify) header.i=@linaro_org.20150623.gappssmtp.com Received: by lists.linaro.org (Postfix, from userid 109) id 7CAB361959; Sun, 8 Nov 2015 20:46:53 +0000 (UTC) X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on ip-10-142-244-252 X-Spam-Level: X-Spam-Status: No, score=-2.5 required=5.0 tests=BAYES_00,DKIM_SIGNED, RCVD_IN_DNSWL_LOW, RCVD_IN_MSPIKE_H3, RCVD_IN_MSPIKE_WL, T_DKIM_INVALID, URIBL_BLOCKED autolearn=disabled version=3.4.0 Received: from [127.0.0.1] (localhost [127.0.0.1]) by lists.linaro.org (Postfix) with ESMTP id C8423619CE; Sun, 8 Nov 2015 20:42:58 +0000 (UTC) X-Original-To: lng-odp@lists.linaro.org Delivered-To: lng-odp@lists.linaro.org Received: by lists.linaro.org (Postfix, from userid 109) id 7D5D56195B; Sun, 8 Nov 2015 20:42:51 +0000 (UTC) Received: from mail-yk0-f181.google.com (mail-yk0-f181.google.com [209.85.160.181]) by lists.linaro.org (Postfix) with ESMTPS id C235C61946 for ; Sun, 8 Nov 2015 20:42:20 +0000 (UTC) Received: by ykfs79 with SMTP id s79so7321500ykf.1 for ; Sun, 08 Nov 2015 12:42:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro_org.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=YSH/LSSjlgjCjinYtRse6RiN4Ic9s5jrelEXqXPuyXc=; b=rPdIs6D0AKWGixl5wZy5vXh4xDLY4sN52qelVHl6YWyRWDBXYXfxnNDcIQkVpq0hZr 4/7+6UTWaLyHF30gAkrFqM/86egMVnA7ImPgsnH34Cghz8JS0q6iQDYKVMEneDGWw+T0 gyH2gVZm32Qke22tFtx37R1reoFt+WzDKR1g+okGqKCPPAWIsSw4L/SBU9yi65Y+HdHv Z85tiZIsI0nig5LjiZxW3q9lLNXHZOThyftwCuVlbCPfXLTZD36vibHMqdNoRAsRa3Ao 2tzTJ7k23Ub6Kw9pDx4d9jlDxvmKMyVynFBiUe4IM89Ar/QoR7L26q/gaawomcjMxsrS jL5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=YSH/LSSjlgjCjinYtRse6RiN4Ic9s5jrelEXqXPuyXc=; b=O84lwhd4A5pr+3FKzNbFDn7DBJ91+H89j6CC9tWg9EF6stPpuKQuXdQz5fv7wkltcR sTe20ZM8UpXPmgXYSSDqgxHcqXEfAjXv2wRTy/oPRhFCm1qZRmLuaTkHbyvGzf3zeKwU iXMCncDnVJSgDJrKYw9jYC9g6Vqz3NEyCpPVvw/cttyeUM1vTVfsAXwvyRibXTqVYKZF LNBHGInRzpZwXoJ5Wt/BWhJGmLW28h5GM86apdXEMuN89gCKtXGwaa3E6kA4SYe5hxmx LERXQ4f4aXOXGcSiJ3Mt/dFo8eUAdP++x+HTrbj8ykNuZK0TC3m9HZusLlLzrbfEYl9N YrlA== X-Gm-Message-State: ALoCoQk/SkjnGXZcLIvkFaOoJTAGilrSgwS19L8tBFvypdqAogGlPvC2YoGmDCUqoWRkVsBD3gg+ X-Received: by 10.13.242.4 with SMTP id b4mr19664773ywf.255.1447015340483; Sun, 08 Nov 2015 12:42:20 -0800 (PST) Received: from Ubuntu15.localdomain (cpe-66-68-129-43.austin.res.rr.com. [66.68.129.43]) by smtp.gmail.com with ESMTPSA id f133sm10270399ywa.27.2015.11.08.12.42.19 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sun, 08 Nov 2015 12:42:19 -0800 (PST) From: Bill Fischofer To: lng-odp@lists.linaro.org Date: Sun, 8 Nov 2015 14:42:10 -0600 Message-Id: <1447015330-24420-7-git-send-email-bill.fischofer@linaro.org> X-Mailer: git-send-email 2.1.4 In-Reply-To: <1447015330-24420-1-git-send-email-bill.fischofer@linaro.org> References: <1447015330-24420-1-git-send-email-bill.fischofer@linaro.org> X-Topics: patch Subject: [lng-odp] [API-NEXT PATCHv2 6/6] linux-generic: queue: streamline and correct release_order() routine X-BeenThere: lng-odp@lists.linaro.org X-Mailman-Version: 2.1.16 Precedence: list List-Id: "The OpenDataPlane \(ODP\) List" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , MIME-Version: 1.0 Errors-To: lng-odp-bounces@lists.linaro.org Sender: "lng-odp" Resolve the corner case of releasing order for an order that still has events on the reorder queue. This also allows the reorder_complete() routine to be streamlined. This patch resolves Bug https://bugs.linaro.org/show_bug.cgi?id=1879 Signed-off-by: Bill Fischofer --- .../linux-generic/include/odp_queue_internal.h | 5 +- platform/linux-generic/odp_queue.c | 53 ++++++++++++++++++---- 2 files changed, 46 insertions(+), 12 deletions(-) diff --git a/platform/linux-generic/include/odp_queue_internal.h b/platform/linux-generic/include/odp_queue_internal.h index 6120740..a70044b 100644 --- a/platform/linux-generic/include/odp_queue_internal.h +++ b/platform/linux-generic/include/odp_queue_internal.h @@ -335,8 +335,7 @@ static inline int reorder_deq(queue_entry_t *queue, static inline void reorder_complete(queue_entry_t *origin_qe, odp_buffer_hdr_t **reorder_buf_return, odp_buffer_hdr_t **placeholder_buf, - int placeholder_append, - int order_released) + int placeholder_append) { odp_buffer_hdr_t *reorder_buf = origin_qe->s.reorder_head; odp_buffer_hdr_t *next_buf; @@ -356,7 +355,7 @@ static inline void reorder_complete(queue_entry_t *origin_qe, reorder_buf = next_buf; order_release(origin_qe, 1); - } else if (!order_released && reorder_buf->flags.sustain) { + } else if (reorder_buf->flags.sustain) { reorder_buf = next_buf; } else { *reorder_buf_return = origin_qe->s.reorder_head; diff --git a/platform/linux-generic/odp_queue.c b/platform/linux-generic/odp_queue.c index 9cab9b2..f388dfc 100644 --- a/platform/linux-generic/odp_queue.c +++ b/platform/linux-generic/odp_queue.c @@ -39,6 +39,11 @@ #include +#define RESOLVE_ORDER 0 +#define SUSTAIN_ORDER 1 + +#define NOAPPEND 0 +#define APPEND 1 typedef struct queue_table_t { queue_entry_t queue[ODP_CONFIG_QUEUES]; @@ -521,8 +526,7 @@ int ordered_queue_enq(queue_entry_t *queue, if (sched && schedule_queue(queue)) ODP_ABORT("schedule_queue failed\n"); - reorder_complete(origin_qe, &reorder_buf, &placeholder_buf, - 1, 0); + reorder_complete(origin_qe, &reorder_buf, &placeholder_buf, APPEND); UNLOCK(&origin_qe->s.lock); if (reorder_buf) @@ -606,7 +610,8 @@ int odp_queue_enq_multi(odp_queue_t handle, const odp_event_t ev[], int num) for (i = 0; i < num; i++) buf_hdr[i] = odp_buf_to_hdr(odp_buffer_from_event(ev[i])); - return num == 0 ? 0 : queue->s.enqueue_multi(queue, buf_hdr, num, 1); + return num == 0 ? 0 : queue->s.enqueue_multi(queue, buf_hdr, + num, SUSTAIN_ORDER); } int odp_queue_enq(odp_queue_t handle, odp_event_t ev) @@ -620,7 +625,7 @@ int odp_queue_enq(odp_queue_t handle, odp_event_t ev) /* No chains via this entry */ buf_hdr->link = NULL; - return queue->s.enqueue(queue, buf_hdr, 1); + return queue->s.enqueue(queue, buf_hdr, SUSTAIN_ORDER); } int queue_enq_internal(odp_buffer_hdr_t *buf_hdr) @@ -879,7 +884,7 @@ int queue_pktout_enq(queue_entry_t *queue, odp_buffer_hdr_t *buf_hdr, order_release(origin_qe, release_count + placeholder_count); /* Now handle sends to other queues that are ready to go */ - reorder_complete(origin_qe, &reorder_buf, &placeholder_buf, 1, 0); + reorder_complete(origin_qe, &reorder_buf, &placeholder_buf, APPEND); /* We're fully done with the origin_qe at last */ UNLOCK(&origin_qe->s.lock); @@ -947,13 +952,43 @@ int release_order(queue_entry_t *origin_qe, uint64_t order, odp_buffer_t placeholder_buf; odp_buffer_hdr_t *placeholder_buf_hdr, *reorder_buf, *next_buf; - /* Must tlock the origin queue to process the release */ + /* Must lock the origin queue to process the release */ LOCK(&origin_qe->s.lock); - /* If we are in the order we can release immediately since there can - * be no confusion about intermediate elements + /* If we are in order we can release immediately since there can be no + * confusion about intermediate elements */ if (order <= origin_qe->s.order_out) { + reorder_buf = origin_qe->s.reorder_head; + + /* We're in order, however there may be one or more events on + * the reorder queue that are part of this order. If that is + * the case, remove them and let ordered_queue_enq() handle + * them and resolve the order for us. + */ + if (reorder_buf && reorder_buf->order == order) { + odp_buffer_hdr_t *reorder_head = reorder_buf; + + next_buf = reorder_buf->next; + + while (next_buf && next_buf->order == order) { + reorder_buf = next_buf; + next_buf = next_buf->next; + } + + origin_qe->s.reorder_head = reorder_buf->next; + reorder_buf->next = NULL; + + UNLOCK(&origin_qe->s.lock); + reorder_head->link = reorder_buf->next; + return ordered_queue_enq(reorder_head->target_qe, + reorder_head, RESOLVE_ORDER, + origin_qe, order); + } + + /* Reorder queue has no elements for this order, so it's safe + * to resolve order here + */ order_release(origin_qe, 1); /* Check if this release allows us to unblock waiters. At the @@ -965,7 +1000,7 @@ int release_order(queue_entry_t *origin_qe, uint64_t order, * element(s) on the reorder queue */ reorder_complete(origin_qe, &reorder_buf, - &placeholder_buf_hdr, 0, 1); + &placeholder_buf_hdr, NOAPPEND); /* Now safe to unlock */ UNLOCK(&origin_qe->s.lock);