From patchwork Tue Nov 8 09:53:42 2016 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Patchwork-Submitter: Vincent Guittot X-Patchwork-Id: 81272 Delivered-To: patch@linaro.org Received: by 10.182.113.165 with SMTP id iz5csp1596782obb; Tue, 8 Nov 2016 01:56:36 -0800 (PST) X-Received: by 10.99.126.6 with SMTP id z6mr17488760pgc.182.1478598995938; Tue, 08 Nov 2016 01:56:35 -0800 (PST) Return-Path: Received: from vger.kernel.org (vger.kernel.org. [209.132.180.67]) by mx.google.com with ESMTP id k5si36059915pgn.247.2016.11.08.01.56.35; Tue, 08 Nov 2016 01:56:35 -0800 (PST) Received-SPF: pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) client-ip=209.132.180.67; Authentication-Results: mx.google.com; dkim=pass header.i=@linaro.org; spf=pass (google.com: best guess record for domain of linux-kernel-owner@vger.kernel.org designates 209.132.180.67 as permitted sender) smtp.mailfrom=linux-kernel-owner@vger.kernel.org; dmarc=pass (p=NONE dis=NONE) header.from=linaro.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753630AbcKHJ4c (ORCPT + 27 others); Tue, 8 Nov 2016 04:56:32 -0500 Received: from mail-wm0-f42.google.com ([74.125.82.42]:35157 "EHLO mail-wm0-f42.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S932546AbcKHJyf (ORCPT ); Tue, 8 Nov 2016 04:54:35 -0500 Received: by mail-wm0-f42.google.com with SMTP id a197so234096318wmd.0 for ; Tue, 08 Nov 2016 01:54:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=8bbA/NKltWMCmZbqTum3/20yRLeekA5SELARHUsJFwM=; b=SR2g19L1y8WYob2Ph64rKCwepPib+UajJ1yym/XjnS7F7A1bl1pcI2QWpkxIZ7l/+N gXBikVk+Mvy+kz7pCoFCUxvNyEG62xkMUE2QAnXkXJ+kyoldxSV1oCaxirvRPeQ0p6JR gxINKTniAL0E3JgQmHTBsE0+jdEcyidhIciw8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=8bbA/NKltWMCmZbqTum3/20yRLeekA5SELARHUsJFwM=; b=VnZW6nDGytyGYu/lX5rf72Lh94DuyntoZzutcHqK56LwdwUgs6EhLfM9B8MB8FC8kO 9ME2xIXlgsuQtCP88RSzKwPM5nHR8Q89DxVBUjaTKDnlkbHkO7ZNyw0QUijth7OJ6weq MvGB3zxkbrwNhdwQeCqbSnESowXT8HQuywMzGhfepK4G0jWfiD3K8FolWBIB8kcutjPU VJs4d8adtAuyCEwHIybU8UIYo0a90Eai63OGHLbkkDj0C9w2jAfPw83HKSVV9MZhm0Rp GefjLep+JI/OF6Z6u4x26UpTb2PMZ9i2JJOMupM5S8v5rH6IoWzseEESMazWszDqqFlN VUkg== X-Gm-Message-State: ABUngvf0DaDPOZf8SBxa26bpunByI5vzjM7VwWk59Wo/Ol/gWO2izBWP1WTGtxJAEfpr0Bhj X-Received: by 10.194.165.136 with SMTP id yy8mr11202024wjb.14.1478598873949; Tue, 08 Nov 2016 01:54:33 -0800 (PST) Received: from localhost.localdomain ([2a01:e35:8bd4:7750:6483:2475:9666:6640]) by smtp.gmail.com with ESMTPSA id p13sm18606435wmd.20.2016.11.08.01.54.32 (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 08 Nov 2016 01:54:33 -0800 (PST) From: Vincent Guittot To: peterz@infradead.org, mingo@kernel.org, linux-kernel@vger.kernel.org, dietmar.eggemann@arm.com Cc: yuyang.du@intel.com, Morten.Rasmussen@arm.com, pjt@google.com, bsegall@google.com, kernellwp@gmail.com, Vincent Guittot Subject: [PATCH 1/6 v7] sched: factorize attach/detach entity Date: Tue, 8 Nov 2016 10:53:42 +0100 Message-Id: <1478598827-32372-2-git-send-email-vincent.guittot@linaro.org> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1478598827-32372-1-git-send-email-vincent.guittot@linaro.org> References: <1478598827-32372-1-git-send-email-vincent.guittot@linaro.org> Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Factorize post_init_entity_util_avg and part of attach_task_cfs_rq in one function attach_entity_cfs_rq. Create symmetric detach_entity_cfs_rq function Signed-off-by: Vincent Guittot --- kernel/sched/fair.c | 53 +++++++++++++++++++++++++++++++---------------------- 1 file changed, 31 insertions(+), 22 deletions(-) -- 2.7.4 diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c index c242944..b27cac0 100644 --- a/kernel/sched/fair.c +++ b/kernel/sched/fair.c @@ -708,9 +708,7 @@ void init_entity_runnable_average(struct sched_entity *se) } static inline u64 cfs_rq_clock_task(struct cfs_rq *cfs_rq); -static int update_cfs_rq_load_avg(u64 now, struct cfs_rq *cfs_rq, bool update_freq); -static void update_tg_load_avg(struct cfs_rq *cfs_rq, int force); -static void attach_entity_load_avg(struct cfs_rq *cfs_rq, struct sched_entity *se); +static void attach_entity_cfs_rq(struct sched_entity *se); /* * With new tasks being created, their initial util_avgs are extrapolated @@ -742,7 +740,6 @@ void post_init_entity_util_avg(struct sched_entity *se) struct cfs_rq *cfs_rq = cfs_rq_of(se); struct sched_avg *sa = &se->avg; long cap = (long)(SCHED_CAPACITY_SCALE - cfs_rq->avg.util_avg) / 2; - u64 now = cfs_rq_clock_task(cfs_rq); if (cap > 0) { if (cfs_rq->avg.util_avg != 0) { @@ -770,14 +767,12 @@ void post_init_entity_util_avg(struct sched_entity *se) * such that the next switched_to_fair() has the * expected state. */ - se->avg.last_update_time = now; + se->avg.last_update_time = cfs_rq_clock_task(cfs_rq); return; } } - update_cfs_rq_load_avg(now, cfs_rq, false); - attach_entity_load_avg(cfs_rq, se); - update_tg_load_avg(cfs_rq, false); + attach_entity_cfs_rq(se); } #else /* !CONFIG_SMP */ @@ -8687,30 +8682,19 @@ static inline bool vruntime_normalized(struct task_struct *p) return false; } -static void detach_task_cfs_rq(struct task_struct *p) +static void detach_entity_cfs_rq(struct sched_entity *se) { - struct sched_entity *se = &p->se; struct cfs_rq *cfs_rq = cfs_rq_of(se); u64 now = cfs_rq_clock_task(cfs_rq); - if (!vruntime_normalized(p)) { - /* - * Fix up our vruntime so that the current sleep doesn't - * cause 'unlimited' sleep bonus. - */ - place_entity(cfs_rq, se, 0); - se->vruntime -= cfs_rq->min_vruntime; - } - /* Catch up with the cfs_rq and remove our load when we leave */ update_cfs_rq_load_avg(now, cfs_rq, false); detach_entity_load_avg(cfs_rq, se); update_tg_load_avg(cfs_rq, false); } -static void attach_task_cfs_rq(struct task_struct *p) +static void attach_entity_cfs_rq(struct sched_entity *se) { - struct sched_entity *se = &p->se; struct cfs_rq *cfs_rq = cfs_rq_of(se); u64 now = cfs_rq_clock_task(cfs_rq); @@ -8722,10 +8706,35 @@ static void attach_task_cfs_rq(struct task_struct *p) se->depth = se->parent ? se->parent->depth + 1 : 0; #endif - /* Synchronize task with its cfs_rq */ + /* Synchronize entity with its cfs_rq */ update_cfs_rq_load_avg(now, cfs_rq, false); attach_entity_load_avg(cfs_rq, se); update_tg_load_avg(cfs_rq, false); +} + +static void detach_task_cfs_rq(struct task_struct *p) +{ + struct sched_entity *se = &p->se; + struct cfs_rq *cfs_rq = cfs_rq_of(se); + + if (!vruntime_normalized(p)) { + /* + * Fix up our vruntime so that the current sleep doesn't + * cause 'unlimited' sleep bonus. + */ + place_entity(cfs_rq, se, 0); + se->vruntime -= cfs_rq->min_vruntime; + } + + detach_entity_cfs_rq(se); +} + +static void attach_task_cfs_rq(struct task_struct *p) +{ + struct sched_entity *se = &p->se; + struct cfs_rq *cfs_rq = cfs_rq_of(se); + + attach_entity_cfs_rq(se); if (!vruntime_normalized(p)) se->vruntime += cfs_rq->min_vruntime;