Chengming Zhou dc6e0818bc sched/cpuacct: Optimize away RCU read lock ...

Since cpuacct_charge() is called from the scheduler update_curr(),
we must already have rq lock held, then the RCU read lock can
be optimized away.

And do the same thing in it's wrapper cgroup_account_cputime(),
but we can't use lockdep_assert_rq_held() there, which defined
in kernel/sched/sched.h.

Suggested-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Signed-off-by: Chengming Zhou <zhouchengming@bytedance.com>
Signed-off-by: Peter Zijlstra (Intel) <peterz@infradead.org>
Link: https://lore.kernel.org/r/20220220051426.5274-2-zhouchengming@bytedance.com

2022-03-01 16:18:38 +01:00

..

autogroup.c

sched: move autogroup sysctls into its own file

2022-02-02 13:11:37 +01:00

autogroup.h

sched: move autogroup sysctls into its own file

2022-02-02 13:11:37 +01:00

clock.c

sched: Fix various typos

2021-03-22 00:11:52 +01:00

completion.c

completion: Use lockdep_assert_RT_in_threaded_ctx() in complete_all()

2020-03-23 18:40:25 +01:00

core_sched.c

sched/core: Accounting forceidle time for all tasks except idle task

2022-01-18 12:09:59 +01:00

core.c

Merge tag 'v5.17-rc5' into sched/core, to resolve conflicts

2022-02-21 11:53:51 +01:00

cpuacct.c

sched/cpuacct: Optimize away RCU read lock

2022-03-01 16:18:38 +01:00

cpudeadline.c

sched,rt: Use the full cpumask for balancing

2020-11-10 18:39:00 +01:00

cpudeadline.h

…

cpufreq_schedutil.c

sched/uclamp: Fix iowait boost escaping uclamp restriction

2022-01-27 12:57:19 +01:00

cpufreq.c

cpufreq: Avoid leaving stale IRQ work items during CPU offline

2019-12-12 17:59:43 +01:00

cpupri.c

sched: Fix various typos

2021-03-22 00:11:52 +01:00

cpupri.h

sched/cpupri: Add CPUPRI_HIGHER

2020-10-29 11:00:30 +01:00

cputime.c

Merge tag 'sched_core_for_v5.17_rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip

2022-01-11 17:14:59 -08:00

deadline.c

sched/dl: Support schedstats for deadline sched class

2021-10-05 15:51:53 +02:00

debug.c

sched/debug: Remove mpol_get/put and task_lock/unlock from sched_show_numa

2022-01-27 12:57:18 +01:00

fair.c

Merge tag 'v5.17-rc5' into sched/core, to resolve conflicts

2022-02-21 11:53:51 +01:00

features.h

sched: Disable TTWU_QUEUE on RT

2021-10-05 15:52:12 +02:00

idle.c

sched/idle: Make the idle timer expire in hard interrupt context

2021-09-09 10:36:16 +02:00

isolation.c

sched/isolation: Split housekeeping cpumask per isolation features

2022-02-16 15:57:56 +01:00

loadavg.c

sched: Make multiple runqueue task counters 32-bit

2021-05-12 21:34:17 +02:00

Makefile

sched, kcsan: Enable memory barrier instrumentation

2021-12-09 16:42:28 -08:00

membarrier.c

sched/membarrier: Fix membarrier-rseq fence command missing from query bitmask

2022-01-25 22:30:25 +01:00

pelt.c

sched: Fix various typos

2021-03-22 00:11:52 +01:00

pelt.h

sched/pelt: Relax the sync of util_sum with util_avg

2022-01-18 12:09:58 +01:00

psi.c

Merge tag 'v5.17-rc5' into sched/core, to resolve conflicts

2022-02-21 11:53:51 +01:00

rt.c

sched/rt: Try to restart rt period timer when rt runtime exceeded

2021-12-07 15:14:10 +01:00

sched-pelt.h

sched/fair: Fix "runnable_avg_yN_inv" not used warnings

2019-06-17 12:15:58 +02:00

sched.h

sched/numa: Fix NUMA topology for systems with CPU-less nodes

2022-02-16 15:57:53 +01:00

smp.h

sched/headers: Split out open-coded prototypes into kernel/sched/smp.h

2020-05-28 11:03:20 +02:00

stats.c

sched: Introduce task block time in schedstats

2021-10-05 15:51:48 +02:00

stats.h

psi: Fix PSI_MEM_FULL state when tasks are in memstall and doing reclaim

2021-11-17 14:49:00 +01:00

stop_task.c

sched: Make struct sched_statistics independent of fair sched class

2021-10-05 15:51:45 +02:00

swait.c

sched/swait: Prepare usage in completions

2020-03-21 16:00:23 +01:00

topology.c

sched/isolation: Use single feature type while referring to housekeeping cpumask

2022-02-16 15:57:55 +01:00

wait_bit.c

sched/wait: fix ___wait_var_event(exclusive)

2019-12-17 13:32:50 +01:00

wait.c

wait: add wake_up_pollfree()

2021-12-09 10:49:56 -08:00