fs: icache RCU free inodes
Nick Piggin authored

RCU free the struct inode. This will allow:

- Subsequent store-free path walking patch. The inode must be consulted for
  permissions when walking, so an RCU inode reference is a must.
- sb_inode_list_lock to be moved inside i_lock because sb list walkers who want
  to take i_lock no longer need to take sb_inode_list_lock to walk the list in
  the first place. This will simplify and optimize locking.
- Could remove some nested trylock loops in dcache code
- Could potentially simplify things a bit in VM land. Do not need to take the
  page lock to follow page->mapping.

The downsides of this is the performance cost of using RCU. In a simple
creat/unlink microbenchmark, performance drops by about 10% due to inability to
reuse cache-hot slab objects. As iterations increase and RCU freeing starts
kicking over, this increases to about 20%.

In cases where inode lifetimes are longer (ie. many inodes may be allocated
during the average life span of a single inode), a lot of this cache reuse is
not applicable, so the regression caused by this patch is smaller.

The cache-hot regression could largely be avoided by using SLAB_DESTROY_BY_RCU,
however this adds some complexity to list walking and store-free path walking,
so I prefer to implement this at a later date, if it is shown to be a win in
real situations. I haven't found a regression in any non-micro benchmark so I
doubt it will be a problem.
Signed-off-by: default avatarNick Piggin <npiggin@kernel.dk>
fa0d7e3d
Name Last commit Last update
..
alpha Merge branch 'kconfig' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6
arm Merge branch 'fix' of git://git.kernel.org/pub/scm/linux/kernel/git/ycmiao/pxa-linux-2.6
avr32 Merge branch 'kconfig' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6
blackfin BKL: remove extraneous #include <smp_lock.h>
cris Merge branch 'kconfig' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6
frv BKL: remove extraneous #include <smp_lock.h>
h8300 BKL: remove extraneous #include <smp_lock.h>
ia64 fs: change d_delete semantics
m32r Merge branch 'kconfig' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6
m68k BKL: remove extraneous #include <smp_lock.h>
m68knommu BKL: remove extraneous #include <smp_lock.h>
microblaze Merge branch 'kconfig' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6
mips MIPS: Fix build errors in sc-mips.c
mn10300 arch/mn10300/kernel/irq.c: fix build
parisc parisc: convert the rest of the irq handlers to simple/percpu
powerpc fs: icache RCU free inodes
s390 [S390] nohz/s390: fix arch_needs_cpu() return value on offline cpus
score Merge branch 'kconfig' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6
sh sh: Fix up SH7201 clkfwk build.
sparc Merge git://git.kernel.org/pub/scm/linux/kernel/git/davem/sparc-2.6
tile arch/tile: handle rt_sigreturn() more cleanly
um uml: disable winch irq before freeing handler data
x86 arch/x86/oprofile/op_model_amd.c: Perform initialisation on a single CPU
xtensa Merge branch 'kconfig' of git://git.kernel.org/pub/scm/linux/kernel/git/mmarek/kbuild-2.6
.gitignore arch: Ignore arch/i386 and arch/x86_64
Kconfig