linux/arch/powerpc/include/asm
Anton Blanchard b6dcde5c74 powerpc: Fix hypervisor TLB batching
Profiling of a page fault scalability microbenchmark shows flush_hash_range
is not calling the batch hpte invalidate hcall (H_BULK_REMOVE).

It turns out we have a duplicate firmware feature for hcall-bulk and the
current setup code stops after finding the first match. This meant we never
batch and always do individual invalidates.

The patch below removes the duplicate and shifts FW_FEATURE_CMO to close
the gap. With the patch applied the single threaded page fault rate improves
from 217169 to 238755 per second on a POWER5 test box, a 10% improvement.

Signed-off-by: Anton Blanchard <anton@samba.org>
Signed-off-by: Benjamin Herrenschmidt <benh@kernel.crashing.org>
2009-10-14 16:58:37 +11:00
..
iseries
8xx_immap.h
8253pit.h time: move PIT_TICK_RATE to linux/timex.h 2009-06-16 19:47:27 -07:00
abs_addr.h
agp.h agp: kill phys_to_gart() and gart_to_phys() 2009-08-03 09:05:00 +01:00
asm-compat.h
atomic.h powerpc: Use generic atomic64_t implementation on 32-bit processors 2009-06-15 13:27:38 +10:00
auxvec.h
backlight.h
bitops.h powerpc: expose the multi-bit ops that underlie single-bit ops. 2009-08-20 10:12:23 +10:00
bitsperlong.h asm-generic: introduce asm/bitsperlong.h 2009-06-11 21:02:14 +02:00
bootx.h
btext.h
bug.h
bugs.h
byteorder.h
cache.h
cacheflush.h
cell-pmu.h
cell-regs.h powerpc/cell: Move CBE_IOPTE_* to <asm/cell-regs.h> 2009-08-20 10:29:26 +10:00
checksum.h
clk_interface.h
code-patching.h
compat.h
cpm1.h powerpc/cpm1: Remove IMAP_ADDR 2009-06-23 08:09:54 -05:00
cpm2.h powerpc/cpm: Remove some cruft code and defines 2009-05-19 00:47:19 -05:00
cpm.h
cputable.h
cputhreads.h powerpc/mm: Add HW threads support to no_hash TLB management 2009-08-20 10:12:37 +10:00
cputime.h cputime: Optimize jiffies_to_cputime(1) 2009-08-03 14:48:36 +02:00
current.h
dbdma.h
dbell.h
dcr-generic.h
dcr-mmio.h
dcr-native.h
dcr-regs.h
dcr.h
delay.h powerpc: Fix spin_event_timeout() to be robust over context switches 2009-07-08 13:50:24 +10:00
device.h powerpc: Change archdata dma_data to a union 2009-09-24 15:31:43 +10:00
disassemble.h
div64.h
dma-mapping.h powerpc: Change archdata dma_data to a union 2009-09-24 15:31:43 +10:00
dma.h
edac.h
eeh_event.h
eeh.h
elf.h powerpc: Fix up elf_read_implies_exec() usage 2009-05-21 15:44:21 +10:00
emergency-restart.h
emulated_ops.h powerpc: Keep track of emulated instructions 2009-05-21 15:44:26 +10:00
errno.h
exception-64e.h powerpc/book3e-64: Add helper function to setup IVORs 2009-08-28 14:24:13 +10:00
exception-64s.h powerpc: Remove use of a second scratch SPRG in STAB code 2009-08-20 10:12:28 +10:00
fb.h
fcntl.h
feature-fixups.h powerpc: Enable MMU feature sections for inline asm 2009-05-21 15:44:21 +10:00
firmware.h powerpc: Fix hypervisor TLB batching 2009-10-14 16:58:37 +11:00
fixmap.h powerpc: Minor cleanups of kernel virt address space definitions 2009-05-27 16:32:50 +10:00
floppy.h
fs_pd.h
fsl_gtm.h
fsl_lbc.h powerpc/fsl: Increase the number of possible localbus banks 2009-06-15 21:45:32 -05:00
fsldma.h fsldma: Add DMA_SLAVE support 2009-09-08 17:53:04 -07:00
ftrace.h
futex.h
gpio.h
grackle.h
hardirq.h powerpc: Switch to asm-generic/hardirq.h 2009-08-20 10:29:27 +10:00
heathrow.h
highmem.h powerpc/mm: Make k(un)map_atomic out of line 2009-06-26 14:37:25 +10:00
hugetlb.h
hvcall.h
hvconsole.h
hvcserver.h
hw_irq.h perf: Do the big rename: Performance Counters -> Performance Events 2009-09-21 14:28:04 +02:00
hydra.h
i8259.h
ibmebus.h
ide.h
immap_86xx.h
immap_cpm2.h
immap_qe.h
io-defs.h
io.h
ioctl.h
ioctls.h
iommu.h powerpc: Change archdata dma_data to a union 2009-09-24 15:31:43 +10:00
ipcbuf.h
ipic.h
irq_regs.h
irq.h powerpc/irq: Improve nanodoc 2009-09-11 11:27:57 +10:00
irqflags.h
Kbuild
kdebug.h
kdump.h
kexec.h
keylargo.h
kgdb.h
kmap_types.h
kprobes.h
kvm_44x.h
kvm_asm.h
kvm_e500.h
kvm_host.h KVM: Prepare memslot data structures for multiple hugepage sizes 2009-09-10 08:33:02 +03:00
kvm_para.h
kvm_ppc.h
kvm.h
libata-portmap.h
linkage.h
lmb.h
local.h
lppaca.h powerpc: Shield code specific to 64-bit server processors 2009-06-09 16:47:38 +10:00
lv1call.h
machdep.h powerpc/pci: Pull ppc32 PCI features into common 2009-08-28 14:24:15 +10:00
macio.h
mc146818rtc.h
mediabay.h
mman.h mm: add MAP_HUGETLB for mmaping pseudo-anonymous huge page regions 2009-09-22 07:17:41 -07:00
mmu_context.h powerpc: Add TLB management code for 64-bit Book3E 2009-08-20 10:25:09 +10:00
mmu-8xx.h powerpc: Add TLB management code for 64-bit Book3E 2009-08-20 10:25:09 +10:00
mmu-40x.h powerpc: Add TLB management code for 64-bit Book3E 2009-08-20 10:25:09 +10:00
mmu-44x.h powerpc: Add TLB management code for 64-bit Book3E 2009-08-20 10:25:09 +10:00
mmu-book3e.h powerpc/booke: Move MMUCSR definition into mmu-book3e.h 2009-08-24 20:48:05 -05:00
mmu-hash32.h powerpc: Name xpn & x fields in HW Hash PTE format 2009-08-28 14:24:12 +10:00
mmu-hash64.h powerpc/pseries: Fix to handle slb resize across migration 2009-09-02 16:19:01 +10:00
mmu.h powerpc/mm: Add MMU features for TLB reservation & Paired MAS registers 2009-08-28 14:24:12 +10:00
mmzone.h
module.h
mpc5xxx.h powerpc/5xxx: Add common mpc5xxx_get_bus_frequency() function 2009-06-17 00:30:22 -06:00
mpc6xx.h
mpc8xx.h
mpc52xx_psc.h ASoC: Add a few more mpc5200 PSC defines 2009-05-24 19:31:04 +01:00
mpc52xx.h powerpc/5xxx: Add common mpc5xxx_get_bus_frequency() function 2009-06-17 00:30:22 -06:00
mpc8260.h
mpic.h
msgbuf.h
msi_bitmap.h
mutex.h
nvram.h powerpc/nvram: Enable use Generic NVRAM driver for different size chips 2009-09-11 16:02:11 +10:00
of_device.h
of_platform.h
ohare.h
oprofile_impl.h
paca.h perf: Tidy up after the big rename 2009-09-21 14:34:11 +02:00
page_32.h asm-generic: rename page.h and uaccess.h 2009-06-11 21:02:17 +02:00
page_64.h powerpc: Add memory management headers for new 64-bit BookE 2009-08-20 10:25:06 +10:00
page.h powerpc: Add memory management headers for new 64-bit BookE 2009-08-20 10:25:06 +10:00
param.h
parport.h
pasemi_dma.h
pci-bridge.h powerpc/pci: Pull ppc32 PCI features into common 2009-08-28 14:24:15 +10:00
pci.h Merge branch 'linux-next' of git://git.kernel.org/pub/scm/linux/kernel/git/jbarnes/pci-2.6 2009-09-16 07:49:54 -07:00
percpu.h
perf_event.h perf_event, powerpc: Fix compilation after big perf_counter rename 2009-09-22 09:30:40 +02:00
pgalloc-32.h mm: Pass virtual address to [__]p{te,ud,md}_free_tlb() 2009-07-27 12:10:38 -07:00
pgalloc-64.h mm: Pass virtual address to [__]p{te,ud,md}_free_tlb() 2009-07-27 12:10:38 -07:00
pgalloc.h powerpc/mm: Fix encoding of page table cache numbers 2009-08-20 10:25:12 +10:00
pgtable-ppc32.h powerpc/fsl-booke: Use HW PTE format if CONFIG_PTE_64BIT 2009-09-02 16:20:41 +10:00
pgtable-ppc64-4k.h
pgtable-ppc64-64k.h powerpc/mm: Fix misplaced #endif in pgtable-ppc64-64k.h 2009-08-20 10:12:35 +10:00
pgtable-ppc64.h powerpc/mm: Cleanup handling of execute permission 2009-08-27 13:12:51 +10:00
pgtable.h powerpc/32: Always order writes to halves of 64-bit PTEs 2009-08-18 14:48:39 +10:00
phyp_dump.h
pmac_feature.h
pmac_low_i2c.h
pmac_pfunc.h
pmc.h powerpc/pmc: Don't access lppaca on Book3E 2009-09-24 15:31:39 +10:00
pmi.h
poll.h
posix_types.h
ppc4xx.h
ppc_asm.h powerpc: Adjust base and index registers in Altivec macros 2009-08-28 14:24:12 +10:00
ppc-opcode.h powerpc/mm: Add opcode definitions for tlbivax and tlbsrx. 2009-08-20 10:12:38 +10:00
ppc-pci.h powerpc/pci: Merge ppc32 and ppc64 versions of phb_scan() 2009-09-02 15:45:53 +10:00
processor.h
prom.h
ps3.h ps3: Replace direct file operations by callback 2009-06-15 16:47:26 +10:00
ps3av.h
ps3fb.h
ps3gpu.h ps3fb: Tear down FB setup during cleanup 2009-06-15 13:26:21 +10:00
ps3stor.h
pSeries_reconfig.h
pte-8xx.h powerpc/mm: Fix 40x and 8xx vs. _PAGE_SPECIAL 2009-09-24 15:31:49 +10:00
pte-40x.h powerpc/mm: Fix 40x and 8xx vs. _PAGE_SPECIAL 2009-09-24 15:31:49 +10:00
pte-44x.h powerpc/mm: Cleanup handling of execute permission 2009-08-27 13:12:51 +10:00
pte-book3e.h powerpc/fsl-booke: Use HW PTE format if CONFIG_PTE_64BIT 2009-09-02 16:20:41 +10:00
pte-common.h powerpc/mm: Fix 40x and 8xx vs. _PAGE_SPECIAL 2009-09-24 15:31:49 +10:00
pte-fsl-booke.h powerpc/fsl-booke: Use HW PTE format if CONFIG_PTE_64BIT 2009-09-02 16:20:41 +10:00
pte-hash32.h powerpc/mm: Cleanup handling of execute permission 2009-08-27 13:12:51 +10:00
pte-hash64-4k.h
pte-hash64-64k.h powerpc/mm: Fix potential access to freed pages when using hugetlbfs 2009-06-26 16:55:36 +10:00
pte-hash64.h
ptrace.h powerpc: Add PTRACE_SINGLEBLOCK support 2009-06-09 13:29:25 +10:00
qe_ic.h
qe.h powerpc/qe: Implement qe_alive_during_sleep() helper function 2009-08-30 21:51:33 -07:00
reg_8xx.h
reg_booke.h powerpc/book3e-64: Add support to initial_tlb_book3e for non-HES TLB 2009-08-28 14:24:14 +10:00
reg_fsl_emb.h
reg.h powerpc: Add definitions used by exception handling on 64-bit Book3E 2009-08-20 10:25:07 +10:00
resource.h
rheap.h
rio.h
rtas.h powerpc: Use one common impl. of RTAS timebase sync and use raw spinlock 2009-06-26 16:55:25 +10:00
rtc.h
rwsem.h
scatterlist.h powerpc: Use sg->dma_length in sg_dma_len() macro on 32-bit 2009-05-21 15:44:25 +10:00
seccomp.h
sections.h
sembuf.h
serial.h
setjmp.h
setup.h powerpc: derive COMMAND_LINE_SIZE from asm-generic 2009-08-28 14:24:16 +10:00
sfp-machine.h
shmbuf.h
shmparam.h
sigcontext.h
siginfo.h
signal.h asm-generic: rename termios.h, signal.h and mman.h 2009-06-11 21:01:52 +02:00
smp.h cpumask: remove arch_send_call_function_ipi 2009-09-24 09:34:47 +09:30
smu.h
socket.h net: implement a SO_DOMAIN getsockoption 2009-08-05 13:02:57 -07:00
sockios.h
sparsemem.h
spinlock_types.h
spinlock.h locking, powerpc: Rename __spin_try_lock() and friends 2009-08-31 18:08:48 +02:00
spu_csa.h
spu_info.h
spu_priv1.h
spu.h
sstep.h
stat.h
statfs.h
string.h
suspend.h
swab.h
swiotlb.h powerpc: use dma_map_ops struct 2009-08-28 14:24:10 +10:00
synch.h
syscall.h
syscalls.h
systbl.h perf: Do the big rename: Performance Counters -> Performance Events 2009-09-21 14:28:04 +02:00
system.h powerpc: Set init_bootmem_done on NUMA platforms as well 2009-06-09 16:43:04 +10:00
tce.h
termbits.h
termios.h asm-generic: rename termios.h, signal.h and mman.h 2009-06-11 21:01:52 +02:00
thread_info.h sched: INIT_PREEMPT_COUNT 2009-07-10 14:24:05 -07:00
time.h
timex.h
tlb.h powerpc/mm: Rework & cleanup page table freeing code path 2009-08-20 10:24:56 +10:00
tlbflush.h powerpc/mm: Make low level TLB flush ops on BookE take additional args 2009-08-20 10:12:41 +10:00
topology.h cpumask: remove obsolete topology_core_siblings and topology_thread_siblings: powerpc 2009-09-24 09:34:42 +09:30
tsi108_irq.h
tsi108_pci.h
tsi108.h
types.h asm-generic: introduce asm/bitsperlong.h 2009-06-11 21:02:14 +02:00
uaccess.h
ucc_fast.h
ucc_slow.h
ucc.h
ucontext.h
udbg.h
uic.h
unaligned.h
uninorth.h
unistd.h perf: Do the big rename: Performance Counters -> Performance Events 2009-09-21 14:28:04 +02:00
user.h
vdso_datapage.h
vdso.h powerpc: Move 64bit VDSO to improve context switch performance 2009-08-20 10:12:24 +10:00
vga.h
vio.h
xilinx_intc.h
xilinx_pci.h powerpc/virtex: Add support for Xilinx PCI host bridge 2009-06-06 10:14:22 -06:00
xmon.h
xor.h