- Code: Select all
pool: Jungle
state: ONLINE
scan: scrub canceled on Thu Nov 8 11:13:51 2012
config:
NAME STATE READ WRITE CKSUM
Jungle ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
GPTE_BC0E811C-8DE7-4A95-8A71-9E7A525494DD ONLINE 0 0 0 at disk4s2
GPTE_50EB154C-79D7-4C2B-9653-A6BA9CF465C7 ONLINE 0 0 0 at disk2s2
mirror-1 ONLINE 0 0 0
GPTE_868ECDB0-5D93-48D8-BDFD-59BB25C1D2E2 ONLINE 0 0 0 at disk5s2
GPTE_B23AFB99-6F8B-4C6D-9758-D92787E79D74 ONLINE 0 0 0 at disk6s2
cache
GPTE_3394835C-C6B9-4715-A5EA-65D7E46A0B93 ONLINE 0 0 0 at disk3s2
When I first boot, Xbench gives awesome numbers for Disk Test, around ~2000 or so.
However, after a few hours of uptime, for some reason performance gets massively degraded as you can see below.

This is zstat during an XBench run:
- Code: Select all
v2012.09.23 89 threads 1 mount 99072 vnodes 19:11:38
____________________________________________________________________________
KALLOC KERNEL/MAPS TOTAL EQUITY
WIRED 197 MiB 1867 MiB/1876 2065 MiB 10.09%
PEAK 236 MiB 2012 MiB 2249 MiB
VMPAGE 207596 (IN) 37406 (OUT) 37405 (SYNC) 11616 (MDS)
____________________________________________________________________________
HITS MISSES
ARC overall: 72% (34571162) 28% (13060311)
ARC demand data: 93% (11118398) 7% (828994)
ARC demand meta: 87% (19260831) 13% (2754167)
ARC prefetch data: 26% (3056934) 74% (8537543)
ARC prefetch meta: 54% (1134999) 46% (939607)
DMU zfetch: 92% (46887000) 8% (3818889)
____________________________________________________________________________
SIZE SLAB AVAIL INUSE TOTAL PEAK KMEM CACHE NAME
72 4096 92783 23762 116545 149930 kmem_slab_cache
24 4096 222783 527381 750164 819469 kmem_bufctl_cache
88 4096 214 1001 1215 25200 taskq_ent_cache
360 4096 4 18 22 22 taskq_cache
824 8192 5 4 9 75141 zio_cache
48 4096 81 2 83 76526 zio_link_cache
80 4096 7428 99072 106500 125050 sa_cache
840 8192 3511 104516 108027 202572 dnode_t
216 4096 108069 112323 220392 383724 dmu_buf_impl_t
200 4096 69858 3018162 3088020 3200760 arc_buf_hdr_t
104 4096 84190 9214 93404 263834 arc_buf_t
192 4096 19 1 20 820 zil_lwb_cache
400 4096 1678 99072 100750 125020 znode_t
Any ideas?