|
Centre Mont-Royal
Montreal, Canada July 13-17, 2009 |
|||||
|
Keynotes
Venue
|
Chopstix - A fine-grained system monitorSapan Bhatia (sapan.bhatia@gmail.com)Production systems are commonly plagued by intermittent problems that are difficult to diagnose. This paper describes a diagnostic tool, called Chopstix, that continuously collects profiles of low-level OS events (e.g., scheduling, L2 cache misses, CPU utilization, I/O operations, page allocation, locking) at the granularity of executables, procedures and instructions. Chopstix then reconstructs these events offline for analysis. We have used Chopstix to diagnose several evasive problems in a large-scale production system, thereby reducing these intermittent problems to reproducible bugs that can be debugged using standard techniques. The key to Chopstix is an approximate data collection strategy that incurs very low overhead. An evaluation shows Chopstix requires under 1% of the CPU, under 256Kbytes of RAM, and under 16Mbytes of disk space per day to collect a rich set of system-wide data. We will present the implementation of Chopstix in the Linux kernel, and motivate our choice of the types of variables we monitor. |
| |||||||||||||||
|
Copyright © 2009 Linux Symposium Inc. All rights reserved. |
|||||||||||||||||