Operating Systems Engineering OS Scheduling By Dan Tsafrir, 27/4/2011 1 OSE 2011– OS scheduling
What’s OS scheduling u u u 2 OS policies & mechanisms to allocate resources to entities v Enforce a policy (e. g. , “shortest first”) v Using an OS mechanism (e. g. , “thread chooser”) Entities v Threads, processes, process groups, users, I/O ops (web requests, disk accesses…) Resources v CPU cycles, memory, I/O bandwidth (network, disk) Dynamic setting v Usually scheduling must occur when resources reassignment can happen with some frequency v Not applicable to more static resources (like disk space) Varying scale v From shared memory accesses (HW) to parallel jobs (SW) OSE 2011– OS scheduling
Overload Scheduling unavoidable v When resources are shared u But it’s mostly interesting in a state of overload v When demand exceeds available resources v E. g. , if |threads| <= |cores|, scheduling is trivial § Well, not really, as threads placement might impact performance greatly (caches are shared) § For parallel jobs on, say, the Bluegene supercomputer, this example is more or less true § Likewise, in the cloud, when there are more physical servers than VMs (and you’re willing to pay for power) u A good scheduling policy v Gives the most important entity what it needs v Equally important => fair share u 3 OSE 2011– OS scheduling
Popularity of OS scheduling research Especially popular in the days of time-sharing v When there was a shortage of resources all around u Many scheduling problems become uninteresting v When you can just cheaply buy more/faster resources u But there were always important exceptions v Web servers handling peak demands (flash crowds, attacks, prioritizing paying customers) u And nowadays… v Embedded (power/performance considerations on your handheld device) v Cloud servers u 4 OSE 2011– OS scheduling
Key challenges Knowing what’s important v Can’t read clients’ mind; often unrealistic to explicitly ask u Many relevant, often conflicting performance metrics v Throughput vs. latency (e. g. , network packets) v Throughput vs. fairness (e. g. , DRAM accesses) v Power vs. speed (e. g. , DVFS) v Soft/hard realtime v … u Many schedulers v CPU, disk, I/O, memory, … v Interaction not necessarily healthy u Countless domain-specific, workload-dependent, ad-hoc solutions v No generic solution u 5 OSE 2011– OS scheduling
Addressing challenges – baseline 1. 2. Expose scheduling decisions, allow control, allow different policies 3. 6 Understand where scheduling is occurring Account for resource consumption to allow intelligent control OSE 2011– OS scheduling
Multilevel priority queue u u Used by all general-purpose OSes v Unix family, Windows family u 7 Running reduces priority to run more v Multiple ready queues, ordered by importance v Run most important first in a round-robin fusion v Use preemption if more important process enters the system v The negative feedback loop ensures no starvation v If you sleep a lot => consume little CPU => you’re important => when awakened, you’d typically immediately get a CPU Problematic in many respects v What if you run a lot but are still very important to the user? OSE 2011– OS scheduling
Pitfall: priority inversion Example v One CPU v P_low holds a lock v P_high waits for it v P_med becomes runnable => OS preempts P_low v (From real life: exactly what happened in 1 st Mars Rover) u Example v Many CPU-bound background processes v X server serves multiple clients => CPU quota might run out u Possible solution: priority inheritance v P_high lends its priority to P_low until key is released v X clients lend their priority to X server until serviced u 8 OSE 2011– OS scheduling
Pitfall: uncoordinated schedulers u u 9 Example v Even though CPU-scheduler favors emacs (always sleeps), v disk I/O scheduler does not, preferring higher throughput over emacs’s I/O ops Example v Emacs needs memory => memory is tight => must wait v Other processes have dirty pages => write to disk v Disk I/O scheduler doesn’t know these writes are important OSE 2011– OS scheduling
Active field of research u “No justified complaints: On fair sharing of multiple resources” [Dec, 2010; Dolev, Feitelson, Linial et. Al; TR] “We define fairness in such a scenario as the situation where every user either gets all the resources he wishes for, or else gets at least his entitlement on some bottleneck resource, and therefore cannot complain about not getting more. We then prove that a fair allocation according to this definition is guaranteed to exist for any combination of user requests and entitlements. The proof, which uses tools from theory of ordinary differential equations, is constructive and provides a method to compute the allocations numerically. ” 10 OSE 2011– OS scheduling
Active field of research u “RSIO: Automatic User Interaction Detection and Scheduling” [Jun 2010; Zheng, Viennot, Nieh; SIGMETRICS] “We present RSIO, a processor scheduling framework for improving the response time of latency-sensitive applications by monitoring accesses to I/O channels and inferring when user interactions occur. RSIO automatically identifies processes involved in a user interaction and boosts their priorities at the time the interaction occurs to improve system response time. RSIO also detects processes indirectly involved in processing an interaction, automatically accounting for dependencies and boosting their priorities accordingly. ” 11 OSE 2011– OS scheduling
Active field of research u “Secretly monopolizing the CPU without superuser privileges” [Aug 2007; Tsafrir, Etsion, Feitelson; USENIX Security] u See next presentation… 12 OSE 2011– OS scheduling
Скачать презентацию Operating Systems Engineering OS Scheduling By Dan Tsafrir
de86395c5c59669f9d9bc46d7d409847.ppt