IOS 103 OPERATING SYSTEM DEADLOCKS Objectives At the

IOS 103 OPERATING SYSTEM DEADLOCKS

Objectives At the end of the course, the student should be able to: • Define deadlock; • Discuss how the deadlock occurs; • Discuss how to prevent deadlock; • Discuss how to avoid deadlock; • Discuss how to detect deadlock; • Discuss how to recover from deadlock.

Deadlocks Introduction • • In a multiprogramming environment, several processes may compete for a finite number of resources. A process requests resources such as memory space, CPU cycles, files and I/O devices, if the resources are not available at that time, the process enters a waiting state. Sometimes, a waiting process is never again able to change state because the resources it has requested are held by other waiting processes, this is called deadlock.

Deadlocks Introduction • • A system consists of a finite number of resources to be distributed among a number of competing processes. The resources are partitioned into several types, each consisting of some number of identical instances. If a process requests an instance of a resource type, the allocation of any instance of the type will satisfy the request. If it will not, then the instances are not identical and the resource type classes have not been defined properly.

Deadlocks Introduction • A process must request a resource before using it and must release the resource after using it. A process may request as many resources as it requires to carry out its designated task. Obviously, the number of resources requested may not exceed the total number of resources available in the system. In other words, a process cannot request three printers if the system has only two.

Deadlocks Under the normal mode of operation, a process may utilize a resource in only the following sequence: 1. Request: The process requests the resource. If the request cannot be granted immediately, then the requesting process must wait until it can acquire the resource. 2. Use: The process can operate on the resource (for example, if the resource is a printer, the process can print on the printer). 3. Release: The process releases the resource.

Deadlocks To illustrate deadlock state: • Consider a system with three CD RW drives. Suppose each of three processes holds one of these CD RW drives. If each process now requests another drive, the processes will be in deadlock state. (The same resource type) • Consider a system with one printer and one DVD drive. Suppose that process PI is holding the DVD and process PJ is holding the printer. If PI requests the printer and PJ requests the DVD drive, a deadlock occurs. (Different resource type)

Deadlocks Deadlock can arise if four conditions hold simultaneously: • Mutual exclusion: only one process at a time can use a resource. • Hold and wait: a process holding at least one resource is waiting to acquire additional resources held by other processes. • No preemption: a resource can be released only voluntarily by the process holding it, after that process has completed its task.

Deadlocks • Circular wait: there exists a set {P 0, P 1, …, Pn} of waiting processes such that P 0 is waiting for a resource that is held by P 1, P 1 is waiting for a resource that is held by P 2, …, Pn– 1 is waiting for a resource that is held by Pn, and Pn is waiting for a resource that is held by P 0

Resource- Allocation Graph Deadlocks can be described more precisely in terms of a directed graph called a system resourceallocation graph. This graph consists of a set of vertices V and a set of edges E. The set of vertices V is partitioned into two different types of nodes: • P = {P 1, P 2, …, Pn}, the set consisting of all the processes in the system • R = {R 1, R 2, …, Rm}, the set consisting of all resource types in the system

Resource- Allocation Graph A directed edge from process Pi to resource type Rj is denoted by Pi→Rj; it signifies that process Pi has requested an instance of resource type Rj and is currently waiting for that resource. A directed edge from resource type Rj to process Pi is denoted by Rj→Pi; it signifies that an instance of resource type Rj has beed allocated to process Pi. • Request edge – directed edge Pi→Rj • Assignment edge – directed edge Rj→Pi

Resource- Allocation Graph Pictorially, we represent: • Process: a circle • Resource Type with 4 instances: rectangle with dots • Pi requests instance of Rj Pi Rj • Pi is holding an instance of Rj Pi Rj

Resource- Allocation Graph Example: The sets P, R and E: • P = { P 1, P 2, P 3 } • R = { R 1, R 2, R 3, R 4} • E = {P 1 → R 1 , P 2 → R 3 , R 1 → P 2 , R 2 → P 1 , R 3 → P 3 } Resource instances: • One instance of resource type R 1 • Two instances of resource type R 2 • One instance of resource type R 3 • Three instances of resource type R 4

Resource- Allocation Graph Process states: • Process P 1 is holding an instance of resource type R 2 and is waiting for an instance of resource type R 1. • Process P 2 is holding an instance of R 1 and an instance of R 2 and is waiting for an instance of R 3. • Process P 3 is holding an instance of R 3.

Resource- Allocation Graph • If the graph contains no cycles, then no process in the system is deadlocked. If the graph does contain a cycle, then a deadlock may exist. • If each resource type has several instances, then a cycle does not necessarily imply that a deadlock has occurred. In this case, a cycle in the graph is a necessary but not a sufficient condition for the existence of deadlock.

Resource- Allocation Graph • Let’s use the previous graph: • Suppose that process P 3 requests an instance of resource type R 2. Since no resource instance is currently available, a request edge P 3→R 2 is added to the graph. At this point, two minimal cycles exist in the system. P 1→R 1 →P 2 →R 3 →P 3 →R 2 →P 1 P 2→R 3 →P 3 →R 2 →P 2

Resource- Allocation Graph • Therefore: • Processes P 1, P 2 and P 3 are deadlocked. Process P 2 is waiting for the resource R 3, which is held by process P 3. Process P 3 is waiting for either process P 1 or process P 2 to release resource R 2. In addition, process P 1 is waiting for process P 2 to release resource R 1.

Resource- Allocation Graph Consider: P 1→R 1 →P 3 →R 2 →P 1 • However, there is no deadlock. Observe that process P 4 may release its instance of resource type R 2. That resource can then be allocated to P 3, breaking the cycle.

Resource- Allocation Graph • In summary, if a resource-allocation graph does not have a cycle, then the system is not in a deadlocked state. If there is a cycle, then the system may or may not be in deadlocked state. This observation is important when we deal with the deadlock problem.

Resource- Allocation Graph Generally: • If graph contains no cycles no deadlock • If graph contains a cycle: • If only one instance per resource type, then deadlock • If several instances per resource type, possibility of deadlock

Methods for Handling Deadlocks • We can use a protocol to prevent or avoid deadlocks, ensuring that the system will never enter a deadlocked state. • We can allow the system to enter a deadlocked state, detect it and recover. • We can ignore the problem altogether and pretend that deadlocks never occur in the system.

Deadlock Prevention Mutual Exclusion • This condition must hold for non-sharable resources. (Example: a printer cannot be simultaneously shared by several processes. ) • Sharable resources, in contrast, do not require mutually exclusive access and thus cannot be involved in a deadlock. (Example: read-only files. ) • In general, however, we cannot prevent deadlocks by denying the mutual-exclusion condition, because some resources are intrinsically non-sharable.

Deadlock Prevention Hold and Wait • Must guarantee that whenever a process requests a resource, it does not hold any other resources. • Require process to request and be allocated all its resources before it begins execution or allow process to request resources only when the process has none. • Example 1: A process that copies data from DVD drive to a file on disk, sorts the file and then prints the results to a printer. (Request first the DVD drive, disk file and printer. )

Deadlock Prevention Hold and Wait • Example 2: Request the DVD drive and disk file then copy the file from DVD drive. Then request the disk file and printer then prints the file from disk file. • Disadvantages: • Resource utilization may be low. Since the resources were requested and waited to be used. • Starvation. Other processes will wait indefinitely for resources being used.

Deadlock Prevention No Preemption • There be no preemption of resources that have already been allocated. • If a process is holding some resources and requests another resource that cannot be immediately allocated to it (the process must wait), then all resources the process is currently holding are preempted. • The preempted resources are added to the list of resources for which the process is waiting. • The process will be restarted only when it can regain its old resources as well as the new ones that is requesting.

Deadlock Prevention No Preemption • This is often applied to resources whose state can be easily saved and restored later such as CPU registers and memory space. • It cannot generally be applied to such resources as printers and tape drives.

Deadlock Prevention Circular Wait • This is to impose a total ordering of all resource types and to require that each process requests resources in an increasing order of enumeration. • Example: F(tape drive) = 1 F(disk drive) = 5 F(printer) = 12 • In the example, requests first the tape drive before the printer. In developing the ordering or hierarchy, it is up to application developers based on the normal order of usage of the resources.

Deadlock Avoidance • An alternative method for avoiding deadlocks is to require additional information about how resources are to be requested. • The simplest and most useful model requires that each process declare the maximum number of resources of each type that it may need. Given this a priori information, it is possible to construct an algorithm that ensures that the system will never enter a deadlocked state. Such an algorithm defines the deadlock-avoidance approach.

Deadlock Avoidance • A deadlock-avoidance algorithm dynamically examines the resource-allocation state to ensure that a circular-wait condition can never exist. • The resource-allocation state is defined by the number of available and allocated resources and the maximum demands of the processes.

Deadlock Avoidance Safe State • A state is safe if the system can allocate resources to each process (up to its maximum) in some order and still avoid a deadlock. • More formally, a system is in safe state only if there exists a safe sequence. • When a process requests an available resources, system must decide if immediate allocation leaves the system in a safe state.

Deadlock Avoidance Safe State • System is in safe state if there exists a sequence <P 1, P 2, …, Pn> of ALL the processes is the systems such that for each Pi, the resources that Pi can still request can be satisfied by currently available resources + resources held by all the Pj, with j < i

Deadlock Avoidance Safe State That is: • If Pi resource needs are not immediately available, then Pi can wait until all Pj have finished • When Pj is finished, Pi can obtain needed resources, execute, return allocated resources, and terminate • When Pi terminates, Pi +1 can obtain its needed resources, and so on

Deadlock Avoidance Safe State • If a system is in safe state = no deadlocks • If a system is in unsafe state = possibility of deadlocks • Avoidance = ensure that a system will never enter an unsafe state

Deadlock Avoidance Safe State • Example: A system with 12 magnetic tape drives and 3 processes. Max. Needs Current Needs P 0 10 5 P 1 4 2 P 2 9 2 • A t 0, P 0 holding 5, P 1 holding 2 and P 2 holding 2. So 3 free tape drives. Therefore, Safe State. • A t 1, P 2 requests 1 tape drive (total of 3), P 0 requests 5 tape drives (but only 2 available) and P 1 will wait. Therefore, Unsafe State.

Deadlock Avoidance Resource-Allocation-Graph Algorithm • Claim edge Pi Rj indicated that process Pj may request resource Rj; represented by a dashed line • Claim edge converts to request edge when a process requests a resource • Request edge converted to an assignment edge when the resource is allocated to the process • When a resource is released by a process, assignment edge reconverts to a claim edge • Resources must be claimed a priori in the system • This is applicable for single instance of resource type.

Deadlock Avoidance Resource-Allocation-Graph Algorithm • If no cycle exists, then the allocation of the resource will leave the system in a safe state.

Deadlock Avoidance Resource-Allocation-Graph Algorithm • If a cycle is found, then the allocation will put the system in an unsafe state. In that case, process Pi will have to wait for its requests to be satisfied.

Deadlock Avoidance Banker’s Algorithm • This algorithm applicable for multiple instances of a resource type. • The name was chosen because the algorithm could be used in a banking system to ensure that the bank never allocated its available cash in such a way that it could no longer satisfy the needs of all its customers. • Each process must declare the maximum number of instances of each resource type that may need.

Deadlock Avoidance Banker’s Algorithm Data Structures for the Banker’s Algorithm: Let: n =no. of processes & m =number of resources types • Available: Vector of length m. If available [j] = k, there are k instances of resource type Rj available • Max: n x m matrix. If Max [i, j] = k, then process Pi may request at most k instances of resource type Rj • Allocation: n x m matrix. If Allocation[i, j] = k then Pi is currently allocated k instances of Rj • Need: n x m matrix. If Need[i, j] = k, then Pi may need k more instances of Rj to complete its task Need [i, j] = Max[i, j] – Allocation [i, j]

Deadlock Avoidance Banker’s Algorithm Data Structures for the Banker’s Algorithm: Example: Let X and Y be vectors of length n. And X ≤ Y if and only if X[i] ≤ Y[i] for all i=1, 2, …n. If X=(1, 7, 3, 2) and Y=(0, 3, 2, 1) then Y ≤ X. In addition, Y < X if Y ≤ X and Y ≠ X

Deadlock Avoidance Banker’s Algorithm Safety Algorithm 1. Let Work and Finish be vectors of length m and n, respectively. Initialize: Work = Available & Finish [i] = false for i = 0, 1, …, n- 1 2. Find and i such that both: (a) Finish [i] = false (b) Needi Work If no such i exists, go to step 4 3. Work = Work + Allocationi Finish[i] = true go to step 2 4. If Finish [i] == true for all i, then the system is in a safe state • This require an order of m x n 2 operations to determine whether a state is safe.

Deadlock Avoidance Banker’s Algorithm Resource-Request Algorithm Request = request vector for process Pi. If Requesti [j] = k then process Pi wants k instances of resource type Rj 1. If Requesti Needi go to step 2. Otherwise, raise error condition, since process has exceeded its maximum claim 2. If Requesti Available, go to step 3. Otherwise Pi must wait, since resources are not available 3. Pretend to allocate requested resources to Pi by modifying the state as follows: Available = Available – Request; Allocationi = Allocationi + Requesti; Needi = Needi – Requesti; l. If safe the resources are allocated to Pi l. If unsafe Pi must wait, and the old resourceallocation state is restored

Deadlock Avoidance Banker’s Algorithm Examples: • 5 processes P 0 through P 4; 3 resource types: A (10 instances), B (5 instances), and C (7 instances) Snapshot at time T 0: Allocation Max Available ABC ABC P 0 010 753 332 P 1 200 322 P 2 302 902 P 3 211 222 P 4 002 433

Deadlock Avoidance Banker’s Algorithm Example: Then • The content of the matrix Need is defined to be Max – Allocation Need ABC P 0 7 4 3 P 1 1 2 2 P 2 6 0 0 P 3 0 1 1 P 4 4 3 1 • The system is in a safe state since the sequence < P 1, P 3, P 4, P 2, P 0> satisfies safety criteria

Deadlock Avoidance Banker’s Algorithm Example: What is P 1 requests (1, 0, 2) Check that Request Available (that is, (1, 0, 2) (3, 3, 2) =true Allocation Need Available ABC ABC P 0 010 743 230 P 1 302 020 P 2 301 600 P 3 211 011 P 4 002 431 • Executing safety algorithm shows that sequence < P 1, P 3, P 4, P 0, P 2> satisfies safety requirement • Can request for (3, 3, 0) by P 4 be granted? No • Can request for (0, 2, 0) by P 0 be granted? No

Deadlock Detection • If a system does not employ either a deadlockprevention or a deadlock-avoidance algorithm, then a deadlock may occur. • Therefore the system may provide an algorithm that examines the state of the system to determine whether a deadlock has occurred. • And an algorithm to recover from the deadlock.

Deadlock Detection Single Instance of Each Resource Type Maintain wait-for graph • Nodes are processes • Pi Pj if Pi is waiting for Pj • Periodically invoke an algorithm that searches for a cycle in the graph. If there is a cycle, there exists a deadlock • An algorithm to detect a cycle in a graph requires an order of n 2 operations, where n is the number of vertices in the graph

Deadlock Detection Single Instance of Each Resource Type Resource-Allocation Graph Corresponding wait-for graph

Deadlock Detection Several Instances of a Resource Type • The wait-for graph scheme is not applicable to a resource-allocation system with multiple instances of each resource type. Therefore: similar to banker’s algorithm. • Available: A vector of length m indicates the number of available resources of each type. • Allocation: An n x m matrix defines the number of resources of each type currently allocated to each process. • Request: An n x m matrix indicates the current request of each process. If Request [ij] = k, then process Pi is requesting k more instances of resource type. Rj.

Deadlock Detection Several Instances of a Resource Type Example 1: 1. Let Work and Finish be vectors of length m and n, respectively Initialize: (a) Work = Available (b)For i = 1, 2, …, n, if Allocationi 0, then Finish[i] = false; otherwise, Finish[i] = true 2. Find an index i such that both: (a)Finish[i] == false (b) Requesti Work If no such i exists, go to step 4

Deadlock Detection Several Instances of a Resource Type Example 1: 3. Work = Work + Allocationi Finish[i] = true go to step 2 4. If Finish[i] == false, for some i, 1 i n, then the system is in deadlock state. Moreover, if Finish[i] == false, then Pi is deadlocked • Algorithm requires an order of O(m x n 2) operations to detect whether the system is in deadlocked state

Deadlock Detection Several Instances of a Resource Type Example 2: • Five processes P 0 through P 4; three resource types • A (7 instances), B (2 instances), and C (6 instances) Snapshot at time T 0: Allocation Request Available ABC ABC P 0 010 000 P 1 200 202 P 2 303 000 P 3 211 100 P 4 002 Sequence <P 0, P 2, P 3, P 1, P 4> will result in Finish[i] = true for all i

Deadlock Detection Several Instances of a Resource Type Example 2: • P 2 requests an additional instance of type C Request ABC P 0 000 P 1 201 P 2 001 P 3 100 P 4 002 • State of system? • Can reclaim resources held by process P 0, but insufficient resources to fulfill other processes; requests • Deadlock exists, consisting of processes P 1, P 2, P 3, and P 4

Deadlock Detection-Algorithm Usage • When, and how often, to invoke depends on: • How often a deadlock is likely to occur? • How many processes will need to be rolled back? • one for each disjoint cycle • If detection algorithm is invoked arbitrarily, there may be many cycles in the resource graph and so we would not be able to tell which of the many deadlocked processes “caused” the deadlock

Recovery from Deadlock • When a detection algorithm determines that a deadlock exists: • Inform the operator that a deadlock has occurred and let the operator deal with the deadlock manually. • Let the system recover from the deadlock automatically.

Recovery from Deadlock Options for breaking a deadlock: • Simply to abort one or more processes to break the circular-wait. • To preempt some resources from one or more of the deadlocked processes.

Recovery from Deadlock Process Termination To eliminate deadlocks by aborting a process, we use one of two methods. In both methods, the system reclaims all resources allocated to the terminated processes. • Abort all deadlocked processes. This method clearly will break the deadlock cycle, but at great expense. • Abort one process at a time until the deadlock cycle is eliminated. This method incurs considerable overhead, since after each process is aborted.

Recovery from Deadlock Process Termination In which order of the processes should we choose to abort? • Priority of the process • How long process has computed, and how much longer to completion • Resources the process has used • Resources process needs to complete • How many processes will need to be terminated • Is process interactive or batch?

Recovery from Deadlock Resource Preemption To eliminate deadlocks, we successfully preempt some resources from processes and give these resources to other processes until the deadlock cycle is broken. • Selecting a victim. We must determine the order of preemption to minimize cost. • Rollback. We must rollback the process to some safe state and restart it from that state. • Starvation. How can we guarantee that resources will not always be preempted from the same process? (same process may always be picked as victim or include number of rollback in cost factor)