10 Binary Tree Data Structures Binary trees and

10 Binary Tree Data Structures • Binary trees and binary search trees. • Searching. • Insertion. • Deletion. • Traversal. • Implementation of sets using BSTs.

Binary trees (1) • A binary tree consists of a header, plus a number of nodes connected by links in a hierarchical data structure: § Each node contains an element (value or object), plus links to at most two other nodes (its left child and right child). § The header contains a link to a node designated as the root node. A root node C B header E D leaf node F G

Binary trees (2) • A leaf node is one that has no children (i. e. , both its links are null). • Every node, except the root node, is the left or right child of exactly one other node (its parent). The root node has no parent – the only link to it is the header. • The size of a binary tree is the number of nodes (elements). • An empty binary tree has size zero. Its header is null.

Binary trees and subtrees (1) • Each node has both a left subtree and a right subtree (either of which may be empty). The node’s left (right) subtree consists of the node’s left (right) child together with that child’s own children, grandchildren, etc. A A’s left subtree B A’s right subtree C D E F G B’s left subtree is empty B’s right subtree C’s left subtree C’s right subtree

Binary trees and subtrees (2) • Each subtree is itself a binary tree. • This gives rise to an equivalent recursive definition. A binary tree is: § empty, or § nonempty, in which case it has a root node containing an element, a link to a left subtree, and a link to a right subtree.

Node and tree depths (1) • Observation: For any node N in a tree, there is exactly one sequence of links between the root node and N. • The depth of node N is the number of links between the root node and N. • The depth of a tree is the depth of the deepest node in the tree. § A tree consisting of a single node has depth 0. § By convention, an empty tree has depth – 1.

Node and tree depths (2) • Illustrations: depth 0 A (a) depth 1 C B balanced E D F J (b) K depth 2 depth 0 L depth 1 ill-balanced M N depth 2 P depth 3

Node and tree depths (3) • Illustrations (continued): (c) depth 0 S depth 1 T very illbalanced U depth 2 V depth 3 W depth 4 X depth 5

Balanced binary trees • A binary tree of depth d is balanced if all nodes at depths 0, 1, …, d– 2 have two children. § Nodes at depth d– 1 may have two/one/no children. § Node at depth d have no children (by definition). § A binary tree of depth 0 or 1 is always balanced. • A balanced binary tree of depth d has at least 2 d and at most 2 d+1 – 1 nodes. Conversely: Depth of balanced binary tree of size n = floor(log 2 n) • An ill-balanced binary tree of depth d could have as few as d+1 nodes. Conversely: Max. depth of ill-balanced binary tree of size n = n– 1

Binary search trees (1) • A binary search tree (or BST) is a binary tree with the following property. For any node in the binary tree, if that node contains element elem: § Its left subtree (if nonempty) contains only elements less than elem. § Its right subtree (if nonempty) contains only elements greater than elem.

Binary search trees (2) • Illustrations: lion (a) fox rat cat pig tiger dog (b) cat pig fox dog tiger lion rat

Binary search trees (3) • An equivalent recursive definition is also possible. A binary search tree is: § empty, or § nonempty, in which case it has: • a root node containing an element elem • a link to a left subtree in which (if it is not empty) all elements are less than elem • a link to a right subtree in which (if it is not empty) all elements are greater than elem.

Binary search trees (4) • Java class implementing BST nodes: public class BSTNode { protected Comparable element; protected BSTNode left, right; protected BSTNode (Comparable elem) { element = elem; left = null; right = null; } … } BSTNode methods (to follow)

Binary search trees (5) • Java class implementing BST headers: public class BST { private BSTNode root; public BST () { // Construct an empty BST. root = null; } … } BST methods (to follow)

BST search (1) • Problem: Search for a given target value in a BST. • Idea: Compare the target with the element in the root node. § If it is equal, the search is successful. § If it is less, search the left subtree. § If it is greater, search the right subtree. § If the subtree is empty, the search is unsuccessful.

BST search (2) • BST search algorithm: To find which if any node of a BST contains an element equal to target: 1. 2. Set curr to the BST’s root. Repeat: 2. 1. If curr is null: 2. 1. 1. Terminate with answer none. 2. 2. Otherwise, if target is equal to curr’s element: 2. 2. 1. Terminate with answer curr. 2. 3. Otherwise, if target is less than curr’s element: 2. 3. 1. Set curr to curr’s left child. 2. 4. Otherwise, if target is greater than curr’s element: 2. 4. 1. Set curr to curr’s right child.

BST search (3) • Animation (successful search): To find which if any node of a BST contains an element equal to target: 1. Set curr to the BST’s root. 2. Repeat: 2. 1. If curr is null, terminate with answer none. 2. 2. Otherwise, if target is equal to curr’s element, terminate with answer curr. 2. 3. Otherwise, if target is less than curr’s element, set curr to curr’s left child. 2. 4. Otherwise, if target is greater than curr’s element, set curr to curr’s right child. lion root target fox rat curr cat pig dog tiger pig

BST search (4) • Animation (unsuccessful search): To find which if any node of a BST contains an element equal to target: 1. Set curr to the BST’s root. 2. Repeat: 2. 1. If curr is null, terminate with answer none. 2. 2. Otherwise, if target is equal to curr’s element, terminate with answer curr. 2. 3. Otherwise, if target is less than curr’s element, set curr to curr’s left child. 2. 4. Otherwise, if target is greater than curr’s element, set curr to curr’s right child. lion root target fox rat curr cat pig dog tiger goat

BST search (5) • Analysis (counting comparisons): Let the BST’s size be n. If the BST has depth d, the number of comparisons is at most d+1. • If the BST is well-balanced, its depth is floor(log 2 n): Max. no. of comparisons = floor(log 2 n) + 1 Best-case time complexity is O(log n). • If the BST is ill-balanced, its depth is at most n– 1: Max. no. of comparisons = n Worst-case time complexity is O(n).

BST search (6) • Implementation as a Java method (in class BST): public BSTNode search (Comparable target) { int direction = 0; BSTNode curr = root; for (; ; ) { if (curr == null) return null; direction = target. compare. To(curr. element); if (direction == 0) return curr; else if (direction < 0) curr = curr. left; else curr = curr. right; } }

BST insertion (1) • Idea: To insert a new element into a BST, proceed as if searching for that element. If the element is not already present, the search will lead to a null link. Replace that null link by a link to a leaf node containing the new element.

BST insertion (2) • BST insertion algorithm: To insert the element elem into a BST: 1. 2. Set parent to null, and set curr to the BST’s root. Repeat: 2. 1. If curr is null: 2. 1. 1. Replace the null link from which curr was taken (either the BST’s root or parent’s left child or parent’s right child) by a link to a newlycreated leaf node with element elem. 2. 1. 2. Terminate. 2. 2. Otherwise, if elem is equal to curr’s element: 2. 2. 1. Terminate. 2. 3. Otherwise, …

BST insertion (3) • BST insertion algorithm (continued): 2. 3. child. 2. 4. child. Otherwise, if elem is less than curr’s element: 2. 3. 1. Set parent to curr, and set curr to curr’s left Otherwise, if elem is greater than curr’s element: 2. 4. 1. Set parent to curr, and set curr to curr’s right

BST insertion (4) • Animation (empty BST): To insert the element elem into a BST: 1. Set parent to null, and set curr to the BST’s root. 2. Repeat: 2. 1. If curr is null, replace the null link from which curr was taken by a link to a newly-created leaf node with element elem, and terminate. 2. 2. Otherwise, if elem is equal to curr’s element, terminate. 2. 3. Otherwise, if elem is less than curr’s element, set parent to curr and set curr to curr’s left child. 2. 4. Otherwise, if elem is greater than curr’s element, set parent to curr and set curr to curr’s right child. root parent curr goat elem goat

BST insertion (5) • Animation (nonempty BST): To insert the element elem into a BST: 1. Set parent to null, and set curr to the BST’s root. 2. Repeat: 2. 1. If curr is null, replace the null link from which curr was taken by a link to a newly-created leaf node with element elem, and terminate. 2. 2. Otherwise, if elem is equal to curr’s element, terminate. 2. 3. Otherwise, if elem is less than curr’s element, set parent to curr and set curr to curr’s left child. 2. 4. Otherwise, if elem is greater than curr’s element, set parent to curr and set curr to curr’s right child. lion root parent fox rat curr cat elem goat

BST insertion (6) • Analysis (counting comparisons): No. of comparisons is the same as for BST search. • If the BST is well-balanced: Max. no. of comparisons = floor(log 2 n) + 1 Best-case time complexity is O(log n). • If the BST is ill-balanced: Max. no. of comparisons = n Worst-case time complexity is O(n).

BST insertion (7) • Implementation as a Java method (in class BST): public void insert (Comparable elem) { int direction = 0; BSTNode parent = null, curr = root; for (; ; ) { if (curr == null) { BSTNode ins = new BSTNode(elem); if (root == null) root = ins; else if (direction < 0) parent. left = ins; else parent. right = ins; return; }

BST insertion (8) • Implementation (continued): direction = elem. compare. To(curr. element); if (direction == 0) return; parent = curr; if (direction < 0) curr = curr. left; else curr = curr. right; } }

BSTs in practice: insertions (1) • Whether a BST is well-balanced or ill-balanced depends on the order of insertions. • If the inserted elements are randomly ordered, the BST will probably be reasonably well-balanced. • If the inserted elements happen to be in ascending (or descending) order, the BST will be extremely ill-balanced.

Example 1: successive insertions (1) • Animation (inserting ‘lion’, ‘fox’, ‘rat’, ‘cat’, ‘pig’, ‘dog’, ‘tiger’): Initially: After inserting ‘tiger’: ‘lion’: ‘fox’: ‘rat’: ‘cat’: ‘pig’: ‘dog’: lion fox cat rat pig dog tiger

Example 1 (2) • Animation (inserting ‘cat’, ‘dog’, ‘fox’, ‘lion’, ‘pig’, ‘rat’): Initially: After inserting ‘rat’: ‘cat’: ‘dog’: ‘fox’: ‘lion’: ‘pig’: cat dog fox lion pig rat

BSTs in practice: insertions (2) • The following trials show the results of loading a BST with n randomly-generated elements. • First trial with n = 35: 0 2 4 6

BSTs in practice: insertions (3) • Second trial with n = 35: 0 2 4 6 8

BST deletion • Deleting a subtree’s leftmost element. • Deleting a subtree’s topmost element. • Deleting an arbitrary given element in a BST.

Deleting a leftmost element (1) • Problem: Delete the leftmost element in a subtree. • Two cases to consider: 1) The subtree’s topmost node has no left child. 2) The subtree’s topmost node has a left child. • Note: By definition, the leftmost node has no left child.

Deleting a leftmost element (2) • Case 1 (topmost node has no left child): Replace the subtree by its own right subtree. E. g. : Before: top lion rat leftmost node After: top’ pig tiger lion rat pig tiger

Deleting a leftmost element (3) • Case 2 (topmost node has a left child): Link the leftmost node’s parent to the leftmost node’s right child. E. g. : lion Before: top leftmost node After: top’ garbage rat cat fox pig tiger lion rat cat fox pig tiger

Deleting a leftmost element (4) • Algorithm: To delete the leftmost element in the (nonempty) subtree whose topmost node is top: 1. If top has no left child: case 1 1. 1. Terminate with top’s right child as answer. 2. If top has a left child: case 2 2. 1. Set parent to top, and set curr to top’s left child. 2. 2. While node curr has a left child, repeat: 2. 2. 1. Set parent to curr, and set curr to curr’s left child. 2. 3. Set parent’s left child to curr’s right child. 2. 4. Terminate with top as answer.

Deleting a leftmost element (5) • Implementation as a Java method (in class BSTNode): private BSTNode delete. Leftmost () { if (this. left == null) return this. right; else { BSTNode parent = this, curr = this. left; while (curr. left != null) { parent = curr; curr = curr. left; } parent. left = curr. right; return this; } }

Deleting a topmost element (1) • Problem: Delete the topmost element in a subtree. • Four cases to consider: 1) The topmost node has no children. 2) The topmost node has a right child but no left child. 3) The topmost node has a left child but no right child. 4) The topmost node has two children.

Deleting a topmost element (2) • Case 1 (topmost node has no children): Replace the subtree by an empty subtree. E. g. : Before: top lion After: lion top’

Deleting a topmost element (3) • Case 2 (topmost node has a right child but no left child): Replace the subtree by its own right subtree. E. g. : Before: top lion rat pig After: top’ tiger lion rat pig tiger

Deleting a topmost element (4) • Case 3 (topmost node has a left child but no right child): Replace the subtree by its own left subtree. E. g. : lion Before: top fox cat After: top’ goat lion fox cat goat

Deleting a topmost element (5) • Case 4 (topmost node has two children): Copy the right subtree’s leftmost element into the topmost node, then delete the right subtree’s leftmost element. E. g. : lion Before: top rat fox cat After: tiger pig top’ cat garbage rat fox pig tiger

Deleting a topmost element (6) • Algorithm: To delete the topmost element in the subtree whose topmost node is top: 1. 2. 3. If top has no left child: cases 1, 2 1. 1. Terminate with top’s right child as answer. If top has no right child: cases 1, 3 2. 1. Terminate with top’s left child as answer. If top has two children: case 4 3. 1. Set top’s element to the leftmost element in top’s right subtree. 3. 2. Delete the leftmost element in top’s right subtree. 3. 3. Terminate with top as answer.

Deleting a topmost element (7) • Auxiliary algorithm: To determine the leftmost element in the (nonempty) subtree whose topmost node is top: 1. 2. 3. Set curr to top. While curr has a left child, repeat: 2. 1. Set curr to curr’s left child. Terminate with curr’s element as answer.

Deleting a topmost element (8) • Implementation as a Java method (in class BSTNode): public BSTNode delete. Topmost () { if (this. left == null) return this. right; else if (this. right == null) return this. left; else { // this node has two children this. element = this. right. get. Leftmost(); this. right = this. right. delete. Leftmost(); return this; } }

Deleting a topmost element (9) • Auxiliary method (in class BSTNode): private Comparable get. Leftmost () { BSTNode curr = this; while (curr. left != null) curr = curr. left; return curr. element; }

Deleting a given element (1) • BST deletion algorithm: To delete the element elem in a BST: 1. 2. Set parent to null, and set curr to the BST’s root node. Repeat: 2. 1. If curr is null: 2. 1. 1. Terminate. 2. 2. Otherwise, if elem is equal to curr’s element: 2. 2. 1. Delete the topmost element in the subtree whose topmost node is curr, and let del be a link to the resulting subtree. 2. 2. 2. Replace the link to curr by del. 2. 2. 3. Terminate. 2. 3. Otherwise, …

Deleting a given element (2) • BST deletion algorithm (continued): 2. 3. child. 2. 4. child. Otherwise, if elem is less than curr’s element: 2. 3. 1. Set parent to curr, and set curr to curr’s left Otherwise, if elem is greater than curr’s element: 2. 4. 1. Set parent to curr, and set curr to curr’s right

Deleting a given element (3) • Animation: To delete the element elem in a BST: 1. Set parent to null, and set curr to the BST’s root node. 2. Repeat: 2. 1. If curr is null, terminate. 2. 2. Otherwise, if elem is equal to curr’s element: … 2. 2. 1. Delete the topmost element in the subtree whose topmost 2. 3. Otherwise, nodeifiselem curr, isand lessletthan del curr’s be a link element, to the resulting set parentsubtree. to curr, and set. Replace 2. 2. 2. curr to curr’s the linkleft to child. curr by del. 2. 4. 2. 2. 3. Otherwise, Terminate. if elem is greater than curr’s element, set parent to curr, 2. 3. Otherwise, and set curr… to curr’s right child. root parent curr del lion elem fox rat dog pig tiger fox

Deleting a given element (4) • Implementation as a Java method (in class BST): public void delete (Comparable elem) { int direction = 0; BSTNode parent = null, curr = root; for (; ; ) { if (curr == null) return; direction = elem. compare. To(curr. element); if (direction == 0) { BSTNode del = curr. delete. Topmost(); if (curr == root) root = del; else if (curr == parent. left) parent. left = del; else parent. right = del; return;

Deleting a given element (5) • Implementation (continued): parent = curr; if (direction < 0) curr = parent. left; else // direction > 0 curr = parent. right; } }

BSTs in practice: deletions • Whether a BST is well-balanced or ill-balanced depends on the order of insertions and deletions. • Deletion can make a well-balanced BST ill-balanced, or vice versa.

Example 2: successive deletions • Animation (deleting ‘lion, ‘fox’, ‘pig’): Initially: After deleting ‘pig’: ‘lion’: ‘fox’: lion pig rat fox cat pig dog garbage tiger

Binary tree traversal • Binary tree traversal: Visit all nodes (elements) of the tree in some predetermined order. • During a binary tree traversal, we must visit the root node, traverse the left subtree, and traverse the right subtree. But in which order? • In-order traversal: Traverse the left subtree, then visit the root node, then traverse the right subtree. • Pre-order traversal: Visit the root node, then traverse the left subtree, then traverse the right subtree. • Post-order traversal: Traverse the left subtree, then traverse the right subtree, then visit the root node.

Binary tree in-order traversal (1) • Schematic:

Binary tree in-order traversal (2) • Illustration: lion rat fox cat pig tiger dog • In-order traversal of a BST visits the elements in ascending order.

Binary tree in-order traversal (3) • Binary tree in-order traversal algorithm (generic): To traverse, in in-order, the subtree whose topmost node is top: 1. 2. If top is not null: 1. 1. Traverse, in in-order, top’s left subtree. 1. 2. Visit top. 1. 3. Traverse, in in-order, top’s right subtree. Terminate.

Example 3: printing elements in order • Java method: public static void print. In. Order (BSTNode top) { // Print, in ascending order, all the elements in the BST subtree // whose topmost node is top. if (top != null) { print. In. Order(top. left); System. out. println(top. element); visit top print. In. Order(top. right); } }

Binary tree pre-order traversal (1) • Schematic:

Binary tree pre-order traversal (2) • Illustration: lion rat fox cat pig dog tiger

Binary tree pre-order traversal (3) • Binary tree pre-order traversal algorithm (generic): To traverse, in pre-order, the subtree whose topmost node is top: 1. 2. If top is not null: 1. 1. Visit top. 1. 2. Traverse, in pre-order, top’s left subtree. 1. 3. Traverse, in pre-order, top’s right subtree. Terminate.

Binary tree post-order traversal (1) • Schematic:

Binary tree post-order traversal (2) • Illustration: lion rat fox cat pig dog tiger

Binary tree post-order traversal (3) • Binary tree post-order traversal algorithm (generic): To traverse, in post-order, the subtree whose topmost node is top: 1. 2. If top is not null: 1. 1. Traverse, in post-order, top’s left subtree. 1. 2. Traverse, in post-order, top’s right subtree. 1. 3. Visit top. Terminate.

Implementation of sets using BSTs (1) • Represent an (unbounded) set by a BST whose elements are the set members. Invariant: Empty set: Illustration: MX CA US represents the set {CA, MX, US}

Implementation of sets using BSTs (2) • Note: The BST representation of a set is not unique: FR DE represents the set {BE, DE, FR, IT, LU, NL} LU BE IT NL IT BE represents the set {BE, DE, FR, IT, LU, NL} LU DE NL FR

Implementation of sets using BSTs (3) • Summary of algorithms and time complexities: Operation Algorithm Time complexity contains BST search O(log n) O(n) best worst add BST insertion O(log n) O(n) best worst remove BST deletion O(log n) O(n) best worst