Trees Binary Trees and Binary Search Trees 2
Trees, Binary Trees, and Binary Search Trees
2 Trees * Linear n access time of linked lists is prohibitive Does there exist any simple data structure for which the running time of most operations (search, insert, delete) is O(log N)? * Trees Basic concepts n Tree traversal n Binary tree n Binary search tree and its operations n
3 Trees *A tree T is a collection of nodes T can be empty n (recursive definition) If not empty, a tree T consists of n a (distinguished) node r (the root), 1 and zero or more nonempty sub-trees T 1, T 2, . . , Tk 1
4 * Tree can be viewed as a ‘nested’ lists: n * list of lists … Tree is also a graph …
5 Some Terminologies * Child and Parent Every node except the root has one parent n A node can have a zero or more children n * Leaves are nodes with no children Sibling n nodes with same parent
6 More Terminologies * Path n * Length of a path n * * length of the unique path from the root to that node Height of a node n n * number of edges on the path Depth of a node n * A sequence of edges length of the longest path from that node to a leaf all leaves are at height 0 The height of a tree = the height of the root = the depth of the deepest leaf Ancestor and descendant n n n If there is a path from n 1 to n 2 n 1 is an ancestor of n 2, n 2 is a descendant of n 1 Proper ancestor and proper descendant
7 Example: UNIX Directory
8 Tree Operations * * Traversal, the most important we will not implement a general ‘tree’, so wont discuss Search n Insertion n Deletion n
9 Tree Traversal * Used to print out the data in a tree in a certain order * Pre-order traversal Print the data at the root n Recursively print out all data in the leftmost subtree n… n Recursively print out all data in the rightmost subtree n
10 A drawing of tree with two pointers … Struct Tree. Node { double element; // the data Tree. Node* child; // FIRST child : go to the next generation Tree. Node* next; // next SIBLING : go to the same generation }
11 preorder(tree) if empty(tree) stop else print(element(tree)) preorder(child(tree)) preorder(next(tree))
12 Example: Unix Directory Traversal Pre. Order Post. Order
13 Binary Trees * A tree in which no node can have more than two children Generic binary tree * The depth of an “average” binary tree is considerably smaller than N, even though in the worst case, the depth can be as large as N – 1. Worst-case binary tree
14 Binary Tree ADT * Implementation at most two children, we can keep direct pointers to them n a linked list is physically a pointer, so is a tree! n * Possible operations on the Binary Tree ADT n * Tree operations: n * Parent, left_child, right_child, sibling, root, etc Search, insertion and deletion Make a Binary Tree ADT later …
15 A drawing of linked list with one pointer … A drawing of binary tree with two pointers … Struct Binary. Node { double element; // the data Binary. Node* left; // left child Binary. Node* right; // right child }
16 Example: Expression Trees Leaves are operands (constants or variables) * The internal nodes contain operators * Will not be a binary tree if some operators are not binary *
17 Preorder, Postorder and Inorder * Preorder traversal node, left, right n prefix expression n 1 ++a*bc*+*defg
18 Preorder, Postorder and Inorder * Postorder traversal left, right, node n postfix expression 1 abc*+de*f+g*+ n * Inorder traversal left, node, right n infix expression 1 a+b*c+d*e+f*g n
19 Preorder, Postorder and Inorder Pseudo Code
20 Binary tree insertion and deletion …
21 BST: Binary Search Tree
22 Recall the binary search algorithm * 4 7 10 15 19 20 42 54 87 90 22
23 Binary Search Trees (BST) *A data structure for efficient searching, insertion and deletion * Binary search tree property For every node X n All the keys in its left subtree are smaller than the key value in X n All the keys in its right subtree are larger than the key value in X n
24 Binary Search Trees A binary search tree Not a binary search tree
25 Binary Search Trees The same set of keys may have different BSTs * Average depth of a node is O(log N) * Maximum depth of a node is O(N)
26 Searching BST * If we are searching for 15, then we are done. * If we are searching for a key < 15, then we should search in the left subtree. * If we are searching for a key > 15, then we should search in the right subtree.
27
28 Searching (Find) * Find X: return a pointer to the node that has key X, or NULL if there is no such node find(const double x, Binary. Node* t) const * Time complexity: O(height of the tree)
29 Inorder Traversal of BST * Inorder traversal of BST prints out all the keys in sorted order Inorder: 2, 3, 4, 6, 7, 9, 13, 15, 17, 18, 20
30 find. Min/ find. Max Goal: return the node containing the smallest (largest) key in the tree * Algorithm: Start at the root and go left (right) as long as there is a left (right) child. The stopping point is the smallest (largest) element * Binary. Node* find. Min(Binary. Node* t) const * Time complexity = O(height of the tree)
31 Insertion Proceed down the tree as you would with a find * If X is found, do nothing (or update something) * Otherwise, insert X at the last spot on the path traversed * * Time complexity = O(height of the tree)
32 void insert(double x, Binary. Node*& t) { if (t==NULL) t = new Binary. Node(x, NULL); else if (x<t->element) insert(x, t->left); else if (t->element<x) insert(x, t->right); else ; // do nothing }
33 Insertion Example * Construct a BST successively from a sequence of data: * 35, 60, 2, 80, 40, 85, 32, 33, 31, 5, 30
34 Deletion * When we delete a node, we need to consider how we take care of the children of the deleted node. n This has to be done such that the property of the search tree is maintained.
35 Deletion under Different Cases * Case n Delete it immediately * Case n 1: the node is a leaf 2: the node has one child Adjust a pointer from the parent to bypass that node
36 Deletion Case 3 * Case n Replace the key of that node with the minimum element at the right subtree 1 n 3: the node has 2 children (or replace the key by the maximum at the left subtree!) Delete that minimum element 1 Has either no child or only right child because if it has a left child, that left child would be smaller and would have been chosen. So invoke case 1 or 2. * Time complexity = O(height of the tree)
37 void remove(double x, Binary. Node*& t) { if (t==NULL) return; if (x<t->element) remove(x, t->left); else if (t->element < x) remove (x, t->right); else if (t->left != NULL && t->right != NULL) // two children { t->element = fin. Min(t->right) ->element; remove(t->element, t->right); } else { Binarynode* old. Node = t; t = (t->left != NULL) ? t->left : t->right; delete old. Node; } }
38 Deletion Example * Removing 40 from (a) results in (b) using the smallest element in the right subtree (i. e. the successor) 30 30 5 5 40 2 80 35 32 31 60 33 (a) 60 2 35 32 85 31 80 85 33 (b)
39 * Removing 40 from (a) results in (c) using the largest element in the left subtree (i. e. , the predecessor) 30 30 5 5 40 2 80 35 32 31 60 35 2 85 32 31 33 80 60 85 33 (a) (c) 39
40 * Removing 30 from (c), we may replace the element with either 5 (predecessor) or 31 (successor). If we choose 5, then (d) results. 5 30 5 2 32 31 33 (c) 35 32 80 60 85 31 33 80 60 85 (d) 40
41 Example: compute the number of nodes?
42 Example: Successor The successor of a node x is defined as: n The node y, whose key(y) is the successor of key(x) in sorted order of this tree. (2, 3, 4, 6, 7, 9, 13, 15, 17, 18, 20) Some examples: Which node is the successor of 2? Which node is the successor of 9? Which node is the successor of 13? Which node is the successor of 20? Null Search trees 42
43 Scenario I: Node x Has a Right Subtree By definition of BST, all items greater than x are in this right sub-tree. Successor is the minimum( right( x ) ) maybe null Search trees 43
44 Scenario II: Node x Has No Right Subtree and x is the Left Child of Parent (x) Successor is parent( x ) Why? The successor is the node whose key would appear in the next sorted order. Think about traversal in-order. Who would be the successor of x? The parent of x! Search trees 44
45 Scenario III: Node x Has No Right Subtree and Is Not a Left-Child of an Immediate Parent Successor of x y Keep moving up the tree until you find a parent which branches from the left(). Stated in Pseudo code. x Search trees 45
46 Three Scenarios to Determine Successor(x) x has right descendants => minimum( right(x) ) Scenario I x has no right descendants x is the left child of some node => parent(x) Scenario II Search trees x is the right child of some node Scenario III 46
47 Successor Pseudo-Codes Verify this code with this tree. Find successor of 3 4 9 13 13 15 18 20 Note that parent( root ) = NULL Scenario III Search trees 47
48 Problem * If we use a “doubly linked” tree, finding parent is easy. class Node { int data; Node * left; Node * right; Node * parent; }; * But usually, we implement the tree using only pointers to the left and right node. So, finding the parent is tricky. class Node { int data; Node * left; Node * right; }; For this implementation we need to store the ‘path’ Stack! 48
49 Use a Stack to Find Successor PART I Initialize an empty Stack s. Start at the root node, and traverse the tree until we find the node x. Push all visited nodes onto the stack. PART II Once node x is found, find successor using 3 scenarios mentioned before. Parent nodes are found by popping the stack! 49
50 Example Successor(root, 13) Part I Traverse tree from root to find 13 order -> 15, 6, 7, 13 7 6 15 Stack s 50
51 Successor(root, 13) Part II Find Parent (Scenario III) y =pop()=6 y =pop()=7 x = 13 y=s. pop() while y!=NULL and x=right(y) x = y; if s. isempty() y=NULL else y=s. pop() return y 7 6 15 Stack s 51
52 Make a binary or BST ADT …
53 For a generic (binary) tree: Struct Node { double element; // the data Node* left; // left child Node* right; // right child } class Tree { public: Tree(); // constructor Tree(const Tree& t); ~Tree(); // destructor bool empty() const; double root(); // decomposition (access functions) Tree& left(); Tree& right(); bool search(const double x); void insert(const double x); // compose x into a tree void remove(const double x); // decompose x from a tree private: Node* root; } (insert and remove are different from those of BST)
54 For BST tree: Struct Node { double element; // the data Node* left; // left child Node* right; // right child } class BST { public: BST(); // constructor BST(const Tree& t); ~BST(); // destructor bool empty() const; double root(); // decomposition (access functions) BST& left(); BST& right(); bool serch(const double x); // search an element void insert(const double x); // compose x into a tree void remove(const double x); // decompose x from a tree private: Node* root; } BST is for efficient search, insertion and removal, so restricting these functions.
55 class BST { public: Weiss textbook: BST(); BST(const Tree& t); ~BST(); bool empty() const; bool search(const double x); // contains void insert(const double x); // compose x into a tree void remove(const double x); // decompose x from a tree private: Struct Node { double element; Node* left; Node* right; Node(…) {…}; // constructuro for Node } Node* root; void insert(const double x, Node*& t) const; // recursive function void remove(…) Node* find. Min(Node* t); void make. Empty(Node*& t); // recursive ‘destructor’ bool contains(const double x, Node* t) const; }
56 Comments: root, left subtree, right subtree are missing: 1. we can’t write other tree algorithms, is implementation dependent, BUT, 2. this is only for BST (we only need search, insert and remove, may not need other tree algorithms) so it’s two layers, the public for BST, and the private for Binary Tree. 3. it might be defined internally in ‘private’ part (actually it’s implicitly done).
57 A public non-recursive member function: void insert(double x) { insert(x, root); } A private recursive member function: void insert(double x, Binary. Node*& t) { if (t==NULL) t = new Binary. Node(x, NULL); else if (x<t->element) insert(x, t->left); else if (t->element<x) insert(x, t->right); else ; // do nothing }
By inheritance 58 Struct Node { double element; // the data template<typename T> Struct Node { Node* left; // left child T element; // the data Node* right; // right child Node* left; // left child } Node* right; // right child } Class Binary. Tree { … } template<typename T> class Binary. Tree { … class BST : public Binary. Tree { } } template<typename T> class BST : public Binary. Tree<T> { void BST: : search () { } } void BST: : insert () { void BST<T>: : search (const T& x) { } } void BST: : delete () { void BST<T>: : insert (…) { } } void BST<T>: : delete (…) { } All search, insert and deletion have to be redefined.
59 More general BST … template<typename T> Struct Node { T element; // the data Node* left; // left child template<typename T> Node* right; // right child class Binary. Tree { } … } template<typename T> class Binary. Tree { … template<typename T, typename K> class BST : public Binary. Tree<T> { } } template<typename T> class BST : public Binary. Tree<T> { void BST<T>: : search (const K& key) { } } void BST<T>: : search (const T& x) { } void BST<T>: : insert (…) { } void BST<T>: : delete (…) { } Search ‘key’ of K might be different from the data record of T!!!
60 Deletion Code (1/4) * First Element Search, and then Convert Case III, if any, to Case I or II template<class E, class K> BSTree<E, K>& BSTree<E, K>: : Delete(const K& k, E& e) { // Delete element with key k and put it in e. // set p to point to node with key k (to be deleted) Binary. Tree. Node<E> *p = root, // search pointer *pp = 0; // parent of p while (p && p->data != k){ // move to a child of p pp = p; if (k < p->data) p = p->Left. Child; else p = p->Right. Child; } 60
61 Deletion Code (2/4) if (!p) throw Bad. Input(); // no element with key k e = p->data; // save element to delete // restructure tree // handle case when p has two children if (p->Left. Child && p->Right. Child) { // two children convert to zero or one child case // find predecessor, i. e. , the largest element in // left subtree of p Binary. Tree. Node<E> *s = p->Left. Child, *ps = p; // parent of s while (s->Right. Child) { // move to larger element ps = s; s = s->Right. Child; } 61
62 Deletion Code (3/4) // move from s to p p->data = s->data; p = s; // move/reposition pointers for deletion pp = ps; } // p now has at most one child // save child pointer to c for adoption Binary. Tree. Node<E> *c; if (p->Left. Child) c = p->Left. Child; else c = p->Right. Child; // deleting p if (p == root) root = c; // a special case: delete root else { // is p left or right child of pp? if (p == pp->Left. Child) pp->Left. Child = c; //adoption else pp->Right. Child = c; } 62
63 Deletion Code (4/4) delete p; return *this; } 63
- Slides: 63