Noncomparison Based Sorting All the sorting algorithms we

Noncomparison Based Sorting All the sorting algorithms we have seen assume binary comparisons as the basic primative Suppose we had a set of n integers that range from 1…n, no two integers the same, and an array of length n. Is x before y? How long would it take to sort this array? What if we had a set of integers, all between 1…n in value, and we had duplicates? How can we tell how many of each integer we have? Can we write an algorithm that runs in O(n)? 1

Bucketsort Suppose we are sorting n numbers from 0 to m, where we know the numbers are approximately uniformly distributed. Interval = high – low + 1 / number of buckets We can set up n buckets, each responsible for an interval of m/n numbers from 1 to m Given an input number x, it belongs in bucket number x – low /interval. 2

Example: Array of numbers: 5, 18, 13, 8, 11, 1 6 numbers, so 6 buckets Range each bucket will hold is calculated as follows: Bucket range: (high – low + 1)/n or (18 -1 + 1)/6, so bucket range is 3 0 1 2 3 [ ] [ ] 4 [ ] 5 [ ] 1 -3 4 -6 7 -9 10 -12 13 -15 16 -18 Now to find which bucket: (arr[n] – arr[smallest] )/ bucketrange (5 -1)/3 (round down) (18 -1)/3 (13 -1)/3… 0 1 2 3 4 5 [ 1 ] [ 5 ] [8 ] [11 ] [13 ] [18 ] 1 -3 4 -6 7 -9 10 -12 13 -15 16 -18 3

Analysis If we use an array of buckets, each item gets mapped to the right bucket in O(1) time. With uniformly distributed keys, the expected number of items per bucket is 1. Thus sorting each bucket takes O(1) time! The total effort of bucketing, sorting buckets, and concatenating the sorted buckets together is O(n). And no comparisons! 4

Bucket sort with multiple entries in a bucket What if we have multiple entries with the same key? For example, what if we were sorting names? All Smiths would end up in the same bucket We have no idea how many Smiths there will be. Solution? What would be a worst case for bucket. Sort number-wise? 5

Bucket Sort with Linked Lists We make an array of linked lists. We move each new element into the list in the appropriate order. (What type of sort is this? ) Then, when done, we just walk down the array and append each list. Result – sorted array When does Bucket. Sort work best? Worst? 6

Algorithm BUCKET_SORT (A, range, B) n = length [A] m = range for (int i = 1; i<n; i++) { Insert A[i] into B[(A[i]*n)/m] using Insertion sort } Concatenate the lists B[0], B[1], . . B[n-1] together in order. 7

Radix Sort What if we have very large key values? Think about the decimal representation of a number: x = a + 10*b + 100*c +1000*d +… a, b, c, d, … are all single digit integers (0… 9) Now we can do a bucketsort on a, b, c, d We do a bucketsort on a, then we do a bucketsort on b, then c, then d, etc. (smallest to largest). Why smallest first? 8

Radix Sort in action Let’s try it: 427, 496, 834, 222, 333, 444, 595, 582, 767, 294 First pass: 222, 582 Second Pass: 222, 427 Third Pass: 222, 294 333, 834, 444, 294 444 767 595 496 582 333 427, 444, 496 582, 594 427, 767 294, 594, 496 767 834 9

Try: (missing left digits are 0 s) 647, 315, 16, 14, 359, 453, 203, 235 First Pass: 453, 203 Second Pass: 203 Third Pass: 14, 16 14 315, 235 16 14, 315, 16 235 647 359 453, 359 203, 235 315, 359, 453 647 10

Radix Sort Analysis The algorithm takes O(n) time per sort. There are k = digit length bucket sorts (3 digits) So the total time is O(n*k) 11