Tag Archives: Bubble sort

Computer Algorithms: Bucket Sort

January 2, 2013algorithmsAlgorithm, Bubble sort, Bucket, Bucket sort, Combinatorics, Counting sort, Insertion sort, linear sorting algorithm, linear time sorting algorithms, Mathematics, Order theory, Radix sort, Sort, Sorting algorithms, two linear time sorting algorithmsStoimen

Introduction

What’s the fastest way to sort the following sequence [9, 3, 0, 5, 4, 1, 2, 6, 8, 7]? Well, the question is a bit tricky since the input is somehow “predefined”. First of all we have only integers, and fortunately they are all different. That’s great and we know that in practice it’s almost impossible to count on such lucky coincidence. However here we can sort the sequence very quickly.

First of all we can pass through all these integers and by using an auxiliary array we can just put them at their corresponding index. We know in advance that that is going to work really well, because they are all different.

There is only one major problem in this solution. That’s because we assume all the integers are different. If not – we can just put all them in one single corresponding index.

That is why we can use bucket sort.

Overview

Bucket sort it’s the perfect sorting algorithm for the sequence above. We must know in advance that the integers are fairly well distributed over an interval (i, j). Then we can divide this interval in N equal sub-intervals (or buckets). We’ll put each number in its corresponding bucket. Finally for every bucket that contains more than one number we’ll use some linear sorting algorithm.

The thing is that we know that the integers are well distributed, thus we expect that there won’t be many buckets with more than one number inside.

That is why the sequence [1, 2, 3, 2, 1, 2, 3, 1] won’t be sorted faster than [4, 3, 1, 2, 9, 5, 4, 8].

Pseudo Code

1. Let n be the length of the input list L;
2. For each element i from L
   2.1. If B[i] is not empty
      2.1.1. Put A[i] into B[i] using insertion sort;
      2.1.2. Else B[i] := A[i] 
3. Concatenate B[i .. n] into one sorted list;

Complexity

The complexity of bucket sort isn’t constant depending on the input. However in the average case the complexity of the algorithm is O(n + k) where n is the length of the input sequence, while k is the number of buckets.

The problem is that its worst-case performance is O(n^2) which makes it as slow as bubble sort.

Application

As the other two linear time sorting algorithms (radix sort and counting sort) bucket sort depends so much on the input. The main thing we should be aware of is the way the input data is dispersed over an interval.

Another crucial thing is the number of buckets that can dramatically improve or worse the performance of the algorithm.

This makes bucket sort ideal in cases we know in advance that the input is well dispersed.

Computer Algorithms: Order Statistics

May 28, 2012algorithmsAlgorithm, Best worst and average case, Bubble sort, Merge sort, PHP, Quicksort, Selection algorithm, Sorting algorithms, then searchStoimen

Introduction

We know that finding the minimum in a list of integers is a fairly simple task, but what about finding the i-th smallest element? Then the task isn’t that trivial and we have to think for a different approach.

First of all there are some very basic and intuitive approaches. Since finding the minimum is so easy, can we just find the minimum, than exclude it from the list and then search the minimum again until we find the i-th smallest element.

Continue reading →

You think you know algorithms. Quiz results!

May 9, 2012quizAlgorithm, Bubble sort, Divide and conquer algorithm, Merge sort, Quicksort, Radix sort, Sort, Sorting algorithmsStoimen

Finally the results from “You think you know algorithms” are out. This time only 3 of you have answered correctly to all the questions.

1. Which string searching algorithm is faster?

Morris-Pratt correct answer (ref)
Brute force
Rabin-Karp

Quiz results for "Which string searching algorithm is faster?"

Continue reading →

Computer Algorithms: Radix Sort

March 19, 2012algorithmsBest worst and average case, Bubble sort, Bucket sort, faster algorithm, faster linear complexity algorithms, Heapsort, input algorithms, Insertion sort, Introduction Algorithms, linear complexity algorithms, Merge sort, PHP, purpose sorting algorithms, Quicksort, Radix sort, Shell sort, Sort, Sorting algorithmsStoimen

Introduction

Algorithms always depend on the input. We saw that general purpose sorting algorithms as insertion sort, bubble sort and quicksort can be very efficient in some cases and inefficient in other. Indeed insertion and bubble sort are considered slow, with best-case complexity of O(n²), but they are quite effective when the input is fairly sorted. Thus when you have a sorted array and you add some “new” values to the array you can sort it quite effectively with insertion sort. On the other hand quicksort is considered one of the best general purpose sorting algorithms, but while it’s a great algorithm when the data is randomized it’s practically as slow as bubble sort when the input is almost or fully sorted.

Now we see that depending on the input algorithms may be effective or not. For almost sorted input insertion sort may be preferred instead of quicksort, which in general is a faster algorithm.

Just because the input is so important for an algorithm efficiency we may ask are there any sorting algorithms that are faster than O(n.log(n)), which is the average-case complexity for merge sort and quicksort. And the answer is yes there are faster, linear complexity algorithms, that can sort data faster than quicksort, merge sort and heapsort. But there are some constraints!

Everything sounds great but the thing is that we can’t sort any particular data with linear complexity, so the question is what rules the input must follow in order to be sorted in linear time.

Such an algorithm that is capable of sorting data in linear O(n) time is radix sort and the domain of the input is restricted – it must consist only of integers.

Overview

Let’s say we have an array of integers which is not sorted. Just because it consists only of integers and because array keys are integers in programming languages we can implement radix sort.

First for each value of the input array we put the value of “1” on the key-th place of the temporary array as explained on the following diagram.

Continue reading →

Computer Algorithms: Quicksort

March 13, 2012algorithmsAlgorithm, brilliant sorting algorithm, Bubble sort, Divide and conquer algorithm, elegant general purpose sorting algorithm, elegant solution, faster algorithms, Insertion sort, Merge sort, PHP, purpose sorting algorithm, Quicksort, Recursion, recursive solution, Selection algorithm, Sort, Sorting algorithms, SpreadsortStoimen

Introduction

When it comes to sorting items by comparing them merge sort is one very natural approach. It is natural, because simply divides the list into two equal sub-lists then sort these two partitions applying the same rule. That is a typical divide and conquer algorithm and it just follows the intuitive approach of speeding up the sorting process by reducing the number of comparisons. However there are other “divide and conquer” sorting algorithms that do not follow the merge sort scheme, while they have practically the same success. Such an algorithm is quicksort.

Overview

Back in 1960 C. A. R. Hoare comes with a brilliant sorting algorithm. In general quicksort consists of some very simple steps. First we’ve to choose an element from the list (called a pivot) then we must put all the elements with value less than the pivot on the left side of the pivot and all the items with value greater than the pivot on its right side. After that we must repeat these steps for the left and the right sub-lists. That is quicksort! Simple and elegant!

Continue reading →

stoimen's web log

on web development

Tag Archives: Bubble sort

Computer Algorithms: Bucket Sort

Introduction

Overview

Pseudo Code

Complexity

Application

Computer Algorithms: Order Statistics

Introduction

You think you know algorithms. Quiz results!

1. Which string searching algorithm is faster?

Computer Algorithms: Radix Sort

Introduction

Overview

Computer Algorithms: Quicksort

Introduction

Overview