Introduction To Data Structures Module
Introduction To Data Structures Module
Introduction To Data Structures Module
UNIT I
INTRODUCTION
Data Structure is a way of collecting and organising data in such a way that we can
perform operations on these data in an effective way.
Data Structures is about rendering data elements in terms of some relationship, for better
organization and storage. For example, we have data player's name "Virat" and age 26.
Here "Virat" is of String data type and 26 is of integer data type.
We can organize this data as a record like Player record. Now we can collect and store
player's records in a file or database as a data structure. For example: "Dhoni" 30,
"Gambhir" 31, "Sehwag" 33.
In simple language, Data Structures are structures programmed to store ordered data, so
that various operations can be performed on it easily.
Data : The term ‘DATA’ simply referes to a a value or a set of values. These values may
present anything about something, like it may be roll no of a student, marks, name of an
employee, address of person etc.
Data item : A data item refers to a single unit of value. For eg. roll no of a student, marks,
name of an employee, address of person etc. are data items. Data items that can be
divided into sub items are called group items (Eg. Address, date, name), where as those
who can not be divided in to sub items are called elementary items (Eg. Roll no, marks,
city, pin code etc.).
15CS201J- DATA STRUCTURES UNIT-I
Entity - with similar attributes ( e.g all employees of an organization) form an entity set
A 17 M 109cs0132 CSE
B 18 M 109ee1234 EE
Anything that can store data can be called as a data structure, hence Integer, Float,
Boolean, Char etc, all are data structures. They are known as Primitive Data Structures.
Then we also have some complex Data Structures, which are used to store large and
connected data. Some example of Abstract Data Structure are :
Array
Linked List
Stack
Queue
Tree
Graph
All these data structures allow us to perform different operations on data. We select
these data structures based on which type of operation is required.
15CS201J- DATA STRUCTURES UNIT-I
Basic Operations
The data in the data structures are processed by certain operations. The particular data
structure chosen largely depends on the frequency of the operation that needs to be
performed on the data structure.
• Traversing
• Searching
• Insertion
• Deletion
• Sorting
• Merging
(1) Traversing: Accessing each record exactly once so that certain items in the
record may be processed.
(2) Searching: Finding the location of a particular record with a given key value, or
finding the location of all records which satisfy one or more conditions.
(3) Inserting: Adding a new record to the structure.
15CS201J- DATA STRUCTURES UNIT-I
An abstract data type (ADT) refers to a set of data values and associated operations that
are specified accurately, independent of any particular implementation. With an ADT, we
know what a specific data type can do, but how it actually does it is hidden. Simply hiding
the implementation
Array is a container which can hold fix number of items and these items should be of
same type. Most of the data structures make use of array to implement their algorithms.
Following are important terms to understand the concepts of Array.
Array Representation
Arrays can be declared in various ways in different languages. For illustration, let's take
C array declaration.
15CS201J- DATA STRUCTURES UNIT-I
As per above shown illustration, following are the important points to be considered.
Basic Operations
Following are the basic operations supported by an array.
Linked List is a linear data structure and it is very common data structure which consists
of group of nodes in a sequence which is divided in two parts. Each node consists of its
own data and the address of the next node and forms a chain. Linked Lists are used to
create trees and graphs.
15CS201J- DATA STRUCTURES UNIT-I
• They are a dynamic in nature which allocates the memory when required.
• Insertion and deletion operations can be easily implemented.
• Stacks and queues can be easily executed.
• Linked List reduces the access time.
Linked lists let you insert elements at the beginning and end of the list.
Singly Linked List : Singly linked lists contain nodes which have a data part as well as an
address part i.e. next, which points to the next node in sequence of nodes. The operations
we can perform on singly linked lists are insertion, deletion and traversal.
15CS201J- DATA STRUCTURES UNIT-I
Doubly Linked List : In a doubly linked list, each node contains two links the first link
points to the previous node and the next link points to the next node in the sequence.
Circular Linked List : In the circular linked list the last node of the list contains the
address of the first node and forms a circular chain.
Stacks
Stack is an abstract data type with a bounded (predefined) capacity. It is a simple data
structure that allows adding and removing elements in a particular order. Every time an
15CS201J- DATA STRUCTURES UNIT-I
element is added, it goes on the top of the stack, the only element that can be removed is
the element that was at the top of the stack, just like a pile of objects.
Applications of Stack
• The simplest application of a stack is to reverse a word. You push a given word
to stack - letter by letter - and then pop letters from the stack.
• There are other uses also like : Parsing, Expression Conversion(Infix to Postfix,
Postfix to Prefix etc) and many more.
Implementation of Stack
15CS201J- DATA STRUCTURES UNIT-I
Stack can be easily implemented using an Array or a Linked List. Arrays are quick, but are
limited in size and Linked List requires overhead to allocate, link, unlink, and deallocate,
but is not limited in size. Here we will implement Stack using array.
-1 Stack is Empty
Analysis of Stacks
Below mentioned are the time complexities for various operations that can be performed
on the Stack data structure.
Queue is also an abstract data type or a linear data structure, in which the first element is
inserted from one end called REAR(also called tail), and the deletion of exisiting element
takes place from the other end called as FRONT(also called head). This makes queue as
FIFO data structure, which means that element inserted first will also be removed first.
The process to add an element into queue is called Enqueue and the process of removal
of an element from queue is called Dequeue.
1. Like Stack, Queue is also an ordered list of elements of similar data types.
2. Queue is a FIFO( First in First Out ) structure.
3. Once a new element is inserted into the Queue, all the elements inserted before
the new element in the queue must be removed, to remove the new element.
4. peek( ) function is oftenly used to return the value of first element without
dequeuing it.
Applications of Queue
Queue, as the name suggests is used whenever we need to have any group of objects in an
order in which the first one coming in, also gets out first while the others wait for there
turn, like in the following scenarios :
15CS201J- DATA STRUCTURES UNIT-I
1. Serving requests on a single shared resource, like a printer, CPU task scheduling
etc.
2. In real life, Call Center phone systems will use Queues, to hold people calling
them in an order, until a service representative is free.
3. Handling of interrupts in real-time systems. The interrupts are handled in the
same order as they arrive, First come first served.
Analysis of Queue
• Enqueue : O(1)
• Dequeue : O(1)
• Size : O(1)
Tree represents nodes connected by edges. We'll going to discuss binary tree or binary
search tree specifically.
Binary Tree is a special datastructure used for data storage purposes. A binary tree has a
special condition that each node can have two children at maximum. A binary tree have
benefits of both an ordered array and a linked list as search is as quick as in sorted array
and insertion or deletion operation are as fast as in linked list.
15CS201J- DATA STRUCTURES UNIT-I
Terms
Following are important terms with respect to tree.
A graph is a pictorial representation of a set of objects where some pairs of objects are
connected by links. The interconnected objects are represented by points termed
as vertices, and the links that connect the vertices are called edges.
Formally, a graph is a pair of sets (V, E), where V is the set of vertices and E is the set of
edges, connecting the pairs of vertices. Take a look at the following graph −
V = {a, b, c, d, e}
Edge − Edge represents a path between two vertices or a line between two
vertices. In example given below, lines from A to B, B to C and so on represents
edges. We can use a two dimensional array to represent array as shown in image
below. Here AB can be represented as 1 at row 0, column 1, BC as 1 at row 1,
column 2 and so on, keeping other combinations as 0.
15CS201J- DATA STRUCTURES UNIT-I
Adjacency − Two node or vertices are adjacent if they are connected to each other
through an edge. In example given below, B is adjacent to A, C is adjacent to B and
so on.
Basic Operations
Following are basic primary operations of a Graph which are following.
Algorithms Basics
From data structure point of view, following are some important categories of algorithms
Characteristics of an Algorithm
Not all procedures can be called an algorithm. An algorithm should have the below
mentioned characteristics −
Algorithm Analysis
An algorithm is said to be efficient and fast, if it takes less time to execute and consumes
less memory space. The performance of an algorithm is measured on the basis of
following properties:
1. Time Complexity
2. Space Complexity
Suppose X is an algorithm and n is the size of input data, the time and space used by the
Algorithm X are the two main factors which decide the efficiency of X.
• Time Factor − The time is measured by counting the number of key operations
such as comparisons in sorting algorithm
• Space Factor − The space is measured by counting the maximum memory
space required by the algorithm.
The complexity of an algorithm f(n) gives the running time and / or storage space
required by the algorithm in terms of n as the size of input data.
Space Complexity
Space required by an algorithm is equal to the sum of the following two components −
• A fixed part that is a space required to store certain data and variables that are
independent of the size of the problem. For example simple variables &
constant used and program size etc.
• A variable part is a space required by variables, whose size depends on the
size of the problem. For example dynamic memory allocation, recursion stacks
space etc.
15CS201J- DATA STRUCTURES UNIT-I
Space complexity S(P) of any algorithm P is S(P) = C + SP(I) Where C is the fixed part and
S(I) is the variable part of the algorithm which depends on instance characteristic I.
Following is a simple example that tries to explain the concept −
Asymptotic Notations
The main idea of asymptotic analysis is to have a measure of efficiency of algorithms that
doesn’t depend on machine specific constants, and doesn’t require algorithms to be
implemented and time taken by programs to be compared. Asymptotic notations are
mathematical tools to represent time complexity of algorithms for asymptotic analysis.
The following 3 asymptotic notations are mostly used to represent time complexity of
algorithms.
1) Θ Notation:
The theta notation bounds a function from above and below, so it defines exact
asymptotic behavior. A simple way to get Theta notation of an expression is to drop low
order terms and ignore leading constants. For example, consider the following
expression.
Dropping lower order terms is always fine because there will always be a n0 after which
beats irrespective of the constants involved. For a given function g(n), we
denote Θ(g(n)) is following set of functions.
15CS201J- DATA STRUCTURES UNIT-I
The above definition means, if f(n) is theta of g(n), then the value f(n) is always between
c1*g(n) and c2*g(n) for large values of n (n >= n0). The definition of theta also requires
that f(n) must be non-negative for values of n greater than n0.
2. Big O Notation:
The Big O notation defines an upper bound of an algorithm, it bounds a function only
from above. For example, consider the case of Insertion Sort. It takes linear time in best
case and quadratic time in worst case. We can safely say that the time complexity of
Insertion sort is O( ). Note that O( ) also covers linear time. If we use Θ notation to
represent time complexity of Insertion sort, we have to use two statements for best and
worst cases:
The Big O notation is useful when we only have upper bound on time complexity of an
algorithm. Many times we easily find an upper bound by simply looking at the algorithm.
15CS201J- DATA STRUCTURES UNIT-I
3) Ω Notation:
Just as Big O notation provides an asymptotic upper bound on a function, Ω notation
provides an asymptotic lower bound. Ω Notation< can be useful when we have lower
bound on time complexity of an algorithm. As discussed in the previous post, the best
case performance of an algorithm is generally not useful; the Omega notation is the least
used notation among all three.
For a given function g(n), we denote by Ω(g(n)) the set of functions.
15CS201J- DATA STRUCTURES UNIT-I
Linear Search
A linear search is the basic and simple search algorithm. A linear search searches an
element or value from an array till the desired element or value is not found and it
searches in a sequence order. It compares the element with all the other elements given
in the list and if the element is matched it returns the value index else it return -1. Linear
Search is applied on the unsorted or unordered list when there are fewer elements in a
list.
Pseudocode:-
linear(a[n], key)
for( i = 0; i < n; i++)
if (a[i] == key)
return i;
return -1;
15CS201J- DATA STRUCTURES UNIT-I
Asymptotic Analysis
In the worst case analysis, we calculate upper bound on running time of an algorithm. We
must know the case that causes maximum number of operations to be executed. For
Linear Search, the worst case happens when the element to be searched (target in the
above code) is not present in the array. When target is not present, the search() functions
compares it with all the elements of array one by one. Therefore, the worst case time
complexity of linear search would be Θ(n).
In average case analysis, we take all possible inputs and calculate computing time for all
of the inputs. Sum all the calculated values and divide the sum by total number of inputs.
We must know (or predict) distribution of cases. For the linear search problem, let us
assume that all cases are uniformly distributed (including the case of target not being
present in array).
In the best case analysis, we calculate lower bound on running time of an algorithm. We
must know the case that causes minimum number of operations to be executed. In the
linear search problem, the best case occurs when Target is present at the first location.
The number of operations in the best case is constant (not dependent on n). So time
complexity in the best case would be Θ(1)
15CS201J- DATA STRUCTURES UNIT-I
Binary Search
Binary Search is applied on the sorted array or list. In binary search, we first compare the
value with the elements in the middle position of the array. If the value is matched, then
we return the value. If the value is less than the middle element, then it must lie in the
lower half of the array and if it's greater than the element then it must lie in the upper
half of the array. We repeat this procedure on the lower (or upper) half of the array.
Binary Search is useful when there are large numbers of elements in an array.
In the above program logic, we are first comparing the middle number of the list, with the
target, if it matches we return. If it doesn't, we see whether the middle number is greater
than or smaller than the target.
If the Middle number is greater than the Target, we start the binary search again, but this
time on the left half of the list, that is from the start of the list to the middle, not beyond
that.
If the Middle number is smaller than the Target, we start the binary search again, but on
the right half of the list, that is from the middle of the list to the end of the list.
15CS201J- DATA STRUCTURES UNIT-I
Complexity Analysis
Let T(n) be the number of comparisons done in the worst case for an array of size n. For
the purposes of analysis, assume n is a power of 2, ie n = .
Then
// 2nd iteration
// 3rd iteration
...
// ith iteration
...
So we expect binary search to be significantly more efficient than linear search for large
values of n.
Bubble Sort
Bubble Sort is an algorithm which is used to sort N elements that are given in a memory
for eg: an Array with N number of elements. Bubble Sort compares all the element one by
one and sort them based on their values.
It is called Bubble sort, because with each iteration the smaller element in the list bubbles
up towards the first place, just like a water bubble rises up to the water surface.
Sorting takes place by stepping through all the data items one-by-one in pairs and
comparing adjacent data items and swapping each pair that is out of order.
15CS201J- DATA STRUCTURES UNIT-I
further. Because as per the above logic, the for loop will keep going for six iterations even
if the array gets sorted after the second iteration.
Hence we can insert a flag and can keep checking whether swapping of elements is taking
place or not. If no swapping is taking place that means the array is sorted and wew can
jump out of the for loop.
In Bubble Sort, n-1 comparisons will be done in 1st pass, n-2 in 2nd pass, n-3 in 3rd pass
and so on. So the total number of comparisons will be
(n-1)+(n-2)+(n-3)+.....+3+2+1
Sum = n(n-1)/2
i.e O(n2)
The main advantage of Bubble Sort is the simplicity of the algorithm. Space complexity
for Bubble Sort is O(1), because only single additional memory space is required
for temp variable
Best-case Time Complexity will be O(n), it is when the list is already sorted.
Insertion Sorting
It is a simple Sorting algorithm which sorts the array by shifting elements one by one.
Following are some of the important characteristics of Insertion Sort.
Now lets, understand the above simple insertion sort algorithm. We took an array with 6
integers. We took a variable key, in which we put each element of the array, in each pass,
starting from the second element, that is a[1].
Then using the while loop, we iterate, until j becomes equal to zero or we find an element
which is greater than key, and then we insert the key at that position.
In the above array, first we pick 1 as key, we compare it with 5(element before 1), 1 is
smaller than 5, we shift 1 before 5. Then we pick 6, and compare it with 5 and 1, no
shifting this time. Then 2 becomes the key and is compared with, 6 and 5, and then 2 is
placed after 1. And this goes on, until complete array gets sorted.
ARRAYS
Array
An Array is a data structure which can store a fixed-size sequential collection of elements
of the same type.
An array is used to store a collection of data, but it is often more useful to think of an
array as a collection of variables of the same type.
Instead of declaring individual variables, such as number0, number1, ..., and number99,
you declare one array variable such as numbers and use numbers[0], numbers[1], and ...,
numbers[99] to represent individual variables.
All arrays consist of contiguous memory locations. The lowest address corresponds to the
first element and the highest address to the last element.
15CS201J- DATA STRUCTURES UNIT-I
What is List???
List Structure::
Empty List: If Size of the list is Zero (i.e N=0), it is Empty List.
Precedes and Succeeds: For any list except empty list, we say that Ai+1 follows (or
succeeds) Ai (i<N) and that Ai-1 precedes Ai (i>1)
LIST Operations:
1. Add We can add new item/row in our list at first or at last or at any position.
2. Edit - If we entered wrong value for an item/row, don't worry we can edit/enter the
right value at any point of time.
3. Search - If we want to search for a value in a big List, We can use CTRL+F to search and
we can find the value which we need or position of row/item which contains the value
which we need.
1. Insert (x,p,L)
Insert x at position p in list L
If p = END(L), insert x at the end
If L does not have position p, result is undefined
2. Locate(x,L)
returns position of x on L
returns END(L) if x does not appear
3. Retrieve (p, L)
returns element at position p on L
undefined if p does not exist or p = END(L)
4. Delete (p, L)
delete element at position p in L
undefined if p = END(L) or does not exist
5. Next (p, L)
returns the position immediately following position p
6. Prev (p, L)
returns the position previous to p
7. Makenull (L)
causes L to become an empty list and returns position END(L)
8. First (L)
15CS201J- DATA STRUCTURES UNIT-I
Operations:
Fresh LIST::
1. Is Empty(LIST)
2. Is Full(LIST)
1. Free the 1st Position of the list by moving all the Element to one position
forward i.eNew Position=Current Position + 1.
1. Move all the elements except one in the 1st position to one position
backward i.eNew Position= Current Position -1
2. After the 1st step, element in the 1st position will be automatically
deleted.
3. else
1. Free the nth Position of the list by moving all Elements to one position
forwardexcept n-1,n-2,... 1 Position i.e move only from n to current size
position Elements. i.e New Position=Current Position + 1.
A linked-list is a sequence of data structures which are connected together via links.
Linked List is a sequence of links which contains items. Each link contains a connection to
another link. Linked list the second most used data structure after array. Following are
important terms to understand the concepts of Linked List.
As per above shown illustration, following are the important points to be considered.
Each Link carries a data field(s) and a Link Field called next.
Each Link is linked with its next link using its next link.
Last Link carries a Link as null to mark the end of the list.
Sparse matrix
In computer programming, a matrix can be defined with a 2-dimensional array. Any array with
'm' columns and 'n' rows represents a mXn matrix. There may be a situation in which a matrix
contains more number of ZERO values than NON-ZERO values. Such matrix is known as sparse
matrix.
When a sparse matrix is represented with 2-dimensional array, we waste lot of space to
represent that matrix. For example, consider a matrix of size 100 X 100 containing only 10 non-
15CS201J- DATA STRUCTURES UNIT-I
zero elements. In this matrix, only 10 spaces are filled with non-zero values and remaining
spaces of matrix are filled with zero. That means, totally we allocate 100 X 100 X 2 = 20000 bytes
of space to store this integer matrix. And to access these 10 non-zero elements we have to make
scanning for 10000 times.resentations
A sparse matrix can be represented by using TWO representations, those are as follows...
1. Triplet Representation
2. Linked Representation
Triplet Representation
In this representation, we consider only non-zero values along with their row and column index
values. In this representation, the 0th row stores total rows, total columns and total non-zero
values in the matrix.
For example, consider a matrix of size 5 X 6 containing 6 number of non-zero values. This matrix
can be represented as shown in the image...
In above example matrix, there are only 6 non-zero elements ( those are 9, 8, 4, 2, 5 & 2) and
matrix size is 5 X 6. We represent this matrix as shown in the above image. Here the first row in
the right side table is filled with values 5, 6 & 6 which indicates that it is a sparse matrix with 5
rows, 6 columns & 6 non-zero values. Second row is filled with 0, 4, & 9 which indicates the value
15CS201J- DATA STRUCTURES UNIT-I
in the matrix at 0th row, 4th column is 9. In the same way the remaining non-zero values also
follows the similar pattern.
Linked Representation
In linked representation, we use linked list data structure to represent a sparse matrix. In this
linked list, we use two different nodes namely header node and element node. Header node
consists of three fields and element node consists of five fields as shown in the image...
Consider the above same sparse matrix used in the Triplet representation. This sparse matrix
can be represented using linked representation as shown in the below image...
15CS201J- DATA STRUCTURES UNIT-I
In above representation, H0, H1,...,H5 indicates the header nodes which are used to represent
indexes. Remaining nodes are used to represent non-zero elements in the matrix, except the very
first node which is used to represent abstract information of the sparse matrix (i.e., It is a matrix
of 5 X 6 with 6 non-zero elements).
In this representation, in each row and column, the last node right field points to it's respective
header node.