Gyan Ganga Institute of Technology and Sciences,Jabalpur
Computer Science and Engineering
CSE-Data Science, IV semester DS406
PYTHON FOR DATA SCIENCE
LAB MANUAL
List of Experiments
1. Write a python program to reverse a string.
2. Write a python program to perform following operation using lists:
a. append element in the list
b. compare two lists
c. convert list to dictionary
3. Write a Program to transpose a table/pandas data frame.
4. Write a NumPy program to create a 3x3 matrix with values ranging from 2 to 10.
5. Write a python program to perform following operation on Data Frame:
a. Create two different Data Frames and perform the merging operations on it.
b. Create two different Data Frames and perform the grouping operations on it.
c. Create two different Data Frames and perform the concatenating operations on it
6. Program to check regular expression pattern is matching with string or not in Python
7. Create a sample dataset and apply the following aggregation function on it:
1. mean(), median()
2. min(), max()
3. std(), var()
4. sum()
8. Write a python program to get row wise proportion using crosstab () function.
9. Write a python program to display a bar chart of the popularity of programming languages.
10. Write a Python program to create bar plot of scores by group and gender. Use multiple X
values on the same chart for men and women.
Sample Data:
Means (men) = (22, 30, 35, 35, 26)
Means (women) = (25, 32, 30, 35, 29)
Experiment 1
Aim: Write a python program to reverse a string.
def reverse_string(str):
revstr=""
index=len(str)
while index>0:
revstr=revstr+str[index-1]
index=index-1
return revstr
print(reverse_string("Welcome"))
Output:
emocleW
Experiment 2
Aim: Write a python program to perform following operation using lists:
1. append element in the list
2. compare two lists
3. convert list to dictionary
# appending the element in the list
list1=[1,2,3,4,5]
for i in list1:
print(i)
list2=['a','b','c','d','e']
list1.append(list2)
print(list1)
Output:
[1, 2, 3, 4, 5, ['a', 'b', 'c', 'd', 'e']]
# comparing two lists
import collections
l1 = [10, 20, 30, 40, 50]
l2 = [10, 20, 30, 50, 40, 70]
l3 = [50, 10, 30, 20, 40]
l1.sort()
l2.sort()
l3.sort()
if l1 == l3:
print ("The lists l1 and l3 are the same")
else:
print ("The lists l1 and l3 are not the same")
if l1 == l2:
print ("The lists l1 and l2 are the same")
else:
print ("The lists l1 and l2 are not the same")
Output:
The lists l1 and l3 are the same
The lists l1 and l2 are not the same
# convert list to dictionary
index = [1,2,3]
languages = [‘a’, ’b’, ’c’]
dictionary={k:v for k, v in zip(index, languages)}
print(dictionary)
Output:
{1: 'a', 2: 'b', 3: 'c'}
Experiment 3
Aim: Write a Program to transpose a table/pandas data frame.
import numpy as np
import pandas as pd
d1 = {'c1': [2, 3], 'c2': [4, 5]}
df1 = pd.DataFrame(data=d1)
print(df1)
df1Transpose=df1.T
print(df1_transpose)
Output:
c1 c2
0 2 4
1 3 5
0 1
c1 2 3
c2 4 5
Experiment 4
Aim: Write a NumPy program to create a 3x3 matrix with values ranging from 2 to
10.
import numpy as np
x = np.arange(2, 11).reshape(3,3)
print(x)
Output:
[[ 2 3 4]
[ 5 6 7]
[ 8 9 10]]
Experiment 5
Aim: Write a python program to perform following operation on Data Frame:
a. Create two different Data Frames and perform the merging operations on it.
b. Create two different Data Frames and perform the grouping operations on it.
c. Create two different Data Frames and perform the concatenating operations on it
a. Create two different Data Frames and perform the merging operations on it.
df1 = pd.DataFrame(
{
"A": ["A0", "A1", "A2", "A3"],
"B": ["B0", "B1", "B2", "B3"],
"C": ["C0", "C1", "C2", "C3"],
"D": ["D0", "D1", "D2", "D3"],
},
index=[0, 1, 2, 3],
)
df2 = pd.DataFrame(
{
"A": ["A4", "A5", "A6", "A7"],
"B": ["B4", "B5", "B6", "B7"],
"C": ["C4", "C5", "C6", "C7"],
"D": ["D4", "D5", "D6", "D7"],
},
index=[4, 5, 6, 7],
)
df3 = pd.DataFrame(
{
"A": ["A8", "A9", "A10", "A11"],
"B": ["B8", "B9", "B10", "B11"],
"C": ["C8", "C9", "C10", "C11"],
"D": ["D8", "D9", "D10", "D11"],
},
index=[8, 9, 10, 11],
)
frames = [df1, df2, df3]
result = pd.concat(frames)
Output:
A B C D
0 A0 B0 C0 D0
1 A1 B1 C1 D1
2 A2 B2 C2 D2
3 A3 B3 C3 D3
4 A4 B4 C4 D4
5 A5 B5 C5 D5
6 A6 B6 C6 D6
7 A7 B7 C7 D7
8 A8 B8 C8 D8
9 A9 B9 C9 D9
10 A10 B10 C10 D10
11 A11 B11 C11 D11
Create two different Data Frames and perform the grouping operations on it:
Any groupby operation involves one of the following operations on the original object.
They are −
Splitting the Object
Applying a function
Combining the results
In many situations, we split the data into sets and we apply some functionality on each
subset. In the apply functionality, we can perform the following operations −
Aggregation − computing a summary statistic
Transformation − perform some group-specific operation
Filtration − discarding the data with some condition
Example:
Split Data into Groups
Pandas object can be split into any of their objects. There are multiple ways to split an
object like −
obj.groupby('key')
obj.groupby(['key1','key2'])
obj.groupby(key,axis=1)
import pandas as pd
ipl_data = {'Team': ['Riders', 'Riders', 'Devils', 'Devils', 'Kings',
'kings', 'Kings', 'Kings', 'Riders', 'Royals', 'Royals', 'Riders'],
'Rank': [1, 2, 2, 3, 3,4 ,1 ,1,2 , 4,1,2],
'Year': [2014,2015,2014,2015,2014,2015,2016,2017,2016,2014,2015,2017],
'Points':[876,789,863,673,741,812,756,788,694,701,804,690]}
df = pd.DataFrame(ipl_data)
grouped = df.groupby('Year')
for name,group in grouped:
print (name)
print (group)
Output:
2014
Team Rank Year Points
0 Riders 1 2014 876
2 Devils 2 2014 863
4 Kings 3 2014 741
9 Royals 4 2014 701
2015
Team Rank Year Points
1 Riders 2 2015 789
3 Devils 3 2015 673
5 kings 4 2015 812
10 Royals 1 2015 804
2016
Team Rank Year Points
6 Kings 1 2016 756
8 Riders 2 2016 694
2017
Team Rank Year Points
7 Kings 1 2017 788
11 Riders 2 2017 690
Using the get_group() method, we can select a single group.
# import the pandas library
import pandas as pd
ipl_data = {'Team': ['Riders', 'Riders', 'Devils', 'Devils', 'Kings',
'kings', 'Kings', 'Kings', 'Riders', 'Royals', 'Royals', 'Riders'],
'Rank': [1, 2, 2, 3, 3,4 ,1 ,1,2 , 4,1,2],
'Year': [2014,2015,2014,2015,2014,2015,2016,2017,2016,2014,2015,2017],
'Points':[876,789,863,673,741,812,756,788,694,701,804,690]}
df = pd.DataFrame(ipl_data)
grouped = df.groupby('Year')
print (grouped.get_group(2014))
Output:
Team Rank Year Points
0 Riders 1 2014 876
2 Devils 2 2014 863
4 Kings 3 2014 741
9 Royals 4 2014 701
Aggregations
An aggregated function returns a single aggregated value for each group. Once the group
by object is created, several aggregation operations can be performed on the grouped
data.
An obvious one is aggregation via the aggregate or equivalent agg method −
# import the pandas library
import pandas as pd
import numpy as np
ipl_data = {'Team': ['Riders', 'Riders', 'Devils', 'Devils', 'Kings',
'kings', 'Kings', 'Kings', 'Riders', 'Royals', 'Royals', 'Riders'],
'Rank': [1, 2, 2, 3, 3,4 ,1 ,1,2 , 4,1,2],
'Year': [2014,2015,2014,2015,2014,2015,2016,2017,2016,2014,2015,2017],
'Points':[876,789,863,673,741,812,756,788,694,701,804,690]}
df = pd.DataFrame(ipl_data)
#Aggregations using agg() function
grouped = df.groupby('Year')
print (grouped['Points'].agg(np.mean))
grouped = df.groupby('Team')
# to see the size of each group is by applying the size() function
print (grouped.agg(np.size))
# pass a list or dict of functions to do aggregation with, and generate DataFrame as
output
print (grouped['Points'].agg([np.sum, np.mean, np.std]))
# Transformation
grouped = df.groupby('Team')
score = lambda x: (x - x.mean()) / x.std()*10
print (grouped.transform(score))
Output:
Year
2014 795.25
2015 769.50
2016 725.00
2017 739.00
Name: Points, dtype: float64
Rank Year Points
Team
Devils 2 2 2
Kings 3 3 3
Riders 4 4 4
Royals 2 2 2
kings 1 1 1
sum mean std
Team
Devils 1536 768.000000 134.350288
Kings 2285 761.666667 24.006943
Riders 3049 762.250000 88.567771
Royals 1505 752.500000 72.831998
kings 812 812.000000 NaN
Rank Year Points
0 -15.000000 -11.618950 12.843272
1 5.000000 -3.872983 3.020286
2 -7.071068 -7.071068 7.071068
3 7.071068 7.071068 -7.071068
4 11.547005 -10.910895 -8.608621
5 NaN NaN NaN
6 -5.773503 2.182179 -2.360428
7 -5.773503 8.728716 10.969049
8 5.000000 3.872983 -7.705963
9 7.071068 -7.071068 -7.071068
10 -7.071068 7.071068 7.071068
11 5.000000 11.618950 -8.157595
Experiment 6
Aim: Program to check regular expression pattern is matching with string or not
in Python
#Need module 're' for regular expression
import re
search_string = "Hello-World"
pattern = "World"
match = re.match(pattern, search_string)
#If-statement after search() tests if it succeeded
if match:
print("regex matches: ", match.group())
else:
print('pattern not found')
Output:
pattern not found
Experiment 7
Aim: Create a sample dataset and apply the following aggregation function on it:
1. mean(), median()
2. min(), max()
3. std(), var()
4. sum()
import pandas as pd
import numpy as np
raw_data = {'name': ['Willard Morris', 'Al Jennings', 'Omar Mullins', 'Spencer McDaniel'],
'age': [20, 19, 22, 21],
'favorite_color': ['blue', 'blue', 'yellow', "green"],
'grade': [88, 92, 95, 70]}
df = pd.DataFrame(raw_data, index = ['Willard Morris', 'Al Jennings', 'Omar Mullins',
'Spencer McDaniel'])
print(df)
print(df['grade'].mean())
print(df['grade'].median())
print(df['grade'].sum())
print(df['grade'].var())
print(df['grade'].std())
print(df['grade'].max())
print(df['grade'].min())
Output:
name age favorite_color grade
Willard Morris Willard Morris 20 blue 88
Al Jennings Al Jennings 19 blue 92
Omar Mullins Omar Mullins 22 yellow 95
Spencer McDaniel Spencer McDaniel 21 green 70
86.25
90.0
345
125.58333333333333
11.206396982676159
95
70
Experiment 8
Aim: Write a python program to get row wise proportion using crosstab () function.
import pandas as pd
import numpy as np
#Create a DataFrame
d={
'Name':['Alisa','Bobby','Cathrine','Alisa','Bobby','Cathrine',
'Alisa','Bobby','Cathrine','Alisa','Bobby','Cathrine'],
'Exam':['Semester 1','Semester 1','Semester 1','Semester 1','Semester 1','Semester 1',
'Semester 2','Semester 2','Semester 2','Semester 2','Semester 2','Semester 2'],
'Subject':['Mathematics','Mathematics','Mathematics','Science','Science','Science',
'Mathematics','Mathematics','Mathematics','Science','Science','Science'],
'Result':['Pass','Pass','Fail','Pass','Fail','Pass','Pass','Fail','Fail','Pass','Pass','Fail']}
df = pd.DataFrame(d,columns=['Name','Exam','Subject','Result'])
pd.crosstab(df.Subject, df.Result,margins=True)
# Two way frequency table or cross table: Get proportion using crosstab() function
#### Rename the index and columns
my_crosstab.columns = ["Fail" , "Pass" , "rowtotal"]
my_crosstab.index= ["Mathematics","Science","coltotal"]
#Get row wise proportion using crosstab() function
#### Get the row proportion
print(my_crosstab.index(my_crosstab["rowtotal"],axis=0))
Output:
Experiment 9
Aim: Write a python program to display a bar chart of the popularity of
programming languages.
import matplotlib.pyplot as plt
x = ['Java', 'Python', 'PHP', 'JavaScript', 'C#', 'C++']
popularity = [22.2, 17.6, 8.8, 8, 7.7, 6.7]
x_pos = [i for i, _ in enumerate(x)]
plt.bar(x_pos, popularity, color=(0.4, 0.6, 0.8, 1.0), edgecolor='blue')
plt.xlabel("Languages")
plt.ylabel("Popularity")
plt.title("PopularitY of Programming Language\n" + "Worldwide, Oct 2017 compared to a
year ago")
plt.xticks(x_pos, x)
# Turn on the grid
plt.minorticks_on()
plt.grid(which='major', linestyle='-', linewidth='0.5', color='red')
# Customize the minor grid
plt.grid(which='minor', linestyle=':', linewidth='0.5', color='black')
plt.show()
Output:
Experiment 10
Aim: . Write a Python program to create bar plot of scores by group and gender. Use
multiple X values on the same chart for men and women.
Sample Data:
Means (men) = (22, 30, 35, 35, 26)
Means (women) = (25, 32, 30, 35, 29)
import numpy as np
import matplotlib.pyplot as plt
# data to plot
n_groups = 5
men_means = (22, 30, 33, 30, 26)
women_means = (25, 32, 30, 35, 29)
# create plot
fig, ax = plt.subplots()
index = np.arange(n_groups)
bar_width = 0.35
opacity = 0.8
rects1 = plt.bar(index, men_means, bar_width,
alpha=opacity,
color='g',
label='Men')
rects2 = plt.bar(index + bar_width, women_means, bar_width,
alpha=opacity,
color='r',
label='Women')
plt.xlabel('Person')
plt.ylabel('Scores')
plt.title('Scores by person')
plt.xticks(index + bar_width, ('G1', 'G2', 'G3', 'G4', 'G5'))
plt.legend()
plt.tight_layout()
plt.show()
Output:
