0% found this document useful (0 votes)
332 viewsComplete Python With NumPy & Pandas - Naresh-i-Technologies
Course Details
Uploaded by
ApurvaCopyright
© © All Rights Reserved
Available Formats
Download as PDF or read online on Scribd
0% found this document useful (0 votes)
332 viewsComplete Python With NumPy & Pandas - Naresh-i-Technologies
Course Details
Uploaded by
ApurvaCopyright
© © All Rights Reserved
Available Formats
Download as PDF or read online on Scribd
/ 13
ISO 9001:2015 Certified Company
i NARESH 7
technologies
In-Depth Core & Advanced
PY THON
with
NumPy « Pandas
In collaboration with
> Full Stack JAVA DEVELOPER Program
Nasscom’ fut
Full Stack DATA SCIENCE & Al Program
© 040 - 2374 6666
® info@nareshit.com
® www.nareshit.com Introduction to Languages
» What is Language?
» Types of languages
» Introduction to Translators
« Compiler
« Interpreter
» What is Scripting Language?
» Types of Script
» Programming Languages v/s
Scripting Languages
» Difference between Scripting and
Programming languages
® What is programming paradigm?
» Procedural programming paradigm
» Object oriented programming
paradigm
= NARESH.
Introduction to Python
® What is Python?
® WHY PYTHON?
» History
» Features - Dynamic, Interpreted,
Object oriented, Embeddable,
Extensible, Large standard libraries,
Free and Open source
® Why Python is General Language?
» Limitations of Python
© What is PSF?
» Python implementations
» Python applications
» Python versions
® PYTHON IN REALTIME INDUSTRY
® Difference between Python 2.x and 3.x
» Difference between Python 3.7 and 3.8
® Software Development Architectures
Python Software's
» Python Distributions
» Download &Python Installation Process
in Windows, Unix, Linux and Mac
» Online Python IDLE
» Python Real-time IDEs like Spyder,
Jupyter Note Book, PyCharm, Rodeo,
Visual Studio Code, ATOM, PyDevetc
Python Language Fundamentals
» Python Implementation
Alternatives/Flavors
» Keywords
» Identifiers
» Constants / Literals
» Data types
» Python VS JAVA
» Python Syntax Different Modes of Python
» Interactive Mode
» Scripting Mode
» Programming Elements
» Structure of Python program
» First Python Application
» Comments in Python
» Python file extensions
» Setting Path in Windows
» Edit and Run python program
without IDE
» Edit and Run python program
using IDEs
» INSIDE PYTHON
» Programmers View of Interpreter
» Inside INTERPRETER,
» What is Byte Code in PYTHON?
» Python Debugger
Python variables
» bytes Data Type
» byte array
» String Formatting in Python
» Math, Random, Secrets Modules
» Introduction
> Initialization of variables
» Local variables
» Global variables
» ‘global’ keyword
» Input and Output operations
» Data conversion functions - int(),
float), complex(), str(), chr(), ord()
«!NARES}
Operators
» Arithmetic Operators
© Comparison Operators
» Python Assignment Operators
» Logical Operators
» Bitwise Operators
» Shift operators
® Membership Operators
» Identity Operators
» Ternary Operator
© Operator precedence
» Difference between "is" vs “=="
Input & Output Operators
» Print
> Input
» Command line arguments
Control Statements
® Conditional control statements
olf
« if-else
¢ If-elif-else
« Nested-if
» Loop control statements
“for
¢ while
« Nested loops
» Branching statements
«@ Break
“ Continue
« Pass
« Return
» Case studies Data structures or Collections
» Introduction
» Importance of Data structures
» Applications of Data structures
» Types of Collections
« Sequence
> Strings , List, Tuple, range
« Non sequence
» Set, Frozen set, Dictionary
» Case studies
4 What is string
« Representation of Strings
« Processing elements using indexing
4 Processing elements using Iterators
4 Manipulation of String using
Indexing and Slicing
« String operators
4 Methods of String object
« String Formatting
« String functions
4 String Immutability
» Case studies
List Collection
» What is List
» Need of List collection
» Different ways of creating List
» List comprehension, List indices
» Processing elements of List through
Indexing and Slicing
» List object methods
» List is Mutable
» Mutable and Immutable elements of List
» Nested Lists, List_of_lists
» Hardcopy, shallowCopy and DeepCopy
» zip() in Python
» How to unzip?
» Python Arrays:
» Case studies
“NARESH! a
Tuple collection
© What is tuple?
» Different ways of creating Tuple
® Method of Tuple object
» Tuple is Immutable
» Mutable and Immutable elements
of Tuple
» Process tuple through Indexing
and Slicing
» List v/s Tuple
» Case studies
Set collection
» What is set?
» Different ways of creating set
» Difference between list and set
» Iteration Over Sets
» Accessing elements of set
» Python Set Methods
» Python Set Operations
» Union of sets
» functions and methods of set
» Python Frozen set
» Difference between set and frozenset ?
» Case study
Dictionary collection
> What is dictionary?
» Difference between list,
set and dictionary
» How to create a dictionary?
» PYTHON HASHING?
» Accessing values of dictionary
» Python Dictionary Methods
» Copying dictionary, Updating Dictionary
» Reading keys from Dictionary
® Reading values from Dictionary
» Reading items from Dictionary
® Delete Keys from the dictionary
» Sorting the Dictionary
» Python Dictionary Functions,
and methods
» Dictionary comprehension = || “NARESH?
1 | Packages
a . ® Organizing python project into packages
. » Types of packages - pre defined,
Functions user defined.
» What is Function? » Package v/s Folder
» Advantages of functions > _init_.py file
» Syntax and Writing function » Importing package
» Calling or Invoking function » PIP
» Classification of Functions » Introduction to PIP
« No arguments and No return values » Installing PIP
« With arguments and No return values » Installing Python packages
With arguments and With return values » Un installing Python packages
@ No arguments and With return values
Recursion ooPs
» Python argument type functions : » Procedural v/s Object oriented
« Default argument functions programming
@ Required(Positional) arguments function » Principles of OOP - Encapsulation,
« Keyword arguments function Abstraction (Data Hiding)
« Variable arguments functions » Classes and Objects
» ‘pass’ keyword in functions » How to define class in python
» Lambda functions/Anonymous functions —_» Types of variables - instance variables,
« map() class variables.
« filter() » Types of methods - instance methods,
« reduce() class method, static method
» Nested functions » Constructors.
» Non local variables, global variables » Object initialization
» Closures » ‘self’ reference variable
2
» Decorators ‘cls' reference variable
» Generators Access modifiers - private(_),
» Iterators protected(_), public
» Monkey patching » AT property class
» Property() object
Python Modules » Creating object properties using
» Importance of modular programming setaltr, getaltr functions
©
Encapsulation(Data Binding)
What is polymorphism?
» What is module
» Types of Modules - Pre defined,
User defined. Overriding
» User defined modules creation i) Method overriding
» Functions based modules ii) Constructor overriding
» Class based modules, Connecting modules —_¢ Overloading
> Import module, From ... import i) Method Overloading .
» Module alias / Renaming module ii) Constructor Overloading
® Built In properties of module iii) Operator Overloading || » Class re-usability
» Composition
» Aggregation
» Inheritance - single, multi level, multiple,
hierarchical and hybrid inheritance and
Diamond inheritance
» Constructors in inheritance
» Object class
» super()
» Runtime polymorphism
» Method overriding
» Method resolution order(MRO)
» Method overriding in Multiple
inheritance and Hybrid Inheritance
» Duck typing
» Concrete Methods in Abstract
Base Classes
» Difference between Abstraction &
Encapsulation
» Inner classes
» Introduction
» Writing inner class
» Accessing class level members of
inner class
» Accessing object level members of
inner class
» Local inner classes
» Complex inner classes
» Case studies
«NARESH 7°
Exception Handling & Types of Errors
© What is Exception?
© Why exception handling?
» Syntax error v/s Runtime error
» Exception codes - AttributeError,
ValueError, IndexError, TypeError...
« Handling exception - try except block
Try with multi except
«Handling multiple exceptions with
single except block
Finally block
4 Try-except-finally
«Try with finally
4 Case study of finally block
Raise keyword
« Custom exceptions / User defined
«exceptions
«Need to Custom exceptions
» Case studies
Regular expressions
» Understanding regular expressions
» String v/s Regular expression string
» “re” module functions
> Matcho)
» Search()
» Split()
» Findall()
» Compile’)
» Sub()
» Subn()
» Expressions using operators and symbols
» Simple character matches
» Special characters
» Character classes
» Mobile number extraction
» Mail extraction
» Different Mail ID patterns
» Data extraction
» Password extraction
» URL extraction .
» Vehicle number extraction a
» Case study a
.
File & Directory handling
» Introduction to files
> Opening file
» File modes
» Reading data from file
» Writing data into file
» Appending data into file
» Line count in File
» CSV module
» Creating CSV file
» Reading from CSV file
» Writing into CSV file
» Object serialization - pickle module
» XML parsing
» JSON parsing
Python Logging
» Logging Levels
» implement Logging
» Configure Log File in over writing Mode
» Timestamp in the Log Messages
» Python Program Exceptions to the
Log File
» Requirement of Our Own Customized
Logger
» Features of Customized Logger
Date & Time module
» How to use Date & Date Time class
» How to use Time Delta object
» Formatting Date and Time
» Calendar module
» Text calendar
» HTML calendar
«!NARES}
OS module
» Shell script commands
» Various OS operations in Python
» Python file system shell methods
» Creating files and directories
» Removing files and directories
» Shutdown and Restart system
» Renaming files and directories
» Executing system commands
Multi-threading & Multi Processing
» Introduction
© Multi tasking v/s Multi threading
» Threading module
» Creating thread-inheriting Thread class,
Using callable object
» Life cycle of thread
» Single threaded application
» Multi threaded application
» Can we call run() directly?
» Need to start() method
» Sleep)
» Joing
» Synchronization-Lock class- acquire(),
release() functions
» Case studies
Garbage collection
» Introduction
» Importance of Manual
garbage collection
» Self reference objects
garbage collection
» ‘gc’ module
» Collect() method
» Threshold function
» Case studies 1 | Data analytics modules
a » Numpy
= » Introduction
Python Data Base » Scipy
Communications(PDBC) » Introduction
» Introduction to DBMS applications » Arrays
» File system v/s DBMS » Datatypes
» Communicating with MySQL » Matrices
» Python - MySQL connector » N dimension arrays
© mysql.connector module » Indexing and Slicing
» connect() method » Pandas
» Oracle Database » Introduction
» Install cx_Oracle » Data Frames
» Cursor Object methods » Merge , Join, Concat
» execute() method » MatPlotLib introduction
» executeMany() method » Drawing plots
» fetchone() » Introduction to Machine learning
» fetchmany() » Types of Machine Learning?
» fetchall() » Introduction to Data science
» Static queries v/s Dynamic queries DJANGO
» Transaction management
» Case studies » Introduction to PYTHON Django
» What is Web framework?
Python - Network Programming » Why Frameworks?
» What is Sockets? » Define MVT Design Pattern
» What is Socket Programming? » Difference between MVC and MVT
» The socket Module |
» Server Socket Methods
» Connecting to a server
» Asimple server-client program
» Server
» Client
Tkinter & Turtle
» Introduction to GUI programming
» Tkinter module
» Tk class
» Components / Widgets
» Label, Entry, Button , Combo, Radio
» Types of Layouts
» Handling events
» Widgets properties
» Case studies PANDAS
Pandas - Introduction
Pandas - Environment Setup
Pandas - Introduction to Data Structures
» Dimension & Description
» Series
» DataFrame
» Data Type of Columns
» Panel
Pandas — Series i
» pandas.Series
» Create an Empty Series
» Create a Series f
» rom ndarray
» rom dict
» rom Scalar
» Accessing Data from Series
with Position
» Retrieve Data Using Label (Index)
Pandas - DataFrame
» pandas.DataFrame
» Create DataFrame
» Create an Empty DataFrame
» Create a DataFrame from Lists
» Create a DataFrame from Dict of
ndarrays / Lists
» Create a DataFrame from List of Dicts
» Create a DataFrame from Dict of Series
» Column Selection
» Column Addition
» Column Deletion
» Row Selection, Addition, and Deletion
Pandas - Panel
» pandas.Panel()
» Create Panel
» Selecting the Data from Panel
«NARESH
Pandas - Basic Functionality
» DataFrame Basic Functionality
Pandas - Descriptive Statistics
» Functions & Description
» Summarizing Data
Pandas - Function Application
» Table-wise Function Application
» Row or Column Wise Function
Application
® Element Wise Function Application
Pandas - Reindexing
» Reindex to Align with Other Objects
» Filling while ReIndexing
» Limits on Filling while Reindexing
» Renaming
Pandas - Iteration
» Iterating a DataFrame
» iteritems()
» iterrows()
» itertuples()
Pandas - Sorting
» By Label
» Sorting Algorithm Pandas - Working with Text Data
Pandas - Options and Customization
» get_option(param)
» set_option(param,value)
» reset_option(param)
» describe_option(param)
» option_context()
Pandas - Indexing and Selecting Data
> Jot)
» loc)
» ix)
» Use of Notations
Pandas - Statistical Functions
» Percent_change
» Covariance
» Correlation
» Data Ranking
Pandas - Window Functions
» .rollingQ) Function
» .expanding() Function
» ,ewm() Function
Pandas - Aggregations
» Applying Aggregations on DataFrame
Pandas - Missing Data
» Cleaning / Filling Missing Data
» Replace NaN with a Scalar Value
» Fill NA Forward and Backward
» Drop Missing Values
» Replace Missing (or) Generic Values
Pandas - GroupBy
» Split Data into Groups
» View Groups
» Iterating through Groups
» Select a Group
» Aggregations
» Transformations
m® Filtration
«NARESH 7°
Pandas - Merging/Joining
» Merge Using 'how' Argument
Pandas - Concatenation
» Concatenating Objects
» Time Series
Pandas - Date Functionality
Pandas - Timedelta
Pandas - Categorical Data
Object Creation
Pandas - Visualization
» Bar Plot
» Histograms
» Box Plots
» Area Plot
» Scatter Plot
» Pie Chart
Pandas - IO Tools
» read.csv
Pandas - Sparse Data
Pandas - Caveats & Gotchas
Pandas - Comparison with SQL NUMPY
NUMPY - INTRODUCTION
NUMPY - ENVIRONMENT
NUMPY - NDARRAY OBJECT
NUMPY - DATA TYPES
» Data Type Objects (dtype)
NUMPY -
ARRAY ATTRIBUTES | |
» ndarray.shape
» ndarray.ndim
» numpy.itemsize
> numpy.flags
NUMPY -
ARRAY CREATION ROUTINES
> numpy.empty
> numpy.zeros
» numpy.ones
NUMPY -
ARRAY FROM EXISTING DATA
> numpy.asarray
© numpy.frombuffer
» numpy.fromiter
NUMPY -
ARRAY FROM NUMERICAL RANGES
» numpy.arange
» numpy.linspace
» numpy.logspace
NUMPY - INDEXING & SLICING
NUMPY - ADVANCED INDEXING
» Integer indexing
» Boolean Array Indexing
«NARESH 7°
iechnotegcn Ml
i
oO
NUMPY - BROADCASTING
NUMPY - ITERATING OVER ARRAY
» Iteration
> Order
» Modifying Array Values
» External Loop
» Broadcasting Iteration
NUMPY - ARRAY MANIPULATION
numpy.reshape
numpy.ndarray.flat
numpy.ndarray,flatten
numpy.ravel
numpy.transpose
numpy.ndarray.T
numpy.swapaxes
numpy.rollaxis.
numpy. broadcast
numpy.broadcast_to
numpy.expand_dims
numpy.squeeze
numpy.concatenate
numpy.stack
numpy.hstack and numpy.vstack
numpy.split
numpy.hsplit and numpy.vsplit
numpy.resize
numpy.append
numpy.insert
numpy.delete .
numpy.unique
verre rr eee eer TT TTTes [| NARESH!
a NUMPY - COPIES & VIEWS
a » No Copy
. » View or Shallow Copy
NUMPY - BINARY OPERATORS » Deep Copy
» bitwise_and NUMPY - MATRIX LIBRARY
» bitwise_or
matlib.empty()
» numpy.invert() Hy
» left_shift » numpy.matlib.zeros()
> right shift » numpy.matlib.ones()
numpy.matlib.eye()
NUMPY - STRING FUNCTIONS numpy.matlib.identity()
NUMPY - MATHEMATICAL FUNCTIONS numpy.matlib.rand()
» Trigonometric Functions NUMPY - LINEAR ALGEBRA
» Functions for Rounding » numpy.dot()
NUMPY - ARITHMETIC OPERATIONS » numpy.vdot()
ve
» numpy.reciprocall) »> numpy.inner()
» numpy.power() » numpy.matmul()
» numpy.mod() » Determinant
NUMPY - STATISTICAL FUNCTIONS §—” "UMPY-linalg-solve()
» numpy.arin() and numpy.amax() NUMPY - MATPLOTLIB
» numpy.ptp0) » Sine Wave Plot
» numpy.percentile() » subplot
» numpy.median() » bar()
» numpy.mean()
» numpy.average() NUMPY -
» Standard Deviation oH HISTOGRAM USING MATPLOTLIB
» Variance » numpy.histogram()
NUMPY - SORT, » ple
SEARCH & COUNTING FUNCTIONS NUMPY - I/O WITH NUMPY
» numpy.sort() » numpy.save()
» numpy.argsort() » savetxt()
» numpy.lexsort()
» numpy.argmax() and numpy.argmin()
» numpy.nonzero() . 4 <>
» numpy.where()