AI/ML Algorithms - Deep Revision Notes
AI/ML Algorithms - Deep Revision Notes
1. Linear Regression - Predicting Continuous Values
-------------------------------------------
- Predicts continuous values (e.g., price, salary, temperature).
- Formula: Y = mX + c
- Minimizes Mean Squared Error (MSE).
- Real Example: Predicting used car price based on age.
2. Logistic Regression - Binary Classification
-------------------------------------------
- Predicts binary outcomes (yes/no).
- Uses sigmoid function to output probabilities between 0 and 1.
- Formula: P(y=1|x) = 1 / (1 + e^-(mx + c))
- Real Example: Predicting whether a tumor is malignant or benign.
3. Decision Tree - Rule-Based Learning
-------------------------------------------
- Splits data into paths based on feature conditions.
- Uses entropy or Gini index to decide splits.
- Real Example: Credit card fraud detection.
4. Random Forest - Ensemble of Decision Trees
-------------------------------------------
- Creates multiple trees and aggregates their predictions.
- Reduces overfitting, increases accuracy.
- Real Example: Customer churn prediction.
5. Support Vector Machine (SVM)
-------------------------------------------
- Finds the best boundary (hyperplane) separating two classes.
AI/ML Algorithms - Deep Revision Notes
- Maximizes margin between support vectors.
- Uses kernel tricks for non-linear data.
- Real Example: Face recognition.
6. K-Nearest Neighbors (KNN)
-------------------------------------------
- Classifies a point by majority vote among K nearest neighbors.
- Uses distance metrics like Euclidean distance.
- Real Example: Movie recommendation.
7. K-Means Clustering - Unsupervised Grouping
-------------------------------------------
- Groups data into K clusters based on similarity.
- Repeats centroid assignment until convergence.
- Real Example: Customer segmentation in marketing.
8. Naive Bayes - Probability-Based Classification
-------------------------------------------
- Uses Bayes' Theorem assuming feature independence.
- Fast and efficient for text data.
- Real Example: Email spam detection.
9. Artificial Neural Networks (ANN)
-------------------------------------------
- Models like the brain with layers of neurons.
- Learns using forward/backpropagation and gradient descent.
- Real Example: Digit recognition from images.
10. Principal Component Analysis (PCA)
-------------------------------------------
- Reduces data dimensions while preserving variance.
- Helps with visualization and speed in large datasets.
AI/ML Algorithms - Deep Revision Notes
- Real Example: Image compression or preprocessing.