🟣 ML + AI · Lesson 51

Logistic Regression

What is Logistic Regression?

Logistic Regression means logistic Regression is used for classification problems where output is a class such as yes/no or pass/fail.

In real programs, this topic helps in yes/no prediction. Learn the idea first, then type the program yourself and compare the output.

💡 At a Glance

Point	Details
Course Area	Machine Learning + AI Concepts used for prediction, classification, clustering and AI-based projects.
Main Use	yes/no prediction
Example File	`logistic-regression.py`
Practice Focus	Run, change values, and explain the output line by line.

Why should you learn this?

It is useful for yes/no prediction.
It connects with pass/fail or spam/not spam classification.
It improves your ability to read, write and debug Python programs.

Important Terms

These terms are used directly in this lesson. Understand them before memorising the code.

Term	Meaning
classification	Predicting a category or class.
probability	Chance value between 0 and 1.
binary output	binary output is an important term in this topic.
sigmoid	Function that converts values into probability-like output.
class label	class label is an important term in this topic.

Syntax / Basic Pattern

The simple pattern is: prepare data, apply the concept, then show the result.

Basic Pattern

from sklearn.linear_model import LogisticRegression
X = [[20], [35], [50], [65], [80], [95]]
y = [0, 0, 0, 1, 1, 1]   # 0 = Fail, 1 = Pass
model = LogisticRegression()
model.fit(X, y)
print("Predicted class:", model.predict([[72]])[0])

Complete Example Program

Python – logistic-regression.py

from sklearn.linear_model import LogisticRegression

X = [[20], [35], [50], [65], [80], [95]]
y = [0, 0, 0, 1, 1, 1]   # 0 = Fail, 1 = Pass

model = LogisticRegression()
model.fit(X, y)

print("Predicted class:", model.predict([[72]])[0])

Expected Output

Predicted class: 1

Program Explanation

from sklearn.linear_model import LogisticRegression imports ready-made features from a module/library.
X = [[20], [35], [50], [65], [80], [95]] stores a value in X.
y = [0, 0, 0, 1, 1, 1] # 0 = Fail, 1 = Pass stores a value in y.
model = LogisticRegression() stores a value in model.
model.fit(X, y) performs the next step of the program logic.
print("Predicted class:", model.predict([[72]])[0]) displays information or calculated result on the screen.

Where will you use it?

Yes/no prediction.
Pass/fail or spam/not spam classification.
Probability-based decisions.

Common Mistakes

Training and testing the model on the same data.
Using an algorithm without understanding the input features.
Reporting only accuracy without checking actual mistakes and limitations.

Practice Tasks

Type the program in logistic-regression.py and run it.
Change input values or sample data and observe the new output.
Create one example related to yes/no prediction.
Write 5 lines explaining the logic in your own words.

Summary

Logistic Regression is not a theory-only topic. You should be able to explain the meaning, write the example, run it successfully, and use it in a small practical program.