🟣 ML + AI · Lesson 59

Model Evaluation Metrics

What is Model Evaluation?

Model Evaluation means model evaluation checks how well a machine learning model performs on unseen data.

In real programs, this topic helps in checking model quality. Learn the idea first, then type the program yourself and compare the output.

💡 At a Glance

Point	Details
Course Area	Machine Learning + AI Concepts used for prediction, classification, clustering and AI-based projects.
Main Use	checking model quality
Example File	`model-evaluation.py`
Practice Focus	Run, change values, and explain the output line by line.

Why should you learn this?

It is useful for checking model quality.
It connects with comparing predictions with actual values.
It improves your ability to read, write and debug Python programs.

Important Terms

These terms are used directly in this lesson. Understand them before memorising the code.

Term	Meaning
accuracy	Fraction of correct predictions.
precision	How many predicted positives were actually positive.
recall	How many actual positives were found by the model.
confusion matrix	Table comparing actual and predicted classes.
MAE	MAE is an important term in this topic.

Syntax / Basic Pattern

The simple pattern is: prepare data, apply the concept, then show the result.

Basic Pattern

from sklearn.metrics import accuracy_score, confusion_matrix
y_true = [1, 0, 1, 1, 0]
y_pred = [1, 0, 0, 1, 0]
print("Accuracy:", accuracy_score(y_true, y_pred))
print(confusion_matrix(y_true, y_pred))

Complete Example Program

Python – model-evaluation.py

from sklearn.metrics import accuracy_score, confusion_matrix

y_true = [1, 0, 1, 1, 0]
y_pred = [1, 0, 0, 1, 0]

print("Accuracy:", accuracy_score(y_true, y_pred))
print(confusion_matrix(y_true, y_pred))

Expected Output

Accuracy: 0.8 [[2 0] [1 2]]

Program Explanation

from sklearn.metrics import accuracy_score, confusion_matrix imports ready-made features from a module/library.
y_true = [1, 0, 1, 1, 0] stores a value in y_true.
y_pred = [1, 0, 0, 1, 0] stores a value in y_pred.
print("Accuracy:", accuracy_score(y_true, y_pred)) displays information or calculated result on the screen.
print(confusion_matrix(y_true, y_pred)) displays information or calculated result on the screen.

Where will you use it?

Checking model quality.
Comparing predictions with actual values.
Selecting a useful model.

Common Mistakes

Training and testing the model on the same data.
Using an algorithm without understanding the input features.
Reporting only accuracy without checking actual mistakes and limitations.

Practice Tasks

Type the program in model-evaluation.py and run it.
Change input values or sample data and observe the new output.
Create one example related to checking model quality.
Write 5 lines explaining the logic in your own words.

Summary

Model Evaluation is not a theory-only topic. You should be able to explain the meaning, write the example, run it successfully, and use it in a small practical program.

Model Evaluation क्या है?

Model Evaluation ka matlab hai: Model evaluation checks how well a machine learning model performs on unseen data. Simple words me, ye topic practical Python programs likhne me direct use hota hai.

Is topic ko sirf definition ke liye nahi, balki checking model quality jaise real examples ke liye practice karein.

यह क्यों सीखना जरूरी है?

Ye checking model quality me kaam aata hai.
Ye comparing predictions with actual values se bhi connected hai.
Isse aap code ka output aur errors better samajh paate hain.

Important Terms

Term	Meaning
accuracy	Fraction of correct predictions.
precision	How many predicted positives were actually positive.
recall	How many actual positives were found by the model.
confusion matrix	Table comparing actual and predicted classes.
MAE	MAE is an important term in this topic.

Syntax / Basic Pattern

Basic idea: pehle data तैयार करें, phir Python logic apply करें, aur finally result display करें.

Basic Pattern

from sklearn.metrics import accuracy_score, confusion_matrix
y_true = [1, 0, 1, 1, 0]
y_pred = [1, 0, 0, 1, 0]
print("Accuracy:", accuracy_score(y_true, y_pred))
print(confusion_matrix(y_true, y_pred))

Complete Example Program

Python – model-evaluation.py

from sklearn.metrics import accuracy_score, confusion_matrix

y_true = [1, 0, 1, 1, 0]
y_pred = [1, 0, 0, 1, 0]

print("Accuracy:", accuracy_score(y_true, y_pred))
print(confusion_matrix(y_true, y_pred))

Expected Output

Accuracy: 0.8 [[2 0] [1 2]]

Program Explanation

from sklearn.metrics import accuracy_score, confusion_matrix imports ready-made features from a module/library.
y_true = [1, 0, 1, 1, 0] stores a value in y_true.
y_pred = [1, 0, 0, 1, 0] stores a value in y_pred.
print("Accuracy:", accuracy_score(y_true, y_pred)) displays information or calculated result on the screen.
print(confusion_matrix(y_true, y_pred)) displays information or calculated result on the screen.

Practical Uses

Checking model quality.
Comparing predictions with actual values.
Selecting a useful model.

Common Mistakes

Training and testing the model on the same data.
Using an algorithm without understanding the input features.
Reporting only accuracy without checking actual mistakes and limitations.

Practice Tasks

Program ko model-evaluation.py file me type karke run karein.
Values change karke output compare karein.
checking model quality par ek छोटा example banayen.
Logic ko apne words me 5 lines me likhein.

सारांश

Model Evaluation ko tab complete maanenge jab aap iska meaning, example, output aur practical use clearly explain kar saken.

← Back to Python Tutorial