HomeMachine LearningSupervised Learning: Classification and Regression Problems

Supervised Learning: Classification and Regression Problems

In supervised learning, an information (called label) is attached to an object/observation (called Training data). The training data is consist of a set of training examples/labels.  Each example is a pair consisting of an input object and the desired output value.

Input object is typically a vector and the desired output is called as the supervisory signal.

Supervised Learning:

The process is to learn and predict for observations without labels.
– X, Y (Pre classified training examples)
– Given an observation X, what is the best label for Y?

supervised learning
Source: NPTEL

Here, in this machine learning algorithm, we provide the information such as (X, Y), where every Y is a label for corresponding X.
With the help of different pairs of (X, Y) we create a model, after the training and tunning of the model, we provide new input to the model to find the best Yt for the input Xt.

It is called supervised learning because the process of an algorithm learning from the training dataset can be thought of as a Supervisor supervising the learning process.


Supervised Learning
Source: NPTEL

Above image shows the example, though it can be further divided into Classification and Regression problems.

Classification Problems: In this type of Supervised Learning, the output is categorical. Such as,
1. True/False
2. Buy/Sell
3. Missing/Found
4. Dog/Cat
5. Orange/Banana.

Regression Problems: In this type of Supervised Learning, the output is a real value. Such as,
1. Height
2. Dollars
3. Weight
4. Temperature
5. Pointers
6. Salary

Some of the examples of Supervised Learning algorithms are:
• Decision trees
• Support vector machine (SVM)
• k-Nearest Neighbors
• Naive Bayes
• Random forest
• Linear regression
• polynomial regression
• SVM for regression


Supervised Learning:

– X, Y (Pre classified training examples).
– Given an observation X, what is the best label for Y?

Classification: Assign a label.

Regression: Predict a continuous numerical value.

Satyam Prasad Tiwari
Satyam Prasad Tiwari
A coder, who is enthusiastic about writing.


  1. […] Supervised Learning -Learning is done under the supervision of supervisor or expert. For example, pattern recognition, it involves a teacher or trainer which gives the answer to ANN and then ANN comes up with guesses while recognizing. Then, the network compares its guesses with teacher’s correct answer and makes adjustment accordingly to obtain the desired output by removing errors. […]

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Recent Articles