---
title: How the Main Machine Learning Concepts Are Connected
description: "Machine Learning Terminology and Basic Concepts # Machine Learning Terminology and Basic Concepts Before learning Machine Learning algorithms such as **Linear Regression, Logistic Regression, KNN, Decision Trees, and Neural Networks**, it is important to understand the basic terminology used in…"
url: "https://csestudy247.com/docs/how-the-main-machine-learning-concepts-are-connected/"
updated: "2026-09-24"
category: ML
---

# How the Main Machine Learning Concepts Are Connected

Machine Learning Terminology and Basic Concepts

# Machine Learning Terminology and Basic Concepts

Before learning Machine Learning algorithms such as **Linear Regression, Logistic Regression, KNN, Decision Trees, and Neural Networks**, it is important to understand the basic terminology used in Machine Learning.

Terms such as **dataset, features, target, samples, training data, testing data, model, prediction, parameters, and hyperparameters** appear in almost every Machine Learning project.

The following diagram connects the most important concepts from the dataset to the final prediction.

 flowchart TD A\["📊 Dataset"\] A --> B\["Samples"\] A --> C\["Features X"\] A --> D\["Target y"\] C --> E\["🏋️ Training Data"\] D --> E E --> F\["⚙️ ML Algorithm"\] F --> G\["🔢 Learn Parameters"\] F --> H\["⚙️ Hyperparameters"\] G --> I\["🧠 Trained Model"\] H --> I I --> J\["📥 New Input"\] J --> K\["🔮 Prediction"\] style A fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style B fill:#eef6ff,stroke:#005cbf,stroke-width:2px style C fill:#eef6ff,stroke:#005cbf,stroke-width:2px style D fill:#fff0f5,stroke:#e91e63,stroke-width:2px style E fill:#fff7e6,stroke:#ff9800,stroke-width:2px style F fill:#eef6ff,stroke:#005cbf,stroke-width:2px style G fill:#fff0f5,stroke:#e91e63,stroke-width:2px style H fill:#fff0f5,stroke:#e91e63,stroke-width:2px style I fill:#edf8ef,stroke:#28a745,stroke-width:2px style J fill:#eef6ff,stroke:#005cbf,stroke-width:2px style K fill:#edf8ef,stroke:#28a745,stroke-width:2px

---

## 2. What Is a Dataset?

### Simple Explanation

  **Dataset** means a collection of data that is used for training, testing, or analyzing a Machine Learning model.

### Example: Student Placement Dataset

Suppose we have the following student data:

| IQ | CGPA | Study Hours | Placement |
| --- | --- | --- | --- |
| 90 | 8.2 | 5 | Yes |
| 75 | 6.5 | 2 | No |
| 110 | 9.1 | 6 | Yes |

The complete table is called a **dataset**.

  **Exam Definition:** A dataset is a collection of data samples or observations used for training, testing, or evaluating a Machine Learning system.   **Remember:** Dataset = Collection of Data

---

## 3. What Are Features?

### Simple Explanation

  **Features** are the input variables given to a Machine Learning model to make a prediction.

### Example

In the student placement dataset, the following columns are features:

- IQ
- CGPA
- Study Hours

 flowchart TD A\["📥 Features X"\] A --> B\["IQ"\] A --> C\["CGPA"\] A --> D\["Study Hours"\] B --> E\["🧠 ML Model"\] C --> E D --> E E --> F\["🎯 Prediction"\] style A fill:#eef6ff,stroke:#005cbf,stroke-width:2px style B fill:#eef6ff,stroke:#005cbf,stroke-width:2px style C fill:#eef6ff,stroke:#005cbf,stroke-width:2px style D fill:#eef6ff,stroke:#005cbf,stroke-width:2px style E fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style F fill:#edf8ef,stroke:#28a745,stroke-width:2px  **Exam Definition:** A feature is an input variable or measurable characteristic used by a Machine Learning model to make predictions.   **Remember:** Features = Input Variables

---

## 4. What Is a Target or Label?

### Simple Explanation

  The **target** is the output that the Machine Learning model is trying to predict. In classification problems, the target is also commonly called the **label**.

### Example

For our student placement problem:

- IQ → Feature
- CGPA → Feature
- Study Hours → Feature
- **Placement → Target / Label**

 flowchart TD A\["IQ"\] B\["CGPA"\] C\["Study Hours"\] A --> D\["🧠 ML Model"\] B --> D C --> D D --> E\["🎯 Placement"\] E --> F\["Yes / No"\] style A fill:#eef6ff,stroke:#005cbf,stroke-width:2px style B fill:#eef6ff,stroke:#005cbf,stroke-width:2px style C fill:#eef6ff,stroke:#005cbf,stroke-width:2px style D fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style E fill:#fff0f5,stroke:#e91e63,stroke-width:2px style F fill:#edf8ef,stroke:#28a745,stroke-width:2px  **Exam Definition:** The target is the output variable that a Machine Learning model learns to predict.   **Remember:** Features = Input

 Target = Output

---

## 5. What Is a Sample?

### Simple Explanation

  A **sample** is one individual observation, example, or data point in a dataset.

### Example

| IQ | CGPA | Study Hours | Placement |
| --- | --- | --- | --- |
| **90** | **8.2** | **5** | **Yes** |
| 75 | 6.5 | 2 | No |

The first row represents **one sample**.

If a dataset contains 10,000 rows, it generally contains **10,000 samples**.

  **Exam Definition:** A sample is a single observation, example, or data point in a dataset.   **Remember:** Sample = One Data Point / One Row

---

## 6. What Is Training Data?

### Simple Explanation

  **Training data** is the portion of the dataset used to teach the Machine Learning model. The model learns patterns and relationships from this data.  flowchart TD A\["📊 Complete Dataset"\] A --> B\["🏋️ Training Data"\] B --> C\["⚙️ ML Algorithm"\] C --> D\["🧠 Trained Model"\] style A fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style B fill:#fff7e6,stroke:#ff9800,stroke-width:2px style C fill:#eef6ff,stroke:#005cbf,stroke-width:2px style D fill:#edf8ef,stroke:#28a745,stroke-width:2px

### Example

Suppose we have 1,000 samples:

- 800 samples → Training
- 200 samples → Testing

  **Exam Definition:** Training data is the portion of a dataset used to train a Machine Learning model and learn patterns from the data.   **Remember:** Training Data → Learn

---

## 7. What Is Testing Data?

### Simple Explanation

  **Testing data** is a separate portion of the dataset used to evaluate the performance of a trained Machine Learning model on unseen data.  flowchart TD A\["🏋️ Training Data"\] B\["🧠 Trained Model"\] C\["🧪 Testing Data"\] D\["📊 Evaluation"\] A --> B B --> C C --> D style A fill:#fff7e6,stroke:#ff9800,stroke-width:2px style B fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style C fill:#eef6ff,stroke:#005cbf,stroke-width:2px style D fill:#edf8ef,stroke:#28a745,stroke-width:2px  📌 Example

Dataset = 1,000 samples

Training = 800 samples

Testing = 200 samples

The model learns from the training samples and is evaluated using the testing samples.

   **Exam Definition:** Testing data is a separate portion of data used to evaluate a trained model on previously unseen examples.   **Remember:** Training Data → Learn

 Testing Data → Evaluate

---

## 8. What Is a Machine Learning Model?

### Simple Explanation

  A **Machine Learning model** is a learned representation of patterns or relationships in training data that can be used to make predictions on new data.  flowchart TD A\["📊 Training Data"\] B\["⚙️ Learning Algorithm"\] C\["🧠 Trained Model"\] A --> B B --> C style A fill:#fff7e6,stroke:#ff9800,stroke-width:2px style B fill:#eef6ff,stroke:#005cbf,stroke-width:2px style C fill:#edf8ef,stroke:#28a745,stroke-width:2px

### Example

Suppose we want to predict house prices. The model may learn relationships between:

- House size
- Number of rooms
- Location
- House age

and the corresponding house price.

  **Exam Definition:** A model is a learned mathematical or computational representation of patterns in data used to make predictions.

---

## 9. What Is a Prediction?

### Simple Explanation

  A **prediction** is the output produced by a trained Machine Learning model when new input data is provided.  flowchart TD A\["📥 New Data"\] B\["🧠 Trained Model"\] C\["🔮 Prediction"\] A --> B B --> C style A fill:#eef6ff,stroke:#005cbf,stroke-width:2px style B fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style C fill:#edf8ef,stroke:#28a745,stroke-width:2px

### Example: Student Placement

  📌 New Student

- IQ = 95
- CGPA = 8.0
- Study Hours = 5

The trained model processes these features.

**Prediction → Placement = Yes**

   **Exam Definition:** Prediction is the output generated by a trained Machine Learning model for a given input.

---

## 10. What Are Parameters?

### Simple Explanation

  **Parameters** are values that a Machine Learning model learns automatically from the training data.

### Example: Linear Regression

Consider the equation:

**y = mx + c**

During training, the model learns values such as:

- **m** → coefficient / slope
- **c** → intercept

These learned values are parameters.

 flowchart TD A\["📊 Training Data"\] B\["⚙️ Training"\] C\["🔢 Learn Parameters"\] D\["🧠 Model"\] A --> B B --> C C --> D style A fill:#fff7e6,stroke:#ff9800,stroke-width:2px style B fill:#eef6ff,stroke:#005cbf,stroke-width:2px style C fill:#fff0f5,stroke:#e91e63,stroke-width:2px style D fill:#edf8ef,stroke:#28a745,stroke-width:2px  **Exam Definition:** A parameter is a value that is learned automatically by a Machine Learning model from training data.   **Remember:** Parameter = Model Learns It

---

## 11. What Are Hyperparameters?

### Simple Explanation

  **Hyperparameters** are configuration values that are set externally to control the learning process or model structure.

### Common Examples

- Learning Rate
- Number of Neighbors (K) in KNN
- Maximum Tree Depth
- Number of Trees
- Number of Epochs
- Batch Size
- Regularization Strength

### Example: KNN

  📌 Choosing K

Suppose we choose:

**K = 5**

The value **5** is a hyperparameter because we configure K as part of setting up the KNN algorithm.

### Example: Gradient Descent

  📌 Learning Rate

Suppose we choose:

**Learning Rate = 0.01**

The learning rate controls the step size used when updating model parameters during optimization.

   **Exam Definition:** A hyperparameter is a configuration value selected externally to control the learning process or structure of a Machine Learning model.   **Remember:** Hyperparameter = We Configure It

---

## 12. Parameters vs Hyperparameters

 flowchart TD A\["🧠 Machine Learning Model"\] A --> B\["Parameters"\] A --> C\["Hyperparameters"\] B --> D\["Learned from Data"\] B --> E\["Updated During Training"\] B --> F\["Example: Weights"\] C --> G\["Configured Externally"\] C --> H\["Controls Training"\] C --> I\["Example: Learning Rate"\] style A fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style B fill:#eef6ff,stroke:#005cbf,stroke-width:2px style C fill:#fff0f5,stroke:#e91e63,stroke-width:2px style D fill:#edf8ef,stroke:#28a745,stroke-width:2px style E fill:#edf8ef,stroke:#28a745,stroke-width:2px style F fill:#edf8ef,stroke:#28a745,stroke-width:2px style G fill:#fff7e6,stroke:#ff9800,stroke-width:2px style H fill:#fff7e6,stroke:#ff9800,stroke-width:2px style I fill:#fff7e6,stroke:#ff9800,stroke-width:2px

| Parameters | Hyperparameters |
| --- | --- |
| Learned from training data | Configured externally |
| Updated during training | Control training/model behavior |
| Example: weights | Example: learning rate |
| Example: regression coefficients | Example: K in KNN |
| Example: neural network weights | Example: number of epochs |

   **Easy Trick:**

 Parameter → **Model learns it.**

 Hyperparameter → **We configure it.**

---

## 13. Complete Example: Student Placement Prediction

Now let's connect all the terminology using one complete Machine Learning example.

| IQ | CGPA | Study Hours | Placement |
| --- | --- | --- | --- |
| 90 | 8.2 | 5 | Yes |
| 75 | 6.5 | 2 | No |
| 110 | 9.1 | 6 | Yes |
| 85 | 7.2 | 3 | Yes |

  flowchart TD A\["📊 Student Dataset"\] A --> B\["📥 Features X"\] A --> C\["🎯 Target y"\] B --> D\["IQ"\] B --> E\["CGPA"\] B --> F\["Study Hours"\] C --> G\["Placement"\] D --> H\["🏋️ Training Data"\] E --> H F --> H G --> H H --> I\["⚙️ ML Algorithm"\] I --> J\["🧠 Trained Model"\] J --> K\["📥 New Student"\] K --> L\["🔮 Prediction"\] style A fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style B fill:#eef6ff,stroke:#005cbf,stroke-width:2px style C fill:#fff0f5,stroke:#e91e63,stroke-width:2px style D fill:#eef6ff,stroke:#005cbf,stroke-width:2px style E fill:#eef6ff,stroke:#005cbf,stroke-width:2px style F fill:#eef6ff,stroke:#005cbf,stroke-width:2px style G fill:#fff0f5,stroke:#e91e63,stroke-width:2px style H fill:#fff7e6,stroke:#ff9800,stroke-width:2px style I fill:#eef6ff,stroke:#005cbf,stroke-width:2px style J fill:#edf8ef,stroke:#28a745,stroke-width:2px style K fill:#eef6ff,stroke:#005cbf,stroke-width:2px style L fill:#edf8ef,stroke:#28a745,stroke-width:2px

### Identify Each Term

| Term | In Our Example |
| --- | --- |
| Dataset | Complete student placement table |
| Sample | One student's row |
| Features | IQ, CGPA, Study Hours |
| Target / Label | Placement |
| Training Data | Data used to teach the model |
| Testing Data | Unseen data used for evaluation |
| Model | Learned relationship from training data |
| Prediction | Predicted Placement |
| Parameters | Values learned during training |
| Hyperparameters | Settings used to control training/model behavior |

---

## 14. Simple Python Example

The following example shows how some of these concepts appear in a typical Machine Learning workflow.

```
from sklearn.model_selection import train_test_split
from sklearn.linear_model import LogisticRegression

# Features
X = [
    [90, 8.2, 5],
    [75, 6.5, 2],
    [110, 9.1, 6],
    [85, 7.2, 3]
]

# Target / Label
y = ["Yes", "No", "Yes", "Yes"]

# Split the data
X_train, X_test, y_train, y_test = train_test_split(
    X,
    y,
    test_size=0.2,
    random_state=42
)

# Create model
model = LogisticRegression()

# Train model
model.fit(X_train, y_train)

# Make prediction
prediction = model.predict(X_test)

print(prediction)
```

   **Here:**

 `X` = Feature matrix
 `y` = Target vector
 `X_train` and `y_train` = Training data
 `X_test` and `y_test` = Testing data
 `model` = Machine Learning model
 `prediction` = Model output

---

## 15. Quick Revision for Exams

**Dataset:** Collection of data.

**Sample:** One observation or row.

**Feature:** Input variable.

**Target / Label:** Output that the model learns to predict.

**Training Data:** Data used for learning.

**Testing Data:** Data used for evaluation.

**Model:** Learned representation of patterns in data.

**Prediction:** Output produced by the trained model.

**Parameter:** Value learned from training data.

**Hyperparameter:** Configuration value used to control the learning process.

## 16. One Diagram to Remember Everything

 flowchart TD A\["📊 DATASET"\] A --> B\["Samples"\] A --> C\["Features X"\] A --> D\["Target y"\] A --> E\["🏋️ Training Data"\] A --> F\["🧪 Testing Data"\] E --> G\["⚙️ ML Algorithm"\] G --> H\["🔢 Learn Parameters"\] G --> I\["⚙️ Hyperparameters"\] H --> J\["🧠 MODEL"\] I --> J J --> K\["📥 New Input"\] K --> L\["🔮 PREDICTION"\] F --> M\["📊 Evaluation"\] J --> M style A fill:#f3e8ff,stroke:#6f42c1,stroke-width:2px style B fill:#eef6ff,stroke:#005cbf,stroke-width:2px style C fill:#eef6ff,stroke:#005cbf,stroke-width:2px style D fill:#fff0f5,stroke:#e91e63,stroke-width:2px style E fill:#fff7e6,stroke:#ff9800,stroke-width:2px style F fill:#fff7e6,stroke:#ff9800,stroke-width:2px style G fill:#eef6ff,stroke:#005cbf,stroke-width:2px style H fill:#fff0f5,stroke:#e91e63,stroke-width:2px style I fill:#fff0f5,stroke:#e91e63,stroke-width:2px style J fill:#edf8ef,stroke:#28a745,stroke-width:2px style K fill:#eef6ff,stroke:#005cbf,stroke-width:2px style L fill:#edf8ef,stroke:#28a745,stroke-width:2px style M fill:#fff7e6,stroke:#ff9800,stroke-width:2px

## Conclusion

Understanding Machine Learning terminology is one of the first steps toward understanding Machine Learning algorithms.

Whenever you see a Machine Learning problem, try to identify:

- What is the **dataset**?
- What are the **features (X)**?
- What is the **target (y)**?
- Which data is used for **training**?
- Which data is used for **testing**?
- What **model** is being trained?
- What **parameters** does it learn?
- Which **hyperparameters** control the model?
- What **prediction** does the model produce?

  **Next Topic:** Train-Test Split and Validation in Machine Learning

---

## Machine Learning Concepts Quiz

1. What is the first step in a typical Machine Learning workflow?

- Model Deployment
- Data Collection
- Model Evaluation
- Feature Engineering

    A Machine Learning project begins by obtaining the data required for the problem.    [Discuss it](#)

Explanation

Data Collection is usually the first step because the model needs relevant data before preprocessing and training can begin.

2. What is the main purpose of data preprocessing?

- To deploy the model
- To increase the number of algorithms
- To clean and prepare data for Machine Learning
- To generate predictions

    Preprocessing prepares raw data so that it can be effectively used by a Machine Learning algorithm.    [Discuss it](#)

Explanation

Data preprocessing involves tasks such as handling missing values, removing duplicates, encoding categorical variables, and scaling features.

3. What does EDA stand for in Machine Learning?

- Efficient Data Algorithm
- Exploratory Data Analysis
- Extended Dataset Application
- Evaluation Data Architecture

    EDA is the process of exploring and understanding a dataset before modeling.    [Discuss it](#)

Explanation

EDA stands for Exploratory Data Analysis. It is used to understand distributions, relationships, outliers, missing values, and patterns in the data.

4. What is the main purpose of feature engineering?

- To delete the target variable
- To create or transform useful input features
- To deploy the model
- To split the test data only

    Feature engineering focuses on improving the representation of input data for the model.    [Discuss it](#)

Explanation

Feature engineering involves creating, transforming, selecting, or combining features to provide useful information to a Machine Learning model.

5. Why is a dataset commonly divided into training and testing data?

- To make the dataset smaller
- To evaluate the model on unseen data
- To remove all features
- To avoid collecting data

    The model should be evaluated on examples that were not used for learning.    [Discuss it](#)

Explanation

Train-test splitting allows the model to learn from the training data and then be evaluated on separate unseen testing data.

6. Which part of the dataset is primarily used to learn model parameters?

- Testing set
- Training set
- Production set
- Deployment set

    The model learns patterns and parameters from the training data.    [Discuss it](#)

Explanation

The training set is used to fit the Machine Learning model and learn its parameters.

7. What is the main purpose of model evaluation?

- To collect raw data
- To measure how well the trained model performs
- To create features only
- To install Python libraries

    Evaluation uses appropriate metrics to measure model performance.    [Discuss it](#)

Explanation

Model evaluation measures how well a trained model performs using suitable metrics such as accuracy, precision, recall, F1-score, MAE, MSE, or R².

8. Which of the following is an example of a classification evaluation metric?

- Mean Absolute Error
- Mean Squared Error
- Accuracy
- Root Mean Squared Error

    Accuracy measures the proportion of correctly classified examples.    [Discuss it](#)

Explanation

Accuracy is commonly used for classification problems, while MAE, MSE, and RMSE are commonly used for regression problems.

9. What is the purpose of model deployment?

- To make the trained model available for real-world use
- To remove the training data
- To perform EDA only
- To collect duplicate records

    Deployment connects the trained model to an application or production environment.    [Discuss it](#)

Explanation

Model deployment makes a trained Machine Learning model available so that it can receive real-world inputs and generate predictions.

10. What is feature scaling used for?

- To change the target into text
- To put numerical features on comparable scales
- To delete the dataset
- To deploy the model

    Scaling transforms numerical features so that differences in magnitude do not disproportionately affect certain algorithms.    [Discuss it](#)

Explanation

Feature scaling transforms numerical features to comparable ranges or distributions. It is particularly important for algorithms such as KNN, SVM, and gradient-based models.

11. Which problem can occur if information from the test set is used during training?

- Underflow
- Data leakage
- Feature naming
- Model deployment

    Using information from evaluation data during training can give an unrealistically optimistic performance estimate.    [Discuss it](#)

Explanation

Data leakage occurs when information that should be unavailable during training, such as information from the test set, influences model training.

12. What is the purpose of a validation set?

- To provide a final unbiased test after all model decisions
- To tune and compare models during development
- To replace the training set completely
- To collect new raw data

    Validation data is commonly used during model development for hyperparameter tuning and model selection.    [Discuss it](#)

Explanation

A validation set is used during development to compare models, tune hyperparameters, and make modeling decisions before final evaluation on the test set.

13. What happens during model training?

- The model learns patterns from training data
- The model is automatically deployed
- The test set is deleted
- Only the dataset name is changed

    Training is the stage where the learning algorithm adjusts model parameters based on the training data.    [Discuss it](#)

Explanation

During model training, the learning algorithm uses training data to estimate or update model parameters so the model can learn relationships in the data.

14. Why is monitoring important after deploying a Machine Learning model?

- Because deployed models never change
- To detect performance problems and changes in real-world data
- To remove all predictions
- To replace preprocessing with deployment

    Real-world data and model performance can change after deployment.    [Discuss it](#)

Explanation

Post-deployment monitoring helps detect issues such as data drift, concept drift, changes in prediction quality, and system failures.