How to insert a new column based on condition in Python?

This recipe helps you insert a new column based on condition in Python

Recipe Objective- How to insert a new column based on condition in Python?

Adding a new column in Python is an easy task. Have you tried adding a column with values based on some condition? Like a column with values that depends on the values of another column. For a small data set with few numbers of rows, it may be easy to do it manually, but for a large dataset with hundreds of rows, it may be challenging to do it manually.

We can do this hectic manual work with few lines of code. We can create a function that will do it for all the rows.

This recipe shows how to create a function to insert a Pandas new column based on condition.

Python Pandas ‘Add New Column Based On Condition’

You can follow the below steps in Pandas to create new column based on condition.

Step 1 - Import the library

import pandas as pd

import numpy as np

We have imported pandas and numpy. No other library is needed for this function.

Step 2 - Creating a Sample Dataset

We will create a Dataframe with columns 'bond_name' and 'risk_score'. We will use a print statement to view our initial dataset.

raw_data = {'bond_name': ['govt_bond_1', 'govt_bond_2', 'govt_bond_3', 'pvt_bond_1', 'pvt_bond_2', 'pvt_bond_3', 'pvt_bond_4'], 'risk_score': [1.6, 0.9, 2.3, 3.0, 2.7, 1.8, 4.1]}

df = pd.DataFrame(raw_data, columns = ['bond_name', 'risk_score'])

print(df)

Step 3 - Creating a function to assign values in column

First, we will create an empty list named rating, which we will append and assign values as per the condition. 

rating = []

We will create a loop that will iterate over all the rows in column 'risk_score' and assign values in the list. We are using the if-else function to make the condition on which we want to assign the values in the column. Here, we want to assign a rating based on risk_score. The condition which we are making is:

  • If the value in risk_score is between 0 and 1, it will assign 'AA' in the rating column.

  • If the value in risk_score is between 1 and 2, it will assign 'A' in the rating column.

  • If the value in risk_score is between 2 and 3, it will assign 'BB' in the rating column.

  • If the value in risk_score is between 3 and 4, it will assign 'B' in the rating column.

  • If the value in risk_score is between 4 and 5, it will assign 'C' in the rating column.

  • If there is no value in risk_score, then it will assign Not_Rated in the rating column.

rating = [] for row in df['risk_score']: if row < 1.0 : rating.append('AA') elif row < 2.0: rating.append('A') elif row < 3.0: rating.append('BB') elif row < 4.0: rating.append('B') elif row < 5.0: rating.append('C') else: rating.append('Not_Rated') 

Explore More Data Science and Machine Learning Projects for Practice. Fast-Track Your Career Transition with ProjectPro

Step 5 - Converting list into column of dataset and viewing the final dataset

So finally, we are adding that list as a column in the dataset and printing the final dataset to see the changes. 

df['rating'] = rating print(df) 

We get the following output-

    bond_name  risk_score

0  govt_bond_1         1.6

1  govt_bond_2         0.9

2  govt_bond_3         2.3

3   pvt_bond_1         3.0

4   pvt_bond_2         2.7

5   pvt_bond_3         1.8

6   pvt_bond_4         4.1

 

     bond_name  risk_score rating

0  govt_bond_1         1.6      A

1  govt_bond_2         0.9     AA

2  govt_bond_3         2.3     BB

3   pvt_bond_1         3.0      B

4   pvt_bond_2         2.7     BB

5   pvt_bond_3         1.8      A

6   pvt_bond_4         4.1      C

Here we see that a new column has been added with the values according to the risk_score.

How to Create New Column in Pandas Dataframe Based on Condition?

The apply() method shows you how to create a new column in a Pandas based on condition. The apply() method takes a function as an argument and applies that function to each row in the DataFrame. The function you pass to the apply() method should return a single value. The function should return a Boolean value when creating a new column based on a condition.

The following code shows how to create a new column called Is_Male in a DataFrame called df based on the value of the Name column:

df['Is_Male'] = df['Name'].apply(lambda name: name.split()[-1] == 'M')

The apply() method is applied to the Name column in this code. The function passed to the apply() method checks the last letter of the name. If the last letter is M, then the function returns True. Otherwise, the function returns False.

Python Pandas ‘Create New Column Based On Other Columns’

In Python Pandas, new column based on another column can be created using the where() method. The where() method takes a condition and a value as arguments. If the condition is met, then the value is returned. Otherwise, another value is returned.

Python Pandas ‘Add Column Based on Other Columns’

You can add column based on other columns, i.e., based on the values of two existing columns, using the assign() method. The assign() method takes a dictionary as an argument, where the keys are the names of the new columns, and the values are the expressions used to fill the columns.

 


Download Materials


What Users are saying..

profile image

Abhinav Agarwal

Graduate Student at Northwestern University
linkedin profile url

I come from Northwestern University, which is ranked 9th in the US. Although the high-quality academics at school taught me all the basics I needed, obtaining practical experience was a challenge.... Read More

Relevant Projects

Build a Face Recognition System in Python using FaceNet
In this deep learning project, you will build your own face recognition system in Python using OpenCV and FaceNet by extracting features from an image of a person's face.

Build a Review Classification Model using Gated Recurrent Unit
In this Machine Learning project, you will build a classification model in python to classify the reviews of an app on a scale of 1 to 5 using Gated Recurrent Unit.

Tensorflow Transfer Learning Model for Image Classification
Image Classification Project - Build an Image Classification Model on a Dataset of T-Shirt Images for Binary Classification

Machine Learning Project to Forecast Rossmann Store Sales
In this machine learning project you will work on creating a robust prediction model of Rossmann's daily sales using store, promotion, and competitor data.

ML Model Deployment on AWS for Customer Churn Prediction
MLOps Project-Deploy Machine Learning Model to Production Python on AWS for Customer Churn Prediction

Walmart Sales Forecasting Data Science Project
Data Science Project in R-Predict the sales for each department using historical markdown data from the Walmart dataset containing data of 45 Walmart stores.

Learn Hyperparameter Tuning for Neural Networks with PyTorch
In this Deep Learning Project, you will learn how to optimally tune the hyperparameters (learning rate, epochs, dropout, early stopping) of a neural network model in PyTorch to improve model performance.

Multilabel Classification Project for Predicting Shipment Modes
Multilabel Classification Project to build a machine learning model that predicts the appropriate mode of transport for each shipment, using a transport dataset with 2000 unique products. The project explores and compares four different approaches to multilabel classification, including naive independent models, classifier chains, natively multilabel models, and multilabel to multiclass approaches.

Build PowerBI Dashboard for Water Quality Sensor Data Analysis
In this PowerBI Project, you will learn to build a PowerBI Dashboard to analyze and visualize water quality sensor data from various European countries.

Time Series Forecasting Project-Building ARIMA Model in Python
Build a time series ARIMA model in Python to forecast the use of arrival rate density to support staffing decisions at call centres.