Python - Remove Duplicates from a List Last Updated : 05 Dec, 2024 Comments Improve Suggest changes Like Article Like Report Removing duplicates from a list is a common operation in Python which is useful in scenarios where unique elements are required. Python provides multiple methods to achieve this. Using set() method is most efficient for unordered lists. Converting the list to a set removes all duplicates since sets only store unique elements. Python a = [1, 2, 2, 3, 4, 4, 5] unique_list = list(set(a)) print(unique_list) Output[1, 2, 3, 4, 5] Explanation:set(a) removes duplicates but may reorder elements since sets are unordered.Wrap the result in list() to convert it back to a list.Let's explore some other methods to remove duplicates from a list.Table of ContentUsing List Comprehension with set()Using dict.fromkeys()Using a Loop for Explicit ControlUsing List ComprehensionList comprehension combined with a enumerate() allows removing duplicates while preserving the original order. To remove duplicates while maintaining the original order we use a set to track seen elements to preserve order. Python a = [1, 2, 2, 3, 4, 4, 5] # Using list comprehension to remove duplicates unique_list = [item for index, item in enumerate(a) if item not in a[:index]] print(unique_list) Output[1, 2, 3, 4, 5] Explanation:seen.add(x) ensures each element is only added once.The list comprehension iterates over the original list and appends only unique elements.Using dict.fromkeys()Dictionaries in Python 3.7+ maintain insertion order making this method efficient way to remove duplicates while preserving order. Python a = [1, 2, 2, 3, 4, 4, 5] unique_list = list(dict.fromkeys(a)) print(unique_list) Output[1, 2, 3, 4, 5] Explanation:dict.fromkeys(a) creates a dictionary with list elements as keys automatically discarding duplicates.Convert the dictionary back to a list using list().Using a Loop for Explicit ControlUsing loop is useful for beginners as it follows step-by-step logic to remove duplicates. This method will remove the original order of elements. Python a = [1, 2, 2, 3, 4, 4, 5] unique_list = [] for x in a: if x not in unique_list: unique_list.append(x) print(unique_list) Output[1, 2, 3, 4, 5] Explanation:Iterates over the original list and appends only elements not already in unique_list.This method preserves the order of elements. Comment More infoAdvertise with us Next Article Python - Remove Duplicates from a List chinmoy lenka Follow Improve Article Tags : Misc Python Python Programs python-list Python list-programs +1 More Practice Tags : Miscpythonpython-list Similar Reads Python | Remove duplicates from nested list The task of removing duplicates many times in the recent past, but sometimes when we deal with the complex data structure, in those cases we need different techniques to handle this type of problem. Let's discuss certain ways in which this task can be achieved. Method #1 : Using sorted() + set() Th 5 min read Remove Duplicate Strings from a List in Python Removing duplicates helps in reducing redundancy and improving data consistency. In this article, we will explore various ways to do this. set() method converts the list into a set, which automatically removes duplicates because sets do not allow duplicate values.Pythona = ["Learn", "Python", "With" 3 min read Remove Unordered Duplicate Elements from a List - Python Given a list of elements, the task is to remove all duplicate elements from the list while maintaining the original order of the elements.For example, if the input is [1, 2, 2, 3, 1] the expected output is [1, 2, 3]. Let's explore various methods to achieve this in Python.Using setWe can initialize 3 min read Python | Duplicate substring removal from list Sometimes we can come to the problem in which we need to deal with certain strings in a list that are separated by some separator and we need to remove the duplicates in each of these kinds of strings. Simple shorthands to solve this kind of problem is always good to have. Let's discuss certain ways 7 min read Python - Remove Duplicates from a list And Keep The Order While lists provide a convenient way to manage collections of data, duplicates within a list can sometimes pose challenges. In this article, we will explore different methods to remove duplicates from a Python list while preserving the original order.Using dict.fromkeys()dict.fromkeys() method creat 2 min read Python | Removing duplicates from tuple Many times, while working with Python tuples, we can have a problem removing duplicates. This is a very common problem and can occur in any form of programming setup, be it regular programming or web development. Let's discuss certain ways in which this task can be performed. Method #1 : Using set() 4 min read Python - Remove List Item Removing List Item can be achieved using several built-in methods that provide flexibility in how you remove list items. In this article, we'll explore the different ways to remove list items in Python.Removing Item by Value with remove()The remove() method allows us to remove the first occurrence o 3 min read How to Find Duplicates in a List - Python Finding duplicates in a list is a common task in programming. In Python, there are several ways to do this. Let’s explore the efficient methods to find duplicates. Using a Set (Most Efficient for Large Lists)Set() method is used to set a track seen elements and helps to identify duplicates. Pythona 2 min read Python | Remove duplicate tuples from list of tuples Given a list of tuples, Write a Python program to remove all the duplicated tuples from the given list. Examples: Input : [(1, 2), (5, 7), (3, 6), (1, 2)] Output : [(1, 2), (5, 7), (3, 6)] Input : [('a', 'z'), ('a', 'x'), ('z', 'x'), ('a', 'x'), ('z', 'x')] Output : [('a', 'z'), ('a', 'x'), ('z', 'x 5 min read Python | Get duplicate tuples from list Sometimes, while working with records, we can have a problem of extracting those records which occur more than once. This kind of application can occur in web development domain. Let's discuss certain ways in which this task can be performed. Method #1 : Using list comprehension + set() + count() In 7 min read Like