import pandas as pd

# Drop all duplicates in the DataFrame
df = df.drop_duplicates()

# Drop all duplicates in a specific column of the DataFrame
df = df.drop_duplicates(subset = "column")

# Drop all duplicate pairs in DataFrame
df = df.drop_duplicates(subset = ["column", "column2"])

# Display DataFrame
print(df)

Popularity 10/10 Helpfulness 10/10 Language python

Source: www.datacamp.com

Tags: pandas pa

Link to this answer
Share Copy Link

Contributed on Apr 29 2022

Elisabeth Engering

0 Answers Avg Quality 2/10

drop duplicates pandas first column

Comment

import pandas as pd 
  
# making data frame from csv file 
data = pd.read_csv("employees.csv") 
  
# sorting by first name 
data.sort_values("First Name", inplace = True) 
  
# dropping ALL duplicte values 
data.drop_duplicates(subset ="First Name",keep = False, inplace = True) 
  
# displaying data 
print(data)

Popularity 10/10 Helpfulness 8/10 Language python

Source: Grepper

Tags: pandas pa

Link to this answer
Share Copy Link

Contributed on Jun 28 2020

Sachin

0 Answers Avg Quality 2/10

remove duplicate row in df

Comment

# Below are quick example
# keep first duplicate row
df2 = df.drop_duplicates()

# Using DataFrame.drop_duplicates() to keep first duplicate row
df2 = df.drop_duplicates(keep='first')

# keep last duplicate row
df2 = df.drop_duplicates( keep='last')

# Remove all duplicate rows 
df2 = df.drop_duplicates(keep=False)

# Delete duplicate rows based on specific columns 
df2 = df.drop_duplicates(subset=["Courses", "Fee"], keep=False)

# Drop duplicate rows in place
df.drop_duplicates(inplace=True)

# Using DataFrame.apply() and lambda function 
df2 = df.apply(lambda x: x.astype(str).str.lower()).drop_duplicates(subset=['Courses', 'Fee'], keep='first')

Popularity 10/10 Helpfulness 7/10 Language python

Source: Grepper

Tags: python py

Link to this answer
Share Copy Link

Contributed on Aug 19 2020

Sachin

0 Answers Avg Quality 2/10

pandas drop duplicates from column

Comment

data = data.drop_duplicates(subset=['City'], keep='first')

Popularity 10/10 Helpfulness 5/10 Language python

Source: duckduckgo.com

Tags: pandas pa

Link to this answer
Share Copy Link

Contributed on May 15 2022

Clean Chimpanzee

0 Answers Avg Quality 2/10

remove duplicate columns python dataframe

Comment

df = df.loc[:,~df.columns.duplicated()]

Popularity 10/10 Helpfulness 5/10 Language python

Source: stackoverflow.com

Tags: dataframe data

Link to this answer
Share Copy Link

Contributed on May 28 2020

Happy Hawk

0 Answers Avg Quality 2/10

pandas drop duplicates

Comment

borrar duplicados pandas

# Below are quick example
# keep first duplicate row
df2 = df.drop_duplicates()

# Using DataFrame.drop_duplicates() to keep first duplicate row
df2 = df.drop_duplicates(keep='first')

# keep last duplicate row
df2 = df.drop_duplicates( keep='last')

# Remove all duplicate rows 
df2 = df.drop_duplicates(keep=False)

# Delete duplicate rows based on specific columns 
df2 = df.drop_duplicates(subset=["Courses", "Fee"], keep=False)

# Drop duplicate rows in place
df.drop_duplicates(inplace=True)

# Using DataFrame.apply() and lambda function 
df2 = df.apply(lambda x: x.astype(str).str.lower()).drop_duplicates(subset=['Courses', 'Fee'], keep='first')

Popularity 9/10 Helpfulness 4/10 Language c

Source: sparkbyexamples.com

Tags: c pandas panda

Link to this answer
Share Copy Link

Contributed on Feb 16 2023

malloc

0 Answers Avg Quality 2/10

pd drop duplicate columns

Comment

# For dropping duplicate columns:
df = df.loc[:,~df.columns.duplicated()]

Popularity 9/10 Helpfulness 4/10 Language python

Source: Grepper

Tags: drop

Link to this answer
Share Copy Link

Contributed on Nov 29 2022

Benja

0 Answers Avg Quality 2/10

df index drop duplicates

Comment

df3 = df3[~df3.index.duplicated(keep='first')]

Popularity 10/10 Helpfulness 3/10 Language python

Source: stackoverflow.com

Tags: python py

Link to this answer
Share Copy Link

Contributed on Jan 28 2022

Attractive Alpaca

0 Answers Avg Quality 2/10

how to drop duplicate columns in pandas that dont have the same name?

Comment

# Drop duplicate columns
df2 = df.T.drop_duplicates().T
print(df2)

Popularity 10/10 Helpfulness 3/10 Language python

Source: sparkbyexamples.com

Tags: drop

Link to this answer
Share Copy Link

Contributed on Jul 15 2022

Jose Santiago Bordas

0 Answers Avg Quality 2/10

dropping duplicates in a dataframe pandas

Comment

dataFrame.drop_duplicates(subset=None, keep='first', inplace=False)

Popularity 8/10 Helpfulness 3/10 Language python

Source: stackabuse.com

Tags: dataframe pandas pa

Link to this answer
Share Copy Link

Contributed on Mar 07 2024

Mahmoud Shams El Din

0 Answers Avg Quality 2/10

drop duplicates columns pandas

Contents

More Related Answers