import pandas as pd

# Drop all duplicates in the DataFrame
df = df.drop_duplicates()

# Drop all duplicates in a specific column of the DataFrame
df = df.drop_duplicates(subset = "column")

# Drop all duplicate pairs in DataFrame
df = df.drop_duplicates(subset = ["column", "column2"])

# Display DataFrame
print(df)

Popularity 10/10 Helpfulness 10/10 Language python

Source: www.datacamp.com

Tags: pandas pa

Link to this answer
Share Copy Link

Contributed on Apr 29 2022

Elisabeth Engering

0 Answers Avg Quality 2/10

remove duplicate row in df

Comment

# Below are quick example
# keep first duplicate row
df2 = df.drop_duplicates()

# Using DataFrame.drop_duplicates() to keep first duplicate row
df2 = df.drop_duplicates(keep='first')

# keep last duplicate row
df2 = df.drop_duplicates( keep='last')

# Remove all duplicate rows 
df2 = df.drop_duplicates(keep=False)

# Delete duplicate rows based on specific columns 
df2 = df.drop_duplicates(subset=["Courses", "Fee"], keep=False)

# Drop duplicate rows in place
df.drop_duplicates(inplace=True)

# Using DataFrame.apply() and lambda function 
df2 = df.apply(lambda x: x.astype(str).str.lower()).drop_duplicates(subset=['Courses', 'Fee'], keep='first')

Popularity 10/10 Helpfulness 7/10 Language python

Source: Grepper

Tags: python py

Link to this answer
Share Copy Link

Contributed on Aug 19 2020

Sachin

0 Answers Avg Quality 2/10

delete the entire row while remove duplicates with python'

Comment

result_df = df.drop_duplicates(subset=['Column1', 'Column2'], keep='first')
print(result_df)

Popularity 10/10 Helpfulness 6/10 Language python

Source: stackoverflow.com

Tags: python py

Link to this answer
Share Copy Link

Contributed on Mar 04 2022

Doubtful Dugong

0 Answers Avg Quality 2/10

dataframe delete duplicate rows with same column value

Comment

df = df.drop_duplicates(subset=['Column1', 'Column2'], keep='first')

# Exemple
import pandas as pd
df = pd.DataFrame({"A":["foo", "foo", "foo", "bar"], "B":[0,1,1,1], "C":["A","A","B","A"]})
df.drop_duplicates(subset=['A', 'C'], keep=False)

Popularity 10/10 Helpfulness 6/10 Language python

Source: Grepper

Tags: dataframe data

Link to this answer
Share Copy Link

Contributed on Dec 17 2021

0 Answers Avg Quality 2/10

dataframe delete duplicate rows with same column value

Comment

df = df.drop_duplicates(subset=['Column1', 'Column2'], keep='first')

# Exemple
import pandas as pd
df = pd.DataFrame({"A":["foo", "foo", "foo", "bar"], "B":[0,1,1,1], "C":["A","A","B","A"]})
df.drop_duplicates(subset=['A', 'C'], keep=False)

Popularity 10/10 Helpfulness 5/10 Language python

Source: Grepper

Tags: dataframe data

Link to this answer
Share Copy Link

Contributed on Dec 17 2021

0 Answers Avg Quality 2/10

pandas drop duplicates from column

Comment

data = data.drop_duplicates(subset=['City'], keep='first')

Popularity 10/10 Helpfulness 5/10 Language python

Source: duckduckgo.com

Tags: pandas pa

Link to this answer
Share Copy Link

Contributed on May 15 2022

Clean Chimpanzee

0 Answers Avg Quality 2/10

pandas drop duplicates

Comment

borrar duplicados pandas

# Below are quick example
# keep first duplicate row
df2 = df.drop_duplicates()

# Using DataFrame.drop_duplicates() to keep first duplicate row
df2 = df.drop_duplicates(keep='first')

# keep last duplicate row
df2 = df.drop_duplicates( keep='last')

# Remove all duplicate rows 
df2 = df.drop_duplicates(keep=False)

# Delete duplicate rows based on specific columns 
df2 = df.drop_duplicates(subset=["Courses", "Fee"], keep=False)

# Drop duplicate rows in place
df.drop_duplicates(inplace=True)

# Using DataFrame.apply() and lambda function 
df2 = df.apply(lambda x: x.astype(str).str.lower()).drop_duplicates(subset=['Courses', 'Fee'], keep='first')

Popularity 9/10 Helpfulness 4/10 Language c

Source: sparkbyexamples.com

Tags: c pandas panda

Link to this answer
Share Copy Link

Contributed on Feb 16 2023

malloc

0 Answers Avg Quality 2/10

drop duplicates data frame pandas python

Comment

df.drop_duplicates(keep=False, inplace=True)

Popularity 10/10 Helpfulness 3/10 Language python

Source: stackoverflow.com

Tags: frame fram

Link to this answer
Share Copy Link

Contributed on Jul 26 2022

Athul Mathew

0 Answers Avg Quality 2/10

delete duplicate values pandas

Comment

data.loc[data['email'].duplicated(keep=False),:]

Popularity 9/10 Helpfulness 3/10 Language whatever

Source: openclassrooms.com

Tags: pandas pa

Link to this answer
Share Copy Link

Contributed on Feb 11 2023

Brave Bat

0 Answers Avg Quality 2/10

dropping duplicates in a dataframe pandas

Comment

dataFrame.drop_duplicates(subset=None, keep='first', inplace=False)

Popularity 8/10 Helpfulness 3/10 Language python

Source: stackabuse.com

Tags: dataframe pandas

Link to this answer
Share Copy Link

Contributed on Mar 07 2024

Mahmoud Shams El Din

0 Answers Avg Quality 2/10

python dataframe remove duplicate rows

Contents

More Related Answers