Breaking News: Grepper is joining You.com. Read the official announcement!

how to find duplicates in csv file using python

Biggus Dickus answered on June 27, 2022 Popularity 7/10 Helpfulness 4/10

answer how to find duplicates in csv file using python

how to find duplicates in csv file using python

Comment

import csv
import collections

with open(r"T:\DataDump\Book1.csv") as f:
    csv_data = csv.reader(f,delimiter=",")

    next(csv_data)  # skip title line

    count = collections.Counter()

    # first pass: read the file
    for row in csv_data:
        address = row[6]
        count[address] += 1

    # second pass: display duplicate info & compute total
    total_dups = 0
    for address,nb in count.items():
        if nb>1:
            total_dups += nb
            print('{} is a duplicate address, seen {} times'.format(address,nb))
        else:
            print('{} is a unique address'.format(address))
    print("Total duplicate addresses {}".format(toal_dups))

Popularity 7/10 Helpfulness 4/10 Language python

Source: Grepper

Tags: csv file find python using

Link to this answer
Share Copy Link

Contributed on Jun 27 2022

Biggus Dickus

0 Answers Avg Quality 2/10

Continue with Google

By continuing, I agree that I have read and agree to Greppers's Terms of Service and Privacy Policy.

how to find duplicates in csv file using python

Contents

More Related Answers

how to find duplicates in csv file using python

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.