Breaking News: Grepper is joining You.com. Read the official announcement!

Dump Multiple CSV files into Sqlite Database

Filthy Fox answered on August 14, 2022 Popularity 1/10 Helpfulness 1/10

answer Dump Multiple CSV files into Sqlite Database

Dump Multiple CSV files into Sqlite Database

Comment

import csv
import sqlite3
import glob
import os

def do_directory(dirname, db):
    for filename in glob.glob(os.path.join(dirname, '*.csv')):
        do_file(filename, db)

def do_file(filename, db):
        with open(filename) as f:
            with db:
                data = csv.DictReader(f)
                cols = data.fieldnames
                table=os.path.splitext(os.path.basename(filename))[0]

                sql = 'drop table if exists "{}"'.format(table)
                db.execute(sql)

                sql = 'create table "{table}" ( {cols} )'.format(
                    table=table,
                    cols=','.join('"{}"'.format(col) for col in cols))
                db.execute(sql)

                sql = 'insert into "{table}" values ( {vals} )'.format(
                    table=table,
                    vals=','.join('?' for col in cols))
                db.executemany(sql, (list(map(row.get, cols)) for row in data))

if __name__ == '__main__':
    conn = sqlite3.connect('foo.db')
    do_directory('.', conn)

    
connection = sqlite3.connect('C:/ROAST/3_ANALYSIS/03_SQL-PY/primo.db')
do_file('C:/ROAST/3_ANALYSIS/03_SQL-PY\A08_csv/A08_B1_T5.csv', connection)
or

connection = sqlite3.connect('C:/ROAST/3_ANALYSIS/03_SQL-PY/primo.db')
do_directory('C:/ROAST/3_ANALYSIS/03_SQL-PY\A08_csv',connection)

Popularity 1/10 Helpfulness 1/10 Language python

Source: stackoverflow.com

Tags: csv database dump python sqlite

Link to this answer
Share Copy Link

Contributed on Aug 14 2022

Filthy Fox

0 Answers Avg Quality 2/10

Dump Multiple CSV files into Sqlite Database

Contents

More Related Answers

Dump Multiple CSV files into Sqlite Database

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.