Breaking News: Grepper is joining You.com. Read the official announcement!

Scrapping tables in an HTML file with BeautifulSoup

Danish Ajaib answered on May 20, 2022 Popularity 8/10 Helpfulness 4/10

answer Scrapping tables in an HTML file with BeautifulSoup

Scrapping tables in an HTML file with BeautifulSoup

Comment

import pandas as pd
import base64
import os
from bs4 import BeautifulSoup

file = 'file.html'
output = pd.DataFrame(columns=['Zone Entry', 'Date', 'Time', 'Zone Exit', 'Date', 'Time', 'Dwell', 'Fee'])
table_ids = ['ctl00_contentHolderBody_Table0', 'ctl00_contentHolderBody_Table1', 'ctl00_contentHolderBody_Table2']
all_rows = []
with open(file) as f:
    soup = BeautifulSoup(f, 'html.parser')
    for table in table_ids:
        table = soup.find(lambda tag: tag.name == 'table' and tag.has_attr('id') and tag['id'] == table) 
        rows = table.findAll(lambda tag: tag.name == 'td')
        for t in range(0, len(rows), 8):
            row = []
            for j in range(t,t+8):
                row.append(str(rows[j])[4:-5].strip())
            all_rows.append(row)

pd.DataFrame(all_rows).to_csv('output.csv')

Popularity 8/10 Helpfulness 4/10 Language python

Source: Grepper

Tags: beautifulsoup file html python

Link to this answer
Share Copy Link

Contributed on May 20 2022

Danish Ajaib

0 Answers Avg Quality 2/10

Scrapping tables in an HTML file with BeautifulSoup

Contents

More Related Answers

Scrapping tables in an HTML file with BeautifulSoup

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.