A shortcut to the start_requests method with scrapy

Cute Capuchin answered on February 26, 2022 Popularity 1/10 Helpfulness 1/10

answer A shortcut to the start_requests method with scrapy

A shortcut to the start_requests method with scrapy

Comment

import scrapy


class QuotesSpider(scrapy.Spider):
    name = "quotes"
    start_urls = [
        'http://quotes.toscrape.com/page/1/',
        'http://quotes.toscrape.com/page/2/',
    ]

    def parse(self, response):
        page = response.url.split("/")[-2]
        filename = f'quotes-{page}.html'
        with open(filename, 'wb') as f:
            f.write(response.body)

Popularity 1/10 Helpfulness 1/10 Language css

Source: docs.scrapy.org

Tags: css scrapy shortcut

Link to this answer
Share Copy Link

Contributed on Feb 26 2022

Cute Capuchin

0 Answers Avg Quality 2/10

A shortcut to the start_requests method with scrapy

Contents

More Related Answers

A shortcut to the start_requests method with scrapy

Grepper

Documentation

Social

Legal

Contact

Oops, You will need to install Grepper and log-in to perform this action.