/
githubmirror
/
scrapy
Обзор
Документация
Войти
/
githubmirror
/
scrapy
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
master
tests/CrawlerProcess/args_settings.py
25 строк
617 B
Adrián Chaves
Support asynchronous start requests (#6729)
07 май 2025, 20:04
Не верифицирован
07 май 2025, 20:04
036f3e5
Код
Авторство
О чём код?
from typing import Any import scrapy from scrapy.crawler import Crawler, CrawlerProcess class NoRequestsSpider(scrapy.Spider): name = "no_request" @classmethod def from_crawler(cls, crawler: Crawler, *args: Any, **kwargs: Any): spider = super().from_crawler(crawler, *args, **kwargs) spider.settings.set("FOO", kwargs.get("foo")) return spider async def start(self): self.logger.info(f"The value of FOO is {self.settings.getint('FOO')}") return yield process = CrawlerProcess(settings={}) process.crawl(NoRequestsSpider, foo=42) process.start()