/
githubmirror
/
scrapy
Обзор
Документация
Войти
/
githubmirror
/
scrapy
Код
Запросы
0
Пакеты
0
Релизы
0
Аналитика
Безопасность
master
tests/AsyncCrawlerProcess/twisted_reactor_custom_settings_same.py
22 строки
567 B
Andrey Rakhmatullin
Add `AsyncCrawlerProcess` and `Crawler.crawl_async()` (#6817)
28 май 2025, 16:55
Не верифицирован
28 май 2025, 16:55
05b3b20
Код
Авторство
О чём код?
import scrapy from scrapy.crawler import AsyncCrawlerProcess class AsyncioReactorSpider1(scrapy.Spider): name = "asyncio_reactor1" custom_settings = { "TWISTED_REACTOR": "twisted.internet.asyncioreactor.AsyncioSelectorReactor", } class AsyncioReactorSpider2(scrapy.Spider): name = "asyncio_reactor2" custom_settings = { "TWISTED_REACTOR": "twisted.internet.asyncioreactor.AsyncioSelectorReactor", } process = AsyncCrawlerProcess() process.crawl(AsyncioReactorSpider1) process.crawl(AsyncioReactorSpider2) process.start()