Python Module Index

s
 
s
scrapy
    scrapy.contracts
    scrapy.contracts.default
    scrapy.crawler The Scrapy crawler
    scrapy.downloadermiddlewares
    scrapy.downloadermiddlewares.ajaxcrawl
    scrapy.downloadermiddlewares.cookies Cookies Downloader Middleware
    scrapy.downloadermiddlewares.defaultheaders Default Headers Downloader Middleware
    scrapy.downloadermiddlewares.downloadtimeout Download timeout middleware
    scrapy.downloadermiddlewares.httpauth HTTP Auth downloader middleware
    scrapy.downloadermiddlewares.httpcache HTTP Cache downloader middleware
    scrapy.downloadermiddlewares.httpcompression Http Compression Middleware
    scrapy.downloadermiddlewares.httpproxy Http Proxy Middleware
    scrapy.downloadermiddlewares.redirect Redirection Middleware
    scrapy.downloadermiddlewares.retry Retry Middleware
    scrapy.downloadermiddlewares.robotstxt robots.txt middleware
    scrapy.downloadermiddlewares.stats Downloader Stats Middleware
    scrapy.downloadermiddlewares.useragent User Agent Middleware
    scrapy.exceptions Scrapy exceptions
    scrapy.exporters Item Exporters
    scrapy.extensions.closespider Close spider extension
    scrapy.extensions.corestats Core stats collection
    scrapy.extensions.debug Extensions for debugging Scrapy
    scrapy.extensions.httpcache
    scrapy.extensions.logstats Basic stats logging
    scrapy.extensions.memdebug Memory debugger extension
    scrapy.extensions.memusage Memory usage extension
    scrapy.extensions.statsmailer StatsMailer extension
    scrapy.extensions.telnet Telnet console
    scrapy.http Request and Response classes
    scrapy.item Item and Field classes
    scrapy.linkextractors Link extractors classes
    scrapy.linkextractors.lxmlhtml lxml's HTMLParser-based link extractors
    scrapy.loader Item Loader class
    scrapy.loader.processors A collection of processors to use with Item Loaders
    scrapy.mail Email sending facility
    scrapy.pipelines.files Files Pipeline
    scrapy.pipelines.images Images Pipeline
    scrapy.robotstxt robots.txt parser interface and implementations
    scrapy.selector Selector class
    scrapy.settings Settings manager
    scrapy.signalmanager The signal manager
    scrapy.signals Signals definitions
    scrapy.spiderloader The spider loader
    scrapy.spidermiddlewares
    scrapy.spidermiddlewares.depth Depth Spider Middleware
    scrapy.spidermiddlewares.httperror HTTP Error Spider Middleware
    scrapy.spidermiddlewares.offsite Offsite Spider Middleware
    scrapy.spidermiddlewares.referer Referer Spider Middleware
    scrapy.spidermiddlewares.urllength URL Length Spider Middleware
    scrapy.spiders Spiders base class, spider manager and spider middleware
    scrapy.statscollectors Stats Collectors
    scrapy.utils.log Logging utils
    scrapy.utils.trackref Track references of live objects