generic.runner#

Module Contents#

Classes#

SpiderRunnerConfig

SpiderRunner

A runner to run a spider.

API#

class generic.runner.SpiderRunnerConfig#
spider: str = None#

The name of spider. Not the class name, but the registered names.

args: dict = 'field(...)'#

Arguments for the spider.

class generic.runner.SpiderRunner(config: generic.runner.SpiderRunnerConfig)#

A runner to run a spider.

Initialization

The constructor.

run()#

Runs the spider.

An example:

from generic.runner import SpiderRunner, SpiderRunnerConfig

spider = "read-more"
args = {
    "urls": "https://..."
}
config = SpiderRunnerConfig(spider=spider, args=args)
runner = SpiderRunner(config)
runner.run()

docutils sucks.