:py:mod:`generic.spiders.base` ============================== .. py:module:: generic.spiders.base .. autodoc2-docstring:: generic.spiders.base :allowtitles: Module Contents --------------- Classes ~~~~~~~ .. list-table:: :class: autosummary longtable :align: left * - :py:obj:`GenericSpiderConfig ` - .. autodoc2-docstring:: generic.spiders.base.GenericSpiderConfig :summary: * - :py:obj:`GenericSpider ` - .. autodoc2-docstring:: generic.spiders.base.GenericSpider :summary: Data ~~~~ .. list-table:: :class: autosummary longtable :align: left * - :py:obj:`T ` - .. autodoc2-docstring:: generic.spiders.base.T :summary: API ~~~ .. py:class:: GenericSpiderConfig(/, **data: typing.Any) :canonical: generic.spiders.base.GenericSpiderConfig Bases: :py:obj:`pydantic.BaseModel` .. autodoc2-docstring:: generic.spiders.base.GenericSpiderConfig .. rubric:: Initialization .. autodoc2-docstring:: generic.spiders.base.GenericSpiderConfig.__init__ .. py:attribute:: urls :canonical: generic.spiders.base.GenericSpiderConfig.urls :type: typing.Union[pydantic.HttpUrl, typing.List[pydantic.HttpUrl]] :value: None .. autodoc2-docstring:: generic.spiders.base.GenericSpiderConfig.urls .. py:method:: split_urls(v) :canonical: generic.spiders.base.GenericSpiderConfig.split_urls :classmethod: .. autodoc2-docstring:: generic.spiders.base.GenericSpiderConfig.split_urls .. py:method:: convert_to_string(v) :canonical: generic.spiders.base.GenericSpiderConfig.convert_to_string :classmethod: .. autodoc2-docstring:: generic.spiders.base.GenericSpiderConfig.convert_to_string .. py:data:: T :canonical: generic.spiders.base.T :value: 'TypeVar(...)' .. autodoc2-docstring:: generic.spiders.base.T .. py:class:: GenericSpider(*args, **kwargs) :canonical: generic.spiders.base.GenericSpider Bases: :py:obj:`scrapy_spider_metadata.Args`\ [\ :py:obj:`generic.spiders.base.T`\ ], :py:obj:`scrapy.Spider`, :py:obj:`typing.Generic`\ [\ :py:obj:`generic.spiders.base.T`\ ] .. autodoc2-docstring:: generic.spiders.base.GenericSpider .. rubric:: Initialization .. autodoc2-docstring:: generic.spiders.base.GenericSpider.__init__ .. py:attribute:: allowed_domains :canonical: generic.spiders.base.GenericSpider.allowed_domains :value: [] .. autodoc2-docstring:: generic.spiders.base.GenericSpider.allowed_domains .. py:method:: get_config_class() -> typing.Type[generic.spiders.base.T] :canonical: generic.spiders.base.GenericSpider.get_config_class :abstractmethod: :classmethod: .. autodoc2-docstring:: generic.spiders.base.GenericSpider.get_config_class