itemloaders

pip install itemloaders

Ensure the ItemLoader is instantiated with a valid Scrapy Item or by setting `default_item_class` if creating an item automatically. Also, verify that the `response` or `selector` passed to the ItemLoader is not None.

Example:
from scrapy.loader import ItemLoader
from myproject.items import ProductItem

def parse(self, response):
    if response is None:
        self.logger.warning("Received a None response, skipping ItemLoader initialization.")
        return
    loader = ItemLoader(item=ProductItem(), response=response)
    # ... add_xpath, add_css, etc.
    yield loader.load_item()

Instantiate the `ItemLoader` with a `response` object or a `Selector` object.

Example:
from scrapy.loader import ItemLoader
from myproject.items import MyItem

def parse(self, response):
    loader = ItemLoader(item=MyItem(), response=response)
    # Now you can use add_xpath or add_css
    loader.add_xpath('name', '//h1/text()')
    yield loader.load_item()

Ensure `TakeFirst()` is correctly assigned as an `_out` processor for a specific field or as the `default_output_processor` for the ItemLoader. Also, verify that the data reaching the output processor is indeed an iterable.

Example:
from itemloaders.processors import TakeFirst, MapCompose
from scrapy.loader import ItemLoader

class ProductLoader(ItemLoader):
    default_output_processor = TakeFirst() # Applies to all fields by default
    # Or for a specific field:
    name_out = TakeFirst()
    description_in = MapCompose(str.strip)
    description_out = Join()