Dropbox Exporter for Scrapy

Scrapy feed export storage backend for Dropbox.

Requirements

• Python 3.8+

Installation

pip install git+https://github.com/scrapy-plugins/scrapy-feedexporter-dropbox

Usage

• Add this storage backend to the FEED_STORAGES Scrapy setting. For example:

  # settings.py
  FEED_STORAGES = {'dropbox': 'scrapy_dropbox.DropboxFeedStorage'}

• Configure authentication to generate access token and use it like following:

  For example,

  DROPBOX_API_TOKEN = 'your generated access token here'

• Configure in the FEEDS Scrapy setting the Dropbox URI where the feed needs to be exported.

  FEEDS = {
      "dropbox://<folder_name>/<file_name.extension>": {
          "format": "json"
      }
  }

Feed Options

• This exporter does not support setting overwrite feed option to False (no support by dropbox for append operation)
  • If it's set to False, a warning will be logged.
  • Default is True, so if the file already exists, it will be overwritten