auto-archiver/docs/source/modules/feeder.md

535 B

Feeder Modules

Feeder modules are used to feed URLs into the auto-archiver for processing. Feeders can take these URLs from a variety of sources, such as a file, a database, or the command line.

The default feeder is the command line feeder (cli_feeder), which allows you to input URLs directly into the auto-archiver from the command line.

Command line feeder usage:

auto-archiver [options] -- URL1 URL2 ...
:depth: 1
:glob:
:hidden:
autogen/feeder/*