4.0.0

What's Changed

• Use rabbitmq based task queues for workers by @catileptic and @stchris

  This release makes the ingest-file worker into a rabbitmq based worker (see also https://github.com/alephdata/servicelayer/releases/tag/v1.23.0). To highlight some of the changes:

  • new settings of the form RABBITMQ_* have been introduced https://github.com/alephdata/servicelayer/blob/131171c137ce2a46d3ca36216b9cd7c2bd70125d/servicelayer/settings.py#L37
  • a Redis connection is still needed. Redis is used to coordinate the state of job execution across all workers.
  • it is possible to configure the prefetch count for tasks the ingest-file worker will grab at a time (see https://github.com/alephdata/ingest-file/blob/bd321ec7524c15a9ec0396a153f5575856e476f8/ingestors/settings.py#L57)

Other changes

• Fix tesserocr build by @stchris in #654

Full Changelog: 3.22.0...4.0.0