Queue Monitor

Overview of processing queues and dead-letter queues.

Processing Queues

discovery_queue

active

Main URL discovery jobs

scrape_queue

active

Direct URL scrape jobs

pdf_queue

active

PDF parsing jobs

agent_queue

active

Agent extraction/validation jobs

persist_queue

active

Database write jobs

discovery_queue_dlq

dlq

Dead-letter for discovery_queue

scrape_queue_dlq

dlq

Dead-letter for scrape_queue

pdf_queue_dlq

dlq

Dead-letter for pdf_queue

agent_queue_dlq

dlq

Dead-letter for agent_queue

persist_queue_dlq

dlq

Dead-letter for persist_queue