We are using Fargate instances in Amazon Elastic Container Service to cron the queue process but it doesnt apear to clear down our queue fast, enough. At peak times we are about 30 minutes behind the real time action. I am thiniking of spinning up 6 containers every minute to specifically process an assgined queue using the --queue-id=X function but i have a few questions;
- if you have 6 queues and you want to process queues with the --queue-id parameter , will the queue-ids always be 0-5 ?
- if you have 6 queues and you want to process queues with the --queue-id parameter, can your workers write all 6 queues to the db at once, or do you have to link them together one after the other?
Any help much appreciated!