簡體   English   中英

一旦消息數量超過並發消費者數量,消費者就不會被分配給消息

[英]Consumer not getting allocated to message once the number of messages exceed number of concurrent consumers

我想了解消費者在消費消息后如何為並發消費者工作。 是丟棄了消費者 bean 並創建了新的 bean,還是重新使用了消費者 bean? 可以看到rabbit mq server建立后,當我發送消息時,實例化了一個consumer bean。

我的問題是,一旦消息數量等於並發消費者的數量,則消息偵聽器中的消費者對於下一條消息為空。 我可以在我的日志中看到先前消息的 Ack/Nack,並且預取設置為 1。

XML 配置:

<rabbit:admin connection-factory="cachingConnectionFactory" />

<rabbit:template id="template" connection-factory="cachingConnectionFactory"
    retry-template="retryTemplate" />

<!-- CachingConnectionFactory -->
<bean id="cachingConnectionFactory"
    class="org.springframework.amqp.rabbit.connection.CachingConnectionFactory">
    <constructor-arg ref="clientConnectionFactorySSL" />
    <property name="username" value="${QM_USERNAME}" />
    <property name="password" value="${QM_PASSWORD}" />
    <property name="virtualHost" value="${QM_VIRTUALHOST}" />
    <property name="host" value="${QM_HOST}" />
    <property name="port" value="${QM_PORT}" />
</bean>

<!-- SimpleRabbitListenerContainerFactory -->
        <bean id="rabbitListenerContainerFactory"
            class="org.springframework.amqp.rabbit.config.SimpleRabbitListenerContainerFactory">
            <property name="connectionFactory">
                <ref bean="cachingConnectionFactory" />
            </property>
            <property name="concurrentConsumers" value="5" />
            <property name="maxConcurrentConsumers" value="8" />
             <property name="startConsumerMinInterval" value="3000" />
        </bean>

<!-- Message listener container -->
        <bean id="springListenerContainerRABC"          class="org.springframework.amqp.rabbit.listener.SimpleMessageListenerContainer">
            <property name="connectionFactory" ref="cachingConnectionFactory" />
            <property name="queues" ref="rabbitDestinationRABC" />
            <property name="messageListener" ref="rabbitMessageListenerRABC" />
            **<property name="concurrentConsumers" value="4" />**
            <property name="maxConcurrentConsumers" value="5" />
        </bean>

<!-- Message Listener -->
    <bean id="rabbitMessageListenerRABC" class="com.queue.rabbitmessaging.RabbitMQListener">
        **<property name="consumerType" value="XYZConsumer" />**
        <property name="responseSender" ref="XYZResponseSender" />
        <property name="taskExecutor" ref="taskExecutor" />
        <property name="encoding" value="UTF-16BE" />
    </bean>

<!-- Consumers -->
<bean id="XYZConsumer" class="com.msg.consumer.XYZConsumer"
    scope="prototype" />

這是我在日志中看到的內容:

00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - **Received message for consumer: XYZConsumer**

00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Message :: test1

00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Received message for consumer: XYZConsumer

00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Message :: test2

00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Received message for consumer: XYZConsumer

00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Message :: test3

00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Received message for consumer: XYZConsumer

00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Message :: test4

[org.springframework.amqp.rabbit.RabbitListenerEndpointContainer#0-1] INFO RabbitMQListener - **Received message for consumer: null**

[org.springframework.amqp.rabbit.RabbitListenerEndpointContainer#0-1] INFO RabbitMQListener - Message :: test5

消費者代碼如下:

@EnableRabbit
@Service 
public class RabbitMQListener implements MessageListener {
    @Autowired
    private ApplicationContext applicationContext;

    protected static Logger logger = LoggerFactory.getLogger(RabbitMQListener.class);

    private TaskExecutor taskExecutor;
    private RabbitSender responseSender;
    private String consumerType;
    private String encoding;

     public TaskExecutor getTaskExecutor() {
        return taskExecutor;
    }

    public void setTaskExecutor(TaskExecutor taskExecutor) {
        this.taskExecutor = taskExecutor;
    }

    public void setResponseSender(RabbitSender responseSender) {
        this.responseSender = responseSender;
    }

    public void setConsumerType(String consumerType) {
        this.consumerType = consumerType;
    }

    public void setEncoding(String encoding) {
        this.encoding = encoding;
    }

    @Override
    @RabbitListener(containerFactory = Constants.CONTAINER_FACTORY, queues = "#{'${QM_QUEUES}'.split(',')}")
    public void onMessage(final Message arg0) {

        if (arg0 != null) {
            try {
                String message = new String(arg0.getBody());
                logger.info("Message Properties class: " + arg0.getClass());
                logger.info("Message Properties: " + arg0.getMessageProperties());
                logger.info("Received message for consumer: " + this.consumerType);
                logger.info("Message :: " + message);
                Object bean = applicationContext.getBean(this.consumerType);
                if (bean instanceof Consumer) {
                    logger.debug("Processing message for consumer: " + this.consumerType);
                    Consumer consumer = (Consumer)bean;
                    consumer.setMessage(message);
                    consumer.setResponseSender(responseSender);
                    logger.debug("Executing consumer: " + this.consumerType);
                    taskExecutor.execute(consumer);
                } else {
                    logger.info("Could not process message due to invalid consumer.");
                }

            } 
            catch (AmqpException e1) {
                logger.error("Spring AMQP error processing message.", e1.getMessage());
            }
            catch (Exception e2) {
                logger.error("General error processing message.", e2.getMessage());
            }
        }
        else {
            logger.debug("message received is NULL");
        }

    }


}

所描述的行為與在收到消息后不確認是一致的。 RabbitMQ 可以配置為在傳遞消息時自動確認消息。 如果這沒有發生,或者沒有配置,RabbitMQ 會假設消費者很忙,不會向它傳遞額外的消息。 您必須在成功處理消息后發送ack才能接收隊列中的下一條消息。

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM