[英]How to consume all messages required in a Spring IntegrationFlow when message count is greater than the number of concurrent consumers?
[英]Consumer not getting allocated to message once the number of messages exceed number of concurrent consumers
我想了解消費者在消費消息后如何為並發消費者工作。 是丟棄了消費者 bean 並創建了新的 bean,還是重新使用了消費者 bean? 可以看到rabbit mq server建立后,當我發送消息時,實例化了一個consumer bean。
我的問題是,一旦消息數量等於並發消費者的數量,則消息偵聽器中的消費者對於下一條消息為空。 我可以在我的日志中看到先前消息的 Ack/Nack,並且預取設置為 1。
XML 配置:
<rabbit:admin connection-factory="cachingConnectionFactory" />
<rabbit:template id="template" connection-factory="cachingConnectionFactory"
retry-template="retryTemplate" />
<!-- CachingConnectionFactory -->
<bean id="cachingConnectionFactory"
class="org.springframework.amqp.rabbit.connection.CachingConnectionFactory">
<constructor-arg ref="clientConnectionFactorySSL" />
<property name="username" value="${QM_USERNAME}" />
<property name="password" value="${QM_PASSWORD}" />
<property name="virtualHost" value="${QM_VIRTUALHOST}" />
<property name="host" value="${QM_HOST}" />
<property name="port" value="${QM_PORT}" />
</bean>
<!-- SimpleRabbitListenerContainerFactory -->
<bean id="rabbitListenerContainerFactory"
class="org.springframework.amqp.rabbit.config.SimpleRabbitListenerContainerFactory">
<property name="connectionFactory">
<ref bean="cachingConnectionFactory" />
</property>
<property name="concurrentConsumers" value="5" />
<property name="maxConcurrentConsumers" value="8" />
<property name="startConsumerMinInterval" value="3000" />
</bean>
<!-- Message listener container -->
<bean id="springListenerContainerRABC" class="org.springframework.amqp.rabbit.listener.SimpleMessageListenerContainer">
<property name="connectionFactory" ref="cachingConnectionFactory" />
<property name="queues" ref="rabbitDestinationRABC" />
<property name="messageListener" ref="rabbitMessageListenerRABC" />
**<property name="concurrentConsumers" value="4" />**
<property name="maxConcurrentConsumers" value="5" />
</bean>
<!-- Message Listener -->
<bean id="rabbitMessageListenerRABC" class="com.queue.rabbitmessaging.RabbitMQListener">
**<property name="consumerType" value="XYZConsumer" />**
<property name="responseSender" ref="XYZResponseSender" />
<property name="taskExecutor" ref="taskExecutor" />
<property name="encoding" value="UTF-16BE" />
</bean>
<!-- Consumers -->
<bean id="XYZConsumer" class="com.msg.consumer.XYZConsumer"
scope="prototype" />
這是我在日志中看到的內容:
00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - **Received message for consumer: XYZConsumer**
00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Message :: test1
00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Received message for consumer: XYZConsumer
00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Message :: test2
00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Received message for consumer: XYZConsumer
00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Message :: test3
00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Received message for consumer: XYZConsumer
00:17:49.725 [springListenerContainerRABC-1] INFO RabbitMQListener - Message :: test4
[org.springframework.amqp.rabbit.RabbitListenerEndpointContainer#0-1] INFO RabbitMQListener - **Received message for consumer: null**
[org.springframework.amqp.rabbit.RabbitListenerEndpointContainer#0-1] INFO RabbitMQListener - Message :: test5
消費者代碼如下:
@EnableRabbit
@Service
public class RabbitMQListener implements MessageListener {
@Autowired
private ApplicationContext applicationContext;
protected static Logger logger = LoggerFactory.getLogger(RabbitMQListener.class);
private TaskExecutor taskExecutor;
private RabbitSender responseSender;
private String consumerType;
private String encoding;
public TaskExecutor getTaskExecutor() {
return taskExecutor;
}
public void setTaskExecutor(TaskExecutor taskExecutor) {
this.taskExecutor = taskExecutor;
}
public void setResponseSender(RabbitSender responseSender) {
this.responseSender = responseSender;
}
public void setConsumerType(String consumerType) {
this.consumerType = consumerType;
}
public void setEncoding(String encoding) {
this.encoding = encoding;
}
@Override
@RabbitListener(containerFactory = Constants.CONTAINER_FACTORY, queues = "#{'${QM_QUEUES}'.split(',')}")
public void onMessage(final Message arg0) {
if (arg0 != null) {
try {
String message = new String(arg0.getBody());
logger.info("Message Properties class: " + arg0.getClass());
logger.info("Message Properties: " + arg0.getMessageProperties());
logger.info("Received message for consumer: " + this.consumerType);
logger.info("Message :: " + message);
Object bean = applicationContext.getBean(this.consumerType);
if (bean instanceof Consumer) {
logger.debug("Processing message for consumer: " + this.consumerType);
Consumer consumer = (Consumer)bean;
consumer.setMessage(message);
consumer.setResponseSender(responseSender);
logger.debug("Executing consumer: " + this.consumerType);
taskExecutor.execute(consumer);
} else {
logger.info("Could not process message due to invalid consumer.");
}
}
catch (AmqpException e1) {
logger.error("Spring AMQP error processing message.", e1.getMessage());
}
catch (Exception e2) {
logger.error("General error processing message.", e2.getMessage());
}
}
else {
logger.debug("message received is NULL");
}
}
}
所描述的行為與在收到消息后不確認是一致的。 RabbitMQ 可以配置為在傳遞消息時自動確認消息。 如果這沒有發生,或者沒有配置,RabbitMQ 會假設消費者很忙,不會向它傳遞額外的消息。 您必須在成功處理消息后發送ack
才能接收隊列中的下一條消息。
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.