logo
down
shadow

Spring Kafka replay old messages


Spring Kafka replay old messages

By : beach
Date : November 20 2020, 07:00 PM
This might help you Yes, there is. Have a look at ConsumerSeekAware. The usage is described here. Namely, about this method:
code :
void registerSeekCallback(ConsumerSeekCallback callback);


Share : facebook icon twitter icon
Spring Kafka Client unable to get messages from a Kerberos enabled Kafka Broker topic

Spring Kafka Client unable to get messages from a Kerberos enabled Kafka Broker topic


By : Atom64
Date : March 29 2020, 07:55 AM
I think the issue was by ths following , Ok - We have now resolved this by having our kafka admin setup the right ACLs (permissions) for the kerberos principal for the right consumer group and the right topic.
Refer https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Authorization+Command+Line+Interface for more information
Replay messages in Kafka

Replay messages in Kafka


By : Xing Yao
Date : March 29 2020, 07:55 AM
will be helpful for those in need I assume you mean replay not reply - I have edited your question.
Spring Cloud Stream does not currently expose a mechanism to seek the offsets.
Replay messages from dead letter queue in Spring Cloud Stream with Kafka binder

Replay messages from dead letter queue in Spring Cloud Stream with Kafka binder


By : user3056249
Date : March 29 2020, 07:55 AM
fixed the issue. Will look into that further It turns out by changing the Subject Naming Strategy to be RecordNameStrategy this can be achieved and regardless of the topic name, a record maintains the original schema across all the topics. More details can be found here.
Apache Kafka: Replay messages in a topic

Apache Kafka: Replay messages in a topic


By : Georgios Sfakianakis
Date : March 29 2020, 07:55 AM
I think the issue was by ths following , I'm considering using Apache Kafka as an event store for storing events within a microservice. , Yes, you can seek to a specific offset, but
How to filter Kafka messages before consumer consume in spring Kafka

How to filter Kafka messages before consumer consume in spring Kafka


By : Bellal Hossain
Date : March 29 2020, 07:55 AM
I hope this helps . Yes in spring Kafka you can filter messages before consumer consumes, there is an interface public interface RecordFilterStrategy and method in interface boolean filter(org.apache.kafka.clients.consumer.ConsumerRecord consumerRecord)
so you need to override this filter method and if it returns false consumer will consume the message, and if it return true message will not consume
code :
consumerRecord.key() // will return key of message
consumerRecord.value() // will return the message
 @Bean(name = "kafkaListenerContainerFactory")
public ConcurrentKafkaListenerContainerFactory<String, String> kafkaListenerContainerFactory() {
    ConcurrentKafkaListenerContainerFactory<String, String> factory = new ConcurrentKafkaListenerContainerFactory<>();
    factory.setConcurrency(Integer.parseInt(threads));
    factory.setBatchListener(true);
    factory.setConsumerFactory(kafkaConsumerFactory());
    factory.getContainerProperties().setPollTimeout(Long.parseLong(pollTimeout));
    factory.getContainerProperties().setAckMode(AbstractMessageListenerContainer.AckMode.BATCH);

    if(true) {
        factory.setRecordFilterStrategy(new RecordFilterStrategy<String, String>() {

            @Override
            public boolean filter(ConsumerRecord<String, String> consumerRecord) {
                if(consumerRecord.key().equals("ETEST")) {
                return false;
                }
            else {
                return true;
                 }
            }   
        });
    }

    return factory;
}
Related Posts Related Posts :
  • What happens on a JMS queue when onMessage() throws a JMSException?
  • How does Reactive programming using WebFlux handles dependent external api calls
  • Better way to handle exception is spring-boot
  • Spring boot + JMS + IBM MQ
  • What's mean that Caused by: javax.validation.ValidationException: Unable to find a default provider?
  • Autowire Annotation in Spring without using Component Scanning
  • Injecting Mockito mocks into a Spring bean
  • spring-security-oauth2 vs spring-security-oauth2-core in Spring
  • Ignore an Empty Request Body?
  • org.hibernate.hql.internal.ast.QuerySyntaxException: Employee is not mapped [from Employee];
  • Appropriate Oracle download for hibernate-dialect org.hibernate.dialect.Oracle9Dialect
  • spring boot https PKCS12 DerInputStream.getLength(): lengthTag=111, too big
  • JPA Native query puts parentheses wrong for List paremeter on INSERT INTO VALUES
  • How to connect JPARepository with ItemReader using spring batch?
  • Spring Data MongoDB + Spring Boot starting twice?
  • @Service vs @Component in Spring
  • Validation in spring boot rest controller
  • How Rest Controller handle multiple request at same time for a single instance application?
  • Error : java.lang.ClassNotFoundException: org.hibernate.cfg.AnnotationConfiguration
  • Does @Value support letting default value reference another @Value?
  • Spring boot 2: Fail to reach controller method
  • Execute state actions synchronously
  • How to access application.yml properties in Spring 1.5.9
  • CORS settings in Spring boot does not work
  • Spring boot log settings in application.yml
  • how to get KafkaListener Consumer
  • spring webflux webclient response convert list of string to string
  • What are this Spring version names?
  • Correct guide about spring Oauth 2
  • How does Spring Boot application with application.yml behave for when dependency also has an application.yml file
  • Spring batch unit testing job with external input and db output
  • Does Apache Camel replace or complement creating micro-services with Spring Boot?
  • Redis Cache memory Status
  • ConstraintValidator dependency injection leads to ValidationException when being validated at class level
  • How can I map the fields return in JSON with my entity provided the key in JSON has different name than fields in my ent
  • Content type 'application/x-www-form-urlencoded' not supported" for post method
  • How can i use Myfaces 2.3, Primefaces Elite 7.0.4 & Extensions and Omnifaces 3.3 together in a SpringBoot applicatio
  • Reactive WebClient of non-reactive remote server
  • Enable properties only for testing in Spring
  • PrematureCloseException: Connection prematurely closed
  • Spring application - Override app properties by test properties
  • Proper way to response nothing to ajax request on Spring
  • Spring Boot - Push message to Angular UI
  • Spring boot: path param is null
  • A UserDetailsService must be set Error in Spring Boot app
  • How does Spring convert config values with units to natural numbers
  • How to disconnect from rabbitmq after each test?
  • Autowiring of beans in spring boot with @Qualifier annotation
  • Spring Cloud Gateway not starting when deployed as WAR showing webFluxConversionService error
  • How to return response as Json from spring filter?
  • Spring OAuth2 ResourceServer dependency hell
  • How can I use @Transactional in multithreaded environment
  • Can not access controller.RestController for maven build
  • Spring Boot Tries to Access A Post Request URL but shows GET not supported
  • Jackson Mapping Issue
  • Kafka consumer not committing offset correctly
  • How does spring security maintain authentication information between request?
  • Best practice of Spring Security with user details storage in microservices
  • It takes too long to send response (http status) back with sending emails
  • How does DelegatingFilterProxy know which filter to call to delegate the doFilter call?
  • shadow
    Privacy Policy - Terms - Contact Us © 35dp-dentalpractice.co.uk