I have configured this property delete.retention.ms at the time of creating topic in kafka on 0.8.1 version.What this property does ? Will this delete message after the specific time interval from kafka.

1 Answer

No, delete.retention.ms or log.cleaner.delete.retention.ms is a property used in log compaction which is turned off as a default.log.rentention.hours is a property that you can control when messages are deleted.

From Broker Configs of Kafka 0.8.1 documentation

log.retention.hours

The amount of time to keep a log segment before it is deleted, i.e. the default data retention window for all topics. Note that if both log.retention.minutes and log.retention.bytes are both set we delete a segment when either limit is exceeded.

log.cleaner.delete.retention.ms

The amount of time to retain delete tombstone markers for log compacted topics. This setting also gives a bound on the time in which a consumer must complete a read if they begin from offset 0 to ensure that they get a valid snapshot of the final stage (otherwise delete tombstones may be collected before they complete their scan).

5

Your Answer

Sign up or log in

Sign up using Google Sign up using Facebook Sign up using Email and Password Submit

Post as a guest

Post Your Answer Discard

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.