Enable event persistence in kafka (#7633)

This commit is contained in:
Praveen raj Mani
2019-05-30 01:49:48 +05:30
committed by kannappanr
parent da8214845a
commit 763fce909b
8 changed files with 139 additions and 21 deletions

View File

@@ -931,10 +931,23 @@ The MinIO server configuration file is stored on the backend in json format. Upd
"1": {
"enable": true,
"brokers": ["localhost:9092"],
"topic": "bucketevents"
"topic": "bucketevents",
"queueDir": "",
"queueLimit": 0,
"tls": {
"enable": false,
"skipVerify": false,
"clientAuth": 0
},
"sasl": {
"enable": false,
"username": "",
"password": ""
}
}
}
```
MinIO supports persistent event store. The persistent store will backup events when the kafka broker goes offline and replays it when the broker comes back online. The event store can be configured by setting the directory path in `queueDir` field and the maximum limit of events in the queueDir in `queueLimit` field. For eg, the `queueDir` can be `/home/events` and `queueLimit` can be `1000`. By default, the `queueLimit` is set to 10000.
To update the configuration, use `mc admin config get` command to get the current configuration file for the minio deployment in json format, and save it locally.