MyFavMirrors/minio
1
0
Fork 0
mirror of https://github.com/minio/minio.git synced 2025-11-07 12:52:58 -05:00
Code Issues Packages Projects Releases Wiki Activity

Revert "Disable crawler in FS/NAS gateway mode (#9695)" (#9702)

Browse Source 
This reverts commit eba423bb9d.

Additionally also address the FS crawler to properly
calculate the sizes for encrypted/compressed content.
This commit is contained in:
Harshavardhana
2020-05-25 11:32:53 -07:00
committed by GitHub
parent fb9be81fab
commit 6e0575a53d
5 changed files with 79 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
docs/config/README.md
View File

@@ -257,7 +257,9 @@ This behavior is consistent across all keys, each key self documents itself with
## Environment only settings (not in config)
#### Usage crawler
Data usage crawler is enabled by default on erasure coded and distributed erasure coded deployments.
> NOTE: Data usage crawler is not supported under Gateway deployments.
Data usage crawler is enabled by default, following ENVs allow for more staggered delay in terms of usage calculation.
The crawler adapts to the system speed and completely pauses when the system is under load. It is possible to adjust the speed of the crawler and thereby the latency of updates being reflected. The delays between each operation of the crawl can be adjusted by the `MINIO_DISK_USAGE_CRAWL_DELAY` environment variable. By default the value is `10`. This means the crawler will sleep *10x* the time each operation takes.