minio/docs/zh_CN/deployment/kernel-tuning/README.md

97 lines
3.7 KiB
Markdown
Raw Normal View History

# Linux服务器上MinIO生产环境的内核调优 [![Slack](https://slack.min.io/slack?type=svg)](https://slack.min.io) [![Docker Pulls](https://img.shields.io/docker/pulls/minio/minio.svg?maxAge=604800)](https://hub.docker.com/r/minio/minio/)
2017-11-22 18:15:40 -05:00
这儿有一份针对MinIO服务器内核调优的建议 你可以拷贝这个[脚本](https://github.com/minio/minio/blob/master/docs/deployment/kernel-tuning/sysctl.sh)到你的服务器上使用。
2017-11-22 18:15:40 -05:00
> 注意: 这是Linux服务器上的通用建议不过在使用前也要非常小心。这些设置不是强制性的而且也不能解决硬件的问题所以不要使用它们提高
> 性能掩盖硬件本身的问题。在任何情况下,都应该先进行硬件基准测试,达到预期结果后才真正的执行优化。
2017-11-22 18:15:40 -05:00
```
#!/bin/bash
2017-11-22 18:15:40 -05:00
cat > sysctl.conf <<EOF
# maximum number of open files/file descriptors
fs.file-max = 4194303
2017-11-22 18:15:40 -05:00
# use as little swap space as possible
vm.swappiness = 1
2017-11-22 18:15:40 -05:00
# prioritize application RAM against disk/swap cache
vm.vfs_cache_pressure = 50
2017-11-22 18:15:40 -05:00
# minimum free memory
vm.min_free_kbytes = 1000000
2017-11-22 18:15:40 -05:00
# follow mellanox best practices https://community.mellanox.com/s/article/linux-sysctl-tuning
# the following changes are recommended for improving IPv4 traffic performance by Mellanox
2017-11-22 18:15:40 -05:00
# disable the TCP timestamps option for better CPU utilization
net.ipv4.tcp_timestamps = 0
2017-11-22 18:15:40 -05:00
# enable the TCP selective acks option for better throughput
net.ipv4.tcp_sack = 1
2017-11-22 18:15:40 -05:00
# increase the maximum length of processor input queues
net.core.netdev_max_backlog = 250000
2017-11-22 18:15:40 -05:00
# increase the TCP maximum and default buffer sizes using setsockopt()
net.core.rmem_max = 4194304
net.core.wmem_max = 4194304
net.core.rmem_default = 4194304
net.core.wmem_default = 4194304
net.core.optmem_max = 4194304
2017-11-22 18:15:40 -05:00
# increase memory thresholds to prevent packet dropping:
net.ipv4.tcp_rmem = "4096 87380 4194304"
net.ipv4.tcp_wmem = "4096 65536 4194304"
2017-11-22 18:15:40 -05:00
# enable low latency mode for TCP:
net.ipv4.tcp_low_latency = 1
2017-11-22 18:15:40 -05:00
# the following variable is used to tell the kernel how much of the socket buffer
# space should be used for TCP window size, and how much to save for an application
# buffer. A value of 1 means the socket buffer will be divided evenly between.
# TCP windows size and application.
net.ipv4.tcp_adv_win_scale = 1
2017-11-22 18:15:40 -05:00
# maximum number of incoming connections
net.core.somaxconn = 65535
2017-11-22 18:15:40 -05:00
# maximum number of packets queued
net.core.netdev_max_backlog = 10000
2017-11-22 18:15:40 -05:00
# queue length of completely established sockets waiting for accept
net.ipv4.tcp_max_syn_backlog = 4096
2017-11-22 18:15:40 -05:00
# time to wait (seconds) for FIN packet
net.ipv4.tcp_fin_timeout = 15
2017-11-22 18:15:40 -05:00
# disable icmp send redirects
net.ipv4.conf.all.send_redirects = 0
2017-11-22 18:15:40 -05:00
# disable icmp accept redirect
net.ipv4.conf.all.accept_redirects = 0
2017-11-22 18:15:40 -05:00
# drop packets with LSR or SSR
net.ipv4.conf.all.accept_source_route = 0
2017-11-22 18:15:40 -05:00
# MTU discovery, only enable when ICMP blackhole detected
net.ipv4.tcp_mtu_probing = 1
2017-11-22 18:15:40 -05:00
EOF
2017-11-22 18:15:40 -05:00
echo "Enabling system level tuning params"
sysctl --quiet --load sysctl.conf && rm -f sysctl.conf
# `Transparent Hugepage Support`*: This is a Linux kernel feature intended to improve
# performance by making more efficient use of processors memory-mapping hardware.
# But this may cause https://blogs.oracle.com/linux/performance-issues-with-transparent-huge-pages-thp
# for non-optimized applications. As most Linux distributions set it to `enabled=always` by default,
# we recommend changing this to `enabled=madvise`. This will allow applications optimized
# for transparent hugepages to obtain the performance benefits, while preventing the
# associated problems otherwise. Also, set `transparent_hugepage=madvise` on your kernel
# command line (e.g. in /etc/default/grub) to persistently set this value.
echo "Enabling THP madvise"
echo madvise | sudo tee /sys/kernel/mm/transparent_hugepage/enabled
```