High Performance Object Storage for AI
Go to file
2020-12-18 11:51:15 -08:00
.github xl: Always set root disk to true in test environment (#11094) 2020-12-12 16:10:07 -08:00
browser lifecycle improvements and additional debug logging (#11096) 2020-12-13 12:05:54 -08:00
buildscripts fix: refactor locks to apply them uniquely per node (#11052) 2020-12-10 07:28:37 -08:00
cmd Profiling does not required object layer to be initialized (#11133) 2020-12-18 11:51:15 -08:00
dockerscripts Remove alpine based image in favour or RedHat UBI (#11006) 2020-12-08 11:14:06 -08:00
docs Update yaml files to latest version RELEASE.2020-12-18T03-27-42Z 2020-12-18 03:45:13 +00:00
mint fix testListMultipartUpload in aws-sdk-go (#11122) 2020-12-16 13:24:10 -08:00
pkg add _MINIO_SERVER_DEBUG env for enabling debug messages (#11128) 2020-12-17 16:52:47 -08:00
.dockerignore Add a basic .dockerignore file to reduce docker context in make docker (#8282) 2019-09-21 04:49:56 +05:30
.gitignore Remove healthcheck script for Docker image (#8095) 2019-08-17 12:44:04 -07:00
.golangci.yml use argon2 with sync.Pool for better memory management (#11019) 2020-12-03 19:23:19 -08:00
.goreleaser.yml add minisign verification for container builds (#10115) 2020-07-22 17:09:31 -07:00
.mailmap Replace Minio refs in docs with MinIO and links (#7494) 2019-04-09 11:39:42 -07:00
.nancy-ignore remove ignoring incorrect CVE (#10597) 2020-09-30 13:10:24 -07:00
code_of_conduct.md cleanup unneeded files, update credits (#8858) 2020-01-20 10:38:58 -08:00
CONTRIBUTING.md fix: docs remove goreportcard, its deprecated 2020-03-24 14:51:06 -07:00
CREDITS update gocredits with new updated dependencies 2020-12-03 11:39:10 -08:00
docker-buildx.sh ubi-minimal doesn't support arm32, remove from build manifest 2020-12-09 18:56:11 -08:00
Dockerfile Remove alpine based image in favour or RedHat UBI (#11006) 2020-12-08 11:14:06 -08:00
Dockerfile.cicd avoid updating nsswitch.conf for redhat UBI images (#11056) 2020-12-08 14:28:12 -08:00
Dockerfile.dev avoid updating nsswitch.conf for redhat UBI images (#11056) 2020-12-08 14:28:12 -08:00
Dockerfile.dev.browser avoid updating nsswitch.conf for redhat UBI images (#11056) 2020-12-08 14:28:12 -08:00
Dockerfile.mint migrate mint tests to latest versions (#9424) 2020-04-22 16:06:58 -07:00
Dockerfile.release Remove alpine based image in favour or RedHat UBI (#11006) 2020-12-08 11:14:06 -08:00
go.mod replication: Ensure to always use nano precision source modtime (#11135) 2020-12-18 11:37:28 -08:00
go.sum replication: Ensure to always use nano precision source modtime (#11135) 2020-12-18 11:37:28 -08:00
LICENSE Initial commit 2014-10-30 21:51:52 -07:00
main.go update docs to indicate go1.14 is minimum 2020-09-09 11:27:48 -07:00
Makefile fix: refactor locks to apply them uniquely per node (#11052) 2020-12-10 07:28:37 -08:00
minio.spec fix: update RPM spec using rpmbuild (#10979) 2020-11-27 13:36:02 -08:00
NOTICE cleanup unneeded files, update credits (#8858) 2020-01-20 10:38:58 -08:00
README_zh_CN.md update docs to indicate go1.14 is minimum 2020-09-09 11:27:48 -07:00
README.md fix: README with missing word (#11035) 2020-12-07 11:11:58 -08:00
ruleguard.rules.go fix: IAM store fallback to list users and policies from disk (#10787) 2020-11-02 17:52:13 -08:00
SECURITY.md Fix SECURITY.md format and newlines 2020-01-03 17:49:34 -08:00
staticcheck.conf Add response header timeouts (#9170) 2020-03-21 22:10:13 -07:00
VULNERABILITY_REPORT.md add vulnerability report policy (#11084) 2020-12-12 17:38:37 -08:00

MinIO Quickstart Guide

Slack Docker Pulls

MinIO

MinIO is a High Performance Object Storage released under Apache License v2.0. It is API compatible with Amazon S3 cloud storage service. Use MinIO to build high performance infrastructure for machine learning, analytics and application data workloads.

Docker Container

Stable

docker run -p 9000:9000 \
  -e "MINIO_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE" \
  -e "MINIO_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" \
  minio/minio server /data

Edge

docker run -p 9000:9000 \
  -e "MINIO_ACCESS_KEY=AKIAIOSFODNN7EXAMPLE" \
  -e "MINIO_SECRET_KEY=wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY" \
  minio/minio:edge server /data

NOTE: Docker will not display the default keys unless you start the container with the -it(interactive TTY) argument. Generally, it is not recommended to use default keys with containers. Please visit MinIO Docker quickstart guide for more information here

macOS

Install minio packages using Homebrew

brew install minio/stable/minio
minio server /data

NOTE: If you previously installed minio using brew install minio then it is recommended that you reinstall minio from minio/stable/minio official repo instead.

brew uninstall minio
brew install minio/stable/minio

Binary Download

Platform Architecture URL
Apple macOS 64-bit Intel https://dl.min.io/server/minio/release/darwin-amd64/minio
chmod 755 minio
./minio server /data

GNU/Linux

Binary Download

Platform Architecture URL
GNU/Linux 64-bit Intel https://dl.min.io/server/minio/release/linux-amd64/minio
wget https://dl.min.io/server/minio/release/linux-amd64/minio
chmod +x minio
./minio server /data
Platform Architecture URL
GNU/Linux ppc64le https://dl.min.io/server/minio/release/linux-ppc64le/minio
wget https://dl.min.io/server/minio/release/linux-ppc64le/minio
chmod +x minio
./minio server /data

Microsoft Windows

Binary Download

Platform Architecture URL
Microsoft Windows 64-bit https://dl.min.io/server/minio/release/windows-amd64/minio.exe
minio.exe server D:\Photos

FreeBSD

Port

Install minio packages using pkg, MinIO doesn't officially build FreeBSD binaries but is maintained by FreeBSD upstream here.

pkg install minio
sysrc minio_enable=yes
sysrc minio_disks=/home/user/Photos
service minio start

Install from Source

Source installation is only intended for developers and advanced users. If you do not have a working Golang environment, please follow How to install Golang. Minimum version required is go1.15

GO111MODULE=on go get github.com/minio/minio

Allow port access for Firewalls

By default MinIO uses the port 9000 to listen for incoming connections. If your platform blocks the port by default, you may need to enable access to the port.

ufw

For hosts with ufw enabled (Debian based distros), you can use ufw command to allow traffic to specific ports. Use below command to allow access to port 9000

ufw allow 9000

Below command enables all incoming traffic to ports ranging from 9000 to 9010.

ufw allow 9000:9010/tcp

firewall-cmd

For hosts with firewall-cmd enabled (CentOS), you can use firewall-cmd command to allow traffic to specific ports. Use below commands to allow access to port 9000

firewall-cmd --get-active-zones

This command gets the active zone(s). Now, apply port rules to the relevant zones returned above. For example if the zone is public, use

firewall-cmd --zone=public --add-port=9000/tcp --permanent

Note that permanent makes sure the rules are persistent across firewall start, restart or reload. Finally reload the firewall for changes to take effect.

firewall-cmd --reload

iptables

For hosts with iptables enabled (RHEL, CentOS, etc), you can use iptables command to enable all traffic coming to specific ports. Use below command to allow access to port 9000

iptables -A INPUT -p tcp --dport 9000 -j ACCEPT
service iptables restart

Below command enables all incoming traffic to ports ranging from 9000 to 9010.

iptables -A INPUT -p tcp --dport 9000:9010 -j ACCEPT
service iptables restart

Test using MinIO Browser

MinIO Server comes with an embedded web based object browser. Point your web browser to http://127.0.0.1:9000 to ensure your server has started successfully.

Screenshot

Test using MinIO Client mc

mc provides a modern alternative to UNIX commands like ls, cat, cp, mirror, diff etc. It supports filesystems and Amazon S3 compatible cloud storage services. Follow the MinIO Client Quickstart Guide for further instructions.

Pre-existing data

When deployed on a single drive, MinIO server lets clients access any pre-existing data in the data directory. For example, if MinIO is started with the command minio server /mnt/data, any pre-existing data in the /mnt/data directory would be accessible to the clients.

The above statement is also valid for all gateway backends.

Upgrading MinIO

MinIO server supports rolling upgrades, i.e. you can update one MinIO instance at a time in a distributed cluster. This allows upgrades with no downtime. Upgrades can be done manually by replacing the binary with the latest release and restarting all servers in a rolling fashion. However, we recommend all our users to use mc admin update from the client. This will update all the nodes in the cluster simultaneously and restart them, as shown in the following command from the MinIO client (mc):

mc admin update <minio alias, e.g., myminio>

NOTE: some releases might not allow rolling upgrades, this is always called out in the release notes and it is generally advised to read release notes before upgrading. In such a situation mc admin update is the recommended upgrading mechanism to upgrade all servers at once.

Important things to remember during MinIO upgrades

  • mc admin update will only work if the user running MinIO has write access to the parent directory where the binary is located, for example if the current binary is at /usr/local/bin/minio, you would need write access to /usr/local/bin.
  • mc admin update updates and restarts all servers simultaneously, applications would retry and continue their respective operations upon upgrade.
  • mc admin update is disabled in kubernetes/container environments, container environments provide their own mechanisms to rollout of updates.
  • In the case of federated setups mc admin update should be run against each cluster individually. Avoid updating mc to any new releases until all clusters have been successfully updated.
  • If using kes as KMS with MinIO, just replace the binary and restart kes more information about kes can be found here
  • If using Vault as KMS with MinIO, ensure you have followed the Vault upgrade procedure outlined here: https://www.vaultproject.io/docs/upgrading/index.html
  • If using etcd with MinIO for the federation, ensure you have followed the etcd upgrade procedure outlined here: https://github.com/etcd-io/etcd/blob/master/Documentation/upgrades/upgrading-etcd.md

Explore Further

Contribute to MinIO Project

Please follow MinIO Contributor's Guide

License

Use of MinIO is governed by the Apache 2.0 License found at LICENSE.