High Performance Object Storage for AI
Go to file
Harshavardhana 082f777281 Revamp bucket metadata healing (#7208)
Bucket metadata healing in the current code was executed multiple
times each time for a given set. Bucket metadata just like
objects are hashed in accordance with its name on any given set,
to allow hashing to play a role we should let the top level
code decide where to navigate.

Current code also had 3 bucket metadata files hardcoded, whereas
we should make it generic by listing and navigating the .minio.sys
to heal such objects.

We also had another bug where due to isObjectDangling changes
without pre-existing bucket metadata files, we were erroneously
reporting it as grey/corrupted objects.

This PR fixes all of the above items.
2019-02-11 09:23:13 +05:30
.github Update Issue & PR Templates to have regression information when available (#6342) 2018-08-23 01:41:22 -07:00
browser Fix regexp matcher of browser assets and paths (#7083) 2019-01-22 10:58:28 -08:00
buildscripts Enable CI control from repository: Add Dockerfile.simpleci (#7122) 2019-02-01 12:04:28 -08:00
cmd Revamp bucket metadata healing (#7208) 2019-02-11 09:23:13 +05:30
dockerscripts docs: fix all Chinese doc links for the new docs site (#6097) 2018-06-28 16:02:02 -07:00
docs Added documentation for MINIO_HTTP_TRACE (#7207) 2019-02-10 11:57:43 +05:30
pkg Fix JSON parser handling for certain objects (#7162) 2019-02-07 08:04:42 +05:30
vendor Fix JSON parser handling for certain objects (#7162) 2019-02-07 08:04:42 +05:30
.gitignore Migrate config.json from config-dir to backend (#6195) 2018-08-15 10:11:47 +05:30
.jshintrc browser: Listing should append instead of replacing previous listing (#4188) 2017-04-28 09:30:26 -07:00
.mailmap Update AB's duplicate email address 2015-08-20 16:10:01 -07:00
.mention-bot Add mention-bot config 2016-05-20 13:53:15 -07:00
.travis.yml Fix build issues on BSDs in pkg/cpu (#7116) 2019-01-22 09:27:23 +05:30
CONTRIBUTING.md Fix slack Link (#7131) 2019-01-22 19:53:50 +05:30
Dockerfile Move docker edge to latest Go as well (#7030) 2018-12-28 17:24:24 -08:00
Dockerfile.dev Quickly build dev docker images using 'make docker' (#6505) 2018-09-25 10:33:25 -07:00
Dockerfile.release Revert "Remove curl after the usage (#6347)" (#6366) 2018-08-26 23:40:21 -07:00
Dockerfile.simpleci Enable CI control from repository: Add Dockerfile.simpleci (#7122) 2019-02-01 12:04:28 -08:00
LICENSE Initial commit 2014-10-30 21:51:52 -07:00
MAINTAINERS.md Fix typo (#5960) 2018-05-22 08:09:30 +05:30
Makefile Fix build issues on BSDs in pkg/cpu (#7116) 2019-01-22 09:27:23 +05:30
NOTICE Fix typo 2016-03-09 13:55:58 +01:00
README.md link to ppc64le binary added (#7065) 2019-01-11 20:16:19 +05:30
README_zh_CN.md Update screenshots. Use png instead of jpgs. (#5770) 2018-04-06 13:51:25 +05:30
hound.yml browser: Listing should append instead of replacing previous listing (#4188) 2017-04-28 09:30:26 -07:00
main.go Relax runtime requirement do not fail, print warning (#6017) 2018-06-06 09:25:12 +05:30
main_test.go Relax runtime requirement do not fail, print warning (#6017) 2018-06-06 09:25:12 +05:30
minio.spec Bring etcd support for bucket DNS federation 2018-06-08 10:22:01 -07:00

README.md

Minio Quickstart Guide

Slack Go Report Card Docker Pulls codecov

Minio is an object storage server released under Apache License v2.0. It is compatible with Amazon S3 cloud storage service. It is best suited for storing unstructured data such as photos, videos, log files, backups and container / VM images. Size of an object can range from a few KBs to a maximum of 5TB.

Minio server is light enough to be bundled with the application stack, similar to NodeJS, Redis and MySQL.

Docker Container

Stable

docker pull minio/minio
docker run -p 9000:9000 minio/minio server /data

Edge

docker pull minio/minio:edge
docker run -p 9000:9000 minio/minio:edge server /data

Note: Docker will not display the autogenerated keys unless you start the container with the -it(interactive TTY) argument. Generally, it is not recommended to use autogenerated keys with containers. Please visit Minio Docker quickstart guide for more information here

macOS

Homebrew

Install minio packages using Homebrew

brew install minio/stable/minio
minio server /data

NOTE: If you previously installed minio using brew install minio then it is recommended that you reinstall minio from minio/stable/minio official repo instead.

brew uninstall minio
brew install minio/stable/minio

Binary Download

Platform Architecture URL
Apple macOS 64-bit Intel https://dl.minio.io/server/minio/release/darwin-amd64/minio
chmod 755 minio
./minio server /data

GNU/Linux

Binary Download

Platform Architecture URL
GNU/Linux 64-bit Intel https://dl.minio.io/server/minio/release/linux-amd64/minio
wget https://dl.minio.io/server/minio/release/linux-amd64/minio
chmod +x minio
./minio server /data
Platform Architecture URL
GNU/Linux ppc64le https://dl.minio.io/server/minio/release/linux-ppc64le/minio
wget https://dl.minio.io/server/minio/release/linux-ppc64le/minio
chmod +x minio
./minio server /data

Microsoft Windows

Binary Download

Platform Architecture URL
Microsoft Windows 64-bit https://dl.minio.io/server/minio/release/windows-amd64/minio.exe
minio.exe server D:\Photos

FreeBSD

Port

Install minio packages using pkg

pkg install minio
sysrc minio_enable=yes
sysrc minio_disks=/home/user/Photos
service minio start

Install from Source

Source installation is only intended for developers and advanced users. If you do not have a working Golang environment, please follow How to install Golang.

go get -u github.com/minio/minio

Allow port access for Firewalls

By default Minio uses the port 9000 to listen for incoming connections. If your platform blocks the port by default, you may need to enable access to the port.

iptables

For hosts with iptables enabled (RHEL, CentOS, etc), you can use iptables command to enable all traffic coming to specific ports. Use below command to allow access to port 9000

iptables -A INPUT -p tcp --dport 9000 -j ACCEPT
service iptables restart

Below command enables all incoming traffic to ports ranging from 9000 to 9010.

iptables -A INPUT -p tcp --dport 9000:9010 -j ACCEPT
service iptables restart

ufw

For hosts with ufw enabled (Debian based distros), you can use ufw command to allow traffic to specific ports. Use below command to allow access to port 9000

ufw allow 9000

Below command enables all incoming traffic to ports ranging from 9000 to 9010.

ufw allow 9000:9010/tcp

firewall-cmd

For hosts with firewall-cmd enabled (CentOS), you can use firewall-cmd command to allow traffic to specific ports. Use below commands to allow access to port 9000

firewall-cmd --get-active-zones

This command gets the active zone(s). Now, apply port rules to the relevant zones returned above. For example if the zone is public, use

firewall-cmd --zone=public --add-port=9000/tcp --permanent

Note that permanent makes sure the rules are persistent across firewall start, restart or reload. Finally reload the firewall for changes to take effect.

firewall-cmd --reload

Test using Minio Browser

Minio Server comes with an embedded web based object browser. Point your web browser to http://127.0.0.1:9000 ensure your server has started successfully.

Screenshot

Test using Minio Client mc

mc provides a modern alternative to UNIX commands like ls, cat, cp, mirror, diff etc. It supports filesystems and Amazon S3 compatible cloud storage services. Follow the Minio Client Quickstart Guide for further instructions.

Pre-existing data

When deployed on a single drive, Minio server lets clients access any pre-existing data in the data directory. For example, if Minio is started with the command minio server /mnt/data, any pre-existing data in the /mnt/data directory would be accessible to the clients.

The above statement is also valid for all gateway backends.

Explore Further

Contribute to Minio Project

Please follow Minio Contributor's Guide

License

FOSSA Status