High Performance Object Storage for AI
Go to file
2016-01-08 19:59:23 -08:00
buildscripts docker: second --ldflags was overriding the first --ldflags option 2015-11-07 15:21:01 -08:00
pkg s3cmd: Fix signature issues related to s3cmd. 2015-12-28 18:05:28 -08:00
vendor cli: vendorize to new CLI package updates. 2015-11-21 09:01:18 -08:00
.gitignore build: Versioning now populated through ldflags 2015-11-02 02:37:26 -08:00
.mailmap Update AB's duplicate email address 2015-08-20 16:10:01 -07:00
.travis.yml Improve disk code to return back disk StatFS{} structure 2015-10-17 20:19:26 -07:00
accesslog-handler.go Implement accessLog handler 2015-10-19 13:07:09 -07:00
api-definitions.go bucket-location: Implement bucket location response. 2015-12-27 00:48:11 -07:00
api-errors.go s3cmd: Handle support for s3cmd. 2015-12-09 17:16:53 -08:00
api-headers.go http: Enable Transfer-Encoding chunked transfer 2016-01-08 00:47:20 -08:00
api-resources.go Implement Bucket ACL support 2015-10-16 19:47:30 -07:00
api-response.go http: Enable Transfer-Encoding chunked transfer 2016-01-08 00:47:20 -08:00
api-signature.go s3cmd: Fix signature issues related to s3cmd. 2015-12-28 18:05:28 -08:00
appveyor.yml http: Enable Transfer-Encoding chunked transfer 2016-01-08 00:47:20 -08:00
auth-utils.go Migrate this project to minio micro services code 2015-10-16 11:26:08 -07:00
AWS-SDK-GO.md doc: Cleanup aws-sdk-go.md 2015-11-23 13:53:55 -08:00
bucket-acl.go Migrate this project to minio micro services code 2015-10-16 11:26:08 -07:00
bucket-handlers.go http: Enable Transfer-Encoding chunked transfer 2016-01-08 00:47:20 -08:00
build-constants.go build: Versioning now populated through ldflags 2015-11-02 02:37:26 -08:00
commands.go Add trie to verify wrong inputs, and provide meaningful messages 2015-09-17 16:49:08 -07:00
config-logger-main.go minio: Add config-folder option. 2015-12-07 12:34:09 -08:00
config-main.go Add logger command - also migrate from old config to newer config 2015-10-21 00:02:16 -07:00
config-version-main.go minio: Add config-folder option. 2015-12-07 12:34:09 -08:00
console.go Migrate this project to minio micro services code 2015-10-16 11:26:08 -07:00
CONTRIBUTING.md Migrate this project to minio micro services code 2015-10-16 11:26:08 -07:00
Docker.md Fix docker.md with data volume container 2015-11-28 11:33:23 -08:00
Dockerfile docker: the docker image will now contain just the static binary 2015-11-06 20:44:58 -08:00
flags.go minio: Add config-folder option. 2015-12-07 12:34:09 -08:00
generic-handlers.go s3cmd: Handle support for s3cmd. 2015-12-09 17:16:53 -08:00
httprange.go Implement Bucket ACL support 2015-10-16 19:47:30 -07:00
INSTALLGO.md Modifed instructions for installing Go. 2015-12-30 12:23:28 +05:30
LICENSE Initial commit 2014-10-30 21:51:52 -07:00
logger_test.go Migrate this project to minio micro services code 2015-10-16 11:26:08 -07:00
logger-file-hook.go logger: Improve logger input argument handling and colorize outputs 2015-11-03 22:51:42 -08:00
logger-mongo-hook.go Add new logging connectors 2015-10-19 23:11:32 -07:00
logger-syslog-hook_nix.go Rename _linux to _nix for OS X build 2015-10-21 20:18:53 -07:00
logger-syslog-hook_windows.go Enable all config loggers 2015-10-21 17:35:07 -07:00
logger.go Migrate this project to minio micro services code 2015-10-16 11:26:08 -07:00
main_test.go Migrate this project to minio micro services code 2015-10-16 11:26:08 -07:00
main.go minio: Add config-folder option. 2015-12-07 12:34:09 -08:00
MAINTAINERS.md doc: Add MAINTAINERS.md 2015-12-02 10:50:54 -08:00
Makefile doc: Add MAINTAINERS.md 2015-12-02 10:50:54 -08:00
NOTICE Move from Minimalist Object Storage to Minio Cloud Storage 2015-07-24 17:51:40 -07:00
notifier.go update: Re-write update command. 2015-11-25 21:17:57 -08:00
object-handlers.go http: Enable Transfer-Encoding chunked transfer 2016-01-08 00:47:20 -08:00
README.md Add aws-cli documentation. 2016-01-08 19:59:23 -08:00
release.cmd release: Add release scripts. 2015-12-02 10:43:41 -08:00
release.sh doc: Add MAINTAINERS.md 2015-12-02 10:50:54 -08:00
routers.go bucket-location: Implement bucket location response. 2015-12-27 00:48:11 -07:00
server_fs_test.go minio: Add config-folder option. 2015-12-07 12:34:09 -08:00
server-config.go minio: Add config-folder option. 2015-12-07 12:34:09 -08:00
server-main.go minio: Fix mc and minio download URLs. 2015-12-13 13:57:56 -08:00
signature_utils_test.go Migrate this project to minio micro services code 2015-10-16 11:26:08 -07:00
signature-handler.go s3cmd: Handle support for s3cmd. 2015-12-09 17:16:53 -08:00
trie.go Add trie to verify wrong inputs, and provide meaningful messages 2015-09-17 16:49:08 -07:00
typed-errors.go Enable all config loggers 2015-10-21 17:35:07 -07:00
update-main.go Fix update URL. 2015-12-22 17:28:47 -08:00
utils.go handlers: read ContentLength value directly from http.Request. 2015-12-27 23:03:32 -08:00
vendor.json atomic: do not sync by default, if needed use CloseAndSync() 2015-11-17 23:04:18 -08:00
verify-runtime.go Implement update command 2015-10-17 15:04:54 -07:00
version_test.go Move all server and controller packages into top-level 2015-09-19 01:07:42 -07:00
version-main.go docker: second --ldflags was overriding the first --ldflags option 2015-11-07 15:21:01 -08:00

Minio Gitter

Minio is a minimal cloud storage server for Micro Services. Written in Golang and licensed under Apache license v2. Compatible with Amazon S3 APIs.

Description

Micro services environment provisions one Minio server per application instance. Scalability is achieved through large number of smaller personalized instances. This version of the Minio binary is built using Filesystem storage backend for magnetic and solid state disks.

Minio Client

Minio Client (mc) provides a modern alternative to Unix commands like ls, cat, cp, sync, and diff. It supports POSIX compatible filesystems and Amazon S3 compatible cloud storage systems. It is entirely written in Golang.

Amazon S3 Compatible Client Libraries

Install Build StatusBuild status

GNU/Linux

Download minio for:

$ chmod +x minio
$ ./minio help

OS X

Download minio from https://dl.minio.io/server/minio/release/darwin-amd64/minio

$ chmod 755 minio
$ ./minio help

Microsoft Windows

Download minio for:

C:\Users\Username\Downloads> minio.exe help

Docker container

Download minio for docker.

$ docker pull minio/minio

Read more here on How to configure data volume containers for Minio?

Source

NOTE: Source installation is intended for only developers and advanced users. minio update continous delivery mechanism is not supported for go get based binary builds. Please download official releases from https://minio.io/#minio.

If you do not have a working Golang environment, please follow Install Golang.

$ GO15VENDOREXPERIMENT=1 go get -u github.com/minio/minio

How to use Minio?

NAME:
  minio server - Start Minio cloud storage server.

USAGE:
  minio server [OPTION VALUE] PATH

  OPTION = expiry        VALUE = NN[h|m|s] [DEFAULT=Unlimited]
  OPTION = min-free-disk VALUE = NN% [DEFAULT: 10%]

EXAMPLES:
  1. Start minio server on Linux.
        $ minio server /home/shared

  2. Start minio server on Windows.
        $ minio server C:\MyShare

  3. Start minio server bound to a specific IP:PORT, when you have multiple network interfaces.
        $ minio --address 192.168.1.101:9000 server /home/shared

  4. Start minio server with minimum free disk threshold to 5%
        $ minio server min-free-disk 5% /home/shared/Pictures

  5. Start minio server with minimum free disk threshold to 15% with auto expiration set to 1h
        $ minio server min-free-disk 15% expiry 1h /home/shared/Documents

Start Minio server.

$ minio server ~/Photos
AccessKey: G5GJRH51R2HSUWYPGIX5  SecretKey: uxhBC1Yscut3/u81l5L8Yp636ZUk32N4m/gFASuZ

To configure Minio Client.

	$ wget https://dl.minio.io/client/mc/release/linux-amd64/mc
	$ chmod 755 mc
	$ ./mc config host add http://localhost:9000 G5GJRH51R2HSUWYPGIX5 uxhBC1Yscut3/u81l5L8Yp636ZUk32N4m/gFASuZ
	$ ./mc mb localhost:9000/photobucket
	$ ./mc cp ~/Photos... localhost:9000/photobucket

Starting minio server:
Listening on http://127.0.0.1:9000
Listening on http://172.30.2.17:9000

How to use AWS CLI with Minio?

This section assumes that you have already installed aws-cli, if not please visit https://aws.amazon.com/cli/

To configure aws-cli, type aws configure and follow below steps.

$ aws configure
AWS Access Key ID [None]: YOUR_ACCESS_KEY_HERE
AWS Secret Access Key [None]: YOUR_SECRET_KEY_HERE
Default region name [None]: us-east-1
Default output format [None]: ENTER

Additionally enable aws-cli to use AWS Signature Version '4' for Minio server.

$ aws configure set default.s3.signature_version s3v4

To list your buckets.

$ aws --endpoint-url http://localhost:9000 s3 ls
2016-01-07 16:38:23 testbucket

To list contents inside bucket.

$ aws --endpoint-url http://localhost:9000 s3 ls testbucket
                           PRE test/
2015-12-17 08:46:41   12232928 vim
2016-01-07 16:38:23   32232928 emacs
2015-12-09 08:05:24     138504 s3cmd

How to use AWS SDK with Minio?

Please follow the documentation here - Using aws-sdk-go with Minio server

How to use s3cmd with Minio?

This section assumes that you have already installed s3cmd, if not please visit http://s3tools.org/s3cmd

Edit the following fields in your s3cmd configuration file ~/.s3cfg .

host_base = localhost:9000
host_bucket = localhost:9000
access_key = YOUR_ACCESS_KEY_HERE
secret_key = YOUR_SECRET_KEY_HERE

To list your buckets.

$ s3cmd ls s3://
2015-12-09 16:12  s3://testbbucket

To list contents inside buckets.

$ s3cmd ls s3://testbucket/
                       DIR   s3://testbucket/test/
2015-12-09 16:05    138504   s3://testbucket/newfile

Contribute to Minio Project

Please follow Minio Contributor's Guide

Jobs

If you think in Lisp or Haskell and hack in go, you would blend right in. Send your github link to callhome@minio.io.