MyFavMirrors/minio
1
0
Fork 0
mirror of https://github.com/minio/minio.git synced 2024-12-26 07:05:55 -05:00
Code Issues Packages Projects Releases Wiki Activity
d6a2fe02d3
minio/go.mod

94 lines
3.4 KiB
Modula-2
Raw Normal View History

add go modules file and start running go 1.11 style builds (#7354)
2019-03-19 16:50:59 -04:00
module github.com/minio/minio
[feat]: change erasure coding default block size from 10MiB to 1MiB (#11721) major performance improvements in range GETs to avoid large read amplification when ranges are tiny and random ``` ------------------- Operation: GET Operations: 142014 -> 339421 Duration: 4m50s -> 4m56s * Average: +139.41% (+1177.3 MiB/s) throughput, +139.11% (+658.4) obj/s * Fastest: +125.24% (+1207.4 MiB/s) throughput, +132.32% (+612.9) obj/s * 50% Median: +139.06% (+1175.7 MiB/s) throughput, +133.46% (+660.9) obj/s * Slowest: +203.40% (+1267.9 MiB/s) throughput, +198.59% (+753.5) obj/s ``` TTFB from 10MiB BlockSize ``` * First Access TTFB: Avg: 81ms, Median: 61ms, Best: 20ms, Worst: 2.056s ``` TTFB from 1MiB BlockSize ``` * First Access TTFB: Avg: 22ms, Median: 21ms, Best: 8ms, Worst: 91ms ``` Full object reads however do see a slight change which won't be noticeable in real world, so not doing any comparisons TTFB still had improvements with full object reads with 1MiB ``` * First Access TTFB: Avg: 68ms, Median: 35ms, Best: 11ms, Worst: 1.16s ``` v/s TTFB with 10MiB ``` * First Access TTFB: Avg: 388ms, Median: 98ms, Best: 20ms, Worst: 4.156s ``` This change should affect all new uploads, previous uploads should continue to work with business as usual. But dramatic improvements can be seen with these changes.
2021-03-06 17:09:34 -05:00
go 1.16
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
add go modules file and start running go 1.11 style builds (#7354)
2019-03-19 16:50:59 -04:00
require (
kms: replace KES client implementation with minio/kes (#12207) This commit replaces the custom KES client implementation with the KES SDK from https://github.com/minio/kes The SDK supports multi-server client load-balancing and requests retry out of the box. Therefore, this change reduces the overall complexity within the MinIO server and there is no need to maintain two separate client implementations. Signed-off-by: Andreas Auernhammer <aead@mail.de>
2021-05-10 21:15:11 -04:00
cloud.google.com/go/storage v1.10.0
update for smartos build (solaris too) (#10378)
2020-08-31 13:19:25 -04:00
github.com/Azure/azure-pipeline-go v0.2.2
github.com/Azure/azure-storage-blob-go v0.10.0
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/Shopify/sarama v1.27.2
add additional metrics per disk API latency, API call counts #11250) ``` mc admin info --json ``` provides these details, for now, we shall eventually expose this at Prometheus level eventually. Co-authored-by: Harshavardhana <harsha@minio.io>
2021-03-16 23:06:57 -04:00
github.com/VividCortex/ewma v1.1.1
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
github.com/alecthomas/participle v0.2.1
update jstream to latest release v1.0.1 (#10909)
2020-11-17 12:13:28 -05:00
github.com/bcicen/jstream v1.0.1
update NTP package for accurate time resolution fixes (#10670)
2020-10-14 02:59:20 -04:00
github.com/beevik/ntp v0.3.0
Update bloom module (#12383) To fix dependency import issues when importing madmin-go v0.7.1
2021-05-27 11:02:39 -04:00
github.com/bits-and-blooms/bloom/v3 v3.0.1
re-implement data usage crawler to be more efficient (#9075) Implementation overview: https://gist.github.com/klauspost/1801c858d5e0df391114436fdad6987b
2020-03-18 19:19:29 -04:00
github.com/cespare/xxhash/v2 v2.1.1
Add support for replication of object tags, retention metadata (#10880)
2020-11-19 14:50:22 -05:00
github.com/cheggaaa/pb v1.0.29
Update colinmarc/hdfs (#11417) Updates needed dependency as well. Fixes #11416
2021-02-02 18:37:30 -05:00
github.com/colinmarc/hdfs/v2 v2.2.0
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
github.com/coredns/coredns v1.4.0
Support bucket versioning (#9377) - Implement a new xl.json 2.0.0 format to support, this moves the entire marshaling logic to POSIX layer, top layer always consumes a common FileInfo construct which simplifies the metadata reads. - Implement list object versions - Migrate to siphash from crchash for new deployments for object placements. Fixes #2111
2020-06-12 23:04:01 -04:00
github.com/dchest/siphash v1.2.1
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
github.com/djherbis/atime v1.0.0
add NVMe drive info [model num, serial num, drive temp. etc.] (#10613) * add NVMe drive info [model num, serial num, drive temp. etc.] * Ignore fuse partitions * Add the nvme logic only for linux * Move smart/nvme structs to a separate file Co-authored-by: wlan0 <sidharthamn@gmail.com>
2020-10-04 13:18:46 -04:00
github.com/dswarbrick/smart v0.0.0-20190505152634-909a45200d6d
Migrate to go1.12 to simplify our cmd/http package (#7302) Simplify the cmd/http package overall by removing custom plain text v/s tls connection detection, by migrating to go1.12 and choose minimum version to be go1.12 Also remove all the vendored deps, since they are not useful anymore.
2019-04-02 21:28:39 -04:00
github.com/dustin/go-humanize v1.0.0
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/eclipse/paho.mqtt.golang v1.3.0
Add support for Elasticsearch 7.x (#12053) - Check ES server version by querying its API - Minimum required version of ES is 5.x - Add deprecation warnings for ES versions < 7.x - Still works with 5.x and 6.x, but support to be removed at a later date. Signed-off-by: Aditya Manthramurthy <aditya@minio.io>
2021-05-10 18:06:58 -04:00
github.com/elastic/go-elasticsearch/v7 v7.12.0
move the dependency to minio/pkg for common libraries (#12397)
2021-05-28 18:17:01 -04:00
github.com/fatih/color v1.12.0
update dependenices for relevant projects (#11445) - minio-go -> v7.0.8 - ldap/v3 -> v3.2.4 - reedsolomon -> v1.9.11 - sio-go -> v0.3.1 - msgp -> v1.1.5 - simdjson-go, md5-simd, highwayhash
2021-02-04 16:49:52 -05:00
github.com/go-ldap/ldap/v3 v3.2.4
feat: Deprecate embedded browser and import console (#12460) This feature also changes the default port where the browser is running, now the port has moved to 9001 and it can be configured with ``` --console-address ":9001" ```
2021-06-17 23:27:04 -04:00
github.com/go-openapi/loads v0.20.2
Update go-sql-driver pkg to support `checkConnLiveness` (#9766) Fixes #9679
2020-06-04 19:11:42 -04:00
github.com/go-sql-driver/mysql v1.5.0
[deps]: update jwt-go dependency (#12544) jwt-go has been renamed to jwt and has a new home. See https://github.com/dgrijalva/jwt-go/issues/462
2021-06-24 11:41:04 -04:00
github.com/golang-jwt/jwt v3.2.1+incompatible
Support for remote tier management (#12090) With this change, MinIO's ILM supports transitioning objects to a remote tier. This change includes support for Azure Blob Storage, AWS S3 compatible object storage incl. MinIO and Google Cloud Storage as remote tier storage backends. Some new additions include: - Admin APIs remote tier configuration management - Simple journal to track remote objects to be 'collected' This is used by object API handlers which 'mutate' object versions by overwriting/replacing content (Put/CopyObject) or removing the version itself (e.g DeleteObjectVersion). - Rework of previous ILM transition to fit the new model In the new model, a storage class (a.k.a remote tier) is defined by the 'remote' object storage type (one of s3, azure, GCS), bucket name and a prefix. * Fixed bugs, review comments, and more unit-tests - Leverage inline small object feature - Migrate legacy objects to the latest object format before transitioning - Fix restore to particular version if specified - Extend SharedDataDirCount to handle transitioned and restored objects - Restore-object should accept version-id for version-suspended bucket (#12091) - Check if remote tier creds have sufficient permissions - Bonus minor fixes to existing error messages Co-authored-by: Poorna Krishnamoorthy <poorna@minio.io> Co-authored-by: Krishna Srinivas <krishna@minio.io> Signed-off-by: Harshavardhana <harsha@minio.io>
2021-04-19 13:30:42 -04:00
github.com/gomodule/redigo v2.0.0+incompatible
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/google/uuid v1.1.2
move to gorilla mux 1.8.0 (#10328)
2020-08-23 02:14:02 -04:00
github.com/gorilla/mux v1.8.0
Update colinmarc/hdfs (#11417) Updates needed dependency as well. Fixes #11416
2021-02-02 18:37:30 -05:00
github.com/jcmturner/gokrb5/v8 v8.4.2
Revert "deprecate embedded browser (#12163)" This reverts commit 736d8cbac483d8bf56c3422ca9a9c4c3e043c6cf. Bring contrib files for older contributions
2021-04-29 22:01:43 -04:00
github.com/json-iterator/go v1.1.11
github.com/klauspost/compress v1.12.2
Update S2 compression (#11753) Relevant updates: * Less allocations on decode: https://github.com/klauspost/compress/pull/322 * Fixed rare out-of-bounds write on amd64. * ARM64 decompression assembly. Around 2x output speed. https://github.com/klauspost/compress/pull/324 * Speed up decompression on non-assembly platforms. https://github.com/klauspost/compress/pull/328 Upgrade cpuid to match simdjson.
2021-03-10 12:41:29 -05:00
github.com/klauspost/cpuid/v2 v2.0.4
Upgrade compress and pgzip package (#10992) Should provide faster decompression for s3 select and other places where it is used.
2020-11-27 13:10:15 -05:00
github.com/klauspost/pgzip v1.2.5
Fix JSON Close data race. (#8486) The JSON stream library has no safe way of aborting while Since we cannot expect the called to safely handle "Read" and "Close" calls we must handle this. Also any Read error returned from upstream will crash the server. We preserve the errors and instead always return io.EOF upstream, but send the error on Close. `readahead v1.3.1` handles Read after Close better. Updates to `progressReader` is mostly to ensure safety. Fixes #8481
2019-11-05 17:20:37 -05:00
github.com/klauspost/readahead v1.3.1
update dependenices for relevant projects (#11445) - minio-go -> v7.0.8 - ldap/v3 -> v3.2.4 - reedsolomon -> v1.9.11 - sio-go -> v0.3.1 - msgp -> v1.1.5 - simdjson-go, md5-simd, highwayhash
2021-02-04 16:49:52 -05:00
github.com/klauspost/reedsolomon v1.9.11
use Access() instead of Lstat() for frequent use (#11911) using Lstat() is causing tiny memory allocations, that are usually wasted and never used, instead we can simply uses Access() call that does 0 memory allocations.
2021-03-29 11:07:23 -04:00
github.com/lib/pq v1.9.0
Add a 'free' version to track deletion of tiered object content (#12470)
2021-06-30 22:32:07 -04:00
github.com/mattn/go-runewidth v0.0.13 // indirect
update deps to latest for some vulnerable deps (#11080) - github.com/miekg/dns - update elasticsearch library deps to circumvent some aws-sdk-go deps
2020-12-10 16:23:06 -05:00
github.com/miekg/dns v1.1.35
Migrate config to KV data format (#8392) - adding oauth support to MinIO browser (#8400) by @kanagaraj - supports multi-line get/set/del for all config fields - add support for comments, allow toggle - add extensive validation of config before saving - support MinIO browser to support proper claims, using STS tokens - env support for all config parameters, legacy envs are also supported with all documentation now pointing to latest ENVs - preserve accessKey/secretKey from FS mode setups - add history support implements three APIs - ClearHistory - RestoreHistory - ListHistory - add help command support for each config parameters - all the bug fixes after migration to KV, and other bug fixes encountered during testing.
2019-10-23 01:59:13 -04:00
github.com/minio/cli v1.22.0
update minio/console to latest master
2021-06-29 15:06:27 -04:00
github.com/minio/console v0.7.5-0.20210628223511-b51d5505f375
Revert "deprecate embedded browser (#12163)" This reverts commit 736d8cbac483d8bf56c3422ca9a9c4c3e043c6cf. Bring contrib files for older contributions
2021-04-29 22:01:43 -04:00
github.com/minio/csvparser v1.0.0
highwayhash: update to latest version containing an arm64 fix (#11901) This commit updates the highwayhash version to `v1.0.2` that fixes a critical issue on arm64.
2021-03-25 14:44:58 -04:00
github.com/minio/highwayhash v1.0.2
kms: replace KES client implementation with minio/kes (#12207) This commit replaces the custom KES client implementation with the KES SDK from https://github.com/minio/kes The SDK supports multi-server client load-balancing and requests retry out of the box. Therefore, this change reduces the overall complexity within the MinIO server and there is no need to maintain two separate client implementations. Signed-off-by: Andreas Auernhammer <aead@mail.de>
2021-05-10 21:15:11 -04:00
github.com/minio/kes v0.14.0
fix: cross compilation on openbsd/amd64 fixes #12620
2021-07-04 03:34:03 -04:00
github.com/minio/madmin-go v1.0.13
fix: support startAfter with S3 gateway fixes #12604
2021-07-05 21:44:00 -04:00
github.com/minio/minio-go/v7 v7.0.13-0.20210706013812-337aa536abe2
move parquet-go to github.com/minio/parquet-go repo
2021-05-03 11:51:43 -04:00
github.com/minio/parquet-go v1.0.0
Add admin file inspector (#12635) Download files from *any* bucket/path as an encrypted zip file. The key is included in the response but can be separated so zip and the key doesn't have to be sent on the same channel. Requires https://github.com/minio/pkg/pull/6
2021-07-09 14:29:16 -04:00
github.com/minio/pkg v1.0.10
Revert "deprecate embedded browser (#12163)" This reverts commit 736d8cbac483d8bf56c3422ca9a9c4c3e043c6cf. Bring contrib files for older contributions
2021-04-29 22:01:43 -04:00
github.com/minio/rpc v1.0.0
update CREDITS with minio/selfupdate project
2020-08-01 02:58:22 -04:00
github.com/minio/selfupdate v0.3.1
update sha256-simd to v1.0.0 (#11607)
2021-02-22 16:19:53 -05:00
github.com/minio/sha256-simd v1.0.0
update dependenices for relevant projects (#11445) - minio-go -> v7.0.8 - ldap/v3 -> v3.2.4 - reedsolomon -> v1.9.11 - sio-go -> v0.3.1 - msgp -> v1.1.5 - simdjson-go, md5-simd, highwayhash
2021-02-04 16:49:52 -05:00
github.com/minio/simdjson-go v0.2.1
update sio package to v0.3.0 (#12254)
2021-05-07 17:41:58 -04:00
github.com/minio/sio v0.3.0
feat: support of ZIP list/get/head as S3 extension (#12267) When enabled, it is possible to list/get files inside a zip file without uncompressing it. Signed-off-by: Anis Elleuch <anis@min.io>
2021-06-10 11:17:03 -04:00
github.com/minio/zipindex v0.2.0
add go modules file and start running go 1.11 style builds (#7354)
2019-03-19 16:50:59 -04:00
github.com/mitchellh/go-homedir v1.1.0
move internal/net to pkg/net package (#12505)
2021-06-14 17:54:37 -04:00
github.com/montanaflynn/stats v0.6.6
update nats.io/jwt dependency (#11066) primarily for a vulnerability report https://nvd.nist.gov/vuln/detail/CVE-2020-26521
2020-12-09 17:30:35 -05:00
github.com/nats-io/nats-server/v2 v2.1.9
Refactor health data structure (#11914) This feature comes with simplified data structures and versioning support. Signed-off-by: Bala.FA <bala.gluster@gmail.com>
2021-06-01 11:55:49 -04:00
github.com/nats-io/nats-streaming-server v0.21.2 // indirect
fix: migrate to go.etcd.io import path (#9987) with the merge of https://github.com/etcd-io/etcd/pull/11823 etcd v3.5.0 will now have a properly imported versioned path this fixes our pending migration to newer repo
2020-07-07 22:04:29 -04:00
github.com/nats-io/nats.go v1.10.0
feat: Deprecate embedded browser and import console (#12460) This feature also changes the default port where the browser is running, now the port has moved to 9001 and it can be configured with ``` --console-address ":9001" ```
2021-06-17 23:27:04 -04:00
github.com/nats-io/nkeys v0.2.0 // indirect
use Access() instead of Lstat() for frequent use (#11911) using Lstat() is causing tiny memory allocations, that are usually wasted and never used, instead we can simply uses Access() call that does 0 memory allocations.
2021-03-29 11:07:23 -04:00
github.com/nats-io/stan.go v0.8.3
Use O_DIRECT while writing to disk (#7479) - Use O_DIRECT while writing to disk - Remove MINIO_DRIVE_SYNC option
2019-04-24 00:25:06 -04:00
github.com/ncw/directio v1.0.5
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/nsqio/go-nsq v1.0.8
update deps to latest for some vulnerable deps (#11080) - github.com/miekg/dns - update elasticsearch library deps to circumvent some aws-sdk-go deps
2020-12-10 16:23:06 -05:00
github.com/olivere/elastic/v7 v7.0.22
fix: readData in bulk call using messagepack byte wrappers (#11228) This PR refactors the way we use buffers for O_DIRECT and to re-use those buffers for messagepack reader writer. After some extensive benchmarking found that not all objects have this benefit, and only objects smaller than 64KiB see this benefit overall. Benefits are seen from almost all objects from 1KiB - 32KiB Beyond this no objects see benefit with bulk call approach as the latency of bytes sent over the wire v/s streaming content directly from disk negate each other with no remarkable benefits. All other optimizations include reuse of msgp.Reader, msgp.Writer using sync.Pool's for all internode calls.
2021-01-07 22:27:31 -05:00
github.com/philhofer/fwd v1.1.1
move parquet-go to github.com/minio/parquet-go repo
2021-05-03 11:51:43 -04:00
github.com/pierrec/lz4 v2.6.0+incompatible
Support https and basic-auth for elasticsearch notification target (#10332)
2020-08-23 12:43:48 -04:00
github.com/pkg/errors v0.9.1
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/prometheus/client_golang v1.8.0
Updated Prometheus metrics (#11141) * Add metrics for nodes online and offline * Add cluster capacity metrics * Introduce v2 metrics
2021-01-18 23:35:38 -05:00
github.com/prometheus/client_model v0.2.0
use Access() instead of Lstat() for frequent use (#11911) using Lstat() is causing tiny memory allocations, that are usually wasted and never used, instead we can simply uses Access() call that does 0 memory allocations.
2021-03-29 11:07:23 -04:00
github.com/prometheus/procfs v0.6.0
simplify context timeout for readiness (#9772) additionally also add CORS support to restrict for specific origin, adds a new config and updated the documentation as well
2020-06-04 17:58:34 -04:00
github.com/rs/cors v1.7.0
update dependenices for relevant projects (#11445) - minio-go -> v7.0.8 - ldap/v3 -> v3.2.4 - reedsolomon -> v1.9.11 - sio-go -> v0.3.1 - msgp -> v1.1.5 - simdjson-go, md5-simd, highwayhash
2021-02-04 16:49:52 -05:00
github.com/secure-io/sio-go v0.3.1
upgrade event notification dependencies (#11095)
2020-12-12 23:31:28 -05:00
github.com/streadway/amqp v1.0.0
fix: implement readMetadata common function for re-use (#12353) Previous PR #12351 added functions to read from the reader stream to reduce memory usage, use the same technique in few other places where we are not interested in reading the data part.
2021-05-21 14:41:25 -04:00
github.com/tinylib/msgp v1.1.6-0.20210521143832-0becd170c402
reduce memory usage in metacache reader (#12334)
2021-05-20 12:00:11 -04:00
github.com/valyala/bytebufferpool v1.0.0
add go modules file and start running go 1.11 style builds (#7354)
2019-03-19 16:50:59 -04:00
github.com/valyala/tcplisten v0.0.0-20161114210144-ceec8f93295a
added support for SASL/SCRAM on Kafka bucket notifications. (#9168) fixes #9167
2020-03-20 14:10:27 -04:00
github.com/xdg/scram v0.0.0-20180814205039-7eeb5667e42c
fix: move to new etcd imports (#12391)
2021-05-28 13:31:42 -04:00
go.etcd.io/etcd/api/v3 v3.5.0-beta.4
go.etcd.io/etcd/client/v3 v3.5.0-beta.4
fix: speed up erasure code upgrade checks (#12626) DiskInfo() calls can stagger and wait if run serially timing out 10secs per drive, to avoid this lets check DiskInfo in parallel to avoid delays when nodes get disconnected.
2021-07-08 04:04:37 -04:00
go.uber.org/atomic v1.7.0
fix: move to new etcd imports (#12391)
2021-05-28 13:31:42 -04:00
go.uber.org/zap v1.16.1-0.20210329175301-c23abee72d19
move madmin to github.com/minio/madmin-go (#12239)
2021-05-06 11:52:02 -04:00
golang.org/x/crypto v0.0.0-20210421170649-83a5a9bb288b
Update yaml files to latest version RELEASE.2021-05-11T23-27-41Z
2021-05-11 20:16:44 -04:00
golang.org/x/sys v0.0.0-20210510120138-977fb7262007
Use rate.Limiter for bandwidth monitoring (#12506) Bonus: fixes a hang when bandwidth caps are enabled for synchronous replication
2021-06-24 21:29:30 -04:00
golang.org/x/time v0.0.0-20210220033141-f8bda1e9f3ba
Update yaml files to latest version RELEASE.2021-05-11T23-27-41Z
2021-05-11 20:16:44 -04:00
golang.org/x/tools v0.1.1 // indirect
kms: replace KES client implementation with minio/kes (#12207) This commit replaces the custom KES client implementation with the KES SDK from https://github.com/minio/kes The SDK supports multi-server client load-balancing and requests retry out of the box. Therefore, this change reduces the overall complexity within the MinIO server and there is no need to maintain two separate client implementations. Signed-off-by: Andreas Auernhammer <aead@mail.de>
2021-05-10 21:15:11 -04:00
google.golang.org/api v0.31.0
move the dependency to minio/pkg for common libraries (#12397)
2021-05-28 18:17:01 -04:00
gopkg.in/yaml.v2 v2.4.0
Update yaml files to latest version RELEASE.2021-01-30T00-20-58Z
2021-01-29 19:45:11 -05:00
)
kms: replace KES client implementation with minio/kes (#12207) This commit replaces the custom KES client implementation with the KES SDK from https://github.com/minio/kes The SDK supports multi-server client load-balancing and requests retry out of the box. Therefore, this change reduces the overall complexity within the MinIO server and there is no need to maintain two separate client implementations. Signed-off-by: Andreas Auernhammer <aead@mail.de>
2021-05-10 21:15:11 -04:00
replace google.golang.org/grpc => google.golang.org/grpc v1.29.1
Reference in New Issue Copy Permalink