Harshavardhana
fb96779a8a
Add large bucket support for erasure coded backend ( #5160 )
...
This PR implements an object layer which
combines input erasure sets of XL layers
into a unified namespace.
This object layer extends the existing
erasure coded implementation, it is assumed
in this design that providing > 16 disks is
a static configuration as well i.e if you started
the setup with 32 disks with 4 sets 8 disks per
pack then you would need to provide 4 sets always.
Some design details and restrictions:
- Objects are distributed using consistent ordering
to a unique erasure coded layer.
- Each pack has its own dsync so locks are synchronized
properly at pack (erasure layer).
- Each pack still has a maximum of 16 disks
requirement, you can start with multiple
such sets statically.
- Static sets set of disks and cannot be
changed, there is no elastic expansion allowed.
- Static sets set of disks and cannot be
changed, there is no elastic removal allowed.
- ListObjects() across sets can be noticeably
slower since List happens on all servers,
and is merged at this sets layer.
Fixes #5465
Fixes #5464
Fixes #5461
Fixes #5460
Fixes #5459
Fixes #5458
Fixes #5460
Fixes #5488
Fixes #5489
Fixes #5497
Fixes #5496
2018-02-15 17:45:57 -08:00
..
2018-02-09 15:19:30 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-01-22 14:54:55 -08:00
2018-01-31 08:15:54 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2017-01-10 16:43:48 -08:00
2017-11-07 15:18:59 -08:00
2018-01-22 14:54:55 -08:00
2017-03-18 11:28:41 -07:00
2018-01-22 14:54:55 -08:00
2016-10-12 11:02:15 -07:00
2016-10-12 11:02:15 -07:00
2017-09-24 16:43:21 -07:00
2016-11-21 13:51:05 -08:00
2018-01-22 14:54:55 -08:00
2017-11-15 14:10:45 -08:00
2018-01-17 10:36:25 -08:00
2018-01-17 10:36:25 -08:00
2018-01-19 16:38:47 -08:00
2018-02-06 15:07:17 -08:00
2018-02-06 15:07:17 -08:00
2017-09-19 12:37:56 -07:00
2018-01-13 10:04:52 +05:30
2017-03-26 12:00:27 -07:00
2017-03-26 12:00:27 -07:00
2018-01-19 16:38:47 -08:00
2018-01-31 08:15:54 -08:00
2017-11-25 11:58:29 -08:00
2018-02-15 17:45:57 -08:00
2018-02-09 15:19:30 -08:00
2018-02-15 17:45:57 -08:00
2018-02-09 15:19:30 -08:00
2017-11-29 13:12:47 -08:00
2018-02-15 17:45:57 -08:00
2018-02-09 15:19:30 -08:00
2017-08-12 19:25:43 -07:00
2017-11-29 13:12:47 -08:00
2018-02-15 17:45:57 -08:00
2018-02-09 15:19:30 -08:00
2017-10-27 16:14:06 -07:00
2017-11-02 11:39:48 -07:00
2018-02-15 17:45:57 -08:00
2017-11-25 11:58:29 -08:00
2018-01-05 13:18:08 +05:30
2018-01-05 13:18:08 +05:30
2018-02-02 10:17:13 -08:00
2018-01-31 08:15:54 -08:00
2018-02-01 13:00:07 +05:30
2017-08-12 19:25:43 -07:00
2017-12-06 12:48:29 +05:30
2018-01-31 08:15:54 -08:00
2018-01-31 08:15:54 -08:00
2017-03-03 16:32:04 -08:00
2017-03-03 16:32:04 -08:00
2017-01-16 17:05:00 -08:00
2017-01-16 17:05:00 -08:00
2017-08-31 14:43:59 -07:00
2017-09-14 10:23:23 -07:00
2017-11-10 17:21:23 -08:00
2017-11-20 14:04:10 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-01-03 13:47:22 -08:00
2018-01-03 13:47:22 -08:00
2017-11-25 11:58:29 -08:00
2018-01-03 13:47:22 -08:00
2017-12-22 14:57:57 -08:00
2018-01-03 13:47:22 -08:00
2017-11-25 11:58:29 -08:00
2017-08-14 18:08:42 -07:00
2017-11-25 11:58:29 -08:00
2018-01-03 13:47:22 -08:00
2018-02-15 17:45:57 -08:00
2018-01-13 10:04:52 +05:30
2017-01-16 17:05:00 -08:00
2017-01-16 17:05:00 -08:00
2016-10-29 12:44:44 -07:00
2018-01-31 13:17:24 -08:00
2018-02-06 15:37:48 -08:00
2018-01-08 14:30:55 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-01-22 14:54:55 -08:00
2018-01-13 22:43:02 +05:30
2018-01-31 18:28:28 -08:00
2017-10-22 11:00:34 +05:30
2018-02-06 15:37:48 -08:00
2018-01-31 13:17:24 -08:00
2018-02-01 15:27:12 +05:30
2017-08-12 19:25:43 -07:00
2017-08-30 09:48:19 -07:00
2018-02-15 17:45:57 -08:00
2017-12-05 17:58:09 -08:00
2017-12-05 17:58:09 -08:00
2018-02-09 15:19:30 -08:00
2018-02-09 15:19:30 -08:00
2017-08-12 19:25:43 -07:00
2018-01-04 11:00:52 +05:30
2018-02-15 17:45:57 -08:00
2017-11-10 17:21:23 -08:00
2018-01-22 14:54:55 -08:00
2018-02-15 17:45:57 -08:00
2017-11-29 13:12:47 -08:00
2018-01-05 11:24:31 -08:00
2016-12-19 19:32:55 -08:00
2017-04-21 07:15:53 -07:00
2016-08-18 16:23:42 -07:00
2016-08-18 16:23:42 -07:00
2018-02-02 09:13:30 +05:30
2018-01-10 10:34:00 -08:00
2017-03-18 11:28:41 -07:00
2018-01-16 12:00:12 -08:00
2018-01-16 12:00:12 -08:00
2017-04-11 10:25:21 -07:00
2017-01-02 20:57:42 +05:30
2018-02-06 15:07:17 -08:00
2017-08-12 19:25:43 -07:00
2017-06-05 12:25:04 -07:00
2018-02-15 17:45:57 -08:00
2017-08-31 14:43:59 -07:00
2018-02-15 17:45:57 -08:00
2018-01-13 10:04:52 +05:30
2018-01-30 21:42:15 -08:00
2018-01-17 07:24:46 -08:00
2018-01-24 09:04:09 +05:30
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2017-10-10 02:14:42 -07:00
2018-02-15 17:45:57 -08:00
2017-02-09 15:20:54 -08:00
2018-01-31 08:15:54 -08:00
2016-09-16 16:44:44 -07:00
2017-11-29 13:12:47 -08:00
2017-09-04 17:45:30 -07:00
2017-11-29 13:12:47 -08:00
2017-11-29 13:12:47 -08:00
2017-11-29 13:12:47 -08:00
2016-11-15 18:14:23 -08:00
2017-11-29 13:12:47 -08:00
2017-11-29 13:12:47 -08:00
2017-11-29 13:12:47 -08:00
2017-11-29 13:12:47 -08:00
2017-11-29 13:12:47 -08:00
2017-11-29 13:12:47 -08:00
2017-11-29 13:12:47 -08:00
2018-01-13 10:04:52 +05:30
2017-11-25 11:58:29 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-09 15:19:30 -08:00
2018-02-02 10:17:13 -08:00
2017-10-22 11:00:34 +05:30
2018-02-09 15:19:30 -08:00
2018-02-15 17:45:57 -08:00
2017-10-22 11:00:34 +05:30
2018-01-31 13:17:24 -08:00
2018-02-06 15:37:48 -08:00
2017-11-25 11:58:29 -08:00
2018-01-04 11:44:45 +05:30
2018-01-04 11:44:45 +05:30
2018-02-09 15:19:30 -08:00
2018-01-13 10:04:52 +05:30
2018-02-15 14:18:28 -08:00
2018-01-13 22:43:02 +05:30
2018-01-13 22:43:02 +05:30
2018-01-30 08:13:13 +05:30
2016-08-18 16:23:42 -07:00
2016-08-18 16:23:42 -07:00
2017-01-18 12:24:34 -08:00
2017-08-15 15:10:50 -07:00
2017-02-03 23:27:50 -08:00
2017-10-13 15:31:15 +05:30
2017-10-13 15:31:15 +05:30
2017-10-13 15:31:15 +05:30
2018-01-30 08:13:13 +05:30
2018-01-30 08:13:13 +05:30
2017-08-12 19:25:43 -07:00
2018-01-30 08:13:13 +05:30
2018-02-15 17:45:57 -08:00
2017-11-29 13:12:47 -08:00
2018-01-01 07:28:10 +05:30
2017-06-21 19:53:09 -07:00
2018-02-15 17:45:57 -08:00
2017-02-07 02:16:29 -08:00
2017-03-18 11:28:41 -07:00
2018-01-22 14:54:55 -08:00
2018-02-06 15:07:17 -08:00
2018-02-06 15:07:17 -08:00
2018-01-19 16:38:47 -08:00
2017-07-18 09:30:46 -07:00
2017-10-08 20:23:42 -07:00
2018-02-09 15:19:30 -08:00
2017-11-25 11:58:29 -08:00
2018-02-09 15:19:30 -08:00
2018-02-09 15:19:30 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-02 10:17:13 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2017-07-12 16:33:21 -07:00
2017-04-11 15:44:27 -07:00
2018-01-05 11:24:31 -08:00
2017-11-29 13:12:47 -08:00
2018-01-11 11:42:05 -08:00
2017-11-29 13:12:47 -08:00
2018-02-02 09:13:30 +05:30
2017-11-13 12:54:03 -08:00
2018-01-09 12:49:50 +05:30
2018-01-09 12:49:50 +05:30
2018-01-02 12:00:02 +05:30
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2016-11-13 11:48:02 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-06 15:07:17 -08:00
2017-09-25 11:32:56 -07:00
2017-11-25 11:58:29 -08:00
2016-10-10 01:42:32 -07:00
2018-01-11 11:42:05 -08:00
2018-02-15 17:45:57 -08:00
2018-02-01 10:47:49 -08:00
2016-08-18 16:23:42 -07:00
2016-08-18 16:23:42 -07:00
2017-11-25 11:58:29 -08:00
2018-02-06 15:07:17 -08:00
2017-12-15 12:33:42 -08:00
2018-01-17 10:54:31 -08:00
2017-12-15 12:33:42 -08:00
2017-12-15 12:33:42 -08:00
2018-02-06 15:37:48 -08:00
2018-02-06 15:37:48 -08:00
2017-10-10 02:14:42 -07:00
2017-02-19 20:46:06 -08:00
2018-02-15 17:45:57 -08:00
2018-02-09 15:19:30 -08:00
2017-11-06 15:59:37 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2017-12-28 23:02:48 +05:30
2018-02-15 17:45:57 -08:00
2017-07-07 14:31:42 -07:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-01-22 14:54:55 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-01-12 18:16:30 +05:30
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00
2018-02-15 17:45:57 -08:00