Commit Graph

849 Commits

Author SHA1 Message Date
Frederick F. Kautz IV
b4ef522a9b Donut frame is now its own package 2015-03-01 00:02:14 -08:00
Frederick F. Kautz IV
97e572f318 Merge pull request #228 from fkautz/pr_out_renaming_write_to_writeframe 2015-02-28 23:53:06 -08:00
Frederick F. Kautz IV
6c2428833a Renaming Write to WriteFrame 2015-02-28 23:52:56 -08:00
Harshavardhana
8ab0cc29f2 Merge pull request #227 from harshavardhana/pr_out_add_donut_benchmark_for_64mb_128mb_256mb_512mb 2015-02-28 17:06:40 -08:00
Harshavardhana
6b397844b9 Add donut benchmark for 64MB, 128MB, 256MB, 512MB
Current average values

~~~
> minio/pkg/storage/donut/v1 *> go test -bench .
OK: 2 passed
PASS
BenchmarkDonut64M              5         266249634 ns/op         252.05 MB/s
BenchmarkDonut128M             3         436507394 ns/op         307.48 MB/s
BenchmarkDonut256M             2         836116359 ns/op         321.05 MB/s
BenchmarkDonut512M             1        1676738951 ns/op         320.19 MB/s
ok      github.com/minio-io/minio/pkg/storage/donut/v1  8.430s
> minio/pkg/storage/donut/v1 *>
~~~
2015-02-28 17:05:46 -08:00
Harshavardhana
24c5ab70be Merge pull request #226 from harshavardhana/pr_out_donut_gen_works_with_new_donut_frame 2015-02-28 16:30:34 -08:00
Harshavardhana
65f22083ca donut_gen works with new Donut Frame 2015-02-28 16:30:18 -08:00
Frederick F. Kautz IV
4d98c355c9 Merge pull request #224 from abperiasamy/units 2015-02-28 16:12:10 -08:00
Frederick F. Kautz IV
a067fdb59d Merge pull request #225 from fkautz/pr_out_donut_now_tests_amount_written_should_match_expected_amount_to_write 2015-02-28 16:10:09 -08:00
Frederick F. Kautz IV
ddc7cf835e Donut now tests amount written should match expected amount to write 2015-02-28 16:09:52 -08:00
Frederick F. Kautz IV
a86e5b5586 Merge pull request #223 from fkautz/pr_out_updating_comment_describing_data_type 2015-02-28 16:00:12 -08:00
Frederick F. Kautz IV
d3d1205eb1 Updating comment describing data type 2015-02-28 15:59:52 -08:00
Frederick F. Kautz IV
c2ae974c94 Merge pull request #222 from fkautz/pr_out_new_donut_frame_implemented 2015-02-28 15:54:45 -08:00
Frederick F. Kautz IV
58a04ee831 New donut frame implemented 2015-02-28 15:54:13 -08:00
Anand Babu (AB) Periasamy
317a1141c0 removed unitconv 2015-02-28 15:53:44 -08:00
Frederick F. Kautz IV
9744efc725 Merge pull request #221 from fkautz/pr_out_adding_streaming_sha512 2015-02-28 15:52:10 -08:00
Frederick F. Kautz IV
90cd8b7b47 Adding streaming sha512 2015-02-28 15:51:33 -08:00
Harshavardhana
56bd413a16 Merge pull request #219 from harshavardhana/pr_out_add_1mb_block_benchmarks 2015-02-28 15:25:24 -08:00
Harshavardhana
7feca3f0d1 Add 1MB block benchmarks 2015-02-28 15:00:24 -08:00
Harshavardhana
20dc738b67 Merge pull request #218 from harshavardhana/pr_out_implement_proper_delimiter_and_prefix_handling 2015-02-28 14:48:46 -08:00
Harshavardhana
0c2d58bc6d Implement proper delimiter and prefix handling
With this change Minio server now responds with, delimited
'object names' in conjunction with prefix filtering

~~~
<ListBucketResult>
  <Name>example-bucket</Name>
  <Prefix></Prefix>
  <Marker></Marker>
  <MaxKeys>1000</MaxKeys>
  <Delimiter>/</Delimiter>
  <IsTruncated>false</IsTruncated>
  <Contents>
    <Key>sample.html</Key>
    <LastModified>2011-02-26T01:56:20.000Z</LastModified>
    <ETag>example-bucket#sample.html</ETag>
    <Size>142863</Size>
    <Owner>
      <ID>minio</ID>
      <DisplayName>minio</DisplayName>
    </Owner>
    <StorageClass>STANDARD</StorageClass>
  </Contents>
  <CommonPrefixes>
    <Prefix>photos/</Prefix>
  </CommonPrefixes>
</ListBucketResult>
~~~

~~~
<ListBucketResult>
  <Name>example-bucket</Name>
  <Prefix>photos/2006/</Prefix>
  <Marker></Marker>
  <MaxKeys>1000</MaxKeys>
  <Delimiter>/</Delimiter>
  <IsTruncated>false</IsTruncated>

  <CommonPrefixes>
    <Prefix>photos/2006/feb/</Prefix>
  </CommonPrefixes>
  <CommonPrefixes>
    <Prefix>photos/2006/jan/</Prefix>
  </CommonPrefixes>
</ListBucketResult>
~~~
2015-02-28 14:47:19 -08:00
Harshavardhana
acee4d16fd Merge pull request #217 from harshavardhana/pr_out_use_validstring 2015-02-27 19:49:33 -08:00
Harshavardhana
d5e5a3b3e6 Use validString 2015-02-27 19:49:18 -08:00
Harshavardhana
27fab98bf9 Merge pull request #216 from harshavardhana/pr_out_add_object_name_validation 2015-02-27 19:42:14 -08:00
Harshavardhana
6ebb48b4ea Add object name validation 2015-02-27 19:42:04 -08:00
Harshavardhana
e7992320c1 Merge pull request #215 from harshavardhana/pr_out_sort_list_of_objects 2015-02-27 17:53:19 -08:00
Harshavardhana
9acb1f728c Sort list of objects 2015-02-27 17:52:55 -08:00
Harshavardhana
3a048dc676 Merge pull request #208 from harshavardhana/pr_out_implement_delimiter_and_path_prefix 2015-02-27 16:24:15 -08:00
Harshavardhana
53669a0854 Implement delimiter, path prefix 2015-02-27 16:23:05 -08:00
Harshavardhana
01e84c596c Merge pull request #214 from harshavardhana/pr_out_remove_donut_gen_binary_and_update_crc32c_function 2015-02-27 14:42:22 -08:00
Harshavardhana
3f8b3462e6 Remove donut_gen binary and update crc32c function 2015-02-27 14:41:53 -08:00
Harshavardhana
9aea7fd97b Merge pull request #213 from harshavardhana/pr_out_crc32c_re_implementation_with_convenience_functions 2015-02-27 14:35:11 -08:00
Harshavardhana
8ce9b84b69 Crc32c re-implementation with Convenience functions
- Sum32([]byte) --> uint32
   - Sum(io.Reader) --> uint32, error
2015-02-27 13:39:17 -08:00
Frederick F. Kautz IV
2e37791681 Merge pull request #212 from fkautz/pr_out_adding_comparison_for_footer_s_inim 2015-02-27 12:40:10 -08:00
Frederick F. Kautz IV
a42872d557 Merge pull request #211 from fkautz/pr_out_moving_donut_gen_to_its_own_dir_and_renaming_it_as_donut_gen_v1 2015-02-27 12:40:07 -08:00
Frederick F. Kautz IV
1f7a3c13a5 Adding comparison for footer's INIM 2015-02-27 12:39:52 -08:00
Frederick F. Kautz IV
2ca62f13a5 Moving donut_gen to its own dir and renaming it as donut_gen_v1 2015-02-27 12:39:14 -08:00
Frederick F. Kautz IV
22ddc3dcbb Merge pull request #210 from fkautz/pr_out_seek_to_beginning_for_tempbuffer 2015-02-27 12:18:58 -08:00
Frederick F. Kautz IV
be768d01a2 Seek to beginning for tempbuffer 2015-02-27 12:18:27 -08:00
Frederick F. Kautz IV
da10fd5a83 Merge pull request #209 from fkautz/pr_out_adding_crc32c_to_write 2015-02-26 23:04:57 -08:00
Frederick F. Kautz IV
5c52da6ebe Adding crc32c to write 2015-02-26 23:04:07 -08:00
Harshavardhana
1786408bcc Merge pull request #206 from harshavardhana/pr_out_remove_http_server_timeouts_write_and_read 2015-02-24 13:56:56 -08:00
Harshavardhana
a9aaff0ee0 Remove HTTP server timeouts write and read.
Implement it later with a proper timer thread. Large file
transfers from 'mc' fail with i/o timeout without this change.
2015-02-24 13:55:24 -08:00
Frederick F. Kautz IV
e0d78e7381 Merge pull request #205 from fkautz/pr_out_making_donut_use_io_readwriteseek_instead_of_io_writer 2015-02-23 20:27:37 -08:00
Frederick F. Kautz IV
ef442289da Making donut use io.ReadWriteSeek instead of io.Writer 2015-02-23 20:27:25 -08:00
Harshavardhana
0f45e17505 Merge pull request #204 from harshavardhana/pr_out_add_bitdeli_badge_and_expose_analytics_beacon 2015-02-23 18:06:19 -08:00
Harshavardhana
3348b79eb8 Add bitdeli badge and expose Analytics beacon 2015-02-23 18:05:58 -08:00
Harshavardhana
182d614bdd Merge pull request #203 from harshavardhana/pr_out_more_updates_on_documentation 2015-02-23 17:45:16 -08:00
Harshavardhana
5e1e5ad786 More updates on documentation 2015-02-23 17:44:55 -08:00
Harshavardhana
2b8adef454 Merge pull request #202 from harshavardhana/pr_out_update_minioapi_documentation 2015-02-23 16:46:57 -08:00