Commit Graph

775 Commits

Author SHA1 Message Date
Anand Babu (AB) Periasamy
81ede6c3fe Merge pull request #241 from abperiasamy/janitor
On janitor duty.
2015-03-01 16:43:04 -08:00
Frederick F. Kautz IV
7ee3017a1c Merge pull request #242 from fkautz/pr_out_renaming_appenduint_to_appenduniqint 2015-03-01 16:39:55 -08:00
Frederick F. Kautz IV
de6131cc7c Renaming AppendUInt to AppendUniqInt 2015-03-01 16:39:45 -08:00
Anand Babu (AB) Periasamy
d9c9634138 removed custom Assert 2015-03-01 15:28:42 -08:00
Frederick F. Kautz IV
60454c53a2 Merge pull request #239 from fkautz/pr_out_adding_test_at_byte_level 2015-03-01 15:15:21 -08:00
Frederick F. Kautz IV
6f300c9ef0 Adding test at byte level 2015-03-01 15:13:09 -08:00
Anand Babu (AB) Periasamy
177121868b removed HomeDir 2015-03-01 15:13:08 -08:00
Frederick F. Kautz IV
cd22304afb Merge pull request #238 from fkautz/pr_out_specifying_more_exact_types_for_data 2015-03-01 14:43:20 -08:00
Frederick F. Kautz IV
0b08312ddd Specifying more exact types for data 2015-03-01 14:43:11 -08:00
Harshavardhana
ed4bca240f Merge pull request #237 from harshavardhana/pr_out_add_tests_add_newheader_for_populating_header_and_validateheader_ 2015-03-01 13:21:26 -08:00
Harshavardhana
9f43659135 Add tests, add NewHeader() for populating Header and ValidateHeader() 2015-03-01 13:19:06 -08:00
Anand Babu (AB) Periasamy
6515678e87 Merge pull request #236 from fkautz/pr_out_adding_data_writer
Adding data writer
2015-03-01 11:36:35 -08:00
Frederick F. Kautz IV
7414dc9b75 Adding data writer 2015-03-01 11:32:30 -08:00
Harshavardhana
359af56397 Merge pull request #235 from harshavardhana/pr_out_move_appendustr_appenduint_into_helpers 2015-03-01 11:19:40 -08:00
Harshavardhana
eb9a4a83ac Move AppendUstr(), AppendUint() into helpers 2015-03-01 11:19:03 -08:00
Frederick F. Kautz IV
9fb67c4195 Merge pull request #234 from fkautz/pr_out_changing_k_and_m_in_data_go_to_match_new_datatype_in_erasure_package 2015-03-01 01:28:43 -08:00
Frederick F. Kautz IV
be12a6b3d9 Changing K and M in data.go to match new datatype in erasure package 2015-03-01 01:28:33 -08:00
Harshavardhana
33601ff567 Merge pull request #233 from harshavardhana/pr_out_make_k_m_to_be_uint8_and_technique_becomes_its_own_type 2015-03-01 01:26:42 -08:00
Harshavardhana
b77c62e25d Make K,M to be uint8 and Technique becomes its own type 2015-03-01 01:25:28 -08:00
Frederick F. Kautz IV
c290b360e4 Merge pull request #232 from fkautz/pr_out_making_changes_to_data_based_on_discussion 2015-03-01 01:18:11 -08:00
Frederick F. Kautz IV
bb0441917c Making changes to data based on discussion 2015-03-01 01:16:22 -08:00
Harshavardhana
1f574d19fc Merge pull request #231 from harshavardhana/pr_out_avoid_allocating_1gig_memory_avoid_such_mistakes 2015-03-01 00:44:05 -08:00
Harshavardhana
2f04a1299e Avoid allocating 1gig memory, avoid such mistakes 2015-03-01 00:43:12 -08:00
Frederick F. Kautz IV
91c48e8d73 Merge pull request #230 from fkautz/pr_out_adding_data_go_does_nothing_for_now 2015-03-01 00:28:15 -08:00
Frederick F. Kautz IV
2916b1278e Adding data.go, does nothing for now. 2015-03-01 00:27:52 -08:00
Frederick F. Kautz IV
9d30475f00 Merge pull request #229 from fkautz/pr_out_donut_frame_is_now_its_own_package 2015-03-01 00:02:35 -08:00
Frederick F. Kautz IV
b4ef522a9b Donut frame is now its own package 2015-03-01 00:02:14 -08:00
Frederick F. Kautz IV
97e572f318 Merge pull request #228 from fkautz/pr_out_renaming_write_to_writeframe 2015-02-28 23:53:06 -08:00
Frederick F. Kautz IV
6c2428833a Renaming Write to WriteFrame 2015-02-28 23:52:56 -08:00
Harshavardhana
8ab0cc29f2 Merge pull request #227 from harshavardhana/pr_out_add_donut_benchmark_for_64mb_128mb_256mb_512mb 2015-02-28 17:06:40 -08:00
Harshavardhana
6b397844b9 Add donut benchmark for 64MB, 128MB, 256MB, 512MB
Current average values

~~~
> minio/pkg/storage/donut/v1 *> go test -bench .
OK: 2 passed
PASS
BenchmarkDonut64M              5         266249634 ns/op         252.05 MB/s
BenchmarkDonut128M             3         436507394 ns/op         307.48 MB/s
BenchmarkDonut256M             2         836116359 ns/op         321.05 MB/s
BenchmarkDonut512M             1        1676738951 ns/op         320.19 MB/s
ok      github.com/minio-io/minio/pkg/storage/donut/v1  8.430s
> minio/pkg/storage/donut/v1 *>
~~~
2015-02-28 17:05:46 -08:00
Harshavardhana
24c5ab70be Merge pull request #226 from harshavardhana/pr_out_donut_gen_works_with_new_donut_frame 2015-02-28 16:30:34 -08:00
Harshavardhana
65f22083ca donut_gen works with new Donut Frame 2015-02-28 16:30:18 -08:00
Frederick F. Kautz IV
4d98c355c9 Merge pull request #224 from abperiasamy/units 2015-02-28 16:12:10 -08:00
Frederick F. Kautz IV
a067fdb59d Merge pull request #225 from fkautz/pr_out_donut_now_tests_amount_written_should_match_expected_amount_to_write 2015-02-28 16:10:09 -08:00
Frederick F. Kautz IV
ddc7cf835e Donut now tests amount written should match expected amount to write 2015-02-28 16:09:52 -08:00
Frederick F. Kautz IV
a86e5b5586 Merge pull request #223 from fkautz/pr_out_updating_comment_describing_data_type 2015-02-28 16:00:12 -08:00
Frederick F. Kautz IV
d3d1205eb1 Updating comment describing data type 2015-02-28 15:59:52 -08:00
Frederick F. Kautz IV
c2ae974c94 Merge pull request #222 from fkautz/pr_out_new_donut_frame_implemented 2015-02-28 15:54:45 -08:00
Frederick F. Kautz IV
58a04ee831 New donut frame implemented 2015-02-28 15:54:13 -08:00
Anand Babu (AB) Periasamy
317a1141c0 removed unitconv 2015-02-28 15:53:44 -08:00
Frederick F. Kautz IV
9744efc725 Merge pull request #221 from fkautz/pr_out_adding_streaming_sha512 2015-02-28 15:52:10 -08:00
Frederick F. Kautz IV
90cd8b7b47 Adding streaming sha512 2015-02-28 15:51:33 -08:00
Harshavardhana
56bd413a16 Merge pull request #219 from harshavardhana/pr_out_add_1mb_block_benchmarks 2015-02-28 15:25:24 -08:00
Harshavardhana
7feca3f0d1 Add 1MB block benchmarks 2015-02-28 15:00:24 -08:00
Harshavardhana
20dc738b67 Merge pull request #218 from harshavardhana/pr_out_implement_proper_delimiter_and_prefix_handling 2015-02-28 14:48:46 -08:00
Harshavardhana
0c2d58bc6d Implement proper delimiter and prefix handling
With this change Minio server now responds with, delimited
'object names' in conjunction with prefix filtering

~~~
<ListBucketResult>
  <Name>example-bucket</Name>
  <Prefix></Prefix>
  <Marker></Marker>
  <MaxKeys>1000</MaxKeys>
  <Delimiter>/</Delimiter>
  <IsTruncated>false</IsTruncated>
  <Contents>
    <Key>sample.html</Key>
    <LastModified>2011-02-26T01:56:20.000Z</LastModified>
    <ETag>example-bucket#sample.html</ETag>
    <Size>142863</Size>
    <Owner>
      <ID>minio</ID>
      <DisplayName>minio</DisplayName>
    </Owner>
    <StorageClass>STANDARD</StorageClass>
  </Contents>
  <CommonPrefixes>
    <Prefix>photos/</Prefix>
  </CommonPrefixes>
</ListBucketResult>
~~~

~~~
<ListBucketResult>
  <Name>example-bucket</Name>
  <Prefix>photos/2006/</Prefix>
  <Marker></Marker>
  <MaxKeys>1000</MaxKeys>
  <Delimiter>/</Delimiter>
  <IsTruncated>false</IsTruncated>

  <CommonPrefixes>
    <Prefix>photos/2006/feb/</Prefix>
  </CommonPrefixes>
  <CommonPrefixes>
    <Prefix>photos/2006/jan/</Prefix>
  </CommonPrefixes>
</ListBucketResult>
~~~
2015-02-28 14:47:19 -08:00
Harshavardhana
acee4d16fd Merge pull request #217 from harshavardhana/pr_out_use_validstring 2015-02-27 19:49:33 -08:00
Harshavardhana
d5e5a3b3e6 Use validString 2015-02-27 19:49:18 -08:00
Harshavardhana
27fab98bf9 Merge pull request #216 from harshavardhana/pr_out_add_object_name_validation 2015-02-27 19:42:14 -08:00