minio

Commit Graph

Author	SHA1	Message	Date
Aditya Manthramurthy	fd4e15c116	Flush the records staging buffer periodically (#7193 ) - Staging buffer is flushed every 500ms. In cases where the result records are slowly generated (e.g. when a where condition matches very few records), this change causes the server to send results even though the staging buffer is not full. - Refactor messageWriter code to use simpler channel based co-ordination instead of atomic variables.	2019-02-06 16:03:05 +05:30
Aditya Manthramurthy	91c839ad28	Use a buffer to collect SQL Select result rows (#7158 ) Batching records into a single SQL Select message in the response leads to significant speed up as the message header overhead is made negligible. This change leads to a speed up of 3-5x for queries that select many small records.	2019-01-28 20:00:18 -08:00
Bala FA	b0deea27df	Refactor s3select to support parquet. (#7023 ) Also handle pretty formatted JSON documents.	2019-01-08 16:53:04 -08:00

Author

SHA1

Message

Date

Aditya Manthramurthy

fd4e15c116

Flush the records staging buffer periodically (#7193 )

- Staging buffer is flushed every 500ms. In cases where the result
  records are slowly generated (e.g. when a where condition
  matches very few records), this change causes the server to send
  results even though the staging buffer is not full.

- Refactor messageWriter code to use simpler channel based
  co-ordination instead of atomic variables.

2019-02-06 16:03:05 +05:30

Aditya Manthramurthy

91c839ad28

Use a buffer to collect SQL Select result rows (#7158 )

Batching records into a single SQL Select message in the response
leads to significant speed up as the message header overhead is made
negligible.

This change leads to a speed up of 3-5x for queries that select many
small records.

2019-01-28 20:00:18 -08:00

Bala FA

b0deea27df

Refactor s3select to support parquet. (#7023 )

Also handle pretty formatted JSON documents.

2019-01-08 16:53:04 -08:00

3 Commits