1
0
mirror of https://github.com/minio/minio.git synced 2025-03-29 08:43:40 -04:00
Klaus Post 5e53f767c4
Use concurrent bz2 decompression ()
Testing with `mc sql --compression BZIP2 --csv-input "rd=\n,fh=USE,fd=;" --query="select COUNT(*) from S3Object" local2/testbucket/nyc-taxi-data-10M.csv.bz2`

Before 96.98s, after 10.79s. Uses about 70% CPU while running.
2021-10-14 11:11:07 -07:00
..