minio/pkg/objcache
Harshavardhana b363709c11 caching: Optimize memory allocations. (#3405)
This change brings in changes at multiple places

 - Reuse buffers at almost all locations ranging
   from rpc, fs, xl, checksum etc.
 - Change caching behavior to disable itself
   under low memory conditions i.e < 8GB of RAM.
 - Only objects cached are of size 1/10th the size
   of the cache for example if 4GB is the cache size
   the maximum object size which will be cached
   is going to be 400MB. This change is an
   optimization to cache more objects rather
   than few larger objects.
 - If object cache is enabled default GC
   percent has been reduced to 20% in lieu
   with newly found behavior of GC. If the cache
   utilization reaches 75% of the maximum value
   GC percent is reduced to 10% to make GC
   more aggressive.
 - Do not use *bytes.Buffer* due to its growth
   requirements. For every allocation *bytes.Buffer*
   allocates an additional buffer for its internal
   purposes. This is undesirable for us, so
   implemented a new cappedWriter which is capped to a
   desired size, beyond this all writes rejected.

Possible fix for #3403.
2016-12-08 20:35:07 -08:00
..
README.md XL/PutObject: Add single putObject and multipart caching. (#2115) 2016-07-08 20:34:27 -07:00
capped-writer.go caching: Optimize memory allocations. (#3405) 2016-12-08 20:35:07 -08:00
objcache.go caching: Optimize memory allocations. (#3405) 2016-12-08 20:35:07 -08:00
objcache_test.go caching: Optimize memory allocations. (#3405) 2016-12-08 20:35:07 -08:00

README.md

PACKAGE DOCUMENTATION

package objcache
    import "github.com/minio/minio/pkg/objcache"

    Package objcache implements in memory caching methods.

VARIABLES

var DefaultExpiry = time.Duration(72 * time.Hour) // 72hrs.

    DefaultExpiry represents default time duration value when individual
    entries will be expired.

var ErrCacheFull = errors.New("Not enough space in cache")
    ErrCacheFull - cache is full.

var ErrKeyNotFoundInCache = errors.New("Key not found in cache")
    ErrKeyNotFoundInCache - key not found in cache.

var NoExpiry = time.Duration(0)
    NoExpiry represents caches to be permanent and can only be deleted.

TYPES

type Cache struct {

    // OnEviction - callback function for eviction
    OnEviction func(key string)
    // contains filtered or unexported fields
}
    Cache holds the required variables to compose an in memory cache system
    which also provides expiring key mechanism and also maxSize.

func New(maxSize uint64, expiry time.Duration) *Cache
    New - Return a new cache with a given default expiry duration. If the
    expiry duration is less than one (or NoExpiry), the items in the cache
    never expire (by default), and must be deleted manually.

func (c *Cache) Create(key string, size int64) (w io.WriteCloser, err error)
    Create - validates if object size fits with in cache size limit and
    returns a io.WriteCloser to which object contents can be written and
    finally Close()'d. During Close() we checks if the amount of data
    written is equal to the size of the object, in which case it saves the
    contents to object cache.

func (c *Cache) Delete(key string)
    Delete - delete deletes an entry from the cache.

func (c *Cache) DeleteExpired()
    DeleteExpired - deletes all the expired entries from the cache.

func (c *Cache) Open(key string) (io.ReadSeeker, error)
    Open - open the in-memory file, returns an in memory read seeker.
    returns an error ErrNotFoundInCache, if the key does not exist.

func (c *Cache) StopExpiry()
    StopExpiry sends a message to the expiry routine to stop expiring cached
    entries. NOTE: once this is called, cached entries will not be expired
    if the consume has called this.