|
Post by Admin on Mar 15, 2014 19:02:47 GMT
Compression in map reduce:-
•Compression reduces no of bytes written to/read from HDFS. •Compression effectively improves the efficiency of net work band with and space. •This saves the amount of data being transformed between map nodes.
LZO:- •LZO is a compression/decompression library . •Compression format: LZO •Com.HADOOP compression. Lzo.lzopcoduc.
NOTE;- ”codec” is the implementation of a compression –decompression algorithm. In hadoop , a ”code c” is represented by an implementation of the “compression code c” inter face.
|
|