Facebook scribe with hdfs

packages:
libevent
hadoop-0.20-libhdfs
JDK for hdfs support

Boost
http://sourceforge.net/projects/boost/
./bootstrap.sh
./bjam
./bjam install

thrift
download form http://thrift.apache.org/download/
./configure
make
make install

fb303
it’s in /contrib/fb303

./bootstrap.sh
./configure CPPFLAGS="-DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H"
(To avoid compile error, recompile thrift with this option if it doesn’t work)
make
make install

Download
git clone https://github.com/facebook/scribe.git
ln -s /usr/java/jdk1.6.0_31/jre/lib/amd64/server/libjvm.so /usr/lib/
./configure –enable-hdfs CPPFLAGS="-DHAVE_INTTYPES_H -DHAVE_NETINET_IN_H -I/usr/java/jdk1.6.0_31/include -I/usr/java/jdk1.6.0_31/include/linux -I/tmp/boost_1_45_0"
make
make install

Run
export LD_LIBRARY_PATH="/usr/local/lib/;/usr/lib";
export CLASSPATH=/usr/lib/hadoop-0.20/hadoop-core.jar:/usr/lib/hadoop-0.20/lib/commons-logging-1.0.4.jar:/usr/lib/hadoop-0.20/lib/guava-r09-jarjar.jar
scribed

Speed
Approx. 200MB per second (uncompressed)
Approx. 18MB per second with gzip -9