Brisk - Truly Peer-to-Peer Hadoop

Posted on Jul 14, 2011 (2 years ago). Seen 4,602 times. No comments. Permalink Feed
Photo Max Walker
Producer
NewCircle, Inc.
Member since Sep 29, 2010
Location: San Francisco
Stream Posts: 295
Tagged as: Hadoop Java Video
In this presentation given at the San Francisco Java User Group on June 14, 2011, SriSatish Ambati, Chief Java Tinkerer at DataStax is going to show you how to run Hadoop MapReduce on a truly peer-to-peer storage layer powered by Cassandra FS.

Brisk is an open-source Hadoop & Hive distribution that uses Apache Cassandra for its core services and storage. Brisk makes it possible to run Hadoop MapReduce on top of CassandraFS, an HDFS-compatible storage layer. By replacing HDFS with CassandraFS, users leverage MapReduce jobs on Cassandra's peer-to-peer, fault-tolerant and scalable architecture.

With CassandraFS all nodes are peers. Data files can be loaded through any node in the cluster and any node can serve as the JobTracker for MapReduce jobs. Hive MetaStore is stored & accessed as just another column family (table) on the distributed data store. Brisk makes Hadoop truly peer-to-peer.

We demonstrate visualization & monitoring of Brisk using OpsCenter. The operational simplicity of Cassandra's multi-datacenter & multi-region aware replication makes Brisk well-suited for a rich set of Applications and use-cases. And by being able to store and isolate HDFS & online data within the same data cluster, Brisk makes analytics possible without ETL!



Here are SriSatish's slides:


About this Event
This event was presented by the The San Francisco Java User Group on June 14, 2011. Organized by Marakana

Want to Learn More About Java?
Check out some of our training classes, or head to TechTV for more great educational videos on open source topics.








Comments

Be the first one to post a comment!