Metronome

KO | EN

gitlite — search

#javascript #php #java #dotfiles #python #golang #hacktoberfest #groovy #alfred-workflow #r #rails #html

★ 111 Open GitHub ↗

Suite of parallel iterative algorithms built on top of Iterative Reduce

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

Metronome is a suite of parallel iterative algorithms that run natively on Hadoop's Next Generation YARN platform.

*  Algorithms
    * Parallel Neural Networks
    * Parallel linear regression
    * Parallel logistic regression
    * Parallel K-means
    * Restricted Boltzmann Machines
    * Parallel Deep Belief Networks 
        * Developed directly in concert with [Adam Gibson and the DL4J project] (http://deeplearning4j.org)
        * [Running Deep Learning with Metronome on Hadoop] (https://github.com/jpatanooga/Metronome/wiki/Running-Deep-Learning-on-Metronome)
        * [Fundamental Architecture of our Deep Learning Library over at DL4J] (http://deeplearning4j.org/overview.html)
* Scales linearly with input size
* Built on top of BSP-style computation framework "Iterative Reduce" (Hadoop / YARN)
* Packaged in a new suite of parallel iterative algorithms called Metronome on [IterativeReduce] (https://github.com/emsixteeen/IterativeReduce)
    * 100% Java, ASF 2.0 Licensed, on github

# Project Next Steps

* 6/5/2014 - we're working on cutting a 0.1 tag and download for the current project snapshot for both
    * IterativeReduce
    * Metronome

# Presentations

Hadoop Summit EU 2013

* [Hadoop Summit EU 2013: Parallel Linear Regression, IterativeReduce, and YARN]  (http://www.slideshare.net/jpatanooga/hadoop-summit-eu-2013-parallel-linear-regression-iterativereduce-and-yarn)

* [Video of Presentation from Hadoop Summit EU 2013] (http://www.youtube.com/watch?feature=player_embedded&v=rwiy_YhbxiI)

BigDataTechCon 2013

* Slides soon

MLConf 2013

* [Parallel Neural Networks on Hadoop Slides] (http://www.slideshare.net/jpatanooga/metronome-ml-confnov2013v20131113)

Hadoop Summit 2014 (San Jose)

* [Slides for Intro To Deep Learning on Hadoop] (http://www.slideshare.net/jpatanooga/hadoop-summit-2014-san-jose-introduction-to-deep-learning-on-hadoop)

* [Video of Hadoop Summit Talk] (https://www.youtube.com/watch?v=h2Ixpfn-DTg&list=PLSAiKuajRe2k0Aw_njj74rIlbdk3JTQ8Y)

Deep Learning Coverage in Wired Magazine

* [Wired - Google Data Center AI] (http://www.wired.com/2014/05/google-data-center-ai/)

* [Wired - Skymind Deep Learning] (http://www.wired.com/2014/06/skymind-deep-learning/)

# Resources
* [General guide on running yarn jobs] (https://github.com/jpatanooga/Metronome/wiki/Running-Jobs-on-YARN-Clusters)
* [Running Deep Learning with Metronome on Hadoop] (https://github.com/jpatanooga/Metronome/wiki/Running-Deep-Learning-on-Metronome)
* [IterativeReduce Programming Model] (https://github.com/emsixteeen/IterativeReduce/wiki/Iterative-Reduce-Programming-Guide)
* Using IRUnit - the IterativeReduce Unit Testing Framework
* [Running parallel linear regression with IRUnit on synthetic test data] (https://github.com/jpatanooga/Metronome/wiki/Running-Parallel-Linear-Regression)

# Contributors and Special Thanks
* Adam Gibson
    * [Github] (https://github.com/agibsonccc/) 
* Michael Katzenellenbollen
    * [Github] (https://github.com/emsixteeen)
* Dr. Jason Baldridge
* Dr. James Scott
* Paul Wilkinson
* David Kale
    * Professional Hipster / Hobbit

Metronome

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README