H2O goes to CodeMesh in London

Key takeaways

The post recaps a CodeMesh London talk titled An API for Distributed Computing about 0xdata's open source in-memory distributed data platform.
The post claims its GLMNET, GBM, and Random Forest implementations run 1000 times faster than disk bound alternatives and 100 times faster than R.
The post states the platform was routinely tested on 100 gigabyte datasets, with customers using 200 gigabyte datasets.
The post describes an API that handles datasets from 1 kilobyte to 1 terabyte without changing code, scaling from a laptop to a 50 server cluster.

We have defined an API and built an open-source platform for dealing with in-memory distributed data. We’ve used it to built state-of-the-art predictive modeling and analytics (e.g. GLMNET, GBM, Random Forest ) that’s 1000x faster than the disk-bound alternatives, and 100x faster than R (we love R but it’s tooo slow on big data!). We’re building our newest algorithms in a few weeks, start to finish, because the platform makes Big Math easy. We routinely test on 100G datasets, have customers using 200G datasets, and have lab tested even more. This talk is about a coding style & API that lets us seamlessly deal with datasets from 1K to 1TB without changing a line of code, lets us use clusters ranging from your laptop to 50 server clusters with many many TB of ram and hundreds of CPUs. Talk objectives: Learn about a platform & API for doing in-memory analytics. Target audience: People who got data, and want to do fast predictive modeling and analytics… or just need a platform that lets them code to Big Data naturally.