Genome Sequencing in a NutshellMay 24, 2016 by Deborah Siegel in Engineering Blog This is a guest post from Deborah Siegel from the Northwest Genome Center and the University of Washington with Denny Lee from Databricks...
Parallelizing Genome Variant AnalysisMay 24, 2016 by Deborah Siegel in Engineering Blog This is a guest post from Deborah Siegel from the Northwest Genome Center and the University of Washington with Denny Lee from Databricks...
Predicting Geographic Population using Genome Variants and K-MeansMay 24, 2016 by Deborah Siegel in Engineering Blog Spark Summit 2016 will be held in San Francisco on June 6–8. Check out the full agenda and get your ticket This is...
New Content in Databricks Community EditionApril 12, 2016 by Ion Stoica in Engineering Blog At the Spark Summit New York , we announced Databricks Community Edition (CE) beta. CE is a free version of the Databricks service...
The Unreasonable Effectiveness of Deep Learning on Apache SparkApril 1, 2016 by Miles Yucht and Reynold Xin in Engineering Blog Update: this post is an April Fools joke. It is not an actual project we're working on. For the past three years, our...
Auto-scaling scikit-learn with Apache SparkFebruary 8, 2016 by Tim Hunter and Joseph Bradley in Engineering Blog Data scientists often spend hours or days tuning models to get the highest accuracy. This tuning typically involves running a large number of...
Deep Learning with Apache Spark and TensorFlowJanuary 25, 2016 by Tim Hunter in Engineering Blog Neural networks have seen spectacular progress during the last few years and they are now the state of the art in image recognition...
MLlib Highlights in Apache Spark 1.6January 21, 2016 by Joseph Bradley in Engineering Blog To learn more about Apache Spark, attend Spark Summit East in New York in Feb 2016 . With the latest release, Apache Spark’s...
Generalized Linear Models in SparkR and R Formula Support in MLlibOctober 5, 2015 by Eric Liang in Engineering Blog To get started with SparkR, download Apache Spark 1.5 or sign up for a 14-day free trial of Databricks today . Apache Spark...
Improved Frequent Pattern Mining in Apache Spark 1.5: Association Rules and Sequential PatternsSeptember 28, 2015 by Feynman Liang, Jiajin Zhang and Dandan Tu in Engineering Blog We would like to thank Jiajin Zhang and Dandan Tu from Huawei for contributing to this blog. To get started mining patterns from...