Large Scale Topic Modeling: Improvements to LDA on Apache Spark
This blog was written by Feynman Liang and Joseph Bradley from Databricks, and Yuhao Yang from Intel. To get started using LDA, download...
New Features in Machine Learning Pipelines in Apache Spark 1.4
Apache Spark 1.2 introduced Machine Learning (ML) Pipelines to facilitate the creation, tuning, and inspection of practical ML workflows. Spark’s latest release, Spark...
Statistical and Mathematical Functions with DataFrames in Apache Spark
We introduced DataFrames in Apache Spark 1.3 to make Apache Spark much easier to use. Inspired by data frames in R and Python...
New MLlib Algorithms in Apache Spark 1.3: FP-Growth and Power Iteration Clustering
This is a guest blog post from Huawei’s big data global team. Huawei, a Fortune Global 500 private company, has put together a...
Running Apache Spark GraphX algorithms on Library of Congress subject heading SKOS
This is a guest post from Bob DuCharme. Original article appeared in: http://www.snee.com/bobdc.blog/2015/04/running-spark-graphx-algorithm.html Well, one algorithm, but a very cool one. Last month...