Scala machine learning libraries

35 libraries, 12 updated this year

Scala's machine learning is closely tied to Apache Spark. MLlib ships with Spark, Spark NLP from John Snow Labs adds production NLP pipelines, and Microsoft's SynapseML (listed under its old name, MMLSpark) brings LightGBM and Cognitive Services into Spark jobs. H2O's Sparkling Water runs H2O models on a Spark cluster.

Breeze provides numerical computing, Smile classical models, and Twitter's Algebird, Scalding and Summingbird abstract aggregations over batch and streaming data. Apache PredictionIO, once a popular machine learning server, was retired.

35 libraries

MLlib in Apache Sparkapache/spark

Distributed machine learning library in Spark.

GeneralData & viz
44.3k updated today

PredictionIOapache/predictionio Archived

PredictionIO, a machine learning server for software developers and data engineers.

Data & viz
12.5k archived

Smilehaifengl/smile

Statistical Machine Intelligence & Learning Engine.

GeneralNLPData & viz
6.4k updated today

Spark NLPJohnSnowLabs/spark-nlp

Natural language processing library built on top of Apache Spark ML to provide simple, performant, and accurate NLP annotations for machine learning pipelines, that scale easily in a distributed environment.

NLP
4.2k updated 1d ago

Scaldingtwitter/scalding

A Scala API for Cascading.

Data & viz
3.5k updated 3y ago
S

ScalaNLPscalanlp/breeze

ScalaNLP is a suite of machine learning and numerical computing libraries.

NLP
3.5k updated 1y ago
S

Spark Notebookspark-notebook/spark-notebook

Interactive and Reactive Data Science using Scala and Spark.

Data & viz
3.1k updated 3y ago

Algebirdtwitter/algebird

Abstract Algebra for Scala.

Data & viz
2.3k updated 11mo ago

Summing Birdtwitter/summingbird Archived

Streaming MapReduce with Scalding and Storm.

Data & viz
2.1k archived

adambigdatagenomics/adam

A genomics processing engine and specialized file format built using Apache Avro, Apache Spark and Parquet. Apache 2 licensed.

General
1.1k updated 7mo ago

H2O Sparkling Waterh2oai/sparkling-water

H2O and Spark interoperability.

General
982 updated 11mo ago

TensorFlow Scalaeaplatanios/tensorflow_scala

Strongly-typed Scala API for TensorFlow.

GeneralDeep learning
936 updated 4y ago

BIDMachBIDData/BIDMach

CPU and GPU-accelerated Machine Learning Library.

General
918 updated 4y ago
D

DeepLearning.scalaThoughtWorksInc/DeepLearning.scala

Creating statically typed dynamic neural networks from object-oriented & functional programming constructs.

GeneralDeep learning
766 updated 2y ago

Figarop2t2/figaro

A Scala library for constructing probabilistic models.

General
757 updated 4y ago

FACTORIEfactorie/factorie

FACTORIE is a toolkit for deployable probabilistic modelling, implemented as a software library in Scala. It provides its users with a succinct language for creating relational factor graphs, estimating parameters and performing inference.

NLP
551 updated 8y ago

brushfirestripe/brushfire Archived

Distributed decision tree ensemble learning in Scala.

General
389 archived

Conjectureetsy/Conjecture Archived

Scalable Machine Learning in Scalding.

General
358 archived

Hydrosphere MistHydrospheredata/mist

A service for deployment Apache Spark MLLib machine learning models as realtime, batch or reactive web services.

GeneralData & viz
325 updated 6mo ago

BIDMatBIDData/BIDMat

CPU and GPU-accelerated matrix library intended to support large-scale exploratory data analysis.

Data & viz
269 updated 5y ago

isolation-forestlinkedin/isolation-forest

A distributed Spark/Scala implementation of the isolation forest algorithm for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.

General
265 updated 2mo ago

Chalkscalanlp/chalk Archived

Chalk is a natural language processing library.

NLP
261 archived

DynaMLtranscendent-ai-labs/DynaML

Scala Library/REPL for Machine Learning Research.

General
202 updated 3y ago

ONNX-ScalaEmergentOrder/onnx-scala

An ONNX (Open Neural Network eXchange) API and backend for typeful, functional deep learning in Scala (3).

GeneralDeep learning
151 updated 25d ago

doddle-modelpicnicml/doddle-model

An in-memory machine learning library built on top of Breeze. It provides immutable objects and exposes its functionality through a scikit-learn-like API.

General
139 updated 2y ago

bioscalabioscala/bioscala

Bioinformatics for the Scala programming language

General
115 updated 1y ago

ganithatresata/ganitha Archived

Scalding powered machine learning.

General
109 archived

SaulCogComp/saul

Flexible Declarative Learning-Based Programming.

General
66 updated 6y ago

MontagueWorkday/upshot-montague

Montague is a semantic parsing library for Scala with an easy-to-use DSL.

NLP
62 updated 4y ago

NDScalaSciScala/NDScala

N-dimensional arrays in Scala 3. Think NumPy ndarray, but with compile-time type-checking/inference over shapes, tensor/axis labels & numeric data types

Deep learningData & viz
48 updated 3y ago

SwiftLearnervaldanylchuk/swiftlearner

Simply written algorithms to help study ML or write your own implementations.

General
40 updated 1y ago

xerialxerial/xerial Deprecated

Data management utilities for Scala.

Data & viz
19 updated 9y ago
About this site
Esc

Type to search every entry. ↑↓ to move, Enter to open.