nndeploynndeploy/nndeploy
An Easy-to-Use and High-Performance AI deployment framework.

nebuly-ai/nebullvm
Automatically apply SOTA optimization techniques to achieve the maximum inference speed-up on your hardware.
An Easy-to-Use and High-Performance AI deployment framework.
OpenCV has C++, C, Python, Java and MATLAB interfaces and supports Windows, Linux, Android and Mac OS.
A deep learning framework developed with cleanliness, readability, and speed in mind.
Open source engineering platform to debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. (Source Code)
Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, JavaScript and more.
The Computational Network Toolkit (CNTK) by Microsoft Research, is a unified deep-learning toolkit that describes neural networks as a series of computational steps via a directed graph.
An offline speech recognition toolkit with C++ support, designed for low-resource devices and multiple languages.
DLib has C++ and Python interfaces for face detection and training general object detectors.