Speedster

nebuly-ai/nebullvm

Automatically apply SOTA optimization techniques to achieve the maximum inference speed-up on your hardware.

  • ai
  • analytics
  • artificial-intelligence
  • deeplearning
  • large-language-models
  • llm

More in C++

nndeploynndeploy/nndeploy

An Easy-to-Use and High-Performance AI deployment framework.

GeneralDeep learningLLMs
1.9k updated 2mo ago

OpenCVopencv/opencv

OpenCV has C++, C, Python, Java and MATLAB interfaces and supports Windows, Linux, Android and Mac OS.

GeneralDeep learningVision
91.3k updated today

CaffeBVLC/caffe

A deep learning framework developed with cleanliness, readability, and speed in mind.

GeneralDeep learning
34.6k updated 2y ago

Opikcomet-ml/opik

Open source engineering platform to debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards. (Source Code)

GeneralLLMs
22.9k updated today

MXNetapache/incubator-mxnet Archived

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Go, JavaScript and more.

GeneralDeep learning
20.8k archived

CNTKMicrosoft/CNTK Archived

The Computational Network Toolkit (CNTK) by Microsoft Research, is a unified deep-learning toolkit that describes neural networks as a series of computational steps via a directed graph.

GeneralDeep learning
17.6k archived

Voskalphacep/vosk-api

An offline speech recognition toolkit with C++ support, designed for low-resource devices and multiple languages.

Deep learningSpeech
15.2k updated 9d ago

DLibdavisking/dlib

DLib has C++ and Python interfaces for face detection and training general object detectors.

GeneralDeep learningVisionData & viz
14.5k updated 3d ago
All 76 in C++
Esc

Type to search every entry. ↑↓ to move, Enter to open.