CVT, a Computer Vision Toolkit.
-
Updated
Aug 24, 2022 - C
CVT, a Computer Vision Toolkit.
A header-only neural network library for microcontrollers, with partial bare-metal & native-os support.
Winner solution of mobile AI (CVPRW 2021).
FrostNet: Towards Quantization-Aware Network Architecture Search
Quantization Aware Training
ATtiny85 arduino example, running an RNN MNIST model via the (internal) 512-Byte EEPROM with ~95% accuracy
将端上模型部署过程中,常见的问题以及解决办法记录并汇总,希望能给其他人带来一点帮助。
Silicon-proven INT8 systolic NPU (8×8 MAC array) taped out on SkyWater 130nm via LibreLane. Features a custom 32-bit ISA, UART–APB host interface, and fused streaming datapath. Validated on chest X-ray pneumonia detection. Silicon Sprint 2026 — AUC.
A tool-calling layer, not a language model — your schemas in, validated calls out, at 48M parameters. Malformed JSON, invented parameter names, and undeclared tools are structurally unreachable on any catalog. Adapt it to your own catalog; 11 negative results included.
Reverse-engineering notes on tscmoo's Pluto StarCraft: BW AI (binary-only release)
Garuda: CVXIF coprocessor optimizing batch-1 attention microkernels with 7.5-9× lower p99 latency. RISC-V INT8 MAC accelerator for transformer inference.
Symmetric INT8 per-tensor and per-channel quantization engine for LLM weights and activations, with SNR and MSE reconstruction telemetry.
Symmetric INT8 per-tensor and per-channel quantization engine for LLM weights and activations, with SNR and MSE reconstruction telemetry.
Tooling for dataset captioning, model merging and quantizing.
C# api wrapper for llm-inference chatllm.cpp
VB.NET api wrapper for llm-inference chatllm.cpp
Optimized PyTorch/Triton MiniMax H3 video VAE for ComfyUI, with reproducible benchmarks and optional mixed INT8 acceleration—no TensorRT engine required.
Central Proteus simulation and Git submodule tracker for the STM32 Smart Car network.
Generating tensorrt model using onnx
To associate your repository with the int8-quantization topic, visit your repo's landing page and select "manage topics."