Go to file
zhangyang2057 e3252386f9 Bump version to v2.3.0 2023-08-25 20:20:31 +08:00
.github GNNE-1906 Feature/opt example (#1064) 2023-08-25 07:07:43 +08:00
benchmark Split runtime function from runtime module (#337) 2021-08-18 18:56:39 +08:00
cmake Feature/runtime kernel test case (#935) 2023-07-07 11:47:01 +08:00
csharp Feature/add preprocess (#940) 2023-05-30 17:20:28 +08:00
docs Doc/shape bucket (#1067) 2023-08-25 15:02:30 +08:00
examples/user_guide GNNE-1906 Feature/opt example (#1064) 2023-08-25 07:07:43 +08:00
modules GNNE-1891 Shape bucket opt (#1040) 2023-08-18 13:35:24 +08:00
python Add shape_bucket attributes into CompileOptions. (#1071) 2023-08-25 20:13:14 +08:00
src GNNE-1904 clamp f16&&bf16 dt input support (#1035) 2023-08-25 10:34:07 +08:00
targets Add auto code format (#745) 2022-12-23 20:22:23 +08:00
tests GNNE-1904 clamp f16&&bf16 dt input support (#1035) 2023-08-25 10:34:07 +08:00
third_party Optimize CI speed (#885) 2023-04-12 10:17:03 +08:00
toolchains Feature/runtime kernel test case (#935) 2023-07-07 11:47:01 +08:00
tools GNNE-1781 resolve (#1024) 2023-07-31 16:21:39 +08:00
.clang-format Move stackvm 2022-05-13 17:00:36 +08:00
.editorconfig Add expr user analysis (#827) 2023-03-14 15:02:56 +08:00
.gitattributes Refactor usage of IoC (#767) 2023-01-11 19:24:38 +08:00
.gitignore GNNE-1781 runtime kernel tests (#996) 2023-07-25 19:16:50 +08:00
.gitmodules Remove onnx submodule 2021-01-18 19:42:41 +08:00
.pep8 Refactor test compare module (#283) 2021-07-14 11:56:59 +08:00
CMakeLists.txt Bump version to v2.3.0 2023-08-25 20:20:31 +08:00
Directory.Packages.props Feature/egraph sat extract (#963) 2023-06-15 15:16:00 +08:00
LICENSE Update license and readme 2019-03-01 11:51:02 +08:00
NuGet.Config op profile avoid ret op (#1025) 2023-07-27 19:01:57 +08:00
README.md GNNE-1906 Feature/opt example (#1064) 2023-08-25 07:07:43 +08:00
conanfile.py GNNE-1904 add case file (#1029) 2023-08-09 17:51:30 +08:00
nncase.sln Add expr user analysis (#827) 2023-03-14 15:02:56 +08:00
pyproject.toml GNNE-1909 remove date in version (#1038) 2023-08-10 12:03:20 +08:00
requirements.test.txt GNNE-1906 Feature/opt example (#1064) 2023-08-25 07:07:43 +08:00
setup.py GNNE-1909 remove date in version (#1038) 2023-08-10 12:03:20 +08:00
test.md fix concat, remove dummy in IsaGen, enable pytest in ci 2022-06-10 16:32:52 +08:00
testEnvironments.json optimized shape/ unroll / pass manager/ typeinfer 2022-09-24 19:28:10 +08:00

README.md

nncase

GitHub repository Gitee repository GitHub release

nncase is a neural network compiler for AI accelerators.

nncase 是一个为 AI 加速器设计的神经网络编译器。

技术交流 QQ 群790699378

Telegram: nncase community

Install from binaries

从二进制安装

Download prebuilt binaries from Release.

下载预编译的二进制文件 Release

Build from source

从源码编译

Build from source

Supported operators

支持的算子

K210/K510

K230

Resources

资源

K210


Architecture

架构

nncase arch

Features

  • Supports multiple inputs and outputs and multi-branch structure
  • Static memory allocation, no heap memory acquired
  • Operators fusion and optimizations
  • Support float and quantized uint8 inference
  • Support post quantization from float model with calibration dataset
  • Flat model with zero copy loading

功能

  • 支持多输入输出网络,支持多分支结构
  • 静态内存分配,不需要堆内存
  • 算子合并和优化
  • 支持 float 和量化 uint8 推理
  • 支持训练后量化,使用浮点模型和量化校准集
  • 平坦模型,支持零拷贝加载