# magicmind_cloud

**Repository Path**: robovoid/magicmind_cloud

## Basic Information

- **Project Name**: magicmind_cloud
- **Description**: MLU云端产品的Magicmind推理模型集合
- **Primary Language**: C++
- **License**: Apache-2.0
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 38
- **Created**: 2023-04-03
- **Last Updated**: 2024-06-15

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# ModelZoo Cloud

## 1.介绍

MagicMind 是面向寒武纪 MLU 的推理加速引擎。

MagicMind 能将 AI 框架(TensorFlow,PyTorch,ONNX,Caffe 等) 训练好的算法模型转换成 MagicMind 统一计算图表示,并提供端到端的模型优化、代码生成以及推理业务部署能力。

本仓库展示如何将 CV 分类、检测、分割、NLP、语音等场景的前沿和经典模型，通过 MagicMind 转换和优化，进而运行在基于 MagicMind 的推理加速引擎的寒武纪加速板卡上的示例程序，为开发者提供丰富的 AI 应用移植参考。

## 2.前提条件

- Linux 常见操作系统版本(如 Ubuntu16.04，Ubuntu18.04，CentOS7.x 等)，安装 docker(>=v18.00.0)应用程序；
- 服务器装配好寒武纪 300 系列及以上的智能加速卡，并安装好驱动(>=v4.20.6)；
- 若不具备以上软硬件条件，可前往[寒武纪开发者社区](https://developer.cambricon.com/)申请试用;

## 3.环境准备

若基于寒武纪云平台环境可跳过该环节。否则需运行以下步骤：

1.请前往[寒武纪开发者社区](https://developer.cambricon.com/)下载 MagicMind(version >= 1.0.1)镜像，名字如下：

magicmind_version_os.tar.gz, 例如 magicmind_1.0.1-1_ubuntu18.04.tar.gz

2.加载：

```bash
docker load -i magicmind_version_os.tar.gz
```

3.运行：

```bash
docker run -it --shm_size 10G --name=dockername \
           --network=host --cap-add=sys_ptrace \
           -v /your/host/path/MagicMind:/MagicMind \
           -v /usr/bin/cnmon:/usr/bin/cnmon \
           --device=/dev/cambricon_dev0:/dev/cambricon_dev0 --device=/dev/cambricon_ctl \
           -w /MagicMind/ magicmind_version_image_name:tag_name /bin/bash
```

## 4.网络支持列表和链接

### CV：

#### Classification:

| MODELS                                                             | FRAMEWORK | MLU370-X4 | MLU370-S4 | CPP | PYTHON |
| ------------------------------------------------------------------ | --------- | --------- | --------- | --- | ------ |
| [AlexNet](buildin/cv/classification/alexnet_bn_caffe)              | Caffe     | YES       | YES       | YES | NO     |
| [ArcFace](buildin/cv/classification/arcface_pytorch)               | PyTorch   | YES       | YES       | YES | NO     |
| [CRNN](buildin/cv/classification/crnn_pytorch)                     | PyTorch   | YES       | YES       | NO  | YES    |
| [DenseNet121](buildin/cv/classification/densenet121_caffe)         | Caffe     | YES       | YES       | YES | NO     |
| [GoogleNet_bn](buildin/cv/classification/googlenet_bn_caffe)       | Caffe     | YES       | YES       | YES | YES    |
| [MobileNetV2](buildin/cv/classification/mobilenetv2_caffe)         | Caffe     | YES       | YES       | YES | YES    |
| [MobileNetV3](buildin/cv/classification/mobilenetv3_pytorch)       | PyTorch   | YES       | YES       | YES | NO     |
| [ResNet50](buildin/cv/classification/resnet50_onnx)                | ONNX      | YES       | YES       | NO  | YES    |
| [ResNet50](buildin/cv/classification/resnet50_paddle)              | Paddle    | YES       | YES       | NO  | YES    |
| [ResNext50](buildin/cv/classification/resnext50_caffe)             | Caffe     | YES       | YES       | YES | YES    |
| [SENet50](buildin/cv/classification/senet50_caffe)                 | Caffe     | YES       | YES       | YES | NO     |
| [SqueezeNet_v1_0](buildin/cv/classification/squeezenet_v1_0_caffe) | Caffe     | YES       | YES       | YES | NO     |
| [SqueezeNet_v1_1](buildin/cv/classification/squeezenet_v1_1_caffe) | Caffe     | YES       | YES       | YES | NO     |
| [VGG16](buildin/cv/classification/vgg16_caffe)                     | Caffe     | YES       | YES       | YES | YES    |
| [SwinTransformer](buildin/cv/classification/SwinTransformer_pytorch)|PyTorch   | YES       | YES       | NO  | YES    |
| [3D-ResNet](buildin/cv/classification/3dresnet_pytorch)            | PyTorch   | YES       | YES       | NO  | YES    |

#### Detection:

| MODELS                                                        | FRAMEWORK  | MLU370-X4 | MLU370-S4 | CPP | PYTHON |
| -----------------------------------------------------         | ---------- | --------- | --------- | --- | ------ |
| [C3D](buildin/cv/detection/c3d_caffe)                         | Caffe      | YES       | YES       | YES | NO     |
| [CenterNet](buildin/cv/detection/centernet_pytorch)           | PyTorch    | YES       | YES       | YES | NO     |
| [DBNet](buildin/cv/detection/dbnet_pytorch)                   | PyTorch    | YES       | YES       | YES | NO     |
| [MaskRCNN](buildin/cv/detection/maskrcnn_pytorch)             | PyTorch    | YES       | YES       | NO  | YES    |
| [Retinaface](buildin/cv/detection/retinaface_pytorch)         | PyTorch    | YES       | YES       | YES | NO     |
| [SSD](buildin/cv/detection/ssd_caffe)                         | Caffe      | YES       | YES       | YES | YES    |
| [YOLOV3](buildin/cv/detection/yolov3_caffe)                   | Caffe      | YES       | YES       | YES | NO     |
| [YOLOV3](buildin/cv/detection/yolov3_tensorflow)              | TensorFlow | YES       | YES       | YES | NO     |
| [YOLOV3](buildin/cv/detection/yolov3_paddle)                  | Paddle     | YES       | YES       | NO  | YES     |
| [YOLOV3 Tiny](buildin/cv/detection/yolov3_tiny_caffe)         | Caffe      | YES       | YES       | YES | NO     |
| [YOLOV5](buildin/cv/detection/yolov5_v6_1_pytorch)            | PyTorch    | YES       | YES       | YES | YES    |
| [YOLOV7](buildin/cv/detection/yolov7_pytorch)                 | PyTorch    | YES       | YES       | YES | YES    |
| [HoiTransformer](buildin/cv/detection/hoitransformer_pytorch) | PyTorch    | YES       | YES       | NO  | YES    |
| [YOLOV4](buildin/cv/detection/yolov4_caffe)           | Caffe      | YES       | YES       | YES | NO     |
| [PSENet](buildin/cv/detection/psenet_tensorflow)      | TensorFlow | YES       | YES       | NO  | YES    |

#### Segmentation:

| MODELS                                            | FRAMEWORK  | MLU370-X4 | MLU370-S4 | CPP | PYTHON |
| ------------------------------------------------- | ---------- | --------- | --------- | --- | ------ |
| [Deeplabv3](buildin/cv/segmentation/deeplabv3_tf) | TensorFlow | YES       | YES       | YES | NO     |
| [Unet](buildin/cv/segmentation/nnUNet_pytorch)    | PyTorch    | YES       | YES       | NO  | YES    |
| [SegNet](buildin/cv/segmentation/segnet_caffe)    | Caffe      | YES       | YES       | YES | NO     |
| [U2Net](buildin/cv/segmentation/u2net_pytorch)    | PyTorch    | YES       | YES       | NO  | YES    |

#### Others:

| MODELS                                      | FRAMEWORK | MLU370-X4 | MLU370-S4 | CPP | PYTHON |
| ------------------------------------------- | --------- | --------- | --------- | --- | ------ |
| [Openpose](buildin/cv/other/openpose_caffe) | Caffe     | YES       | YES       | YES | NO     |
| [Clip](buildin/cv/other/clip_pytorch)       | PyTorch   | YES       | YES       | NO  | YES    |
| [FSANet](buildin/cv/other/fsanet_tensorflow)| TensorFlow| YES       | YES       | NO  | YES    |

### NLP:

#### LanguageModeling:

| MODELS                                                            | FRAMEWORK  | MLU370-X4 | MLU370-S4 | CPP | PYTHON |
| ----------------------------------------------------------------- | ---------- | --------- | --------- | --- | ------ |
| [BERT](buildin/nlp/LanguageModeling/bert_squad_pytorch)           | PyTorch    | YES       | YES       | NO  | YES    |
| [BERT](buildin/nlp/LanguageModeling/bert_tensorflow)              | TensorFlow | YES       | NO        | NO  | YES    |
| [ROBERTA](buildin/nlp/LanguageModeling/roberta_pytorch)           | PyTorch    | YES       | YES       | NO  | YES    |
| [Transformers](buildin/nlp/LanguageModeling/transformers_pytorch) | PyTorch    | YES       | YES       | NO  | YES    |
| [Roformer-sim](buildin/nlp/LanguageModeling/roformer-sim_tensorflow) | TensorFlow | YES       | YES    | NO  | YES    |

#### SpeechSynthesis:

| MODELS                                                  | FRAMEWORK | MLU370-X4 | MLU370-S4 | CPP | PYTHON |
| ------------------------------------------------------- | --------- | --------- | --------- | --- | ------ |
| [TACOTRON2](buildin/nlp/SpeechSynthesis/tacotron2_onnx) | ONNX      | YES       | YES       | NO  | YES    |

#### SpeechRecognition:

| MODELS                                                  | FRAMEWORK | MLU370-X4 | MLU370-S4 | CPP | PYTHON |
| ------------------------------------------------------- | --------- | --------- | --------- | --- | ------ |
| [WeNet](buildin/nlp/SpeechRecognition/WeNet_pytorch)    | PyTorch   | YES       | YES       | NO  | YES    |

## 5.issues/wiki/forum 跳转链接

## 6.contrib 指引和链接

## 7.LICENSE

ModelZoo Cloud 的 License 具体内容请参见[LICENSE](LICENSE)文件。

## 8.免责声明

ModelZoo 仅提供公共数据集以及预训练模型的下载链接，公共数据集及预训练模型并不属于 ModelZoo, ModelZoo 也不对其质量或维护承担责任。请您在使用公共数据集和预训练模型的过程中，确保符合其对应的使用许可。

如果您不希望您的数据集或模型公布在 ModelZoo 上，或者您希望更新 ModelZoo 中属于您的数据集或模型，请您通过 Gitee 中提交 issue，您也可以联系ecosystem@cambricon.com告知我们。

## 9.Release Note
### v1.3:

- MagicMind支持版本1.0.1

- CV : 新增CRNN/Densenet121/GoogleNet_bn/DBNet/ResNet50(Paddle)/SwinTransformer/3D-ResNet/YoloV3(TensorFlow&Paddle)/YoloV7/HoiTransformer/YoloV4/PSENet/Openpose/Clip/FSANet网络的支持

- NLP : 新增Roberta/Roformer-sim/WeNet网络的支持

### v1.2:

- MagicMind支持版本0.14.0

- CV : 新增AlexNet/SENet50/ArgFace/MaskRCNN/RetinaFace/SegNet/Deeplabv3/U2Net/Openpose网络的支持

- NLP : 新增BERT(TensorFlow)/Transformers网络的支持

### v1.1:

- CV : 新增ResNext50/Squeezenet_v1_1/Squeezenet_v1_0/Centernet/YoloV3/YoloV3 Tiny/C3D/MobileNetV2/MobileNetV3网络的支持

- NLP : 新增Tacotron2网络的支持

### v1.0:

- MagicMind支持版本0.13.0

- CV : 新增ResNet50/VGG16/YoloV5/SSD/Unet网络的支持

- NLP : 新增BERT(PyTorch)网络的支持