Table Of Contents
Table Of Contents

GluonCV: a Deep Learning Toolkit for Computer Vision

GluonCV provides implementations of state-of-the-art (SOTA) deep learning algorithms in computer vision. It aims to help engineers, researchers, and students quickly prototype products, validate new ideas and learn computer vision.

GluonCV features:

  1. training scripts that reproduce SOTA results reported in latest papers,

  2. a large set of pre-trained models,

  3. carefully designed APIs and easy to understand implementations,

  4. community support.

Demo


Check the HD video at Youtube or Bilibili.

Supported Applications

Application Illustration Available Models
Image Classification:
recognize an object in
an image.
50+ models, including
ResNet, MobileNet,
DenseNet, VGG, ...
Object Detection:
detect multiple objects
with their bounding boxes
in an image.
Faster RCNN, SSD, Yolo-v3
Semantic Segmentation:
associate each pixel
of an image with
a categorical label.
FCN, PSP, DeepLab v3
Instance Segmentation:
associate each pixel of
an image with
an instance label.
Mask RCNN
Pose Estimation:
detect human pose
from images.
Simple Pose

Installation

Select your preferences and run the install command.

OS: Linux macOS Windows

Version: Stable Nightly Source

Stable Release.
Nightly build with latest features.
Install GluonCV from source.

Backend: Native CUDA MKL-DNN CUDA + MKL-DNN

Build-in backend for CPU.
Required to run on Nvidia GPUs.
Accelerate Intel CPU performance.
Enable both Nvidia GPUs and Intel CPU acceleration.

Prerequisites:

  • Requires pip >= 9.. Both Python 2 and Python 3 are supported.

  • Nightly build provides latest features for enthusiasts.

Command:

pip install --upgrade mxnet gluoncv
# Here we assume CUDA 10.0 is installed. You can change the number
# according to your own CUDA version.
pip install --upgrade mxnet-cu100 gluoncv
pip install --upgrade mxnet-mkl gluoncv
# Here we assume CUDA 10.0 is installed. You can change the number
# according to your own CUDA version.
pip install --upgrade mxnet-cu100mkl gluoncv
pip install --pre --upgrade mxnet gluoncv
pip install --pre --upgrade mxnet-cu100 gluoncv
pip install --pre --upgrade mxnet-mkl gluoncv
pip install --pre --upgrade mxnet-cu100mkl gluoncv
pip install --pre --upgrade mxnet
git clone https://github.com/dmlc/gluon-cv
cd gluon-cv && python setup.py install --user
pip install --pre --upgrade mxnet-cu100
git clone https://github.com/dmlc/gluon-cv
cd gluon-cv && python setup.py install --user
pip install --pre --upgrade mxnet-mkl
git clone https://github.com/dmlc/gluon-cv
cd gluon-cv && python setup.py install --user
pip install --pre --upgrade mxnet-cu100mkl
git clone https://github.com/dmlc/gluon-cv
cd gluon-cv && python setup.py install --user

Check Installation for more installation instructions and options.

A Quick Example

Object Detection Demo

New to Deep Learning or CV?

For background knowledge of deep learning or CV, please refer to the open source book Dive into Deep Learning.

Adoptions

Companies and organizations using GluonCV:

ACER BYOC PIONEER NRI