Get in Touch

Course Outline

Introduction to Edge AI and the Ascend 310

  • Overview of Edge AI: current trends, constraints, and use cases
  • Architecture of the Huawei Ascend 310 chip and its supported toolchain
  • Understanding CANN’s role within the edge AI deployment stack

Model Preparation and Conversion

  • Exporting trained models from TensorFlow, PyTorch, and MindSpore
  • Utilizing ATC to convert models into the OM format for Ascend devices
  • Addressing unsupported operations and implementing lightweight conversion strategies

Building Inference Pipelines with AscendCL

  • Employing the AscendCL API to execute OM models on the Ascend 310
  • Managing input/output preprocessing, memory allocation, and device control
  • Deploying solutions within embedded containers or lightweight runtime environments

Optimization for Edge Constraints

  • Minimizing model size and tuning precision (FP16, INT8)
  • Using the CANN profiler to pinpoint performance bottlenecks
  • Optimizing memory layout and data streaming for improved efficiency

Deployment with MindSpore Lite

  • Leveraging the MindSpore Lite runtime for mobile and embedded targets
  • Comparing MindSpore Lite against raw AscendCL pipelines
  • Packaging inference models for device-specific deployment

Edge Deployment Scenarios and Case Studies

  • Case study: Implementing an object detection model in a smart camera using the Ascend 310
  • Case study: Real-time classification within an IoT sensor hub
  • Monitoring and updating models deployed at the edge

Summary and Next Steps

Requirements

  • Prior experience with AI model development or deployment workflows
  • Foundational understanding of embedded systems, Linux, and Python
  • Familiarity with deep learning frameworks like TensorFlow or PyTorch

Target Audience

  • Developers of IoT solutions
  • Engineers specializing in embedded AI
  • Edge system integrators and specialists in AI deployment
 14 Hours

Number of participants


Price per participant

Testimonials (1)

Provisional Upcoming Courses (Require 5+ participants)

Related Categories