We use cookies to improve your experience with our site.
Zhuang YM, Hu X, Chen XB et al. DyPipe: A holistic approach to accelerating dynamic neural networks with dynamic pipelining. JOURNAL OFCOMPUTER SCIENCE AND TECHNOLOGY 38(4): 899−910 July 2023. DOI: 10.1007/s11390-021-1161-y.
Citation: Zhuang YM, Hu X, Chen XB et al. DyPipe: A holistic approach to accelerating dynamic neural networks with dynamic pipelining. JOURNAL OFCOMPUTER SCIENCE AND TECHNOLOGY 38(4): 899−910 July 2023. DOI: 10.1007/s11390-021-1161-y.

DyPipe: A Holistic Approach to Accelerating Dynamic Neural Networks with Dynamic Pipelining

  • Dynamic neural network (NN) techniques are increasingly important because they facilitate deep learning techniques with more complex network architectures. However, existing studies, which predominantly optimize the static computational graphs by static scheduling methods, usually focus on optimizing static neural networks in deep neural network (DNN) accelerators. We analyze the execution process of dynamic neural networks and observe that dynamic features introduce challenges for efficient scheduling and pipelining in existing DNN accelerators. We propose DyPipe, a holistic approach to optimizing dynamic neural network inferences in enhanced DNN accelerators. DyPipe achieves significant performance improvements for dynamic neural networks while it introduces negligible overhead for static neural networks. Our evaluation demonstrates that DyPipe achieves 1.7x speedup on dynamic neural networks and maintains more than 96% performance for static neural networks.
  • loading

Catalog

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return