Browsing by Author "Li, Weisheng"

Now showing 1 - 4 of 4
  • Thumbnail Image
    ItemOpen Access
    FAST LEARNING-BASED SPLIT TYPE PREDICTION ALGORITHM FOR VVC
    (IEEE, 2023-10) Wang, Dayong; Chen, Liulin; Lu, Xin; Dufaux, Frederic; Li, Weisheng; Zhu, Ce
    As the latest video coding standard, Versatile Video Coding (VVC) is highly efficient at the cost of very high coding com- plexity, which seriously hinders its widespread application. Therefore, it is very crucial to improve its coding speed. In this paper, we propose a learning-based fast split type (ST) prediction algorithm for VVC using a deep learning approach. We first construct a large-scale database containing sufficient STs with diverse video resolution and content. Next, since the ST distributions of coding units (CUs) of different sizes are significantly distinct, so we separately design neural net- works for all different CU sizes. Then, we merge ambiguous STs into four merged classes (MCs) to train models to obtain probabilities of MCs and skip unlikely ones. Experimental results demonstrate that the proposed algorithm can reduce the encoding time of VVC by 67.53% with 1.89% increase in Bjøntegaard delta bit-rate (BDBR) on average.
  • Thumbnail Image
    ItemOpen Access
    Hybrid strategies for efficient intra prediction in spatial SHVC
    (IEEE, 2022-11-28) Wang, Dayong; Sun, Yu; Lu, Xin; Li, Weisheng; Lele, Xie; Zhu, Ce
    With multi-layer encoding and Inter-layer prediction, Spatial Scalable High Efficiency Video Coding (SSHVC) has extremely high coding complexity. It is very crucial to speed up its coding to promote widespread and cost-effective SSHVC applications. Specifically, we first reveal that the average RD cost of Inter-layer Reference (ILR) mode is different from that of Intra mode, but they both follow the Gaussian distribution. Based on this discovery, we apply the classic Gaussian Mixture Model and Expectation Maximization to determine whether ILR mode is the best mode thus skipping Intra mode. Second, when coding units (CUs) in enhancement layer use Intra mode, it indicates very simple texture is presented. We investigate their Directional Mode (DM) distribution, and divide all DMs into three classes, and then develop different methods with respect to classes to progressively predict the best DMs. Third, by jointly considering rate distortion costs, residual coefficients and neighboring CUs, we propose to employ the Conditional Random Fields model to early terminate depth selection. Experimental results demonstrate that the proposed algorithm can significantly improve coding speed with negligible coding efficiency losses.
  • Thumbnail Image
    ItemOpen Access
    A novel mode selection-based fast intra prediction algorithm for spatial SHVC
    (IEEE, 2023-06) Wang, Dayong; Sun, Yu; Li, Weisheng; Xie, Lele; Lu, Xin; Dufaux, Frederic; Zhu, Ce
    Due to multi-layer encoding and Inter-layer prediction, Spatial Scalable High-Efficiency Video Coding (SSHVC) has extremely high coding complexity. It is very crucial to improve its coding speed so as to promote widespread and cost-effective SSHVC applications. In this paper, we have proposed a novel Mode Selection-Based Fast Intra Prediction algorithm for SSHVC. We reveal the RD costs of Inter-layer Reference (ILR) mode and Intra mode have a significant difference, and the RD costs of these two modes follow Gaussian distribution. Based on this observation, we propose to apply the classic Gaussian Mixture Model and Expectation Maximization in machine learning to determine whether ILR is the best mode so as to skip the Intra mode. Experimental results demonstrate that the proposed algorithm can significantly improve the coding speed with negligible coding efficiency loss.
  • Thumbnail Image
    ItemOpen Access
    A Probability-Based Zero-Block Early Termination Algorithm for QSHVC
    (IEEE, 2023-04-05) Wang, Dayong; Lu, Xin; Sun, Yu; Wang, Qianmin; Li, Weisheng; Dufaux, Frederic; Zhu, Ce
    To seamlessly adapt to time-varying network bandwidths, the Quality Scalable High-Efficiency Video Coding (QSHVC) is developed. However, its coding process is overly complex, and this seriously limits its wide applications in real-time environments. Therefore, it is of great significance to study fast coding algorithms for QSHVC. In this paper, we propose a novel probability-based zero-block early termination algorithm for QSHVC. First, we observed that the generated residual coefficients follow the Laplace distribution if a CU is accurately predicted. According to this observation, we derive the sum of squared differences based All-Zero Block (AZB) decision condition. Second, we develop the Hadamard Transform (HT)- based zero-valued quantized coefficient decision condition to obtain zero-valued quantized coefficients and the corresponding Partial-Zero Block (PZB). Third, the probability of each coding mode and coding depth being chosen as the best ones are combined with both AZBs and PZBs to derive the probability-based early termination condition. The experimental results show that the proposed algorithm can improve the average coding speed by 80.6% with a 0.31% decrease in BDBR.