Review: IPFCN — Intra Prediction Using Fully Connected Network (HEVC Intra Prediction)

Deep Learning Based Intra Prediction, Outperforms HEVC Intra Prediction

Outline

1. Conventional HEVC Intra Prediction

A video is composed of a sequence of frames
Quad-Tree Coding
35 Intra Predictions in HEVC (Left), Some Examples (Right)

2. IPFCN (2017 ICIP)

Intra Prediction using Fully Connected Network (IPFCN)
Different number of layers
Different dimensions (neurons) with 3-layer models
BD-rate (%) using HM-16.9 as anchor for each sequence
Average BD-rate (%)

3. Enhanced IPFCN (2018 TIP)

Different number of layers (Left), Different dimensions (neurons) with 4-layer models for 8×8 blocks (Right)
BD-rate (%) using HM-16.9 as anchor for each sequence
BD-rate (%) for different ranges of QPs
Complexity for Different Models
Prediction Error Reduction (%)
The percentage distribution of CU mode for sequence Rollercoaster. The model is IPFCN-D.

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store