Summary: My Paper Readings and Tutorials About Video Coding

List of Deep Learning Based Video Coding Papers & Tutorials

Sik-Ho Tsang
3 min readMar 29, 2022
Codecs are Used Everywhere in Our Daily Life
  • I moved the video coding paper reading list from Summary: My Paper Reading Lists, Tutorials & Sharings to here, so that I can shorten the list for different topics.
  • Here, there are deep learning papers related to video coding from very beginning to 2020. Though I’ve not updated yet, I know that there are many state-of-the-art approaches appeared in these few years, such as the deep encoder where the whole codec is trained end-to-end, and also there are many new codec standards coming up ...
  • Yet, I hope this summary list can provide a beginner guide or starting point for researchers to start with their research. :)

1. My Paper Readings About Deep Codec

2016 [GDN]

2. My Paper Readings About Video Coding

2.1. Hybrid Codec Filtering

JPEG: 2015 [ARCNN] 2016 [RED-Net] 2017 [DnCNN] [Li ICME’17] [MemNet] 2018 [MWCNN] 2020 [CAR-DRN] [LIU4K] [Ma VCIP’20]
JPEG-HDR: 2020 [Han VCIP’20]
HEVC 2016 [Lin DCC’16] [IFCNN] 2017 [VRCNN] [DCAD] [MMS-net] [DS-CNN] 2018 [DRN] [Lee ICCE’18] [CNNF] [RHCNN] [VRCNN-ext] [S-CNN & C-CNN] [MLSDRN] [ARTN] [Double-Input CNN] [CNNIF & CNNMC] [Residual-VRN] 2019 [B-DRRN] [Liu PCS’19] [DIA_Net] [RRCNN] [QE-CNN] [Jia TIP’19] 2020 [EDCNN] [VRCNN-BN] [MACNN] [Yue VCIP’20] [SEFCNN] [LIU4K]
3D-HEVC: 2018 [RSVE+POST]
AVS3: 2019 [Lin PCS’19] 2020 [CNNLF]
VVC: 2019
[AResNet] [Lu CVPRW’19] [Wang APSIPA ASC’19] [ADCNN] [PRN] 2020 [DRCNN] [Zhang ICME’20] [MGNLF] [RCAN+PRN+] [Nasiri VCIP’20]

2.2. Hybrid Codec Intra Prediction

JPEG: 2017 [MS-ROI] [Baig JVICU’17]
JPEG-HDR: 2020 [Han VCIP’20]
HEVC: 2017 [Xu VCIP’17] [Song VCIP’17] [Li VCIP’17] [Puri EUSIPCO’17] [IPCNN] 2017-2018 [IPFCN] 2018 [HybridNN, Li ICIP’18] [Liu MMM’18] [CNNAC] [Li TCSVT’18] [Spatial RNN] 2019 [PS-RNN] [AP-CNN] [MIP] [Wang VCIP’19] [IntraNN] [CNNAC TCSVT’19] [CNN-CR] 2020 [CNNMC Yokoyama ICCE’20] [PNNS] [CNNCP] [Zhu TMM’20] [Sun VCIP’20] [DLT] 2021 [Zhong ELECGJ’21]
3D-HEVC: 2020 [Liu VCIP’20]
VVC: 2018 [CNNIF & CNNMC] 2019 [Brand PCS’19] 2020 [Bonnineau ICASSP’20] [Santamaria ICMEW’20] [Zhu TMM’20]

2.3. Hybrid Codec Inter Prediction

H.264: 2020 [DRNFRUC & DRNWCMC]
HEVC: 2017
[CNNIF] [Zhang VCIP’17] 2018 [NNIP] [GVTCNN] [Ibrahim ISM’18] [VC-LAPGAN] [VI-CNN] [CNNMCR] [FRUC+DVRF] [RSR] [CNNInvIF / InvIF] 2019 [FRUC+DVRF+VECNN] [Zhao ISCAS’18 & TCSVT’19] [Ma ISCAS’19] [Xia ISCAS’19] [Zhang ICIP’19] [ES] [GVCNN] [Pham ACCESS’19] [CNN-SR & CNN-UniSR & CNN-BiSR] 2020 [FRCNN] [DeepFrame] [U+DVPN] [Multi-Scale CNN] [Klopp TIP’20] [Guo VCIP’20]
AVS3: 2020 [Zhang ICMEW’20]
VVC: 2019
[FRUC+DVRF+VECNN] 2020 [ScratchCNN] [Fischer QoMEX’20]

2.4. Hybrid Codec Fast Prediction

H.264 to HEVC: 2017 [Wei VCIP’17] 2019 [H-LSTM]
HEVC: 2015–2016 [Yu ICIP’15 / Liu ISCAS’16 / Liu TIP’16] 2016 [Laude PCS’16] 2017 [Li ICME’17] [ETH-CNN & ETH-LSTM] 2018 [Katayama ICICT’18] [Chang DCC’18] 2019 [Zhang RCAR’19] [Kim TCVST’19] 2019–2020 [LFHI & LFSD & LFMD Using AK-CNN] 2020 [Yang AICAS’20] [H-FCN]
3D-HEVC: 2019 [AQ-CNN] 2020 [CNN-SENet]
VP9: 2020 [H-FCN]
VVC: 2017
[Jin VCIP’17] [Jin PCM’17] 2018 [Jin ACCESS’18] [Wang ICIP’18] 2019 [Galpin DCC’19] [Pooling-Variable CNN] 2020 [Lin DCC’20] [Amna JRTIP’20] [DeepQTMT] [Santamaria ICMEW’20]

2.5. Hybrid Codec Summary

2020 [Liu TCSVT’20]

--

--

Sik-Ho Tsang

PhD, Researcher. I share what I learn. :) Linktree: https://linktr.ee/shtsang for Twitter, LinkedIn, etc.