JCTVC A114
JCTVC A114
JCTVC A114
Description of video coding technology proposal by NTT, NTT DOCOMO, Orange Labs, Panasonic and Technicolor
15-23 April 2010 1st JCT-VC meeting
Outline
Proposal overview Coding tools Encoder control Performance & Complexity Conclusion
Main properties
Using simple and fundamental coding tools in the decoder Optimized encoding algorithms Implements multi-thread decoding capabilities
Performance
Performs equally well in all sequence classes, bitrates and constraint sets Enhanced chroma reproduction
For all bitrates in both constraint sets Sharper pictures, less blocking artifacts, better chroma representation
Complete documentation
Outline
Proposal overview Coding tools Encoder control Performance & Complexity Conclusion
IQ
IT
Intra Prediction
Intra/Inter
Intra Prediction
collapsing
ME
MC / IC
Denoising/ Deblocking
Reference Memory
Reference Memory
Loop Filter
Encoder
7 April 16, 2010
Decoder
Inter: 8x8 Luma + 4x4 Chroma Intra: 16x16 blocks & Transform can be enabled
superblock superblock superblock superblock
superblock
superblock
superblock
superblock
superblock
superblock
superblock
superblock
Intra16x16 disabled
8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block
Intra16x16 enabled
8x8 block 8x8 block 8x8 block 8x8 block 16x16 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 8x8 block 16x16 block
N=4
N=2
16x16 block
8x8 block 8x8 block
16x16 Y
8x8 U
8x8 V
16x16 block
16x16 block
M=8
M=4
-Luma: Same as MPEG-4 AVC/H.264 for intra8x8 and intra16x16 -Chroma: adaptive filtering implicitly inferred for chroma8x8
10
Entropy coding/decoding
Zero tree coding -In place of Signif. map coding of MPEG-4 AVC/H.264, consistent for Motion and Texture -recursive zero tree for 16x16 transform
CABAC
In-loop filtering
Non-linear Denoising (NDF) Frame Adaptive Denoising Deblocking Filter
-regularization based on a sparsity constraint on the signal -uses a thresholding-based approach in an over-complete transform domain frame-based Wiener filter using residual, prediction and reconstructed signals -Similar to MPEG-4 AVC/H.264 -possible to place deblocking filter before/after NDF
Outline
Proposal overview Coding tools Encoder control Performance & Complexity Conclusion
12
Encoder control
Multi-pass encoding
I, P or B frame type
SAIF on/off
1.Initial ME: search performed in a quadtree structure, from 8x8 to up to 128x128 2.Trellis ME: joint optimization of rows and columns of MVs 3.Region ME: region growing process To reduce complexity, some steps skipped depending on motion precision and interpolation filter type
Intra-picture encoding
2 more SIP types for luma (2x8 and 8x2) For SIP_16x16, 11 prediction modes instead of 4 in MPEG-4 AVC/H.264
For other SIP types, up to 2 TMA modes in addition to the 9 in MPEG-4 AVC/H.264
1 additional mode on top of DC mode: Edge-Based Prediction Mode
13
Outline
Proposal overview Coding tools Encoder control Performance & Complexity Conclusion
14
A revised version has been produced with bug fixing & improvts
Anchor
BD gain Y
BD gain U
Alpha - CS1
Beta - CS2
31.6%
30.4%
29.2%
10.6%
30.0%
10.9%
Alpha -CS1
Beta - CS2
31.7%
30.6%
34.5%
18.3%
35.6%
18.1%
Gamma CS2
47.4%
34.1%
35.1%
Gamma CS2
47.6%
39.2%
40.0%
Comments
Performs equally well in all sequence classes, bitrates and constraint sets Enhanced chroma reproduction
15
Tests conditions
4 machines: 2 Quad-core Xeon E5450 @ 3.00GHz, 32GB RAM 4 machines: 2 Quad-core Xeon E5540 @ 2.53GHz, 32GB RAM
Class C 75 71
Class D 21 19
Class E 145
1 Quad-core Xeon E5420 @ 2.5GHz, 4GB Memory, Windows XP - 32bit Time ratio CDCM / JM
16
2500
ClassA 250.0 200.0 150.0 100.0 50.0 0.0 0 ClassC ClassD 500 1000 1500 2000 2500 3000 3500 4000 4500 ClassE ClassB
17
Outline
Proposal overview Coding tools Encoder control Performance & Complexity Conclusion
18
Conclusion
CDCM codec is proposed in response to the Joint CfP on Video Compression Technology High performance
Superior subjective quality (much better than JM, better than KTA) Excellent objective quality (more than 30% compared to the JM anchors) Better objective and subjective chroma performance observed
Similar quality improvements proving that it is robust, adaptable and not content-specialized
The basic design of the CDCM codec leaves lots of potential for
other decoder tools to be added during the standardization phase further encoder optimization after the standardization phase
19
Conclusion
Attention on parallelizability
20
Annex1: Improvements
21
Annex1: Improvements
Improvements after JCfP bitstreams submission
less blocky 7% average BD-rate improvements for chroma components without any significant change for luma components improvement of chroma
22
interpolation of (7/8th, 7/8th) position of 1/8th pel MC corrected creation of candidate MVs in motion estimation process corrected availability of 8x2 mode for intra prediction corrected sip_type cost now considered when choosing between 4x4, 8x2, 2x8 and 8x8 modes for intra coding bit-cost computation of block coding mode corrected
Decoder related
23
24
Objective performance
25
S0 2P S0
50 45 40 35 30 25 20 15 10 5 0
Y BD-Rate U BD-Rate
Test sequences
AV ER AG BE AV ER AG CE AV ER AG DE AV ER AG Al l-A E VE RA GE A-
V BD-Rate
ra ce et ba llD rill S0 9BQ S1 M 0all Pa rty S1 Sc 1en Ra e S1 ce 2Ho Ba rs sk es et ba llP S1 as 3S1 s BQ 4Sq Bl ow ua in re gB S1 ub 5ble Ra s ce Ho rs es
U BD-Rate
V BD-Rate
On S
1T
S0
ple
3Ki
eo
S0
S0
2P
S0
Test sequences
26
A-
Objective performance
27
S0 3K
-50 10 20 30 40 50 60 0
S0 4P im ar
-40
-30
-20
-10
Y BD-Rate U BD-Rate
Test sequences
BAV ER AG CE AV ER AG DE AV ER AG EAV E ER AG Al l-A E VE RA GE
V BD-Rate
on o kS ce S0 ne S0 56Ca Ba ctu sk et s Ba llD S0 riv 7BQ e S0 Te 8Ba rra sk ce et ba llD rill S0 9BQ S1 0M Pa all rty S1 Sc 1en Ra S1 e ce 2Ho Ba rs sk es et ba llP S1 as 3S1 s BQ 4Bl Sq ow ua in re gB S1 ub 5ble Ra s ce Ho rs es S1 6Vi dy o1 S1 7Vi dy o3 S1 8Vi dy o4
U BD-Rate
V BD-Rate
-10.00
S0 3K
S0
Test sequences
28
Objective performance
29
10
20
30
40
50
60
70
Y BD-Rate U BD-Rate
Test sequences
BAV ER AG CE AV ER AG DE AV ER AG EAV E ER AG Al l-A E VE RA GE
V BD-Rate
S0 3Ki S0 m on 4Pa o rk Sc en S0 S0 e 56Ca Ba ctu sk et s Ba llD S0 riv 7BQ e S0 Te 8Ba rra sk ce et ba llD rill S0 9BQ S1 0M Pa all rty S1 Sc 1en Ra S1 e ce 2Ho Ba rs sk es et ba llP S1 as 3S1 s BQ 4Sq Bl ow ua in re gB S1 ub 5ble Ra s ce Ho rs es S1 6Vi dy o1 S1 7Vi dy o3 S1 8Vi dy o4
U BD-Rate
V BD-Rate
S0
Test sequences
30
B-