TV SoC Solutions for the

Immersive Display &

Intelligent Platform

Sep 18, 2017

SJ Choi
System IC Center
LG Electronics Inc
 LGE Internal Use Only

Contents

1. TV Overview
2. Human Visual System
3. TV Technology Trends
4. TV SoC Overview
5. LG TV SoC
6. Tomorrow’s TV

1 / 20
 LGE Internal Use Only
Digital Convergence & Mobile/TV ‘06 Forecast

Personal Electronics Home Electronics

Convergence into Cellular Convergence into DTV

Note Book
TV
Digital STB

PDA BD Player
Wireless
Camcorder Access Point
Printer

Camera Audio PVR1)

Scanner
Projector
Home Server
MP3 Player Game Player
Gateway
Game Player Health
Care

1) PVR: Personal Video Recorder

ISOCC`06 Keynote
2 / 20
 LGE Internal Use Only
Digital Convergence & Mobile/TV `17 Now

Mobile as Convergence Device TV as Entertainment Device

- Combine All Functionalities - Immersive Display with Premium Contents

Social Finance

Traffic Shopping

Travel Media

Game Health

3 / 20
 LGE Internal Use Only
TV Overview Past and Future

Future Technology
l Wall Paper TV
l Rollable TV
Immersive TV
l Hologram TV
l 3DTV (w/t Glasses)
Smart TV l UHD TV
l Streaming
l Premium Contents
Digital TV
l High-Definition TV
l 16:9 Aspect Ratio

Analog TV
l Black and White TV
l Color TV
4 / 20
 LGE Internal Use Only
TV Overview TV Evolution

FHD 120Hz TV (Frame Rate Conversion, 60 à 120Hz) UHD TV (Super Resolution, HD à UHD)

LED TV (LED Back-light Control, Local Dimming) HDR TV (High Dynamic Range, SDR à HDR)

Smart TV (Streaming & App, Computing Core) OLED TV (Perfect Black, Color)

5 / 20
 LGE Internal Use Only
TV Overview Human Visual System

TV Reflects the Characteristics of the Human Visual System

Human Vision (Eyes + Brain) TV & Human Factor

Left Right
~65mm

u Black & White TV

§ [Human] Sensitive more to Luminance
Rod Cell, Cone Cell

u Digital TV
§ [Human] 16:9 Aspect Ratio is more Natural
4:3 à 16:9
Occipital Lobes
u Immersive TV (UHDTV)
§ [Human] Wider View Angle à More Immersive

u Immersive TV (3DTV)
§ [Human] 3D Depth

6 / 20
 LGE Internal Use Only
TV Overview Human Vision System

TV Display à Higher Contrast and Wider Color Representation

u Bartleson-Breneman Effect u Helmholtz-Kohlrausch Effect

§ [Human] § [Human]
Higher Contrast à Perceived Picture Brighter Wider Color Gamut à Perceived Picture Brighter

7 / 20
 LGE Internal Use Only
TV Overview LCD vs OLED

OLED: Ultimate Display Technology with Excellent Picture Quality

Advantages of OLED TV

u Simple Structure
§ Self-emissive (no BLU1))
§ Pixel Unit = Lighting Unit

u Ultimate Picture Quality

§ Real Black: Ultimate Contrast Ratio
§ Wide Color Gamut

u Innovative Form-Factor
§ Paper-slim Depth (~4mm)
§ Light Weight
§ Curved & Flexible Display
§ Wall Paper Display

1) BLU: Back-Light Unit

8 / 20
 LGE Internal Use Only
TV Overview OLED

LG OLED: White-OLED (Tandem) + Color Filter (RGBW)

RGB OLED (Conventional) W-OLED + Color Filter (LG)

Encapsulation Encapsulation
Cathode Cathode

R
OLED R G B W-OLED G
Tandem (Multi-layer) B

Anode Anode
C/F R G B

§ Color Sub-pixel: RGB-OLED § Color Sub-pixel: W-OLED + Color Filter

§ Issues: Productivity - Color Filter: White + RGB
- Difficult Commercialization - Tandem W-OLED (Multi-layer)
à Improve Luminance
§ TFT: Oxide TFT

9 / 20
 LGE Internal Use Only
TV Overview UHD TV

Super Real Immersive

u Detail with More Number of Pixels u Immersive with Larger Screen Size

Full HD TV UHD TV (8K)

Low H H
Resolution

3xH 0.75xH

30˚ 100˚

* Japan NHK Research

High Resolution FHD UHD_4K UHD_8K

(1,920x1,080) (3,840x2,160) (7,680x4,320)
Screen Size 55” 84”

ABCD
View Angle 30˚ 60˚ 100˚

View Distance 3H: ~2M 1.5H: ~1.5M 0.75H: ~

55” TV: D(~140cm), H(68.5cm), 3H(~2M)

84” TV: D(~213cm), H(104cm), 1.5H(1.5M)

10 / 20
 LGE Internal Use Only
System IC SoC (System-on-a-Chip)

System IC Plays a Crucial Role for the Success of System

u System S/W
§ Platform
TV § BSP1)
§ Service/Contents
§ HW/SW Optimization

u TV System Design
§ Architecture Design
§ SoC Platform Design
§ Global Broadcasting Technology
§ Picture Engine
§ Multimedia Service

u Design Infra
§ Foundry
§ Design Methodology
SoC § Physical Design
§ Low Power Design

1) BSP: Board Support Package

11 / 20
 LGE Internal Use Only
System IC Overview

Market-leading Set Maker develops its own SoC and Platform

60s-70s 80s-00s 2010+

IDMs Fabless & Market-leading
Foundry Set Maker

TV Smart Phone

Past

Set Maker Fabless Set Maker Fabless

Now

12 / 20
 LGE Internal Use Only
TV SoC Overview

Trends
Connectivity

HDMI USB
Analog u Full HD à Ultra HD
A/V
§ UHD Contents
TV Basic
§ Broadcasting Technology
RF Remote
TV SoC
Controller
§ UHD Display
Terrestrial Connectivity Sound User Experience § LCD à OLED Technology
§ HDR Technology
Cable/Satellite Demodulator Picture
TV Panel
A/V Codec Engine
LCD u TV Platform
Smart Feature CPU &
GPU § IP Delivery: TV à Mobile/Tablet
Peripheral OLED
Streaming
§ Contents Delivery: Netflix, Amazon
Memory Controller § User Experiences: webOS, Tizen, Android
App Service Immersive Picture

Contents
DDR eMMC
u Competitions
§ Japan vs Korea
Memory
à Korea vs China/Taiwan
§ Apple/Google

13 / 20
 LGE Internal Use Only
TV SoC SoC Architecture & Design

Computing Unit Sound & Picture Engine

• CPU: ARM Cortex-A72/57 • Audio Codec & Processing
• GPU: ARM Mali • Immersive Picture Engine
• DSP • Display Panel Interface
• Neural Engine (in Future)

Broadcasting & Multimedia Connectivity & Mixed IP

• Global Demodulator: • DDR3/4
ATSC/DVB/ISDB-T/DTMB • HDMI2.0
• Multi-Standard Codec : MPEG- • USB3.0/eMMC5.1
2/H.264/HEVC/VP9 • Ethernet
• ADC/DAC/PLL

14 / 20
 LGE Internal Use Only
TV SoC LG Roadmap

`11 `12 `13 `14 `15 `16 `17

High-end
H15 H15+

TV SoC
1st UHD SoC
(UHD)
Mid-end M16 M16+

UHD Mass-Volume

High-end L9 H13 H14

TV SoC 1st DTV SoC

(FHD)
Mid-end M14 M14+

webOS Platform
FHD Mass-Volume

3D
FRC3 U14 F16 B17
Depth
SR1) Engine 4K/8K TV ATSC3.0
Stand-
Alone Tyche EVE
D13 D14 16 16

4K HEVC2) OLED UHD Wallpaper

Controller Interface

Process 40nm 28nm

1) Super Resolution (FHD à UHD High-Quality Conversion), 2) High Efficiency Video Coding
15 / 20
 LGE Internal Use Only
TV SoC § Interface
M16+(`16)
- Ethernet 100 Mbps Phy
§ Process : TSMC 28nm (T28HPC+, 0.9V/2.5V) - Ethernet 100/1000Mbps MAC
§ Package : 27x27 mm2 fcBGA - USB2.0 x3, USB3.0 x1
- HDMI 2.0b Rx. x4
§ CPU DDR I/F 2133 (32bit x2) eMMC 5.01 M16+ - PWMx3, I2Cx6, UARTx2
- ARM Cortex A53 1.15GHz(x4, OD:0.95)
- NEON, Trustzone UARTx2 § Audio/Sound DSP
- L1$ 32KB/32KB, L2$ 1MB - HiFi EP Dual@600MHz, cache 32KB/32KB
CPU: Audio DSP: - DRA, Ogg Vorbis
I2S Cortex-A53 HiFi EP USB3.0x1
§ GPU/GFX - DTS-M6n
- ARM MALI T820MP2@ 650MHz 1.15GHz Quad 600MHz Dual - DD, DD+, MP2, MP3, ADPCM, LDPCM,
- OpenGL ES 1.1/2.0/3.0/3.1 PWMx3 L2$:1MB USB2.0x3 - AAC, HE-AAC, HE-AAC v2
Encoder:
- OpenCL 1.2 full profile, DirectX 11.1 - WMA9(standard)/10(pro)/loseless, DDCO
- Renderscript for Google TV 480p@30fps - HE-AAC/DD+ to DD
SPI/Vsync
- Vivante GC520@300MHz Graphic Engine GPU: MFD: - G.711, G.729
- DirectFB, AFBC ARM T820MP2 1080p@60fps - AC-4, MPEG-H, ATMOS
JTAG 650MHz Vx1/EPI Tx
4K HEVC Decoder
§ MFD (G1 Decoder) § Picture Quality
4K SHVC Decoder LVDS Tx - 4K MEMC 120Hz.
- FHD 30fps(x2) or FHD 60fps HDMI Rx. x4
- VP8(1080p) Display Engine: - HDR (Dolby, HLG, Technicolor)
- H.264-MVC Stereo High FHD (4K 30fps) HDR, SR 4K VP9 Decoder - 2Dto3D
SPDIF out
- H.264 BP/MP & [email protected] LAN PHY 2Dto3D, Local/D - Enhance SR
- VC-1 SP/MP & AP@L3 TCON - LED Local Dimming(HDR)
- MPEG-2 MP@HL & MPEG-4 SP/ASP OTP ROM - Wide Gamut
I2C x 6
- DivX 3~6, H.263 P0/P3 4K MEMC 120Hz
BUS IF(CI+)
- RV 8/9/10, AVS/AVS+ [email protected] Security Engine § Security Engine
- Sorenson Spark@L70 - OTP, 3DES, AES, RSA, SHA, C2/CSA
- MJPEG Baseline, JPEG 2D Gfx: - Multi2, DVB-CSA
Vivnate520 Analog Demod Demod :
- Trustzone
§ G2 Decoder ATSC,
- MD5, SHA-224
- 4K 10bit VP9 Decoder (60 fps) DVB-T/C, - Secure Random Number Gen.
CLK Comp. ADCs Transport Engine ISDB-T - RSA 2048bit
§ HEVC Decoder
- 4K 10bit HEVC Decoder (120 fps) A.Vid_out A.Aud_out A.Vid_in A.Aud_in GPIO § Demodulator
- VSB/QAM,DVB-T/C,ISDB-T
§ ATSC 3.0 Support - Analog Demod
- ATSC 3.0 TP
- 4K SHVC Decoder (60 fps) § Memory
- Unified memory architecture
§ Encoder - Up to DDR3/4 2133MHz 32x2
- H.264(VP8) 1080p@30fps [email protected] - eMMC5.01
16 / 20
 LGE Internal Use Only
TV SoC Memory Bandwidth

DTV
Demod
Video
Decoder Frame Technical Issues
Rate
Converte
Display r
Analog
Audio
Decoder
Engine
(Picture
(FRC) Display
Interface
u Total Memory Bandwidth
Front-end Quality) § Full HD à Ultra HD
&
A/V
Interface Video
3D § DDR Clock: 800MHzà 933 à 1,066 à
(2Dto3D,
Encoder 3D Depth) § Bus Width: 16x4 (64bit) or 16x6 (96bit)
Internal Bus u Frame Buffer Compression
§ GPU: AFBC (ARM Frame Buffer Compression)
Network § Visually Lossless: 20/40/50%
CPU GPU &
Connectivity
u Real-time Constraints (QoS)
DDR/Flash USB/UART/ HDMI/ DVR/ Audio § Real-time: Picture Engine, Display
Controller I2C/SPI CVBS Out Security Engine
§ Local Buffer
§ Scheduling
u Smart Memory Balancing
§ Video Encoder/Decoder
DDR3/4 DDR3/4
§ CPU/GPU

DDR Memory Interleaving

u CPU/GPU Performance
§ Dedicated CPU/GPU Bus
Reduce Bandwidth Loss
DDR Memory Bandwidth Utilization
Shorten a Latency of Memory Access
17 / 20
 LGE Internal Use Only
TV SoC Picture Engine

TV Picture Engine Spatial Resolution

8K
Real world Human
q Picture Quality: TV Panel + Picture Engine 4K Vision ~`16 `17~
Sun 9
Bit Temporal 10
§ TV Panel: LCD/OLED Resolution 2K
Resolution
direct
108
12bit HD 240Hz Sun 6
10
120Hz light
10bit 700~1,500nit↑
104
q Contrast and Color (TV Panel) 8bit
SD 60Hz
Indoor 2
400nit
light 10
§ Contrast : Dynamic Range BT.709
SDR Moon 10
0

§ Color : Gamut DCI

light 10-2 0.1nit
Color Dynamic 0.001~0.1nit↓
Star 10
-4
§ Resolution : 4K, 8K Gamut Range
light 10-6
BT.2020 HDR
휘도
q Noise and Sharpness (Picture Engine)
§ Noise Reduction: Analog, MPEG Picture Engine
§ Sharpness : Edge, Texture
Basic Differentiation Panel Specific

STB
q Format Conversion (Picture Engine) BDP
HDMI
TNR/DNR FRC OLED
OLED TV
LCD TV
§ Up/down Resolution Scaling Deinterlace HDR
Local
Dimming
§ De-interlacing: Interlaced à Progressive OTT Video Video
Broadcasting Stream Decoder Scaler/SR 3D WCG

q Panel Characteristics Sharpness OSD SR WB

Input
§ LCD Motion Blur: FRC 24/30/60 à 120Hz 24/30/60/120Hz Color
Output
60/120Hz
25/50/100Hz Contrast 50/100Hz

18 / 20
 LGE Internal Use Only
TV SoC Tomorrow’s TV

Home Entertainment Center & Personalized Screen

u Competitions
§ Display: TV Set Makers
§ TV and Mobile Platform
§ Content Service

u Immersive TV Screen
§ Vivid and High Picture Quality
§ Immersive Ultra HD Screen
§ Feeling of “Being There”

u Contents & User Experiences

§ Premium Contents
§ Contents Recommendation
§ Personalized Screen (News/Advertisement)

19 / 20
 LGE Internal Use Only
TV SoC Tomorrow’s TV

Intelligent Platform: Picture Engine

u Prevalence of Deep Learning u Picture Quality

§ Big Data § Pixel Improvement
§ Computing Power : Super Resolution, Noise Reduction
§ Learning Skill
§ Object-Centric Processing
Alexnet : `12 ILSVRC (Image Classification Challenge) Winner
: Object Detection
§ Picture Generation
: Frame Rate Conversion

u Intelligent Picture Quality Tuning

§ Input Analysis & Optimal Picture Tuning
§ Watching & Learning

TV High Quality
EDSR : `17 NTIRE_SR (Super Resolution Challenge) Winner Input Picture Picture

Self Learning Engine

DNN

Input Analysis

20 / 20