Pluggable Display Post Processing Framework

Pluggable Display Post Processing Framework

Loading
Loading Social Plug-ins...
Language: English
Save to myLibrary Download PDF
Go to Page # Page of 37

Description: What is Display Post Processing (DPP)- Specific display panels or interfaces might need special processing for various reasons ranging from functional to quality. E.g.: Dithering of 24bpp to 18bpp low cost panel (to reduce banding), YCbCr instead of RGB, Ensuring colors are mapped accurately to panel color gamut to provide a better shopping experience, etc. Collectively one can call these requirements as “Display Post Processing” or DPP: It has been there in some form or other for a while.

Historical Needs for Display Post Processing- Functional requirements, e.g.: Set top box vendors prefer YCbCr output than RGB: Helps with blacker-than-black and whiter-than-white content, Supporting operating system or web page minimum resolution needs with smaller panels. Historical Needs for Display Post Processing (Contd.)- Image quality- Dithering on 18bpp panel to reduce banding issues,Color gamut manipulation on narrow/wide gamut panel, Panel gamma calibration. OEM differentiation- Enhance color based on ambient environment, Increase color saturation of a narrow gamut panel, Sharpness control for desktop.

Portrait panels are used in a tablet due to multiple reasons: Hold like a mobile, Cost factor, inventory utilization etc. By default when connected to a HDMI * TV, image appearance on tablet is not ideal. GPU needs to rotate on tablet to get the best user experience.

Display Hardware Challenges for Post Processing- A fixed hardware unit in display hardware pipeline can implement some ...Please navigate Paper pages for more details.

 
Author: Sameer KP (Fellow) | Visits: 1088 | Page Views: 1553
Domain:  High Tech Category: Displays Subcategory: Graphics 
Upload Date:
Link Back:
Short URL: https://www.wesrch.com/electronics/pdfEL1NAB7V3QUEP
Loading
Loading...



px *        px *

* Default width and height in pixels. Change it to your required dimensions.

 
Contents:
Intel® Processor Graphics:
Pluggable Display Post Processing Framework
Sameer KP – Platform Architect, Intel Corporation

GVCS007

Agenda
• Historical needs for display post processing
• Display hardware challenges for post processing
• Pluggable IP framework with Intel® Processor Graphics
• Example features
• Live demo
Note: A patent application has been filed for the subject matter
contained in these slides
2

Agenda
• Historical needs for display post processing
• Display hardware challenges for post processing
• Pluggable IP framework with Intel® Processor Graphics
• Example features
• Live demo

3

What is Display Post Processing (DPP)?
• Specific display panels or interfaces might need special processing for
various reasons ranging from functional to quality. E.g.:
- Dithering of 24bpp to 18bpp low cost panel (to reduce banding)
- YCbCr instead of RGB
- Ensuring colors are mapped accurately to panel color gamut to provide a
better shopping experience, etc.

• Collectively one can call these requirements as “Display Post
Processing” or DPP
- It has been there in some form or other for a while

4

E.g.: Dithering on 18bpp Panel
Color banding

Without dithering
5

With dithering

E.g.: Internet Shopping

Default (un-calibrated)
Customer places order
6

Note: Images from Amazon*

Received
(original)
“Customer dissatisfied”

Calibrated monitor
(much more accurate)

Color Accuracy Challenge

7

Source: http://www.amazon.in/Butterflies-Handbag-Rust-BNS-0169/productreviews/B00IJ8AS84/ref=dpx_acr_txt?showViewpoints=1

Historical Needs for Display Post Processing
• Functional requirements, e.g.:
- Set top box vendors prefer YCbCr output than RGB
 Helps with blacker-than-black and whiter-than-white content

- Supporting operating system or web page minimum resolution needs
with smaller panels
 E.g.: Simulating1024x768 panel for operating system with a 1024x600 panel
8

Image from www.audioholics.com

Why Down Scale for Smaller Panel?

800x600 panel
1024x768
Bad user
down scaled
experience to
800x600 –
with limited
better viewing
view of
webpage

9

Historical Needs for Display Post Processing (Contd.)
• Image quality, e.g.:
- Dithering on 18bpp panel to reduce banding issues
- Color gamut manipulation on narrow/wide gamut panel
- Panel gamma calibration

• OEM differentiation, e.g.:
- Enhance color based on ambient environment
- Increase color saturation of a narrow gamut panel
- Sharpness control for desktop

• Augment display fixed hardware, e.g.:
- Portrait panel rotation when in clone configuration with HDMI*
10

E.g.: Improving Color Accuracy on Narrow Gamut Panel

11

Default view on 45% color gamut panel

More color accurate

0.9

Color Accurate Mapping

0.8
0.7
0.6
0.5

With
Calibration

0.9

45%

0.4
0.8

0.3
0.7

0.2
0.6

0.1

sRGB

0.5

Color distorted

0
0

0.4

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

0.9

0.3

0.8

0.2

Original

0.1

0.7

0.1

0.6

0
0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

0.5

45%

0.4
0.3
0.2

Note: Simulated images
12

Color NOT distorted

0.1
0
0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

0.9

E.g.: Portrait panel rotation
• Portrait panels are used in a tablet due to multiple reasons
- Hold like a mobile, Cost factor, inventory utilization etc.

• By default when connected to a HDMI* TV, image appearance on tablet
is not ideal

13

Intel®

Panel scan
direction

Panel scan direction

Intel®

E.g.: Portrait panel rotation
• Portrait panels are used in a tablet due to multiple reasons
- Hold like a mobile, Cost factor, inventory utilization etc.

• By default when connected to a HDMI* TV, image appearance on tablet
is not ideal
• GPU needs to rotate on tablet to get the best user experience

14

Intel®

Panel scan
direction

Panel scan direction

Intel®

Intel®

Agenda
• Historical needs for display post processing
• Display hardware challenges for post processing
• Pluggable IP framework with Intel® Processor Graphics
• Example features
• Live demo

15

Display Hardware Challenges for Post Processing
• A fixed hardware unit in display hardware pipeline can implement some
of the DPP features
- E.g., gamma for monitor calibration
Memory

Memory
Controller

Gamma

Encoder/Port

• At some point hardware might design a color space conversion unit in
this pipeline to meet specific market needs (e.g., YCbCr output)
Memory

16

Memory
Controller

Color Space
Conversion

Gamma

Encoder/Port

Display Hardware Challenges for Post Processing (Contd.)
• Design limitation: No de-gamma unit before color space conversion
- Design can’t be used for color gamut remapping
Memory

Memory
Controller

De-gamma

Color Space
Conversion

Gamma

Encoder/Port

• Features are not always predictable which makes designing the
hardware challenging
- E.g., sharpness requires adjacent pixels & weighting logic
Memory

Memory
Controller

De-gamma

Sharpness
17

Color Space
Conversion

Gamma

Encoder/Port

Agenda
• Historical needs for display post processing
• Display hardware challenges for post processing
• Pluggable IP framework with Intel® Processor Graphics
• Example features
• Live demo

18

Display Post Processing (DPP) Pluggable IP
Framework with Intel® Processor Graphics
Intel® CUISDK

• Custom IP which is pluggable
to software driver

Applications

• Automatically applied to
desktop content

Microsoft*
Operating
System

Intel® Graphics
Driver

Intel® Graphics
Hardware
19

• Using unique IP OEM’s can
add differentiation
ISV Plugin

• Framework is integrated with
display related events (e.g.,
ambient light change)

DPP Capabilities
Intel® CUISDK

Applications

Microsoft*
Operating
System

Intel® Graphics
Driver

Intel® Graphics
Hardware

20

ISV Plugin

DPP Capabilities
• Secured plug-in framework
- Authenticated plug-ins alone can get
plugged in

- No access to frame buffer, plug-in can just
provide the logic to execute

Intel® CUISDK

Applications

Microsoft*
Operating
System

Intel® Graphics
Driver

Intel® Graphics
Hardware

21

Secured
interface

ISV Plugin

DPP Capabilities
• Secured plug-in framework
- Authenticated plug-ins alone can get
plugged in

- No access to frame buffer, plug-in can just
provide the logic to execute

Intel® CUISDK

Applications

Microsoft*
Operating
System

• Native support for
- 3D LUT, sharpness, etc.

Intel® Graphics
Driver

Secured
interface

Inbuilt
IP

Intel® Graphics
Hardware

22

ISV Plugin

DPP Capabilities
• Secured plug-in framework
- Authenticated plug-ins alone can get
plugged in

- No access to frame buffer, plug-in can just
provide the logic to execute

Intel® CUISDK

Applications

Microsoft*
Operating
System

• Native support for
- 3D LUT, sharpness, etc.

• Display “events”
- Listener in user mode tracks/notifies IP of
ambient light change/BKLT change, etc.

- Provides a trigger for IP to re-compute it’s
IP parameters as required
23

Intel® Graphics
Driver

Secured
interface

Inbuilt
IP

Intel® Graphics
Hardware

ISV Plugin

DPP Capabilities
• Secured plug-in framework
- Authenticated plug-ins alone can get
plugged in

- No access to frame buffer, plug-in can just
provide the logic to execute

Intel® CUISDK

Applications

Microsoft*
Operating
System

• Native support for
- 3D LUT, sharpness, etc.

• Display “events”
- Listener in user mode tracks/notifies IP of
ambient light change/BKLT change, etc.

- Provides a trigger for IP to re-compute it’s
IP parameters as required

• Multi-display support
24

Intel® Graphics
Driver

Secured
interface

Inbuilt
IP

Intel® Graphics
Hardware

ISV Plugin

E.g.: Multi-display support

OS Framebuffer

3D LUT1

OS Framebuffer1

3D LUT2

Display 1

Dual display clone

25

Display 2

3D LUT1

Display 1

OS Framebuffer2

3D LUT2

Display 2

Dual display extended

Agenda
• Historical needs for display post processing
• Display hardware challenges for post processing
• Pluggable IP framework with Intel® Processor Graphics
• Example features
• Live demo

26

Example #1: 6-Axis Color Control
• 6-axis color control can adjust colors along
Red/Green/Blue/Cyan/Magenta/Yellow
- A capability present in high end monitors

• Can be used by an OEM/end user to do gamut adjustments
• DPP supports this using internal algorithms and 3D LUT

27

Example #1: 6-Axis Color Control
• 6-axis color control can adjust colors along
Red/Green/Blue/Cyan/Magenta/Yellow
- A capability present in high end monitors

• Can be used by an OEM/end user to do gamut adjustments
• DPP supports this using internal algorithms and 3D LUT

Now available
on laptops too

28

Example #2: Desktop Sharpness
• Sharpness control is available for Video contents
• Sharpness for Desktop contents – especially for image viewing kind of
usage can be a key differentiator
• DPP framework can be used to plug in a sharpness filter

29

Example #3: 3D LUT
• 3D LUT can theoretically provide a direct 1:1 mapping between an input
& output RGB color
- Note: Gamma is a 1D LUT specific for each color channel (R/G/B)

• A plugin can provide 3D LUT along with shader code to generate the
required output color
• Enabled for various OEM’s from driver release 15.33/15.36 onwards

30

Agenda
• Historical needs for display post processing
• Display hardware challenges for post processing
• Pluggable IP framework with Intel® Processor Graphics
• Example features
• Live demo

31

Live Demo
Mrinalini Attaluri – Display Technologist, Intel Corporation
Susanta Bhattacharjee - Graphics Software Engineer, Intel Corporation

Summary
• Intel® Processor Graphics Display post processing plugin framework can
improve display quality without adding extra silicon on panel

• Framework can enhance visual appearance & allow innovative IP
integration
• Framework allows customization and thereby differentiation to OEMs

33

Call to Action
• Contact your Intel representative to get access to Display Post
Processing plug-in APIs
• Work with Intel to bring new image processing techniques to your
system

34

PDF Information
• A PDF of this presentation is available from our Technical Session
Catalog: www.intel.com/idfsessionsSF. This URL is also printed on the
top of Session Agenda Pages in the Pocket Guide.

35

Legal Disclaimer
INFORMATION IN THIS DOCUMENT IS PROVIDED IN CONNECTION WITH INTEL PRODUCTS. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO
ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. EXCEPT AS PROVIDED IN INTEL'S TERMS AND CONDITIONS OF SALE FOR SUCH
PRODUCTS, INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO SALE AND/OR USE OF INTEL
PRODUCTS INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT,
COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.
A "Mission Critical Application" is any application in which failure of the Intel Product could result, directly or indirectly, in personal injury or death. SHOULD YOU
PURCHASE OR USE INTEL'S PRODUCTS FOR ANY SUCH MISSION CRITICAL APPLICATION, YOU SHALL INDEMNIFY AND HOLD INTEL AND ITS SUBSIDIARIES,
SUBCONTRACTORS AND AFFILIATES, AND THE DIRECTORS, OFFICERS, AND EMPLOYEES OF EACH, HARMLESS AGAINST ALL CLAIMS COSTS, DAMAGES, AND
EXPENSES AND REASONABLE ATTORNEYS' FEES ARISING OUT OF, DIRECTLY OR INDIRECTLY, ANY CLAIM OF PRODUCT LIABILITY, PERSONAL INJURY, OR DEATH
ARISING IN ANY WAY OUT OF SUCH MISSION CRITICAL APPLICATION, WHETHER OR NOT INTEL OR ITS SUBCONTRACTOR WAS NEGLIGENT IN THE DESIGN,
MANUFACTURE, OR WARNING OF THE INTEL PRODUCT OR ANY OF ITS PARTS.
Intel may make changes to specifications and product descriptions at any time, without notice. Designers must not rely on the absence or characteristics of any
features or instructions marked "reserved" or "undefined". Intel reserves these for future definition and shall have no responsibility whatsoever for conflicts or
incompatibilities arising from future changes to them. The information here is subject to change without notice. Do not finalize a design with this information.
The products described in this document may contain design defects or errors known as errata which may cause the product to deviate from published
specifications. Current characterized errata are available on request.
Contact your local Intel sales office or your distributor to obtain the latest specifications and before placing your product order.
Copies of documents which have an order number and are referenced in this document, or other Intel literature, may be obtained by calling 1-800-548-4725, or go
to: http://www.intel.com/design/literature.htm
Intel, Look Inside and the Intel logo are trademarks of Intel Corporation in the United States and other countries.
*Other names and brands may be claimed as the property of others.
Copyright ©2014 Intel Corporation.

36

Risk Factors
The above statements and any others in this document that refer to plans and expectations for the second quarter, the year and the future are forwardlooking statements that involve a number of risks and uncertainties. Words such as “anticipates,” “expects,” “intends,” “plans,” “believes,” “seeks,”
“estimates,” “may,” “will,” “should” and their variations identify forward-looking statements. Statements that refer to or are based on projections,
uncertain events or assumptions also identify forward-looking statements. Many factors could affect Intel’s actual results, and variances from Intel’s
current expectations regarding such factors could cause actual results to differ materially from those expressed in these forward-looking statements.
Intel presently considers the following to be important factors that could cause actual results to differ materially from the company’s expectations.
Demand for Intel's products is highly variable and, in recent years, Intel has experienced declining orders in the traditional PC market segment.
Demand could be different from Intel's expectations due to factors including changes in business and economic conditions; consumer confidence or
income levels; customer acceptance of Intel’s and competitors’ products; competitive and pricing pressures, including actions taken by competitors;
supply constraints and other disruptions affecting customers; changes in customer order patterns including order cancellations; and changes in the
level of inventory at customers. Intel operates in highly competitive industries and its operations have high costs that are either fixed or difficult to
reduce in the short term. Intel's gross margin percentage could vary significantly from expectations based on capacity utilization; variations in inventory
valuation, including variations related to the timing of qualifying products for sale; changes in revenue levels; segment product mix; the timing and
execution of the manufacturing ramp and associated costs; excess or obsolete inventory; changes in unit costs; defects or disruptions in the supply of
materials or resources; and product manufacturing quality/yields. Variations in gross margin may also be caused by the timing of Intel product
introductions and related expenses, including marketing expenses, and Intel's ability to respond quickly to technological developments and to
introduce new products or incorporate new features into existing products, which may result in restructuring and asset impairment charges. Intel's
results could be affected by adverse economic, social, political and physical/infrastructure conditions in countries where Intel, its customers or its
suppliers operate, including military conflict and other security risks, natural disasters, infrastructure disruptions, health concerns and fluctuations in
currency exchange rates. Intel’s results could be affected by the timing of closing of acquisitions, divestitures and other significant transactions. Intel's
results could be affected by adverse effects associated with product defects and errata (deviations from published specifications), and by litigation or
regulatory matters involving intellectual property, stockholder, consumer, antitrust, disclosure and other issues, such as the litigation and regulatory
matters described in Intel's SEC filings. An unfavorable ruling could include monetary damages or an injunction prohibiting Intel from manufacturing or
selling one or more products, precluding particular business practices, impacting Intel’s ability to design its products, or requiring other remedies such
as compulsory licensing of intellectual property. A detailed discussion of these and other factors that could affect Intel’s results is included in Intel’s
SEC filings, including the company’s most recent reports on Form 10-Q, Form 10-K and earnings release.
Rev. 4/15/14
37