There’s a great deal of confusion about the use of the two types of conversion described in BT.2390. It is perhaps useful to start with some definition
A scene-referred encoding is one where there is a defined mathematical relationship to the original scene light. Camera log encodings, such as S-Log3 and LogC3 are scene-referred (strictly relative scene-referred, since without knowledge of the camera’s exposure setting the absolute scene luminance cannot be inferred).
A display referred encoding is one where there is a defined mathematical relationship to the light produced by a display. PQ is an absolute display-referred encoding, as a given PQ code value specifies the exact luminance produced by a reference display. BT.1886 is relative display-referred, since the luminance produced is relative to the peak luminance of the display.
A conversion to or from PQ can only ever be performed in display light, since it is a representation in a different format of the absolute luminance produced by the PQ signal.
A conversion to or from a camera log format can only ever be performed in scene light, since these formats do not define the display light produced.
The complication arises with HLG which is in some senses both scene and display-referred. If an HLG camera produces a signal which is exactly as specified in BT.2100, the scene luminance (relative to diffuse white) can be inferred from that signal. In reality, shading and other camera adjustments mean the signal diverges in an unknown way from the pure standard for creative and technical reasons, so scene luminance cannot be inferred. Many argue that HLG is in fact display referred, since BT.2100 describes the relationship between the HLG signal and a 1000 nit reference display, and a reference display should not diverge from the standard.
SDR too has a relationship to scene light defined in Rec.709, and a relationship to display light defined in BT.1886. Again, camera adjustments will break the scene light relationship.
A display light conversion between HLG and SDR aims to match the appearance of the image on the HDR and SDR displays. If gamma compensation is not applied, the luminance ratios on the two displays are identical below the roll-off knee points. Gamma compensation diverges slightly from this with the aim of improving the perceptual match at a different absolute luminance, but the aim is still matching of the two displays.
A scene light conversion between HLG and SDR aims to produce a match between the signals which would have been produced by an HLG and SDR camera pointed at the same scene. These will however not appear exactly the same on HDR and SDR displays. This is because of the different methods used for mapping signal to display in BT.1886 and BT.2100 HLG. The result of this is that shaders viewing an HLG signal or an SDR signal produced using a scene-light conversion might make slightly different choices, particular in regard to saturation.
A number of factors will influence the choice of scene or display light mode (when available) and there is no one correct choice for every scenario.
When up-converting graphics created in SDR (often sRGB) to HLG for inclusion in an HDR transmission, a display light conversion is normally the most appropriate, in order to maintain the appearance of the graphics as they were seen on screen when created.
Likewise when down-converting an HLG signal for SDR transmission, a display light conversion will create the best appearance match between the HDR and SDR streams.
Cameras which are able to simultaneously produce SDR and HDR output often use scene light conversion (in part due to historical limitations in camera processing capabilities). If it is necessary to externally match an in-camera conversion, a scene light conversion is usually more appropriate.
When converting a feed from an SDR only camera for inclusion in an HDR programme, a scene light conversion may be more appropriate, although the choice may be influenced by any processing in the SDR camera which alters the signal from being purely scene-referred.
At the end of the day, thorough testing of the complete setup, including all the different sources and outputs is the only way to ascertain the most appropriate choices.
Some cameras may include separate processing in the HDR and SDR pathways which can alter the scene light relationship.
Copyright ORION-CONVERTTM
Version 1.0 October 2024