Front Cover

High Dynamic Range Video: Concepts, Technologies, and Applications

Copyright

Contents

Contributors

Editors' Biography

Acknowledgments

Overview of HDR Video

1. Introduction

2. COST Action IC1005

2.1 Success Stories

2.1.1 HDR in Dental X-ray Imaging

2.1.2 HDR Tone Mapping in Game Development

2.1.3 New PhD Topic at Vienna University of Technology

2.1.4 The Growth of HDR in France

2.1.5 HDR Imaging of Rocket Launches

2.1.6 World’s First Complete Real-Time HDR Broadcast

2.1.7 Evaluation of HDR Usage for Performance Art Projects

3. The HDR Video Pipeline

3.1 Capture

3.2 Compress

3.3 Display

4. Discussion

Appendix

References

Part 1: Capture

Chapter 1: Ghosting in HDR Video

1 Introduction

2 Image Acquisition Model

3 HDR Image Deghosting Methods

4 HDR Video Capture Methods

4.1 Single Aperture Multiple Sensor Solutions

4.2 Multiple Camera Solutions

4.3 HDR Sensor Solutions

5 Global Video Deghosting

5.1 View Dependent Enhancement of the Dynamic Range of Video [77]

5.2 Histogram-Based Image Registration for Real-Time HDR Videos [78]

5.3 A Real-Time System for Capturing HDR Videos [79]

6 Local Video Deghosting

6.1 High Dynamic Range Video [80]

6.1.1 Capture

6.1.2 HDR Stitching

6.1.3 Temporal Tone Mapping

6.2 Video Matching [82]

6.2.1 Spatial Alignment

6.2.2 Temporal Alignment

6.2.3 HDR Reconstruction

6.3 HDR Video Through Fusion of Exposure Controlled Frames [110]

6.4 High Dynamic Range Video With Ghost Removal [86]

6.4.1 Block-Based Motion Estimation

6.4.2 MV Refinement in Saturated Blocks

6.4.3 HDR Reconstruction

6.4.4 Artifact Removal

6.5 Spatially Adaptive Filtering for Registration Artifact Removal in HDR Video [88]

6.6 Filter-Based Deghosting for Exposure Fusion Video [83]

6.7 Toward Mobile HDR Video [81]

6.8 Patch-Based High Dynamic Range Video [85]

6.9 A MAP Estimation Framework for HDR Video Synthesis [87]

6.10 Motion Aware Exposure Bracketing for HDR Video [120]

References

Chapter 2: Creating HDR Video Using Retargetting

1 Introduction

2 Background in HDR Video and Image Retargeting

2.1 HDR Video Capture

2.2 Image Retargeting

3 Dynamic Camera and Static Scene

3.1 Geometry Estimation

3.2 Video Reconstruction

3.3 Discussion

4 Static Camera and Dynamic Scene

4.1 The Blending Algorithm

4.2 The Classification Mask

4.3 Discussion

5 Summary

References

Chapter 3: HDR Multiview Image Sequence Generation: Toward 3D HDR Video

1 Introduction

1.1 Stereoscopic Imaging

1.2 Epipolar Geometry

2 Multiple Exposure Stereo Matching

2.1 Per Frame CRF Recovery Methods

2.2 Offline CRF Recovery Methods

3 Patch-Based Multiscopic HDR Generation

3.1 Nearest Neighbor Search

3.2 Image Alignment and HDR Generation

4 Results and Discussion

References

Chapter 4: Calibrated Measurement of Imager Dynamic Range

1 Introduction

1.1 Background

2 Method and Materials

2.1 Design

2.1.1 Test Chart and Processing Software

2.1.2 Selected Cameras

2.1.3 Test Procedure

2.1.4 Data Workflow

3 Results

4 Discussion

5 Conclusion

Acknowledgments

References

Part 2: Manipulate

Chapter 5: HDR Video Metrics

1 Introduction

2 Image and Video Quality Assessment

2.1 Full-Reference Metrics

2.2 No-Reference and Reduced-Reference Metrics

3 DRI-VQM

4 HDR-VQM

4.1 Transformation Into Emitted Luminance

4.2 From Emitted to Perceived Luminance

4.3 Decomposition Into Visual Channels

4.4 Pooling

5 Data-Driven Metrics

6 Outlook and Future Work

Acknowledgments

References

Chapter 6: Practical Backwards Compatible High Dynamic Range Compression

1 Introduction

2 Related Work

2.1 HDR Video Compression Methods

3 Practical Backwards Compatible Compression

3.1 Encoding Method

3.2 Channel Scaling

3.3 Decoding Method

4 Comparison Results

4.1 Implementation

4.2 Method and Results

4.3 Still Images

4.4 Discussion

5 Conclusions

Acknowledgments

References

Chapter 7: Real-Time HDR Video Processing and Compression Using an FPGA

1 HDR Video Processing

2 Description of the HDR Acquisition and Compression Task

3 Acquisition of HDR Video

4 HDR Video Compression Implementation

5 HDR Acquisition and Compression System Interfaces

6 HDR Acquisition and Compression Software Structure Overview

7 HDR Acquisition and Compressions Features and Results

References

Chapter 8: Live HDR Video Broadcast Production

1 Introduction

1.1 SDTV, HDTV, and UHDTV

1.2 Real-Time HDR Video Processing

1.3 Dynamic Range Preservation in Live Broadcast Production Workflows

1.4 Main Aspects of Quality Preservation

1.4.1 Banding

1.4.2 Chromatic Deviations

2 Digital TV Basics

2.1 Capture

2.2 Manipulation

2.3 Contribution

2.4 Distribution

2.4.1 Broadcasting Standards

2.4.2 Encoding

2.5 Reproduction

3 Integration of HDR Flows in Standard Broadcasting Pipelines

3.1 Single Layer vs Dual Layer

3.1.1 Single Layer

4 GPU-Based Real-Time Manipulation and Monitoring

5 Conclusions

References

Part 3: Display

Chapter 9: HDR Video on Small Screen Devices

1 Introduction

2 HDR Video Tone-Mapping

2.1 Delivering HDR Video to Mobile Devices

2.1.1 Hardware

Display Features

Local Storage Availability

Power Supply

2.1.2 Context-Related

Ambient Illuminance

Reflections

2.2 Available Solutions

2.3 Future Trends

Acknowledgments

References

Chapter 10: Gaze-Dependent Tone Mapping for HDR Video

1 Introduction

2 Background

3 Gaze-Dependent Tone Compression

3.1 Spacial Extent of Visual Adaptation

3.2 Temporal Adaptation to Light and Dark

3.3 Tone Compression

4 Testbed and Results

5 Conclusions and Future Work

Acknowledgments

References

Part 4: Applications and Uptake

Chapter 11: Improving Tracking Accuracy Using Illumination Neutralization and High Dynamic Range Imaging

1 Introduction

2 Overview

3 Acquisition of the Scene Illumination

3.1 Fisheye Images

3.2 Environment Map Representation

4 Precomputed Radiance Transfer

5 Neutralizing Illumination

5.1 Sampling Environment Maps

5.2 Neutralizing

6 Improving Tracking Accuracy

7 Conclusions

References

Chapter 12: Factors Influencing the Widespread Uptake of HDR Video

1 Introduction

2 Current HDR Video Television Adoption:What and Why

2.1 Incremental Innovation

2.2 Why Might Any Form of HDR Video Imaging Be Adopted?

2.2.1 Response to Falling Prices

2.2.2 Rapid Technological Change

2.2.3 Process of Adoption

2.3 Why Is Adoption at the Moment Taking the Form It Is?

2.4 Is It a Form of Adoption That Will Persist, or Be Quickly Replaced by Something Better?

2.4.1 Focus on Costs of Switching and Stranding

3 Current Adoption: Short Term or Enduring?

3.1 Is This Kind of Adoption Likely to Persist, or Be Overtaken by a More Impressive Technology?

3.2 Constraints: Why Not Adoption Closer to Technological Optimum Possibilities?

3.2.1 Uncertainty Over Consumer Demand and Willingness to Pay

3.2.2 Display Costs

3.2.3 Switching Costs

3.2.4 Important Qualification

4 Supply Conditions and HDR Adoption

4.1 Relevance of Networks

4.2 Compatibility

5 Coordination and the Role of Technology Standards

5.1 Role of Standards

5.1.1 Factors Promoting Adoption of a Common Standard

5.1.2 Factors Impeding Adoption

5.1.3 Options to Creating a Standard

5.2 Some Observations on MPEG Progress

6 Conclusions

References

Further Reading

Index

Back Cover