张润南, 周宁, 周子豪, 杜和恒, 陈钱, 左超. 光场表征及其分辨率提升技术:文献综述及最新进展[J]. 红外与激光工程. DOI: 10.3788/IRLA20240347
引用本文: 张润南, 周宁, 周子豪, 杜和恒, 陈钱, 左超. 光场表征及其分辨率提升技术:文献综述及最新进展[J]. 红外与激光工程. DOI: 10.3788/IRLA20240347
ZHANG Runnan, ZHOU Ning, ZHOU Zihao, DU Heheng, CHEN Qian, ZUO Chao. Light field representation and its resolution improvement techniques: an overview[J]. Infrared and Laser Engineering. DOI: 10.3788/IRLA20240347
Citation: ZHANG Runnan, ZHOU Ning, ZHOU Zihao, DU Heheng, CHEN Qian, ZUO Chao. Light field representation and its resolution improvement techniques: an overview[J]. Infrared and Laser Engineering. DOI: 10.3788/IRLA20240347

光场表征及其分辨率提升技术:文献综述及最新进展

Light field representation and its resolution improvement techniques: an overview

  • 摘要: 自高斯时代以来,成像系统的设计和开发便始终致力于透镜的持续迭代和优化,以收集来自物平面上某点向不同方向发射的光线,并尽可能完美地将其汇聚到像平面上的一个点。然而,成像传感器仅能捕捉并记录下光线的空间位置信息,导致角度信息的丢失,并完全丧失了对三维场景的视角变换与深度感知能力。为了弥补这一缺陷,计算光场成像技术应运而生,它能够记录空间光辐射场的完整分布,联合记录空间位置和角度信息,突破了经典成像的局限性,正逐渐被应用于生命科学、国防安全、虚拟现实/增强现实、环境监测等领域,具有重要的学术研究价值和广阔的应用潜力。然而,光场成像技术仍然受到数字成像器件和图像传感器的联合制约,成像系统的有限空间带宽积致使光场成像在实际应用中往往需要在空间分辨率和角度分辨率之间做出权衡,导致难以达到传统成像技术的高空间分辨率。自光场成像技术诞生以来,如何赋予其更高的自由度,即在保持高分辨率成像的前提下,提高时间分辨率和角度分辨率,从而实现更清晰、更立体的成像性能是光场成像技术亟需解决的关键问题,也一直是该领域的研究热点。该综述全面回顾了光场成像技术的发展历程,阐述了全光函数和四维光场的基本概念,并总结了在时间、空间和角度这三个维度上实现高分辨率成像的关键方法,最后还对光场成像技术的未来发展趋势进行了展望。

     

    Abstract:
    Significance  Since Gauss’s Day, the design and development of imaging systems have been continuously dedicated to the iterative improvement and optimization of lenses, aiming to collect light emitted in various directions from a point on the object plane and converge it as perfectly as possible onto a point on the image plane. However, imaging sensors can only capture and record the spatial position information of the light field, losing the angular information, which causes them to completely lose the ability to perceive perspective transformation and depth of a three-dimensional scene. To compensate for this deficiency, computational light field imaging technology was born, which can record the complete distribution of the radiance, and jointly recording spatial position and angle information, breaking through the limitations of classical imaging. It is gradually being applied to fields such as life sciences, national defense security, virtual reality/augmented reality, and environmental monitoring, with important academic research value and broad application potential. However, light field imaging technology is still jointly constrained by digital imaging devices and image sensors. The limited spatial bandwidth product (SBP) of the imaging system makes light field imaging often have to make trade-offs between spatial resolution and angular resolution in practical applications, making it difficult to achieve the high spatial resolution of traditional imaging technology. Since the birth of light field imaging technique, how to endow it with higher degrees of freedom, that is, to maintain high-resolution imaging while improving temporal resolution and angular resolution, in order to achieve clearer and more stereoscopic imaging performance, is a key problem that light field imaging technology urgently needs to solve, and has always been a hot topic in this field.
    Progress  We first reviews the development history of light field imaging technology, and elaborates in detail on the basic concepts of the seven-dimensional full light field function and the simplified four-dimensional light field. Subsequently, the paper delves into the latest research progress of light field imaging technology in enhancing temporal, spatial, and angular resolution, including the application of microlens arrays, phase scattering plates, heterodyne coding, camera arrays, and other methods in the recording of high-speed dynamic three-dimensional scenes; the achievements of techniques such as transfer function deconvolution, prior information constraints, multi-frame scanning, aperture coding, confocal, and hybrid high/low light field imaging in improving spatial resolution; and methods for enhancing angular resolution through depth constraints, sparse prior constraints, and other approaches. In addition, the article also looks forward to the future development directions of light field imaging technology, including the control of high-dimensional coherence in light fields, the integration of artificial intelligence with light field imaging technology, the development of miniaturized and portable light field imaging devices, new imaging mechanisms, and the prospects for the combination of light field imaging and light field display technology, as well as the potential of light field imaging in special fields. Finally, the paper emphasizes the challenges of light field imaging technology in achieving optimal imaging performance, especially the importance of finding an efficient balance among the three key dimensions of temporal, spatial, and angular resolution. With the continuous progress and innovation of technology, light field imaging technology is expected to further break through the limitations of traditional optical imaging, inject new momentum into the advancement of imaging technology, and open up new application prospects in various fields such as life sciences, remote sensing, computational photography, and spectral imaging.
    Conclusions and Prospects  This review delves into the current state of development and challenges faced by light field imaging technology. Light field imaging still utilizes existing two-dimensional sensor devices, which currently possess only spatial resolution, thus necessitating a trade-off between spatial and angular resolution to achieve the latter. To enhance the spatial resolution of light field imaging, one approach is to improve hardware, such as increasing the pixel resolution of sensors and arranging large-scale camera arrays. On the other hand, temporal resolution can be used to enhance spatial sampling, for instance, by employing aperture coding techniques and multi-frame scanning methods to increase spatial resolution. However, directly upgrading hardware resources can lead to increased costs, as well as potential issues with size, weight, and data transmission processing. Therefore, if one does not wish to enhance performance by physically adding hardware, it is necessary to rely on algorithmic innovation, such as optimizing imaging results using prior information and deep learning. This method is referred to as "punching above one's weight," meaning that performance is improved through algorithms without increasing physical resources. However, we also recognize that the development of light field imaging technology still faces challenges on multiple fronts. To achieve broader applications, future research needs to find a better balance between algorithmic innovation, hardware optimization, and cost-effectiveness. In summary, the future of light field imaging technology is promising, and it will continue to serve as an important tool in fields such as biomedical imaging, materials science, and industrial inspection. Through interdisciplinary collaboration and innovative thinking, we believe that more efficient and accurate imaging technologies can be realized, opening up new horizons for scientific research and practical applications.

     

/

返回文章
返回