大视场通用相机的帧插高速成像方法

Frame interpolation high-speed imaging method for wide-field general-purpose cameras

  • 摘要: 高速摄影在运动物体测试中至关重要,然而,基于电荷耦合器件或互补金属氧化物半导体的传统成像方法在成像速度和光子灵敏度方面存在局限性。高速相机存在设备成本高昂、大视场复杂环境中成像困难、时-空间分辨率的平衡等问题。作为一种补充方案来应对高速成像的需求,提出了一种基于大视场通用相机的帧插高速成像方法(Frame Interpolation High-Speed Imaging Method,FIHSIM),用于提升通用相机的高速成像能力。该方法首先对传统通用相机捕捉的模糊图像进行预处理来消除复杂背景。其次,通过对每张模糊图像的不同时间域的灰度值中恢复出图像的时间信息来重建动态图像,此方法虽未提高相机本身成像速度,但通过插值提升了图像质量,达到高速摄影的成像效果。此外,该方法的性能在强运动或极端光照条件下可能会受到限制。为验证方法可行性,运动目标在FIHSIM与高速相机进行对比实验,通过细致测量及分析图像中物体的位移及其误差,实验结果表明,FIHSIM结合通用相机可以实现高速摄影。基于通用相机的帧插高速成像方法的高速瞬态成像速度能实现从一到一百万帧的速率动态范围,同时保持通用相机相应的空间分辨率。因此,FIHSIM具有高空间分辨率、能够记录大量虚拟帧图片观察动态事件的能力,为高速成像提供了一种有效工具。

     

    Abstract:
    Objective High-speed imaging is critical for testing moving objects. However, traditional imaging methods based on charge-coupled devices or complementary metal-oxide-semiconductor devices have limitations in imaging speed and photon sensitivity. High-speed cameras face challenges such as high equipment costs, imaging difficulties in complex environments with large fields of view, and the need to balance temporal and spatial resolution. This paper proposes a Frame Interpolation High-Speed Imaging Method (FIHSIM) based on wide-field general-purpose cameras to address the abovementioned constraints. This method serves as a complementary solution to meet the needs of high-speed imaging.
    Methods A virtual frame interpolation super-resolution algorithm for general camera image acquisition was proposed for FIHSIM (Fig.1). This method first preprocesses the blurred images captured by conventional general-purpose cameras to eliminate complex backgrounds. Subsequently, normalization, inverse normalization, threshold processing, and deconvolution operations are applied to map the grayscale values from the blurred images to the time domain, separating grayscale values and time information to extract precise temporal information. Finally, with the exposure time and subsampling time as input parameters, they are fed into the frame interpolation reconstruction algorithm to reconstruct the transient scene changes of dynamic targets during exposure.
    Results and Discussions To validate the feasibility of the method, a comparative experiment was conducted between FIHSIM and a high-speed camera. Detailed measurements and analysis of the object's displacement and associated errors in the images indicate minimal discrepancies (Tab.1). The experimental results demonstrate that the method can accurately reconstruct the position of the object's motion front (Fig.4). In the experiment, we utilized a standard CMOS camera with a frame rate of 100 Hz and achieved an imaging speed of 12800 Hz using FIHSIM, representing a 128-fold increase. Two key camera factors constraining the ability to increase frame rates are exposure time and bit depth. The frame interpolation high-speed imaging method proposed maintains a high frame rate during continuous recording, enabling virtual frames to span multiple exposure periods. This method is suitable for scenarios requiring continuous recording of dynamic events. However, specific techniques can increase frame rates in application scenarios where continuous recording is unnecessary. The enhancement factor β, representing the multiplier for increasing the virtual frame rate, is defined by the characteristics of the camera sensor. However, in theory, it can be improved by reducing the exposure time τ to raise the maximum frame rate FMAX, thereby enhancing the camera's ability to freeze motion.
    Conclusions FIHSIM can accurately recover the precise positions of objects at different time points during exposure from the motion-blurred areas in the images, thereby significantly enhancing the temporal resolution of the images. This technology effectively overcomes the limitations of traditional CMOS cameras in high-speed imaging. Furthermore, by precisely measuring the displacement of dynamic target objects, we experimentally validated the outstanding performance of FIHSIM in high-speed imaging. This method utilizes widely available portable general-purpose cameras as imaging and detection platforms, simplifying the implementation of the imaging process. Additionally, FIHSIM exhibits excellent scalability, allowing for selecting cameras with different fields of view and spatial resolutions and pulse light sources with varying pulse widths based on experimental requirements to capture vast fields of view and objects moving at different speeds.

     

/

返回文章
返回