In this Letter, we report on high-contrast gradient ghost imaging (GGI) through dynamic and complex scattering media for edge detection. By introducing a reference beam in the designed setup to correct dynamic change of scaling factors induced by dynamic and complex scattering media, the mismatches between illumination patterns and single-pixel intensity measurements can be corrected. Then, edge information of a sample can be obtained through dynamic and complex scattering media with dual single-pixel detections. The proposed scheme can implement direct edge detection without any postprocessing. It is experimentally verified that the proposed method can realize high-contrast GGI of unknown objects through various dynamic and complex scattering media where conventional schemes cannot work. Our experimental results suggest that the proposed method broadens and deepens the GGI, offering a potential for edge detection in diverse applications.
Ghost imaging has become a strong competitor over some imaging methods, which depend on a pixelated sensor array (e.g., charge-coupled device) in some situations. Owing to characteristics of single-pixel detectors (e.g., large bandwidth and high sensitivity), ghost imaging turns out to be one of the advanced imaging methods.1–5 By using structured illumination and synchronous intensity measurements, ghost imaging can retrieve unknown objects in turbulent or harsh environments.6–8 Ghost imaging has been developed in diverse fields9–13 such as time-resolved imaging and three-dimensional imaging.
Recently, research on edge detection with ghost imaging is being conducted. Edge detection is a fundamental step of human vision perception, which detects peripheries of objects.14,15 Nowadays, edge detection has been widely applied in object recognition, medical diagnosis and safety inspection, etc.16–18 For many edge detection schemes, objects should be retrieved before the differential operators (e.g., Sobel, Canny, and Roberts operators).19–21 Hence, traditional techniques are usually developed based on the premise of clear reconstructions of objects, imposing a limitation on broad applications of edge detection in turbulent or complex scattering environments.22,23 To benefit from ghost imaging for seeing through disturbance, edge detection with ghost imaging has been applied. Liu et al.24 reported that edge information of unknown objects can be detected in a gradient domain using ghost imaging. There is an explosion of ghost imaging-based edge detection schemes such as speckle-shifting ghost imaging, subpixel-speckle-shifting ghost imaging, and joint iteration ghost imaging.25–28 In addition, it has been verified that object edges can be detected in the Fourier domain with differential operators.29 Apart from edge detection of amplitude objects, edge information of phase objects can also be extracted by using single-pixel spiral phase contrast imaging.30 Although progress has been made in ghost imaging-based edge detection, its capability is not sufficient to implement effective edge detection of unknown objects through dynamic and complex scattering media. Since dynamic and complex scattering media lead to dynamic change of scaling factors, it could be impossible for conventional ghost imaging-based edge detection methods to maintain a consistency of illumination patterns and single-pixel intensity measurements. This inconsistency leads to a failure of ghost imaging-based edge detection of unknown objects through dynamic and complex scattering media.
Here, we report a scheme to detect edge information of unknown objects through dynamic and complex scattering media using dual single-pixel detectors. By introducing a reference beam in the designed setup to correct dynamic change of scaling factors, the mismatches between illumination patterns and intensity measurements can be corrected. Then, edge information of unknown objects can be directly detected through dynamic and complex scattering media without any prior information of unknown objects. It is experimentally demonstrated that the proposed method can implement high-contrast edge detection of unknown objects through various dynamic and complex scattering media where conventional ghost imaging-based edge detection methods cannot work. In addition, the number of measurements is not needed to be increased in the proposed method owing to the setup design with dual single-pixel detectors, when edge detection through dynamic and complex scattering media is conducted. This scheme paves a way for edge detection based on ghost imaging through dynamic and complex scattering media.
To realize high-contrast edge detection through dynamic and complex scattering media, a schematic experimental setup with dual single-pixel detectors is shown in Fig. 1. A green laser beam (532.0 nm, CrystaLaser CL-2000) with a power of 25.0 mW is expanded and then collimated to illuminate an amplitude-only spatial light modulator (SLM, Holoeye LC-R720, reflective) with a pixel size of 20.0 μm. The illumination patterns and gradient patterns with 128 × 128 pixels are sequentially and alternately embedded into SLM. Then, the laser beam is modulated and reflected by the SLM. To correct dynamic change of scaling factors, the modulated laser beam is divided into two beams (i.e., a reference beam and an object beam) via a beam splitter cube. The object beam illuminates a sample before passing through dynamic and complex scattering media. The reference beam without any interaction with the sample directly passes through dynamic and complex scattering media. The dynamic and complex scattering media are designed by continuously dropping a certain volume of milk into a transparent water tank [dimensions of 10.0 (L) × 30.0 (W) × 30.0 cm3 (H)], which contains 6000 ml pure water. Here, 1000 ml pure water is first placed into a funnel, and then different volumes of full cream milk are directly added into the funnel in each experiment. In addition, a stirrer with a maximum speed of 1200 revolutions per minute (rpm) is applied to generate dynamic and complex scattering media. Then, light intensities of the object and reference beams propagating through dynamic and complex scattering media are collected by single-pixel detectors (Thorlabs, PDA100A2). For synchronous single-pixel intensity measurements, a data acquisition device (Smacq, USB-5210) and a purpose-built Labview program are used to synchronize and control the SLM and single-pixel detectors. Then, dynamic change of scaling factors aroused by dynamic and complex scattering media is corrected. Finally, edge detection of the unknown objects through dynamic and complex scattering media can be effectively and directly implemented with the corrected scaling factors.
A schematic experimental setup for the proposed edge detection through dynamic and complex scattering media with dual single-pixel detectors. SLM, spatial light modulator; D1 and D2, single-pixel bucket detectors; BS, beam splitter cube; O, object.
A schematic experimental setup for the proposed edge detection through dynamic and complex scattering media with dual single-pixel detectors. SLM, spatial light modulator; D1 and D2, single-pixel bucket detectors; BS, beam splitter cube; O, object.
A schematic of the proposed edge detection through dynamic and complex scattering media. Pi, the ith illumination pattern; Pig, the ith gradient pattern; DCSM, dynamic and complex scattering media; Bi and Bir, single-pixel intensity values recorded in object and reference beam paths with the ith illumination pattern Pi, respectively; Big and Bigr, single-pixel intensity values recorded in object and reference beam paths with the ith gradient pattern Pig, respectively; Bic and Bigc, corrected single-pixel intensities correspond to the ith illumination pattern Pi and the ith gradient pattern Pig; ∇O, the retrieved edge.
A schematic of the proposed edge detection through dynamic and complex scattering media. Pi, the ith illumination pattern; Pig, the ith gradient pattern; DCSM, dynamic and complex scattering media; Bi and Bir, single-pixel intensity values recorded in object and reference beam paths with the ith illumination pattern Pi, respectively; Big and Bigr, single-pixel intensity values recorded in object and reference beam paths with the ith gradient pattern Pig, respectively; Bic and Bigc, corrected single-pixel intensities correspond to the ith illumination pattern Pi and the ith gradient pattern Pig; ∇O, the retrieved edge.
Figure 3 shows the retrieved edges of a 3D-printed plastic sample using conventional GGI and the proposed method with the different number of measurements. The dynamic and complex scattering environment is formed by 6-ml full cream milk continuously dropped into water tank and a stirrer at 700 rpm. Without usage of the reference beam, conventional GGI cannot retrieve any effective edge information of unknown object through dynamic and complex scattering media as shown in Figs. 3(a)–3(e) and 3(k)–3(o). Instead, the proposed method can correct scaling factors aroused by dynamic and complex scattering media with dual single-pixel detectors. Then, outline profiles of the object can be effectively revealed as shown in Figs. 3(f)–3(j) and 3(p)–3(t). When the number of intensity measurements by each single-pixel detector increases from 2000 to 20 000 with an interval of 2000, edges of unknown object can be more clearly observed. Hence, it is experimentally verified that corrections of scaling factors play an important role in edge detection of unknown objects through dynamic and complex scattering media.
Edges obtained by conventional GGI (without reference beam) and the proposed method through complex scattering media with the different number of measurements (2000–20 000 with an interval of 2000). (a)–(e) and (k)–(o) The retrieved edges by conventional GGI, and (f)–(j) and (p)–(t) the retrieved edges by the proposed method. Scale bar in (t) for 3D-printed samples: 2 mm.
Edges obtained by conventional GGI (without reference beam) and the proposed method through complex scattering media with the different number of measurements (2000–20 000 with an interval of 2000). (a)–(e) and (k)–(o) The retrieved edges by conventional GGI, and (f)–(j) and (p)–(t) the retrieved edges by the proposed method. Scale bar in (t) for 3D-printed samples: 2 mm.
Influence of the different number of measurements (by each single-pixel detector) on the visibility of edges obtained by using conventional GGI (without reference beam) and the proposed method.
Influence of the different number of measurements (by each single-pixel detector) on the visibility of edges obtained by using conventional GGI (without reference beam) and the proposed method.
We also apply the proposed method for testing other samples, e.g., samples in Fig. 5. In addition, Group –1, Group 0, and Group 1 of USAF 1951 resolution target (Thorlabs, R3L3S1N) have been tested. Without corrections of scaling factors induced by dynamic and complex scattering media, conventional GGI cannot retrieve edge information about the samples as shown in Figs. 5(a)–5(e) and 5(k)–5(o). For the proposed method, outlines of unknown objects can be clearly recognized as shown in Figs. 5(f)–5(j) and 5(p)–5(t). It is also found that edges of the bars in the resolution target can be distinguished as shown in Figs. 5(r)–5(t), and the finest structure that can be identified in the retrieved edges of the resolution target is Element 4 of Group 1 (176.78 μm) in Fig. 5(t). Hence, it is experimentally verified that the proposed method manifests good performance in high-contrast edge detection through various dynamic and complex scattering media where conventional methods cannot work. Owing to dual single-pixel detections used in the proposed method, influence of dynamic changes of scaling factors is eliminated.
Edges of the samples retrieved by conventional GGI and the proposed method through dynamic and complex scattering media. The dynamic and complex scattering media for these samples are, respectively, formed by dropping different volumes of full cream milk (i.e., 6, 5, 6, 4, 3, 4, 6, 6, 5, and 4 ml) into water tank and the stirrer at different speeds (i.e., 800, 700, 800, 700, 600, 600, 800, 600, 800, and 700 rpm). (a)–(e) and (k)–(o) The edges retrieved by conventional GGI, and (f)–(j) and (p)–(t) edges retrieved by the proposed method. Here, the number of measurements in each detector is 20 000.
Edges of the samples retrieved by conventional GGI and the proposed method through dynamic and complex scattering media. The dynamic and complex scattering media for these samples are, respectively, formed by dropping different volumes of full cream milk (i.e., 6, 5, 6, 4, 3, 4, 6, 6, 5, and 4 ml) into water tank and the stirrer at different speeds (i.e., 800, 700, 800, 700, 600, 600, 800, 600, 800, and 700 rpm). (a)–(e) and (k)–(o) The edges retrieved by conventional GGI, and (f)–(j) and (p)–(t) edges retrieved by the proposed method. Here, the number of measurements in each detector is 20 000.
In conclusion, we have reported a scheme for high-contrast edge detection through dynamic and complex scattering media in ghost imaging. By using dual single-pixel detectors, the influence of dynamic scaling factors induced by dynamic and complex scattering media is eliminated. Then, high-contrast edge detection can be implemented by using the proposed method through dynamic and complex scattering media where conventional GGI cannot work. Furthermore, the proposed method allows direct edge detection of unknown objects without any postprocessing. This scheme is expected to pave a way for directly detecting the edges of unknown objects through dynamic and complex scattering media. Our scheme provides a significant step for the GGI and also remains an exciting avenue for the further research. In terms of imaging efficiency, we can refine the method to realize efficient edge detection by optimizing the number of realizations.33 The positions of the sample and scattering media in the optical channel can also be investigated in the future study.
This work was supported by the Hong Kong Research Grants Council (Nos. C5011-19G, 15224921, and 15223522) and the Hong Kong Polytechnic University (Nos. 1-BD4Q, 1-W167, and 1-W19E).
AUTHOR DECLARATIONS
Conflict of Interest
The authors have no conflicts to disclose.
Author Contributions
Lina Zhou: Conceptualization (lead); Investigation (lead); Writing – original draft (lead). Yin Xiao: Investigation (supporting). Wen Chen: Conceptualization (lead); Methodology (lead); Supervision (lead); Writing – review & editing (lead).
DATA AVAILABILITY
The data that support the findings of this study are available from the corresponding author upon reasonable request.