Frequency-domain diagonal extension imaging

Shan Jiang; Meiling Guan; Jiamin Wu; Guocheng Fang; Xinzhu Xu; Dayong Jin; Zhen Liu; Kebin Shi; Fan Bai; Shu Wang; Peng Xi

doi:10.1117/1.AP.2.3.036005

Translator Disclaimer

2 June 2020 Frequency-domain diagonal extension imaging

Shan Jiang, Meiling Guan, Jiamin Wu, Guocheng Fang, Xinzhu Xu, Dayong Jin, Zhen Liu, Kebin Shi, Fan Bai, Shu Wang, Peng Xi

Author Affiliations +

Advanced Photonics, 2(3), 036005 (2020). https://doi.org/10.1117/1.AP.2.3.036005

Abstract

The pixel size of a charge-coupled device (CCD) camera plays a major role in the image resolution, and the square pixels are attributed to the physical anisotropy of the sampling frequency. We synthesize the high sampling frequency directions from multiple frames acquired with different angles to enhance the resolution by 1.4 × over conventional CCD orthogonal sampling. To directly demonstrate the improvement of frequency-domain diagonal extension (FDDE) microscopy, lens-free microscopy is used, as its resolution is dominantly determined by the pixel size. We demonstrate the resolution enhancement with a mouse skin histological specimen and a clinical blood smear sample. Further, FDDE is extended to lens-based photography with an ISO 12233 resolution target. This method paves a new way for enhancing the image resolution for a variety of imaging techniques in which the resolution is primarily limited by the sampling pixel size, for example, microscopy, photography, and spectroscopy.

1. Introduction

The charge-coupled device (CCD) has revolutionized imaging in the digital era.¹ In microscopy and photography, a lens is typically employed to translate the object of an image to be captured by the CCD or the CMOS sensor. Hence, the size of the CCD pixel has become both a bottleneck and a benchmark parameter for the resolution of digital imaging. The modulated transfer function is an efficient way to evaluate the performance of microscopy or photography as the contrast is plotted in the frequency domain. An interesting approach for super-resolution is that, in structured illumination microscopy (SIM),²^–⁵ the structured pattern is employed to expand the frequency domain, which can improve the spatial resolution by $\sim 2 \times$ .⁶^–⁸ Similarly, in Fourier ptychography microscopy, the sample is illuminated with multiple angles for a synthetic aperture, which is an effective expansion in the frequency domain for an improvement in spatial resolution.⁹^,¹⁰

Lens-free microscopy (LFM) is a novel imaging technique that breaks the space–bandwidth product of conventional lens-based microscopic techniques by avoiding the application of the lens; instead its resolution is directly coupled with the pixel size.¹¹^–¹³ LFM has several distinct advantages, such as single-shot 3D imaging, cost-effectiveness, compactness, and no space–bandwidth product limitation.¹⁴ Applications based on LFM have been realized, such as field-portable microscope,¹⁵ point-of-care testing,¹⁶ telemedicine,¹⁷^,¹⁸ and air quality monitoring.¹⁹ However, the spatial resolution of LFM is still a major bottleneck that prohibits its wide application as it is limited by the pixel size of the 2D detector.¹² On the one hand, several variations of LFM have been demonstrated to overcome the resolution barrier imposed by the pixel size, such as lateral shift-based pixel super-resolution,²⁰ multiangle illumination,²¹^,²² multiheight,²³ wavelength scanning,²⁴ fiber-optic taper,²⁵ and synthetic aperture,²⁶ as well as multiangle illumination achieved with a tunable wavelength semiconductor laser source and a volume phase grating.²⁷ On the other hand, no lateral resolution substantially higher than the size of a pixel with a single imaging exposure has been reported.

In this paper, we utilize the anisotropic resolution of a 2D detector to present a method that can enhance the spatial resolution by $1.4 \times$ . Previously, it is widely accepted that the pixel size is the smallest unit for digital imaging. Here, by exploiting the nonsymmetry of the frequency domain, we propose frequency-domain diagonal extension (FDDE) microscopy in which the resolution can be improved to a $0.7 \times$ pixel size, even in one snapshot, through sampling in the diagonal direction. The principle is straightforward: the diagonal direction samples more densely, thus containing more frequency information. Translating the spatial image to the frequency domain through Fourier transform also clearly reveals this fact.

We first demonstrate the principle of FDDE with LFM,¹²^,¹⁵^,²⁸ as in LFM the resolution is mainly limited by the pixel size. Then, through a combination of multiple frequency components from different angles, a super-resolution image with isotropic resolution can be achieved, similar to the frequency-domain image processing procedure of SIM.⁴^,⁸ The resolution enhancement of FDDE is demonstrated experimentally with a mouse skin specimen and a clinical blood smear sample. We extended FDDE to conventional photography using an ISO 12233 resolution target.

2. Theory

The principle of FDDE microscopy is very straightforward (Fig. 1), that is, the high-frequency component in the diagonal direction is utilized to enhance the resolution. In FDDE microscopy, the image is typically recorded with a 2D sensor with grid-like pixels. The optical transfer function (OTF) of the imaging system and the frequency domain of digital imaging are represented as follows:

Eq. (1)

{\begin{cases} \sqrt{(f_{x}^{2} + f_{y}^{2})} \leq r_{OTF} = \frac{2 NA}{λ}, & OTF (diffraction) \\ | f_{x} | \leq \frac{M}{2 Δ}, | f_{y} | \leq \frac{M}{2 Δ}, & digital imaging (pixel size) \end{cases},

where

f_{x}

and

f_{y}

are the coordinates in the frequency domain,

r_{OTF}

is the boundary of OTF, NA denotes the numerical aperture of the optical system,

λ

is the wavelength,

M

is the magnification of the imaging system, and

Δ

is the pixel size of the detector. As shown in Fig. 1(b), the boundary of the diffraction-limited OTF and the frequency domain of digital imaging is circular and rectangular, respectively. In the case of the undersampling condition, the frequency domain of digital imaging is smaller than the theoretical OTF, due to the nature of the pixel arrangement in Fig. 1(a). As shown in Fig. 1(b), the diagonal boundary of digital imaging,

\sqrt{(f_{x}^{2} + f_{y}^{2})} \leq r_{diagonal} = \frac{\sqrt{2} M}{2 Δ}

, is 1.4 times as large as the horizontal/vertical direction in Eq. (1). A larger diagonal boundary means a bigger bandwidth, and this can be employed to collect higher frequency components for better resolution. This is because the sampling frequency in diagonal direction is actually much higher—the distance is only 0.7 pixels [Fig. 1(a)] in the diagonal direction.²⁹

Fig. 1

An illustration of the FDDE microscopy. (a) Illustration of the sampling interval of an image sensor with a rectangular pixel in the horizontal and diagonal directions. (b) The frequency domain of an image sensor and the OTF of an imaging system in undersampled digital imaging. The green-dash rectangle is the frequency domain of the microscopic image. The yellow-dot circle is the OTF of an imaging system. The green-line rectangle is the frequency domain of undersampled digital imaging. D and H denote the diagonal and horizontal directions, respectively. The spatial domain image of (b) is shown in the upper-right corner. (c) The optical setup of FDDE LFM. (d) Illustration of the frequency stitching algorithm of FDDE.

To elucidate the anisotropic frequency domain of undersampling digital imaging, LFM is employed as its resolution is exclusively dominated by the pixel size. As presented in Fig. 1(c), the LFM system consists of a light source, a sample stage, and an image sensor. In this work, the sample stage is mounted on a rotation stage. The raw images are obtained with different angles between the sample and the image sensor. In the case of holographic inline LFM, the theoretical resolution and the OTF are mainly determined by the wavelength and the coherence of the illumination light and the distance between the sample and the image sensor, and the technique has an isotropic OTF, which also has a circular boundary. Because the pixel size ( $2.2 μ m$ ) is much larger than the theoretical resolution ( $\sim 1 μ m$ ) in LFM, the raw image is a considerably undersampled image (the resolution is limited by pixel size). For a pixel size of $Δ$ , the frequency limit is equal to $1 / (2 \times Δ)$ in the frequency domain, and the OTF is constrained by a smaller rectangle window, as presented in Fig. 1(b). Therefore, the resulting frequency domain has a rectangular shape. In the frequency domain, the maximum frequency limit along the diagonal direction is $\sim 1.4$ -fold that along the horizontal/vertical directions. This implies that the spatial resolution should be higher in the diagonal direction than in the horizontal and vertical directions.

We propose a straightforward method to achieve extended resolution isotropically [Fig. 1(d)]. As higher frequency is attributed to higher resolution in the Fourier domain, it can be utilized to extend the resolution. First, we obtain a series of images at different detection directions. The images are rotated to the same orientation and registered with each other.³⁰ Because of the rotation of the grid 2D detector, the corresponding four corners will contain higher frequencies than the four borders. Then, the high-frequency information in different directions is extracted from the frequency domain of the images. Finally, the high-frequency information is stitched together and then converted back into the spatial domain to obtain a super-resolved image.

The frequency domain $F_{FDDE}$ of FDDE generated with raw images of $n$ frames is expressed as follows:

Eq. (2)

F_{FDDE} (θ) = {F_{i} (θ) | i = \underset{i = 1 : n}{\arg \max} (| F_{i} (θ) |)}, θ \in [0,2 π),

where

F_{i}

denotes the Fourier domain of the

i

’th raw image and

θ

is the azimuth angle with respect to the

X

axis in the Fourier domain. Because of the limitation of the matrix size, the out-of-range frequency domain components are close to 0. However, the rotated frequency domain can introduce additional information into the frequency domain; one can simply update the frequency-domain region with the larger components. Then, by combining the extended components in the frequency domain, the resulting image contains a homogeneously super-resolution with a 1.4-fold improvement over the conventional imaging.

To realize the FDDE algorithm, a blank matrix of the FDDE Fourier domain is created, then each pixel of this matrix is filled with the amplitude and the phase value at the same location from the frequency domain of the raw images. Because the raw images are acquired in different directions, the boundary of the frequency domain of each raw image is different in each direction. Thus, the matrix is filled with the complex value from the biggest boundary of the frequency domain of the raw images, as depicted in Eq. (2). Each pixel in the frequency domain has an angle with respect to the center point. By knowing the angle of each raw image in the experiment, we have the region of the angle for the largest boundary of the frequency domain, given as the red-line marked area in Fig. 1(b). Then we know which raw image should be chosen for each pixel in the frequency domain of FDDE. In this way, we fill every pixel in the frequency domain of FDDE. As a result, the frequency domain in the corresponding angle region from each of the raw images is selected, and then, they are stitched together, as depicted in Fig. 1(d). Then, FDDE is obtained with inverted fast Fourier transformation on the stitched frequency domain.

3. Results

To illustrate the anisotropic resolution of the conventional LFM, a resolution target is imaged. In Fig. 2, the resolution-measuring results with two different orientations of the image sensor are presented. The experiments are carried out with a CMOS chip, which has a pixel size of $2.2 μ m$ . In Fig. 2(a), the resolution target is placed horizontally with respect to the pixel array of the CMOS chip. To elucidate the anisotropic resolution in the diagonal direction, in Fig. 2(b), the resolution board is placed 45 deg with respect to the pixel array of the CMOS chip. Figures 2(a) and 2(b) were reconstructed with the angular spectrum method in Ref. 31 and interpolated with a Fourier zero-padding algorithm by four times. In Figs. 2(a) and 2(b), the lines of group 8, element 1 can be resolved in both images. Moreover, element 3 of group 8 can be resolved in Fig. 2(b), but they are irresolvable in Fig. 2(a). Therefore, the half-pitch resolutions for Figs. 2(e) and 2(f) are 1.94 and $1.55 μ m$ , respectively. The resolution enhancement in the diagonal direction is $\sim 1.3 \times$ . Comparing the Fourier domain of the results, the larger boundary in the diagonal direction in Fig. 2(d) is beneficial to enhancing the resolution in Fig. 2(b). To further illustrate that the enhanced resolution results from the higher frequency components located in the diagonal direction of the Fourier domain, we applied the boundary of the effective Fourier domain of Fig. 2(c) as a rectangular filter on the frequency domain of the 45 deg reconstructed image in Fig. 2(d). After the application of the filter, the lines of $1.55 μ m$ are no longer resolvable as the red dotted line in Fig. 2(f), and the red dotted line profile looks the same as that in Fig. 2(e). Note that the image quality could be further enhanced by utilizing a twin-image eliminating algorithm.³²^,³³

Fig. 2

LFM imaging with different directions of the image sensor. (a) and (b) The reconstructed hologram images of LFM in the horizontal and diagonal directions, respectively. (c) and (d) The frequency domain of the reconstructed images in (a) and (b), respectively. The dotted rectangle marked in (d) represents the effective frequency boundaries in (c). (e) and (f) The line profiles (element 3 of group 8) marked in (a) and (b), respectively. The red dotted line profile in (f) is the same location in the image that filtered the high frequency out of the yellow rectangle, as illustrated by the inset in (d). The yellow arrows indicate the direction of the sample.

Then, we test the performance of FDDE LFM with a hematoxylin-eosin (H&E) stained mouse skin sample, as presented in Fig. 3. Biological samples often contain rich structures, and high frequencies are located in different directions. For example, the stratum corneum on the surface of the skin forms layered structures that can be much smaller than the pixel size of the image sensor ( $2.2 μ m$ ), and the distance between the corneum structures could be as small as several micrometers. These kinds of details are not observable with a single holographic image. To extract such fine details, first, three rotational holographic raw images are acquired with directions of 0, $π / 6$ , and $π / 3$ between the sample and the image sensor. Then, the frequency domains of these three images were synthesized through FDDE, as shown in Figs. 3(c4) and 3(d4).

Fig. 3

Demonstration of FDDE imaging with a mouse skin sample. (a) The FDDE LFM image of the mouse skin sample. (b) An enlarged view of the region marked in (a). (c) LFM images. (c1), (c2), and (c3) are the same area as (c4) in the three-phase images with different orientations. The arrows in the upper-right corner correspond to the direction of the sample in the experiment. The three arrows indicate the FDDE image. In addition, (c2) and (c3) and (d2) and (d3) are rotated back to the same direction as in (c1) and (d1), respectively, for a comparison. The line profile in (c4) is marked between the arrows. The inset in (c4) is imaged with a $10 \times$ bright-field microscope, presented as the ground truth. (d) The frequency domains of the three-phase images and the FDDE image. The yellow rectangle is the boundary of the lensfree microscope. The red line area in (d1)–(d3) is combined into (d4) based on the principle of FDDE.

Fig. 4

Analysis of FDDE imaging with a blood smear specimen. (a) The FDDE image with the blood smear specimen. (b) An enlarged view of the region marked in (a). (c1)–(c3) The conventional LFM of different angles, and (c4) is the LFM with FDDE. The thick arrows in the upper-right corner correspond to the direction of the sample in the experiment in (c1)–(c3). The three arrows indicate the combined FDDE image in (c4). (d) The bright-field image of the same area, presented as the ground truth. (e) The line profile from (c1)–(c4) marked in (c4).

Benefiting from the 1:1 magnification of LFM, the field-of-view (FOV) of our FDDE system can reach $\sim 8 {mm}^{2}$ ( $2.8 m m \times 2.8 m m$ ). As shown in Fig. 3(c), there is a small raindrop-like structure (indicated with the arrow) in the stratum corneum, as shown by the bright-field microscopy image presented in the inset of Fig. 3(c4). However, in each image of the three phases, Fig. 3(c), this structure is not resolvable. In Fig. 3(c3), this structure is resolved as a filled line, but it is resolved as a hollow structure in the other two directions [Figs. 3(c1) and 3(c2)]. This raindrop-like structure can only be resolved in the FDDE image.

This result clearly demonstrates the performance of FDDE microscopy with the histological sample. As presented in the line profile, the distance between the stratum corneum structures is $\sim 3.0 μ m$ , which corresponds to $\sim 1.4 \times$ the pixel size of the image sensor. According to the Nyquist–Shannon sampling theorem, to resolve a two-line structure distance of $\sim 3.0 μ m$ , the half-pitch resolution should be at least $1.5 μ m$ . This corresponds to a resolution enhancement of $\sim 1.4 \times$ , which is consistent with the principle of FDDE. Such a small structure is not resolvable based on the conventional principle of LFM.

Then, the FDDE system is tested with a conventional blood smear sample, as shown in Fig. 4. Because the inner diameter of blood cells is $\sim 3$ to $4 μ m$ , it is difficult for conventional LFM with a pixel size of $2.2 μ m$ to resolve the structure of blood cells. As shown in Figs. 4(c1)–4(c3), a few blood cells can be resolved as a ring structure, and most of the blood cells are observed as dark spots due to insufficient resolution. Some of the blood cells are resolved as a rectangular shape in the conventional single-frame lens-free image, which may be attributed to the rectangular shape of the Fourier domain of LFM. In the FDDE image in Fig. 4(c4), the shape of the red blood cell becomes more circular. Additionally, more blood cells can be resolved as ring structures in the FDDE image. The marked cell is completely irresolvable in any conventional LFM image, and it is observed as a ring structure with FDDE microscopy, which is similar to that in the bright-field image. As presented in Fig. 4(e), the inner diameter of the marked blood cell is $3.3 μ m$ , and this result proves that the half-pitch resolution is $\sim 1.6 μ m$ , which is a resolution enhancement of $\sim 1.4 \times$ . Also, the quality of the blood smear image with FDDE is much better than that of conventional LFM due to a homogeneous high resolution.

Moreover, the principle of FDDE could be extended to lens-based systems, such as photography. In the experiment, an ISO 12233 resolution target is imaged with a camera lens (SV-10035V, VS Technology) coupled with a sCMOS camera (Andor Zyla 4.2). Figures 5(a) and 5(b) present the raw images interpolated four times with a Fourier zero-padding method and with the intensity of the images inverted. The line profiles marked in Figs. 5(a) and 5(b) are presented in Figs. 5(c) and 5(d). In the case of line 1 and 1′, both images can resolve the period of 8 pixels. When the line profile gets closer to the center of the target, the period of lines should decrease. The period is decreased to 6 pixels, as shown in line 2′. However, the distance between dips in line 2 is read as 9 pixels, which is even larger than line 1. This artifact is caused by the lack of a high-frequency component in the Fourier domain. Hence, the resolution in the horizontal and the diagonal direction is 8 and 6 pixels, respectively, which corresponds to 2 and 1.5 pixels in the raw images, respectively. These results are approximately the theoretical limit in the horizontal and diagonal directions with a pixel size determined resolution. The result reflects $\sim 1.3 \times$ higher resolution for the diagonal direction than that of the horizontal direction, which is consistent with the principle of FDDE (see also Supplemental Fig. S3). Therefore, FDDE can be applied to enhance the resolution of lens-based photography as well, when the resolution is limited by the pixel size.

Fig. 5

Lens-based photography with different orientations of ISO 12233 resolution target. (a) and (b) The interpolated images captured with conventional lens and sCMOS chip. (c) and (d) The line profiles marked in (a) and (b), respectively.

4. Conclusion

Compared with other super-resolution schemes,²⁷^,²⁸ this proposed method is more convenient. For example, in subpixel super-resolution schemes, a nanometer-precision motorized translation stage or a tunable laser source is required, which can substantially increase the cost and complexity of the imaging system. In the FDDE method, the accuracy of the rotating angle is not strictly required, and this operation can be easily satisfied with a manual or a motorized rotation stage. This method does not require a computationally laborious subpixel super-resolution algorithm, which is highly sensitive to noise. Another merit is that the resolution enhancement can be further improved by a smaller pixel size. In this case, an upcoming consumer-level CMOS chip with a smaller pixel size and low cost will further enhance the performance and applications of the FDDE in a straightforward manner. For instance, FDDE LFM could reach an isotropic resolution of $0.56 μ m$ by utilizing a CMOS chip with a pixel size of $0.8 μ m$ (IMX586, SONY, cost approximately twenty U.S. dollars). At the same time, the overall cost, complexity of the FDDE system and the algorithm, portability, and robustness are far better than those of conventional optical microscopy. By contrast, in the subpixel sampling super-resolution scheme with a motorized $x - y$ translational stage, the stage should have subpixel accuracy, which brings significant additional cost. Therefore, the FDDE method is conducive to achieving an ultra-compact and low-cost red blood cell examination instrument, which is especially important for rural and underdeveloped areas. In conventional microscopy or imaging, this method can still work if the pixel size of the detector is larger than Nyquist–Shannon sampling of the optical resolution or $> λ / 4 NA$ . FDDE is particularly useful for scenarios in which the pixel size restricts the system resolution. For example, the widely used electron multiplying CCD (EMCCD) features a pixel size of $\sim 16 μ m$ for better sensitivity, much larger than that of a conventional CCD or sCMOS detector. With a large pixel size, either the resolution or the FOV is compromised. Here, with FDDE, one can maintain the sensitivity but gain a resolution enhancement of $1.4 \times$ . This is particularly useful when the resolution is limited by the pixel size, such as LFM, EMCCD-based imaging, and spectroscopy.

In summary, we proposed a novel rotational approach to achieving a higher resolution for digital imaging. The enhanced resolution results from the higher-resolution component located in the diagonal directions, which is straightforward but has not been demonstrated before, to the best of our knowledge. The resolution enhancement is attained by exploiting the higher frequency of the diffraction pattern located in the diagonal direction, in which the frequency border is effectively extended diagonally. We demonstrate FDDE first with LFM and then extend it to lens-based photography. By combining the frequency domains from the images acquired with different angles, the resulting FDDE image has an isotropic resolution enhancement of $\sim 1.4 \times$ . The half-pitch resolution reaches $\sim 1.5 μ m$ when imaging a mouse skin sample and a blood smear sample using a CMOS detector with a pixel size of $2.2 μ m$ . Then, we extended this approach to lens-based photography, yielding the same resolution enhancement. Here, the FDDE image only uses three raw images with different recording directions, but more images with different directions could be acquired for better image quality. This method can also be applied to a wide range of imaging or detection areas in which the limiting factor is the pixel size of the detector due to undersampling, such as microscopy, telescope imaging, and spectroscopy.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (NSFC) (Grant Nos. 31971376, 61705252, 61729501, 91750203, and 51720105015), the Beijing Natural Science Foundation (Grant No. JQ18019), the Natural Science Foundation of Jiangsu Province (Grant No. BK20170388), Australia-China Joint Research Centre for Point-of-Care Testing (Grant Nos. ACSRF65827, SQ2017YFGH001190), and Science and Technology Innovation Commission of Shenzhen (Grant No. KQTD20170810110913065). The authors declare that there are no conflicts of interest regarding the publication of this article.

References

1.

Y. Hiraoka, J. W. Sedat and D. A. Agard, “The use of a charge-coupled device for quantitative optical microscopy of biological structures,” Science, 238 36 –41 (1987). https://doi.org/10.1126/science.3116667 SCIEAS 0036-8075 Google Scholar

2.

D. Li et al., “Extended-resolution structured illumination imaging of endocytic and cytoskeletal dynamics,” Science, 349 (6251), aab3500 (2015). https://doi.org/10.1126/science.aab3500 SCIEAS 0036-8075 Google Scholar

3.

X. Huang et al., “Fast, long-term, super-resolution imaging with Hessian structured illumination microscopy,” Nat. Biotechnol., 36 451 –459 (2018). https://doi.org/10.1038/nbt.4115 NABIF9 1087-0156 Google Scholar

4.

A. Lal et al., “A frequency domain sim reconstruction algorithm using reduced number of images,” IEEE Trans. Image Process., 27 4555 –4570 (2018). https://doi.org/10.1109/TIP.2018.2842149 IIPRE4 1057-7149 Google Scholar

5.

K. Zhanghao et al., “Super-resolution imaging of fluorescent dipoles via polarized structured illumination microscopy,” Nat. Commun., 10 4694 (2019). https://doi.org/10.1038/s41467-019-12681-w NCAOBW 2041-1723 Google Scholar

6.

D. Dan et al., “DMD-based LED-illumination super-resolution and optical sectioning microscopy,” Sci. Rep., 3 1116 (2013). https://doi.org/10.1038/srep01116 SRCEC3 2045-2322 Google Scholar

7.

M. Müller et al., “Open-source image reconstruction of super-resolution structured illumination microscopy data in ImageJ,” Nat. Commun., 7 10980 (2016). https://doi.org/10.1038/ncomms10980 NCAOBW 2041-1723 Google Scholar

8.

A. Lal, C. Shan and P. Xi, “Structured illumination microscopy image reconstruction algorithm,” IEEE J. Sel. Top. Quantum Electron., 22 50 –63 (2016). https://doi.org/10.1109/JSTQE.2016.2521542 IJSQEN 1077-260X Google Scholar

9.

G. Zheng, R. Horstmeyer and C. Yang, “Wide-field, high-resolution Fourier ptychographic microscopy,” Nat. Photonics, 7 739 –745 (2013). https://doi.org/10.1038/nphoton.2013.187 NPAHBY 1749-4885 Google Scholar

10.

L.-H. Yeh et al., “Experimental robustness of Fourier ptychography phase retrieval algorithms,” Opt. Express, 23 (26), 33214 –33240 (2015). https://doi.org/10.1364/OE.23.033214 OPEXFF 1094-4087 Google Scholar

11.

X. Cui et al., “Lensless high-resolution on-chip optofluidic microscopes for Caenorhabditis elegans and cell imaging,” Proc. Natl. Acad. Sci. U.S.A., 105 (31), 10670 –10675 (2008). https://doi.org/10.1073/pnas.0804612105 PNASA6 0027-8424 Google Scholar

12.

G. Stybayeva et al., “Lensfree holographic imaging of antibody microarrays for high-throughput detection of leukocyte numbers and function,” Anal. Chem., 82 3736 –3744 (2010). https://doi.org/10.1021/ac100142a ANCHAM 0003-2700 Google Scholar

13.

Z. Zhang et al., “Mask-modulated lensless imaging with multi-angle illuminations,” APL Photonics, 3 060803 (2018). https://doi.org/10.1063/1.5026226 Google Scholar

14.

Y. Wu and A. Ozcan, “Lensless digital holographic microscopy and its applications in biomedicine and environmental monitoring,” Methods, 136 4 –16 (2018). https://doi.org/10.1016/j.ymeth.2017.08.013 MTHDE9 1046-2023 Google Scholar

15.

M. Lee, O. Yaglidere and A. Ozcan, “Field-portable reflection and transmission microscopy based on lensless holography,” Biomed. Opt. Express, 2 2721 –2730 (2011). https://doi.org/10.1364/BOE.2.002721 BOEICL 2156-7085 Google Scholar

16.

W. Bishara et al., “Holographic pixel super-resolution in portable lensless on-chip microscopy using a fiber-optic array,” Lab Chip, 11 (7), 1276 –1279 (2011). https://doi.org/10.1039/c0lc00684j LCAHAM 1473-0197 Google Scholar

17.

O. Mudanyali et al., “Compact, light-weight and cost-effective microscope based on lensless incoherent holography for telemedicine applications,” Lab Chip, 10 (11), 1417 –1428 (2010). https://doi.org/10.1039/c000453g LCAHAM 1473-0197 Google Scholar

18.

G. Biener et al., “Combined reflection and transmission microscope for telemedicine applications in field settings,” Lab Chip, 11 (16), 2738 –2743 (2011). https://doi.org/10.1039/c1lc20169g LCAHAM 1473-0197 Google Scholar

19.

Y.-C. Wu et al., “Air quality monitoring using mobile microscopy and machine learning,” Light Sci. Appl., 6 (9), e17046 (2017). https://doi.org/10.1038/lsa.2017.46 Google Scholar

20.

W. Bishara et al., “Lensfree on-chip microscopy over a wide field-of-view using pixel super-resolution,” Opt. Express, 18 (11), 11181 –11191 (2010). https://doi.org/10.1364/OE.18.011181 OPEXFF 1094-4087 Google Scholar

21.

G. Zheng et al., “The epetri dish, an on-chip cell imaging platform based on subpixel perspective sweeping microscopy (SPSM),” Proc. Natl. Acad. Sci. U.S.A., 108 (41), 16889 –16894 (2011). https://doi.org/10.1073/pnas.1110681108 PNASA6 0027-8424 Google Scholar

22.

S. O. Isikman, W. Bishara and A. Ozcan, “Lensfree on-chip tomographic microscopy employing multi-angle illumination and pixel super-resolution,” J. Visualized Exp., (66), e4161 (2012). https://doi.org/10.3791/4161 Google Scholar

23.

A. Greenbaum and A. Ozcan, “Maskless imaging of dense samples using pixel super-resolution based multi-height lensfree on-chip microscopy,” Opt. Express, 20 (3), 3129 –3143 (2012). https://doi.org/10.1364/OE.20.003129 OPEXFF 1094-4087 Google Scholar

24.

W. Luo et al., “Pixel super-resolution using wavelength scanning,” Light Sci. Appl., 5 (4), e16060 (2016). https://doi.org/10.1038/lsa.2016.60 Google Scholar

25.

A. F. Coskun et al., “Wide-field lensless fluorescent microscopy using a tapered fiber-optic faceplate on a chip,” Analyst, 136 (17), 3512 –3518 (2011). https://doi.org/10.1039/c0an00926a ANLYAG 0365-4885 Google Scholar

26.

W. Luo et al., “Synthetic aperture-based on-chip microscopy,” Light Sci. Appl., 4 (3), e261 (2015). https://doi.org/10.1038/lsa.2015.34 Google Scholar

27.

M. Rostykus, M. Rossi and C. Moser, “Compact lensless subpixel resolution large field of view microscope,” Opt. Lett., 43 (8), 1654 –1657 (2018). https://doi.org/10.1364/OL.43.001654 OPLEDP 0146-9592 Google Scholar

28.

E. McLeod and A. Ozcan, “Unconventional methods of imaging: computational microscopy and compact implementations,” Rep. Prog. Phys., 79 076001 (2016). https://doi.org/10.1088/0034-4885/79/7/076001 RPPHAG 0034-4885 Google Scholar

29.

J. Pawley, Handbook of Biological Confocal Microscopy, Springer, Boston, Massachusetts (2010). Google Scholar

30.

M. Guizar-Sicairos, S. T. Thurman and J. R. Fienup, “Efficient subpixel image registration algorithms,” Opt. Lett., 33 156 –158 (2008). https://doi.org/10.1364/OL.33.000156 OPLEDP 0146-9592 Google Scholar

31.

T. Latychevskaia and H.-W. Fink, “Practical algorithms for simulation and reconstruction of digital in-line holograms,” Appl. Opt., 54 2424 –2434 (2015). https://doi.org/10.1364/AO.54.002424 APOPAI 0003-6935 Google Scholar

32.

T. Latychevskaia and H.-W. Fink, “Solution to the twin image problem in holography,” Phys. Rev. Lett., 98 (23), 233901 (2007). https://doi.org/10.1103/PhysRevLett.98.233901 PRLTAO 0031-9007 Google Scholar

33.

W. Zhang et al., “Twin-image-free holography: a compressive sensing approach,” Phys. Rev. Lett., 121 (9), 093902 (2018). https://doi.org/10.1103/PhysRevLett.121.093902 PRLTAO 0031-9007 Google Scholar

Biography

Shan Jiang received his BS degree in electronic science and technology from Heilongjiang University in 2008 and his MS degree and PhD in physical electronics from Harbin Institute of Technology in 2010 and 2015, respectively. He is currently a postdoctoral researcher at Peking University. His current research interests include super-resolution microscopy and holography.

Meiling Guan received her BS degree in biomedical engineering from Beijing University of Technology, Beijing, China, in 2018. She is pursuing her PhD in biomedical engineering at Peking University, Beijing, China. Her current interests include image restoration and reconstruction algorithms for image scanning and super-resolution microscopy, phase retrieval and compressed sensing reconstruction of lens-free inline holography, and super-resolution dipole orientation mapping via polarization demodulation.

Jiamin Wu received his BS degree and PhD from the Department of Automation, Tsinghua University, Beijing, China, in 2014 and 2019, respectively. He is currently a postdoctoral fellow within the Institute for Brain and Cognitive Sciences at Tsinghua University. His current research interests include computational microscopy and optical computing, with a particular emphasis on developing computation-based optical setups for observing large-scale biological dynamics in vivo.

Guocheng Fang received his BS and MS degrees in electric science engineering from North University of China, in 2014 and 2017, respectively. He is now pursuing his PhD in biomicrofluidic engineering at University of Technology Sydney. His current research interests include microfluidic-based 3D models culture, organ-on-chip, optofluidic imaging, and optical fiber sensing technology.

Xinzhu Xu received his BS degree in optoelectronic information science and engineering from Northwestern Polytechnical University in 2018, and is now a PhD candidate in biomedical engineering at Peking University, College of Engineering. He is currently interested in the field of image-scanning microscopy, stimulated emission depletion microscopy, minimal photon flux microscopy, and the related optical modulation technology in super-resolution microscopy, which can be utilized in biological research as well as other interdisciplinary studies.

Dayong Jin is a distinguished professor at the University of Technology Sydney since 2017 and a chair professor at Southern University of Science and Technology since 2019. He obtained his PhD from Macquarie University in 2007. His research has been in the physical, engineering, and interdisciplinary sciences. He is a technology developer with expertise covering optics, luminescent materials, sensing, automation devices, microscopy imaging, and analytical chemistry to enable rapid detection of cells and molecules and engineering of sensors and photonics devices.

Zhen Liu received his BS degree in physics and MSc degree in optics in 2010 and 2013, respectively. After years of industrial experience in signal processing and telecommunication, he is now pursuing his PhD in University of Southampton. His research interesting is focusing on nonlinear optics-based biosensing and related signal processing.

Kebin Shi works in the field of optical imaging and spectroscopy for bio-photonics and precision metrology. His recent research interests include super-resolution imaging, nonlinear holography, and femto-second frequency comb metrology. His research publication includes over 80 technical papers and 6 patents.

Fan Bai received BSc degree in physics from Peking University in 2003 and DPhil in biophysics from University of Oxford in 2008. After three years postdoctoral training at University of Oxford and Osaka University, he returned to China in 2011 to lead his own research team. The Bai Lab studies frontiers of biomedical research by combining cutting-edge single-molecule fluorescence imaging and single-cell sequencing, aiming at (1) study circulating tumor cells to gain deeper insights into the molecular mechanism of cancer metastasis and explore its clinical value for non-invasive cancer diagnosis, prognosis, and therapy evaluation; (2) study the genomic features of Chinese cancers; and (3) study bacterial motility, virulence, and mechanisms of antibiotic and bacterial drug resistance and tolerance.

Shu Wang is a professor and a surgeon in Peking University People’s Hospital, China. One of her interests is in translational cancer research on molecular and image diagnosis. She has done a series study on fluorescence-guided sentinel lymph node biopsy and intraoperative cancer diagnosis by high-resolution optical coherence tomography.

Peng Xi is an associate professor at the College of Engineering, Peking University, China. His research interest is on the development of optical super-resolution microscopy techniques. He has published over 60 scientific journal papers in peer-reviewed journals, including Nature, Nature Methods, etc., and delivered over 30 keynote/invited talks at international conferences hosted by SPIE and OSA. He is a senior member of OSA. He has been awarded the Beijing Distinguished Young Scholar in 2018. He is on the editorial board of five SCI-indexed journals: Light: Science and Applications, Advanced Photonics, Microscopy Research and Techniques, Micron, and Scientific Reports.

© The Authors. Published by SPIE and CLP under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation Download Citation

Shan Jiang, Meiling Guan, Jiamin Wu, Guocheng Fang, Xinzhu Xu, Dayong Jin, Zhen Liu, Kebin Shi, Fan Bai, Shu Wang, and Peng Xi "Frequency-domain diagonal extension imaging," Advanced Photonics 2(3), 036005 (2 June 2020). https://doi.org/10.1117/1.AP.2.3.036005

Received: 30 January 2020; Accepted: 14 May 2020; Published: 2 June 2020

JOURNAL ARTICLE
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

SHARE

GET CITATION

6163银河线路检测中心(中国)有限公司-BinG百科'); mywindow.document.write(''); mywindow.document.write('

' + document.title + '

'); mywindow.document.write('

' + document.getElementById('divARTICLECONTENTTop').innerHTML + '

'); mywindow.document.write(' '); mywindow.document.close(); // necessary for IE >= 10 mywindow.focus(); // necessary for IE >= 10*/ // mywindow.print(); };