In nature, animals have evolved various shapes of pupils to detect moving targets with diverse postures effectively. Motivated by the concept of the adaptable aperture pupil, we present a pupil-inspired foveated single-pixel imaging approach featuring a variable foveal, enhancing the correlation between the fovea regions and targets in the scene. Furthermore, this pupil-inspired foveated strategy not only regulates the field of view by mimicking the expansion and contraction of the iris but also aids in target tracking by foveal saccade mimicry. In this way, our method improves the maximum utilization of high-resolution areas by 63%. The methodologies outlined in this study optimize the arrangement of pixel cells during the sampling process and promise to be a practical method enabling single-pixel imaging in dynamic scenes.
REFERENCES
1.
L.
Gu
,
S.
Poddar
,
Y.
Lin
,
Z.
Long
,
D.
Zhang
,
Q.
Zhang
,
L.
Shu
,
X. Z.
Qiu
,
M.
Kam
,
A.
Javey
, and
Z.
Fan
, “
A biomimetic eye with a hemispherical perovskite nanowire array retina
,” Nature
581
, 278
–282
(2020
).2.
X.
Meng
,
R.
Du
, and
A.
Varshney
, “
Eye-dominance-guided foveated rendering
,” IEEE Trans. Visualization Comput. Graph.
26
, 1972
–1980
(2020
).3.
F.
Liao
,
Z.
Zhou
,
B.
Kim
,
J.
Chen
,
J.
Wang
,
T.
Wan
,
Y.
Zhou
,
T.
Hoang
,
C.
Wang
,
J.
Kang
,
J.-H.
Ahn
, and
Y.
Chai
, “
Bioinspired in-sensor visual adaptation for accurate perception
,” Nat. Electron.
5
, 84
–91
(2022
).4.
S.
Petsch
,
S.
Schuhladen
,
L.
Dreesen
, and
H.
Zappe
, “
The engineered eyeball, a tunable imaging system using soft-matter micro-optics
,” Light
5
, e16068
(2016
).5.
Z.
Rao
,
Y.
Lu
,
Z.
Li
,
K.
Sim
,
Z. J.
Ma
,
J.
Xiao
, and
C.
Yu
, “
Curvy, shape-adaptive imagers based on printed optoelectronic pixels with a Kirigami design
,” Nat. Electron.
4
, 513
–521
(2021
).6.
D. B.
Phillips
,
M.-J.
Sun
,
J. M.
Taylor
,
M. P.
Edgar
,
S. M.
Barnett
,
G. M.
Gibson
, and
M. J.
Padgett
, “
Adaptive foveated single-pixel imaging with dynamic supersampling
,” Sci. Adv.
3
, e1601782
(2017
).7.
S.
Thiele
,
K.
Arzenbacher
,
T.
Gissibl
,
H.
Giessen
, and
A. M.
Herkommer
, “
3D-printed eagle eye: Compound microlens system for foveated imaging
,” Sci. Adv.
3
, e1602655
(2017
).8.
N.
Hagen
and
T. S.
Tkaczyk
, “
Foveated endoscopic lens
,” J. Biomed. Opt.
17
(2
), 021104
(2012
).9.
F.
Pardo
,
B.
Dierickx
, and
D.
Scheffer
, “
Space-variant nonorthogonal structure CMOS image sensor design
,” IEEE J. Solid-State Circuits
33
, 842
–849
(1998
).10.
E.
Akbas
and
M. P.
Eckstein
, “
Object detection through search with a foveated visual system
,” PLoS Comput. Biol.
13
, e1005743
(2017
).11.
G.
Wang
,
H.
Deng
,
M.
Ma
,
X.
Zhong
, and
X.
Gong
, “
A non-iterative foveated single-pixel imaging using fast transformation algorithm
,” Appl. Phys. Lett.
123
, 081101
(2023
).12.
T. B.
Pittman
,
Y. H.
Shih
,
D. V.
Strekalov
, and
A. V.
Sergienko
, “
Optical imaging by means of two-photon quantum entanglement
,” Phys. Rev. A
52
, R3429
–R3432
(1995
).13.
G. M.
Gibson
,
S. D.
Johnson
, and
M. J.
Padgett
, “
Single-pixel imaging 12 years on: A review
,” Opt. Express
28
, 28190
–28208
(2020
).14.
Z.
Zhang
,
X.
Ma
, and
J.
Zhong
, “
Single-pixel imaging by means of Fourier spectrum acquisition
,” Nat. Commun.
6
, 6225
(2015
).15.
B.
Sun
,
M. P.
Edgar
,
R.
Bowman
,
L. E.
Vittert
,
S.
Welsh
,
A.
Bowman
, and
M. J.
Padgett
, “
3D computational imaging with single-pixel detectors
,” Science
340
, 844
–847
(2013
).16.
G.
Ma
,
S.
Zhao
,
X.
Wang
,
Z.
Liang
,
Y.
Qian
,
J.
Zhang
,
P.
Zhang
,
H.
Gao
,
R.
Liu
, and
F.
Li
, “
Retinalike foveated imaging through an opaque scattering medium
,” Phys. Rev. Appl.
18
, 044017
(2022
).17.
C.
Zhou
,
J.
Cao
,
Q.
Hao
,
H.
Cui
,
H.
Yao
,
Y.
Ning
,
H.
Zhang
, and
M.
Shi
, “
Adaptive locating foveated ghost imaging based on affine transformation
,” Opt. Express
32
, 7119
–7135
(2024
).18.
M. S.
Banks
,
W. W.
Sprague
,
J.
Schmoll
,
J. A. Q.
Parnell
, and
G. D.
Love
, “
Why do animal eyes have pupils of different shapes?
,” Sci. Adv.
1
, e1500391
(2015
).19.
D. C. D.
Pocock
, “
Sight and knowledge
,” Trans. Inst. Br. Geogr.
6
, 385
(1981
).20.
H. E.
Roaf
, “
The vertebrate eye and its adaptive radiation
,” Nature
151
, 236
(1943
).21.
C. J.
Murphy
and
H. C.
Howland
, “
On the Gekko pupil and Scheiner's disc
,” Vision Res.
26
, 815
–817
(1986
).22.
S. G.
de Groot
and
J. W.
Gebhard
, “
Pupil size as determined by adapting luminance
,” J. Opt. Soc. Am.
42
, 492
–495
(1952
).23.
C.
Choi
,
M. K.
Choi
,
S.
Liu
,
M.
Kim
,
O. K.
Park
,
C.
Im
,
J.
Kim
,
X.
Qin
,
G.
Lee
,
K. W.
Cho
,
M.
Kim
,
E.
Joh
,
J.
Lee
,
D.
Son
,
K.
Seung-Hae
,
N.
Jeon
,
Y.
Song
,
N.
Lu
, and
D.-H.
Kim
, “
Human eye-inspired soft optoelectronic device using high-density MoS2-graphene curved image sensor array
,” Nat. Commun.
8
, 1664
(2017
).24.
K.
Zhang
,
Y. H.
Jung
,
S.
Mikael
,
J.
Seo
,
M.
Kim
,
H.
Mi
,
H.
Zhou
,
Z.
Xia
,
W.
Zhou
,
S.
Gong
, and
Z. J.
Ma
, “
Origami silicon optoelectronics for hemispherical electronic eye systems
,” Nat. Commun.
8
, 1782
(2017
).25.
M.
Lee
,
G. J.
Lee
,
H. J.
Jang
,
E.
Joh
,
H.
Cho
,
M. S.
Kim
,
H. M.
Kim
,
K. M.
Kang
,
J. H.
Lee
,
M.
Kim
,
H.
Jang
,
J.
Yeo
,
F.
Durand
,
N.
Lu
,
D.
Kim
, and
Y. M.
Song
, “
An amphibious artificial vision system with a panoramic visual field
,” Nat. Electron.
5
, 452
–459
(2022
).26.
P.
Gouras
, “
Light and dark adaptation
,” in Physiology of Photoreceptor Organs
, edited by
M. G. F.
Fuortes
(
Springer
,
Berlin, Heidelberg
, 1972
), pp. 609
–634
.27.
W.
Pratt
,
J.
Kane
, and
H.
Andrews
, “
Hadamard transform image coding
,” Proc. IEEE
57
, 58
–68
(1969
).28.
Z.
Zhang
,
X.
Wang
,
G.
Zheng
, and
J.
Zhong
, “
Hadamard single-pixel imaging versus Fourier single-pixel imaging
,” Opt. Express
25
, 19619
–19639
(2017
).29.
Z.-D.
Liu
,
Z.-G.
Li
,
Y.-N.
Zhao
,
S.-H.
Zhang
,
Z.-Y.
Ye
,
D.-J.
Zhang
,
H.-C.
Liu
,
J.
Xiong
, and
H.-G.
Li
, “
Fourier single-pixel imaging via arbitrary illumination patterns
,” Phys. Rev. Appl.
19
, 044025
(2023
).30.
A.
Mittal
,
R.
Soundararajan
, and
A. C.
Bovik
, “
Making a “completely blind” image quality analyzer
,” IEEE Signal Process. Lett.
20
, 209
–212
(2013
).31.
C. M.
Watts
,
D.
Shrekenhamer
,
J. A.
Montoya
,
G. S.
Lipworth
,
J.
Hunt
,
T. A.
Sleasman
,
S.
Krishna
,
D. R.
Smith
, and
W. J.
Padilla
, “
Terahertz compressive imaging with metamaterial spatial light modulators
,” Nat. Photonics
8
, 605
–609
(2014
).32.
Y.
Wang
,
K.
Huang
,
J.
Fang
,
M.
Yan
,
E.
Wu
, and
H.
Ping Zeng
, “
Mid-infrared single-pixel imaging at the single-photon level
,” Nat. Commun.
14
, 1073
(2023
).33.
J.-T.
Ye
,
C.
Yu
,
W.
Li
,
Z.-P.
Li
,
H.
Lu
,
R.
Zhang
,
J.
Zhang
,
F.
Xu
, and
J.-W.
Pan
, “
Ultraviolet photon-counting single-pixel imaging
,” Appl. Phys. Lett.
123
, 024005
(2023
).34.
G.
Wang
,
H.
Deng
,
Y.
Cai
,
M.
Ma
,
X.
Zhong
, and
X.
Gong
, “
Grating-free autofocus for single-pixel microscopic imaging
,” Photonics Res.
12
, 1313
–1321
(2024
).© 2024 Author(s). Published under an exclusive license by AIP Publishing.
2024
Author(s)
You do not currently have access to this content.
