|
|
Real-time outdoor concealed-object detection with passive millimeter wave imaging |
Optics Express, Vol. 19, Issue 3, pp. 2530-2536 (2011)
http://dx.doi.org/10.1364/OE.19.002530
Acrobat PDF (1106 KB)
Abstract
Millimeter wave imaging is finding rapid adoption in security applications such as the detection of objects concealed under clothing. A passive imaging system can be realized as a stand-off type sensor that can operate in open spaces, both indoors and outdoors. In this paper, we address real-time outdoor concealed-object detection and segmentation with a radiometric imaging system operating in the W-band. The imaging system is equipped with a dielectric lens and a receiver array operating at around 94 GHz. Images are analyzed by multilevel segmentation to identify a concealed object. Each level of segmentation comprises vector quantization, expectation-maximization, and Bayesian decision making to cluster pixels on the basis of a Gaussian mixture model. In addition, we describe a faster process that adopts only vector quantization for the first level segmentation. Experiments confirm that the proposed methods provide fast and reliable detection and segmentation for a moving human subject carrying a concealed gun.
© 2011 OSA
1. Introduction
L. Yujiri, M. Shoucri, and P. Moffa, “Passive millimeter-wave imaging,” IEEE Microw. Mag. 4(3), 39–50 (2003). [CrossRef]
R. Appleby and R. N. Anderton, “Millimeter-wave and submillimeter-wave imaging for security and surveillance,” Proc. IEEE 95(8), 1683–1690 (2007). [CrossRef]
L. Yujiri, M. Shoucri, and P. Moffa, “Passive millimeter-wave imaging,” IEEE Microw. Mag. 4(3), 39–50 (2003). [CrossRef]
M. R. Fetterman, J. Grata, G. Jubic, W. L. Kiser Jr, and A. Visnansky, “Simulation, acquisition and analysis of passive millimeter-wave images in remote sensing applications,” Opt. Express 16(25), 20503–20515 (2008). [CrossRef] [PubMed]
A. Denisov, A. Gorishnyak, S. Kuzmin, V. Miklashevich, V. Obolonskv, V. Radzikhovsky, B. Shevchuk, B. Yshenko, V. Uliz’ko, and J. Son, “Some experiments concerning resolution of 32 sensors passive 8 mm wave imaging system,” in Proceeding of the 20th International Symposium on Space Terahertz Technology, ISSTT 2009 (National Radio Astronomy Observatory, 2009), pp. 227–229.
H.-M. Chen, S. Lee, R. M. Rao, M.-A. Slamani, and P. K. Varshney, “Imaging for concealed weapon detection: a tutorial overview of development in imaging sensors and processing,” IEEE Signal Process. Mag. 22(2), 52–61 (2005). [CrossRef]
M.-K. Jung, Y.-S. Chang, S.-H. Kim, W.-G. Kim, and Y.-H. Kim, “Development of passive millimeter wave imaging system at W-band,” in Proceedings of the 34th International Conference on Infrared, Millimeter, and Terahertz Waves, IRMMW-THz 2009 (IEEE Microwave Theory and Techniques Society, 2009), pp. 1–2.
X. Shen, C. R. Dietlein, E. Grossman, Z. Popovic, and F. G. Meyer, “Detection and segmentation of concealed objects in terahertz images,” IEEE Trans. Image Process. 17(12), 2465–2475 (2008). [CrossRef] [PubMed]
S. Yeom, D.-S. Lee, H. Lee, J. Son, and V. P. Guschin, “Three-dimensional passive millimeter-wave imaging and depth estimation,” Proc. SPIE 7690, 76900W , 76900W-6 (2010). [CrossRef]
X. Shen, C. R. Dietlein, E. Grossman, Z. Popovic, and F. G. Meyer, “Detection and segmentation of concealed objects in terahertz images,” IEEE Trans. Image Process. 17(12), 2465–2475 (2008). [CrossRef] [PubMed]
C. D. Haworth, Y. de Saint-Pern, D. Clark, E. Trucco, and Y. R. Petillot, “Detection and tracking of multiple metallic objects in millimeter-wave images,” Int. J. Comput. Vis. 71(2), 183–196 (2007). [CrossRef]
D.-S. Lee, S. Yeom, J. Y. Son, and S.-H. Kim, “Automatic image segmentation for concealed object detection using the expectation-maximization algorithm,” Opt. Express 18(10), 10659–10667 (2010). [CrossRef] [PubMed]
S. Yeom, D.-S. Lee, H. Lee, J. Son, and V. P. Guschin, “Three-dimensional passive millimeter-wave imaging and depth estimation,” Proc. SPIE 7690, 76900W , 76900W-6 (2010). [CrossRef]
D.-S. Lee, S. Yeom, J. Y. Son, and S.-H. Kim, “Automatic image segmentation for concealed object detection using the expectation-maximization algorithm,” Opt. Express 18(10), 10659–10667 (2010). [CrossRef] [PubMed]
2. A passive millimeter wave imaging system
M.-K. Jung, Y.-S. Chang, S.-H. Kim, W.-G. Kim, and Y.-H. Kim, “Development of passive millimeter wave imaging system at W-band,” in Proceedings of the 34th International Conference on Infrared, Millimeter, and Terahertz Waves, IRMMW-THz 2009 (IEEE Microwave Theory and Techniques Society, 2009), pp. 1–2.
M.-K. Jung, Y.-S. Chang, S.-H. Kim, W.-G. Kim, and Y.-H. Kim, “Development of passive millimeter wave imaging system at W-band,” in Proceedings of the 34th International Conference on Infrared, Millimeter, and Terahertz Waves, IRMMW-THz 2009 (IEEE Microwave Theory and Techniques Society, 2009), pp. 1–2.
3. Image segmentation for concealed object recognition
3.1 VQ process
3.2 EM algorithm and Bayesian decision process
D.-S. Lee, S. Yeom, J. Y. Son, and S.-H. Kim, “Automatic image segmentation for concealed object detection using the expectation-maximization algorithm,” Opt. Express 18(10), 10659–10667 (2010). [CrossRef] [PubMed]
3.3 Performance evaluation
D.-S. Lee, S. Yeom, J. Y. Son, and S.-H. Kim, “Automatic image segmentation for concealed object detection using the expectation-maximization algorithm,” Opt. Express 18(10), 10659–10667 (2010). [CrossRef] [PubMed]
4. Experimental and simulation results
5. Conclusion
Acknowledgments
References and links
L. Yujiri, M. Shoucri, and P. Moffa, “Passive millimeter-wave imaging,” IEEE Microw. Mag. 4(3), 39–50 (2003). [CrossRef] | |
H.-M. Chen, S. Lee, R. M. Rao, M.-A. Slamani, and P. K. Varshney, “Imaging for concealed weapon detection: a tutorial overview of development in imaging sensors and processing,” IEEE Signal Process. Mag. 22(2), 52–61 (2005). [CrossRef] | |
National Research Council, Assessment of millimeter-wave and terahertz technology for detection and identification of concealed explosives and weapons (National Academies Press, Washington, D.C., 2007). | |
R. Appleby and R. N. Anderton, “Millimeter-wave and submillimeter-wave imaging for security and surveillance,” Proc. IEEE 95(8), 1683–1690 (2007). [CrossRef] | |
M. R. Fetterman, J. Grata, G. Jubic, W. L. Kiser Jr, and A. Visnansky, “Simulation, acquisition and analysis of passive millimeter-wave images in remote sensing applications,” Opt. Express 16(25), 20503–20515 (2008). [CrossRef] [PubMed] | |
F. Buersgens, G. Acuna, and R. Kersting, “Millimeter wave probing of the acoustic phase for concealed object detection,” Opt. Express 15(14), 8838–8843 (2007), http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-15-14-8838. [CrossRef] [PubMed] | |
A. Denisov, A. Gorishnyak, S. Kuzmin, V. Miklashevich, V. Obolonskv, V. Radzikhovsky, B. Shevchuk, B. Yshenko, V. Uliz’ko, and J. Son, “Some experiments concerning resolution of 32 sensors passive 8 mm wave imaging system,” in Proceeding of the 20th International Symposium on Space Terahertz Technology, ISSTT 2009 (National Radio Astronomy Observatory, 2009), pp. 227–229. | |
K. B. Cooper, R. J. Dengler, N. Llombart, T. Bryllert, G. Chattopadhyay, I. Mehdi, and P. H. Siegel, “An approach for sub-second imaging of concealed objects using terahertz (THz) radar,” J. Infrared, Millimeter Terahertz Waves 30, 1297–1307 (2009). | |
H. Sato, K. Sawaya, K. Mizuno, J. Uemura, M. Takeda, J. Takahashi, K. Yamada, K. Morichika, T. Hasegawa, H. Hirai, H. Niikura, T. Matsuzaki, S. Kato, and J. Nakada, “Passive millimeter-wave imaging for security and safety applications,” Proc. SPIE 7672, 76720V (2010). | |
M.-K. Jung, Y.-S. Chang, S.-H. Kim, W.-G. Kim, and Y.-H. Kim, “Development of passive millimeter wave imaging system at W-band,” in Proceedings of the 34th International Conference on Infrared, Millimeter, and Terahertz Waves, IRMMW-THz 2009 (IEEE Microwave Theory and Techniques Society, 2009), pp. 1–2. | |
X. Shen, C. R. Dietlein, E. Grossman, Z. Popovic, and F. G. Meyer, “Detection and segmentation of concealed objects in terahertz images,” IEEE Trans. Image Process. 17(12), 2465–2475 (2008). [CrossRef] [PubMed] | |
C. D. Haworth, Y. de Saint-Pern, D. Clark, E. Trucco, and Y. R. Petillot, “Detection and tracking of multiple metallic objects in millimeter-wave images,” Int. J. Comput. Vis. 71(2), 183–196 (2007). [CrossRef] | |
D.-S. Lee, S. Yeom, J. Y. Son, and S.-H. Kim, “Automatic image segmentation for concealed object detection using the expectation-maximization algorithm,” Opt. Express 18(10), 10659–10667 (2010). [CrossRef] [PubMed] | |
S. Yeom, D.-S. Lee, H. Lee, J. Son, and V. P. Guschin, “Three-dimensional passive millimeter-wave imaging and depth estimation,” Proc. SPIE 7690, 76900W , 76900W-6 (2010). [CrossRef] | |
A. Gersho and R. M. Gray, Vector Quantization and Signal Compression (Kluwer Academic Publishers, Boston, MA., 1992). | |
C. M. Bishop, Neural Networks for Pattern Recognition (Oxford University Press, 1995), Chap. 2. |
OCIS Codes
(000.5490) General : Probability theory, stochastic processes, and statistics
(100.2000) Image processing : Digital image processing
(100.5010) Image processing : Pattern recognition
(110.2970) Imaging systems : Image detection systems
(100.3008) Image processing : Image recognition, algorithms and filters
(110.6795) Imaging systems : Terahertz imaging
ToC Category:
Image Processing
History
Original Manuscript: November 29, 2010
Revised Manuscript: January 13, 2011
Manuscript Accepted: January 15, 2011
Published: January 26, 2011
Virtual Issues
Vol. 6, Iss. 2 Virtual Journal for Biomedical Optics
Citation
Seokwon Yeom, Dong-Su Lee, Jung-Young Son, Min-Kyoo Jung, YuShin Jang, Sang-Won Jung, and Seok-Jae Lee, "Real-time outdoor concealed-object detection with passive millimeter wave imaging," Opt. Express 19, 2530-2536 (2011)
http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-19-3-2530
Sort: Year | Journal | Reset
References
- L. Yujiri, M. Shoucri, and P. Moffa, “Passive millimeter-wave imaging,” IEEE Microw. Mag. 4(3), 39–50 (2003). [CrossRef]
- H.-M. Chen, S. Lee, R. M. Rao, M.-A. Slamani, and P. K. Varshney, “Imaging for concealed weapon detection: a tutorial overview of development in imaging sensors and processing,” IEEE Signal Process. Mag. 22(2), 52–61 (2005). [CrossRef]
- National Research Council, Assessment of millimeter-wave and terahertz technology for detection and identification of concealed explosives and weapons (National Academies Press, Washington, D.C., 2007).
- R. Appleby and R. N. Anderton, “Millimeter-wave and submillimeter-wave imaging for security and surveillance,” Proc. IEEE 95(8), 1683–1690 (2007). [CrossRef]
- M. R. Fetterman, J. Grata, G. Jubic, W. L. Kiser, and A. Visnansky, “Simulation, acquisition and analysis of passive millimeter-wave images in remote sensing applications,” Opt. Express 16(25), 20503–20515 (2008). [CrossRef] [PubMed]
- F. Buersgens, G. Acuna, and R. Kersting, “Millimeter wave probing of the acoustic phase for concealed object detection,” Opt. Express 15(14), 8838–8843 (2007), http://www.opticsinfobase.org/oe/abstract.cfm?URI=oe-15-14-8838 . [CrossRef] [PubMed]
- A. Denisov, A. Gorishnyak, S. Kuzmin, V. Miklashevich, V. Obolonskv, V. Radzikhovsky, B. Shevchuk, B. Yshenko, V. Uliz’ko, and J. Son, “Some experiments concerning resolution of 32 sensors passive 8 mm wave imaging system,” in Proceeding of the 20th International Symposium on Space Terahertz Technology, ISSTT 2009 (National Radio Astronomy Observatory, 2009), pp. 227–229.
- K. B. Cooper, R. J. Dengler, N. Llombart, T. Bryllert, G. Chattopadhyay, I. Mehdi, and P. H. Siegel, “An approach for sub-second imaging of concealed objects using terahertz (THz) radar,”J. Infrared, Millimeter Terahertz Waves 30, 1297–1307 (2009).
- H. Sato, K. Sawaya, K. Mizuno, J. Uemura, M. Takeda, J. Takahashi, K. Yamada, K. Morichika, T. Hasegawa, H. Hirai, H. Niikura, T. Matsuzaki, S. Kato, and J. Nakada, “Passive millimeter-wave imaging for security and safety applications,” Proc. SPIE 7672, 76720V (2010).
- M.-K. Jung, Y.-S. Chang, S.-H. Kim, W.-G. Kim, and Y.-H. Kim, “Development of passive millimeter wave imaging system at W-band,” in Proceedings of the 34th International Conference on Infrared, Millimeter, and Terahertz Waves, IRMMW-THz 2009 (IEEE Microwave Theory and Techniques Society, 2009), pp. 1–2.
- X. Shen, C. R. Dietlein, E. Grossman, Z. Popovic, and F. G. Meyer, “Detection and segmentation of concealed objects in terahertz images,” IEEE Trans. Image Process. 17(12), 2465–2475 (2008). [CrossRef] [PubMed]
- C. D. Haworth, Y. de Saint-Pern, D. Clark, E. Trucco, and Y. R. Petillot, “Detection and tracking of multiple metallic objects in millimeter-wave images,” Int. J. Comput. Vis. 71(2), 183–196 (2007). [CrossRef]
- D.-S. Lee, S. Yeom, J. Y. Son, and S.-H. Kim, “Automatic image segmentation for concealed object detection using the expectation-maximization algorithm,” Opt. Express 18(10), 10659–10667 (2010). [CrossRef] [PubMed]
- S. Yeom, D.-S. Lee, H. Lee, J. Son, and V. P. Guschin, “Three-dimensional passive millimeter-wave imaging and depth estimation,” Proc. SPIE 7690, 76900W, 76900W-6 (2010). [CrossRef]
- A. Gersho and R. M. Gray, Vector Quantization and Signal Compression (Kluwer Academic Publishers, Boston, MA., 1992).
- C. M. Bishop, Neural Networks for Pattern Recognition (Oxford University Press, 1995), Chap. 2.
Cited By |
OSA is able to provide readers links to articles that cite this paper by participating in CrossRef's Cited-By Linking service. CrossRef includes content from more than 3000 publishers and societies. In addition to listing OSA journal articles that cite this paper, citing articles from other participating publishers will also be listed.
Multimedia
| Multimedia Files | Recommended Software |
| » Media 1: AVI (3401 KB) | QuickTime |
| » Media 2: AVI (100 KB) | QuickTime |
| » Media 3: AVI (100 KB) | QuickTime |
| » Media 4: AVI (100 KB) | QuickTime |





OSA is a member of 