1. Introduction
The demand for high quality optics has increased to satisfy requirements for modern optical systems, and quality control becomes one of the most important subjects in the optical manufacturing industry. Surface defects, such as small scratches and digs, are one area of optical quality that has become more important. While such defects do not affect imaging systems much (unless they are located in a conjugate plane), they can lead to significant damage in high-power laser and short-wave optical systems. For example, small defects can lead to dramatic damage in large-aperture optics in the ICF (Inertial Confinement Fusion) system, including catastrophic failure after repeated laser shots [
1S. Gomez, K. Hale, J. Burrows, and B. Griffiths, “Measurements of surface defects on optical components,” Meas. Sci. Technol. 9(4), 607–616 (1998). [CrossRef]
–
3M. Gebhardt, H. Truckenbrodt, and B. Harnisch, “Surface defect detection and classification with light scattering,” Proc. SPIE 1500, 135–143 (1991). [CrossRef]
].
It is considered challenging to evaluate the surface defects of high quality optical components because the defects are usually of microns while the test samples are of hundreds of millimeters. AFM (Atomic Force Microscope) and SEM (Scanning Electron Microscope) are used to detect and characterize the surface defects on fine optics [
1S. Gomez, K. Hale, J. Burrows, and B. Griffiths, “Measurements of surface defects on optical components,” Meas. Sci. Technol. 9(4), 607–616 (1998). [CrossRef]
,
2H. Ota, M. Hachiya, Y. Ichiyasu, and T. Kurenuma, “Scanning surface inspection system with defect-review SEM and analysis system solutions,” Hatachi Review 55, 78–82 (2006).
]. These methods are suitable for measuring defects within small areas of the samples. However, if the test area is hundreds of millimeters or larger, a huge amount of data will be obtained and the time to acquire and process this data becomes impractical. Scattering energy distribution of surface defects is studied to determine the defects area and even perform defects classification [
3M. Gebhardt, H. Truckenbrodt, and B. Harnisch, “Surface defect detection and classification with light scattering,” Proc. SPIE 1500, 135–143 (1991). [CrossRef]
]. The DAMOCLES system developed by LLNL (Lawrence Livermore National Lab) employs back and edge illuminations, and a mega-pixel CCD(charged-coupled device) to simultaneously get both the surface defects and sub-surface damages of fine optics of up to 1 meter size [
4F. Rainer, R. K. Dickson, R. T. Jennings, J. F. Kimmons, S. M. Maricle, R. P. Mouser, S. Schwartz, and C. L. Weinzapfel, “Development of practical damage mapping and inspection systems,” Proc. SPIE 3492, 556–563 (1999). [CrossRef]
].
A dark-field microscopic scattering imaging system was proposed to detect and evaluate surface defects of large fine optics [
5Y. Yang, C. Lu, J. Liang, D. Liu, L. Yang, and R. Li, “Microscopic dark-field scattering imaging and digitalization evaluation system of defects on optical devices precision surface,” Guangxue Xuebao/Acta Opt. Sin. 27, 1031–1038 (2007).
–
7D. Sun, Y. Yang, F. Wang, L. Yang, and R. Li, “Microscopic scattering imaging system of defects on ultra-smooth surface suitable for digital image processing,” H. Xun, Y. Jiahu, C. W. James, W. Hexin, and H. Sen, eds. (SPIE, 2006), p. 615012.
]. The test sample is illuminated by circular white light source. The scattering light of the defect is captured by the CCD detector through a microscopic imaging system and dark-field image [
8N. Wei, J. You, K. Friehs, E. Flaschel, and T. W. Nattkemper, “In situ dark field microscopy for on-line monitoring of yeast cultures,” Biotechnol. Lett. 29(3), 373–378 (2007). [CrossRef] [PubMed]
,
9K. Rebner, M. Schmitz, B. Boldrini, A. Kienle, D. Oelkrug, and R. W. Kessler, “Dark-field scattering microscopy for spectral characterization of polystyrene aggregates,” Opt. Express 18(3), 3116–3127 (2010). [CrossRef] [PubMed]
] of the defect is recorded. Sub-aperture scanning and stitching techniques are employed to obtain the full image of the test sample. As a result, large optical surfaces of hundreds of millimeters can be examined with a resolution of submicron. The mapping, classification and ranking of surface defects are achieved through processing of the full image. It takes about 60 minutes to evaluate an optical component of 800mm × 450mm.
The original system works well except that sub-aperture stitching encounters problems in some special conditions. Since the test optics are usually of high quality, there is very little characteristic information of the defects in the overlapping areas. In the original stitching method, template matching [
6D. Liu, Y. Y. Yang, L. Wang, Y. M. Zhuo, C. H. Lu, L. M. Yang, and R. J. Li, “Microscopic scattering imaging measurement and digital evaluation system of defects for fine optical surface,” Opt. Commun. 278(2), 240–246 (2007). [CrossRef]
,
10S. Muramatsu, Y. Kobayashi, K. Takahashi, and E. Shimizu, “Development of template matching hardware and its high-speed processing strategy,” Electron. Commun. Jpn. Part III Fundam. Electron. Sci. 84(11), 1–10 (2001). [CrossRef]
] is employed to deal with defect features in the overlapping area of two adjacent sub-aperture images. For overlapping areas without defect features, stitching will be performed with nominal position calculated from resolution of CCD, size of the field of view (FOV), and stepping length of the translation stage, etc. For those sub-apertures that have only one run-through line feature in the overlapping area, the stitching process may fail because it is very difficult to find an accurate template. Also, as the stitching process follows the same order as sub-aperture scanning, stitching error will be yielded by the accumulated positioning error of the translation stage.
In this paper, a feature-based dark-field microscopic image stitching method is proposed to solve the problem above. In this method, the overlapping areas are firstly categorized by the features they contain: template-friendly feature, only one run-through line feature, or no feature. The sub-aperture images with template-friendly feature in the overlapping areas are stitched first, producing some large blocks of sub-apertures; then the sub-apertures with only one run-through line feature are treated with the guidance of their nominal positions; finally, those with no features are stitched following the nominal positions. Experiments show that the method proposed in this paper could effectively stitch the dark-field microscopic sub-aperture images obtained in the defect detection system, and is very suitable to stitch those with very few features all over the aperture.
This paper is constructed as follows: a simple description of the dark-field microscopic scattering imaging system for surface defects evaluation and the current problems with the original stitching method will be presented in Section 2; Section 3 gives a detailed illustration of the new proposed dark-field microscopic image stitching method; comparison experiments with the original and new proposed stitching method are given in Section 4; a conclusion of this paper will be summarized in Section 5.
3. Dark-field microscopic image stitching method
In order to make good use of the information in the overlapping areas, a feature-based multi-cycle dark-field microscopic image stitching method is proposed. In this method, the overlapping areas are firstly categorized by the features they contain: template-friendly feature, only run-through line feature, or no feature. Unlike the linear stitching process in the original method that follows the sub-aperture collection trace, the new method is a region-growing [
13A. Mehnert and P. Jackway, “An improved seeded region growing algorithm,” Pattern Recognit. Lett. 18(10), 1065–1071 (1997). [CrossRef]
] like image stitching process. The sub-aperture images with template-friendly feature in the overlapping areas are stitched first, producing some large groups of sub-apertures; then the sub-apertures with only one run-through line feature can be treated with the guidance of their nominal positions; finally, along with the sub-aperture groups obtained, those with no features in the overlapping areas are stitched following the nominal positions.
The flow chart of the stitching method is shown in
Fig. 4
. The method is divided into two parts: overlapping area classification and multi-cycle image stitching, as shown in red dash-dot rectangle at the top and blue at the bottom of the chart, respectively. Overlapping area classification consists of extraction of overlapping areas, image preprocessing, connected pixel area labeling, feature extraction, and finally overlapping areas classification based on the features that are contained. According to the classification results, multi-cycle image stitching will be carried out.
Fig. 4 Flow chart of the feature-based multi-cycle dark-field microscopic image stitching method.
3.1 Feature-based classification of overlapping areas
At the very beginning, overlapping areas will be extracted from each sub-aperture image and preprocessed properly. Smoothing filtering is used to eliminate the influence of non-uniform illumination and CCD noise on the correlation operation. Then label each connected pixel area as one feature, as is shown in
Fig. 5
, and record the following information:
Fig. 5 The recorded information of the feature, (a) the ellipse that has the same secondary moment with the rectangular pixel area of the feature, (b) the pose of the ellipse shown in (a).
Here, if the feature is line feature,
can be considered to be the long side of the Minimum Bounding Rectangle (MBR) [
14D. Chaudhuri and A. Samal, “A simple method for fitting of bounding rectangle to closed regions,” Pattern Recognit. 40(7), 1981–1989 (2007). [CrossRef]
] of the ellipse, and
is the angle between the line feature and
axis. If the starting and ending points of the feature are not located at the same side of the overlapping area, and
is larger than the threshold
(usually 4:1 as a rule of thumb), it is a run-through line feature. Note that, the run-through line feature can be straight or arc line. Considering the efficiency of the system as well as some other practical aspects (for example, the microscope’s distortion can reduce the effective size of the sub-aperture image), the overlapping area is usually about 1/6 of the sub-aperture. The run-through arc line feature usually does not change its curvature within the overlapping area and it is still difficult for template matching method to find a suitable template.
As is stated above, template matching method is employed in the stitching of the full aperture image. Suitable templates can be obtained for those defects such as scratches, pits, line features that have dead-end in the overlapping area, etc. But template matching may encounter problems if there is only one run-through line feature or no feature in the overlapping area. So the features can be categorized into three types: a) template-friendly feature, b) only one run-through feature, and c) no information feature. Note that if there are two or more run-through line features in an overlapping area, template matching method can also produce good results. This is because the template can be chosen to contain all the feature information and they are also template-friendly features.
Then the overlapping areas can also be categorized based on the defect features contained in them. The overlapping areas which contain template-friendly features are template-friendly overlapping areas (TFOAs); those that have no features are no feature overlapping areas (NFOAs).
Conditions for those overlapping areas with only one run-through line feature are a little different. In the original stitching method, the sub-apertures with only one run-through line feature in their overlapping area were not stitched properly by the template matching method, as is shown in Section 2.2. But the relative positions of some sub-apertures can also be determined by proper design of the stitching trace.
Figure 6
shows some configurations where the relative positions of the sub-apertures or image blocks can be determined by their mutual positions, where
Figs. 6(a) to
6(d) are four different 2 × 2 sub-aperture configurations,
Figs. 6(e) to
6(h) are four example 3 × 3 sub-aperture configurations of image blocks. The
(
= 2, 3) grids represent
sub-aperture images
(
= 1~
,
= 1~
), the “
” represent one run-through line feature, respectively. The relative positions of sub-apertures with the same color are all set. It should be noted that overlapping areas are not shown and the line features in overlapping areas are just placed on the boundary line of grids. We can find in
Fig. 6(a) that even each sub-aperture within the 2 × 2 sub-aperture group has one line feature in their overlapping areas, all the relative positions of the four sub-apertures can be set because of their mutual positions connected by the four line features. Any pseudo-matching along one line will cause ruptures to another line feature. This condition is called “mutual positioning” condition, and all the overlapping areas between the 2 × 2 sub-aperture group are mutual positioning overlapping areas (
MPOAs).
Fig. 6 Illustration of some configurations that the relative positions of the sub-apertures or image blocks can be determined by their mutual positions, (a) to (d) are four different 2 × 2 sub-aperture configurations, (e) to (h) are four example 3 × 3 sub-aperture configurations of image blocks.
Note that, the 2 × 2 mutual positioning sub-aperture group has three simplified versions, as are shown in
Figs. 6(b) to
6(d). In
Fig. 6(b), two of the 2 × 2 sub-apertures have already been stitched together while the relative positions of three sub-apertures within the 2 × 2 group have been obtained in
Fig. 6(c). In
Fig. 6(d), the four sub-apertures are divided into two pairs and the relative positions of the sub-apertures with each pair have been set. Obviously, the above three configurations can be stitched by template matching as the 2 × 2 group shown in
Fig. 6(a).
In fact, not only the four sub-apertures within the 2 × 2 group can meet the mutual positioning condition. The relative positions of bigger image blocks, as examples presented in
Figs. 6(e) to
6(g), can also be determined. This is because the image blocks in
Figs. 6(e) to
6(g) can be converted to the equivalent 2 × 2 mutual positioning configuration as shown in
Figs. 6(a) to
6(d), respectively. At this sense, the image blocks in
Fig. 6(e) to
6(g) also meet the mutual positioning condition and we can call them mutual positioning image blocks (
MPIBs). Note that, the
MPIBs can be extended to larger image blocks, given that the sub-apertures of the image block have two shared overlapping areas, which contain only one run-through line feature, with those of another adjacent image block.
Finally, if the overlapping area which contains only one run-through line feature does not meet the mutual positioning condition, it is a discrete through line overlapping area (DLOA).
3.2 Multi-cycle image stitching
The dark-field microscopic image stitching method proposed in this paper is a feature-based multi-cycle image stitching procedure. As is shown in the section above, the overlapping areas are categorized by the features contained in them. Different types of overlapping areas will be stitched in different cycles.
Cycle I: Stitching of template-friendly overlapping area
Since template-friendly features can be effectively treated with template matching method, the TFOAs will be stitched with template matching method in Cycle I. Note that attention should be paid to the stitching order to reduce the accumulated position error of the translation stage. The number of sub-apertures can be stored in a 1-D matrix as they are collected. In this matrix, closer elements have less positioning error between them and they can be stitched earlier. After this cycle, there will be sub-aperture blocks that are formed by stitching the TFOAs together.
Cycle II: Stitching of 2 × 2 mutual positioning overlapping areas
As is indicated in Section 3.1, the overlapping areas that meet the mutual positioning condition can still be stitched accurately even if they contain only one run-through line feature. For the general 2 × 2 mutual positioning sub-apertures, as is shown in
Fig. 6(a), the process is performed by scanning the four sub-apertures to the suitable positions, as is expressed below:
1) set the stitching template that contains the run-through feature;
2) fix the position of , and move the other three sub-apertures to all the possible positions within an area determined by the sub-aperture sampling system;
3) calculate the mean correlation coefficient of the four templates for each possibility.
The correct stitching should have the largest summation of correlation coefficients.
A similar stitching process can be applied to the simplified 2 × 2 mutual positioning sub-aperture groups shown in
Fig. 6(b) to
6(d) and mutual positioning image blocks in
Fig. 6(e) to
6(g). In short, the key of the new method in dealing with the only one run-through line feature is to change the stitching order from following the sampling order to a self-adapting manner.
Note that new sub-aperture blocks that meet the mutual positioning condition can be yielded after each stitching of the MPOAs or mutual positioning image blocks. Re-definition of the new constructed mutual positioning image blocks is necessary. A detailed illustration is shown in Section 4 Experiment results.
At this time, all the sub-apertures that can be stitched accurately have been stitched accurately. Only those with only one run-through line feature or no feature in the overlapping area are left. The next two cycles handle the stitching of those sub-apertures with only run-through line feature or with no feature.
Cycle III: Stitching of discrete run-through line error
Since the sub-apertures with only one run-through line feature in the overlapping area could not be stitched accurately, and there would not be more defects reported due to incorrect stitching, template matching will be employed in the stitching process. Run-through features would not be broken due to incorrect stitching but can be a little shorter or longer (usually smaller than 2%, determined by the positioning accuracy), as is shown in
Fig. 6(b). This kind of error is not eliminated by the software. A hardware improvement, however, (for instance, improvement on the positioning accuracy of the translation stage) could reduce the length error of an isolated run-through feature.
Cycle IV: Stitching of no feature
When the stitching process comes to this cycle, there is no feature in the overlapping areas between the two adjacent sub-apertures, and template matching method can be employed. Only the nominal position determined by the translation stage and the microscopic system can be used to determine the position of the image stack.
3.3 Graphical expression of multi-cycle image stitching
Figure 7
is a graphical expression of the multi-cycle image stitching process, where
Fig. 7(a) shows the sub-aperture images and features in the overlapping area, and 7(b)-7(e) show the resulting sub-aperture blocks after each cycle of stitching process. The 5 × 5 grids represent 5 × 5 sub-aperture images
(
= 1~5,
= 1~5). The “
■” and “
┃” represent template-friendly features and run-through line features, respectively. It should be noted that overlapping areas are not shown and features in overlapped areas are just placed on the boundary line of grids. If there is nothing on the boundary line of grids means there is no feature in the overlapping areas. Also, defects that are not in the overlapping areas are not present either. As is shown in
Fig. 7(a), there are template-friendly features in the overlapping area of
and
,
and
,
and
,
and
,
and
,
and
,
and
; and there are also some sub-apertures contain only one run-through line feature in their overlapping areas such as
and
,
and
,
and
,
and
,
and
,
and
,
and
,
and
.
Fig. 7 Graphical expression of multi-cycle image stitching, (a) sub-aperture images and features in the overlapping area, (b) sub-aperture blocks after Cycle I: template matching method for TFOAs, (c) sub-aperture blocks after Cycle II: mutual positioning method for MPOAs, (d) sub-aperture blocks after Cycle III: modified template-matching method for DLOAs, (e) sub-aperture blocks after Cycle IV: direct stitching method for OFOAs.
The multi-cycle stitching process of the 5 × 5 sub-aperture images is shown in
Figs. 7(b)-
7(e). The sub-aperture blocks are processed from top to bottom and from left to right. As is illustrated in Section 3.2, sub-apertures with template-friendly feature in the overlapping areas will be stitched in Cycle I with template matching method. As is shown in
Fig. 7(b),
will be combined with
, producing an sub-aperture block
(filled with green);
and
will form
(filled with red);
,
,
and
will construct a larger sub-aperture block
(filled with pink);
,
and
are stitched together and we can get
(filled with blue). Sub-apertures
,
,
,
and
, which has only one run-through line feature in the overlapping areas, are labeled as
,
,
,
and
, respectively. All the sub-aperture blocks,
(
= 1,2,3,…), will join the stitching process in Cycle II. Note that, the sub-apertures which have no feature in the overlapping areas are left unlabeled because they are left to be treated in Cycle IV.
In Cycle II, the MPOAs will be stitched. It is apparent that the overlapping areas of the sub-aperture blocks
,
,
and
meet the mutual positioning condition and can be stitched together, producing a new sub-aperture block
. Note that, the sub-aperture block
is in a mutual positioning condition with the sub-apertures with the sub-aperture block
. So the position of
can be determined by
under the mutual positioning method. As is shown in
Fig. 7(c), the new sub-aperture block
is come out from
and
. The sub-aperture blocks that are not stitched in this cycle are given new labels for the stitching of next cycle:
,
and
, are labeled
,
and
, respectively.
After the two cycles above, all the sub-apertures that can be stitched correctly have been stitched together. The resulted sub-aperture blocks have only one run-through line feature in the overlapping areas (if they have feature in the overlapping area) but do not meet the mutual positioning condition. All these sub-aperture blocks will be stitched with the modified template matching method in Cycle III. As is shown in
Fig. 7(d), sub-aperture blocks
,
and
are stitched together, producing
. After this cycle, neither of the resulted sub-aperture blocks has feature information in the overlapping area. Since it is difficult to exactly locate all the sub-aperture blocks over the full aperture, direct stitching will be applied under their nominal positions that are determined by the system parameters such as the resolution of CCD, the size of the field of view (FOV), and the stepping length of the translation stage, etc. So in Cycle IV, all the sub-aperture blocks are directly stitched together and form the full aperture image (
Fig. 7(e)).
From the expression above, we can find that the new multi-cycle image stitching method employs four cycles to obtain the full aperture image: sub-apertures with different kinds of overlapping areas are processed in separate cycles; after each cycle, sub-aperture blocks may grow bigger and bigger, until to the full aperture image at the end of the stitching procedure.
4. Experimental results
Experiments on the new dark-field microscopic image stitching method were carried out and are presented in this section, including a comparison with the original method. The test sample is a standard reticle plate that is used to calibrate the real size of the defects [
6D. Liu, Y. Y. Yang, L. Wang, Y. M. Zhuo, C. H. Lu, L. M. Yang, and R. J. Li, “Microscopic scattering imaging measurement and digital evaluation system of defects for fine optical surface,” Opt. Commun. 278(2), 240–246 (2007). [CrossRef]
]. It is a 127mm × 127mm square fused silica plate with a thickness of 2.54mm. A group of standard defects, such as scratches, pits, etc, are grooved on it by electron beam exposure (EBE) [
15M. Stepanova, S. Dew, M. Mohammad, M. Muhammad, and S. Dew, “Fundamentals of electron beam exposure and development,” in Nanofabrication (Springer, 2012), pp. 11–41.
] and ion beam etching (IBE) [
16V. Y. Guzhov, “Ion-beam etching technology in the production of optical elements,” J. Opt. Technol. 69(9), 685 (2002). [CrossRef]
]. The sub-apertures collected by the microscopic system are of 700 × 500 pixels and the object field of the 2 × digital microscope is 1.75mm × 1.25mm. The positioning error of the translation stage that is used for sub-aperture sampling is ± 10
. The full aperture image is obtained by stitching the sub-apertures together.
Since the full image of the test sample is very large, only a sub-aperture block that contains 4 × 4 sub-aperture images is examined in detail here to illustrate how the technique works.
Figure 8
shows the full aperture image obtained with the original method. Sub-aperture grids are provided to give better impression of each image’s position. Also, detailed views of some critical areas (A, B, C and D) on the sub-aperture block are provided on the right part of
Fig. 8. From
Fig. 8 we can find apparent ruptures at many areas over the sub-aperture block. This is because the original stitching method encounters problems with no feature or only one run-through line feature in the overlapping area when the stitching process follows the same order of sub-aperture scanning. As is shown on the left part of
Fig. 8, there is no feature in the overlapping area between sub-apertures
and
, so
is placed directly at its nominal position. Since there are template-friendly features in the overlapping areas that followed until the one between
and
, the influence on stitching has not been found. But after direct stitching of
and
, which have no feature between, the mismatch can be seen apparently (please refer to the detailed view “A”). Similarly, mismatch between
and
, as can be seen clearly in the detailed view “B”, is caused by the direct stitching of
and
, and
and
. The mismatch caused by the only one run-through line feature in the overlapping area can be seen at the detailed view “C”. Since there is only one run-through line feature between
and
, stitching error may occur along the run-through line feature (though could not be seen until mismatch is apparent). Another mismatch can be seen in the detailed view of area “D”. This mismatch is a cumulative result of the previous stitching errors. Both the direct stitching error of
and
, and the stitching error along the run-through line feature between
and
have contribution to it.
Fig. 8 Sub-aperture block of 4 × 4 sub-aperture images obtained using the original algorithm (on the left) with detailed views of some critical areas (on the right).
The same sub-aperture groups are stitched together by the new proposed multi-cycle dark-field microscopic image stitching method. The results are shown in
Fig. 9
. Similarly, the sub-aperture grids and detailed view of some critical areas are also presented. It is demonstrated in
Fig. 9 that unlike the mismatches obtained with the original method, the stitching result with the new method is more encouraging. In fact, it is not easy to find ruptures with the new method because categorized overlapping areas are stitched in different cycles. The overlapping areas containing template-friendly features are processed first, then those meeting the mutual positioning condition and those containing discrete run-through line feature are treated successively, and finally those with no feature are directly placed at the nominal positions.
Fig. 9 Sub-aperture block of 4 × 4 sub-aperture images obtained using the new proposed dark-field microscopic image stitching method (on the left) with detailed views of some critical areas (on the right).
Note that there are some run-through line features in the overlapping area between and , and between and . They are parallel run-through line features and sometimes act as only one run-through line feature with template matching stitching. But such features are practically nonexistent on “regular” optical surfaces; they only exist on special calibration artifacts, such as the standard reticle plate. This is also the reason that parallel features are not considered in the feature categorization in Section 3. In this experiment, the parallel run-through line features are treated as only one run-through line feature in the stitching process.
The graphic expression of the stitching process of the above experiment with the new method is shown in
Fig. 10
, where
Fig. 10(a) is the sub-aperture images and features in the overlapping areas, 10(b) and 10(c) are sub-aperture blocks after Cycle I and II, respectively. All the markers and symbols share the same meanings with those in
Fig. 7. In Cycle I, sub-apertures with connected
TFOAs are stitched together, forming three sub-aperture blocks:
,
and
. Only one sub-aperture image of
has an overlapping area with one of
. Two sub-apertures of
:
and
share overlapping areas with
and
of
, respectively. Another two sub-apertures of
:
and
overlap with
and
of
, respectively. Note that, there are two 2 × 2 sub-aperture groups meet the mutual positioning condition: one contains
,
,
and
, the other contains
,
,
and
. As is indicated in Section 3, the sub-aperture blocks are processed from top to bottom and from left to right. So in Cycle II,
and
are stitched first, forming
. Then sub-aperture block
is examined with its neighbors and is found to meet mutual positioning condition with the previous got
.
and
are stitched together and produce the new
. Since the positions of all the sub-apertures are determined, the multi-cycle dark-field microscopic image stitching procedure ends up, and
is the full aperture image that was pursued.
Fig. 10 Graphic expression of the above 4 × 4 sub-aperture stitching process with the new proposed method, (a) sub-aperture images and features in the overlapping area, (b) sub-aperture blocks after Cycle I: template matching method for TFOAs, (c) sub-aperture blocks after Cycle II: mutual positioning method for MPOAs.
Note that, some connections in the full aperture image obtained above, for instance, the detailed view of “B”, “C” and “D”, are not so smooth. It is because the illumination across the view field of the DM is not very uniform. Shadows of the defect features can be found, and deviates from each other by the shape, size, position, illumination direction of the defects. This effect could not be eliminated by software but can be improved by the upgrade of the illumination system of the defect evaluation system.