Professional Documents
Culture Documents
AES-2018-Intelligent Assessment of Subsurface Cracks in Optical Glass Generated in Mechanical Grinding Process
AES-2018-Intelligent Assessment of Subsurface Cracks in Optical Glass Generated in Mechanical Grinding Process
a r t i c l e i n f o a b s t r a c t
Article history: Grinding process of optical glass has been reported to be related with the creation of subsurface cracks.
Received 20 May 2017 However, for the time being, most measurement methods have been depended on human operations. In
Revised 31 July 2017
this paper, an intelligent assessment method based on image processing technique is proposed. Grind-
Accepted 13 August 2017
ing trials proved that, the proposed method can accurately (with the biggest relative error of 3.53%) and
Available online 17 August 2017
quickly (nearly 1.6 seconds per micrographs) recognize and measure the subsurface crack depths. More
Keywords: importantly, the proposed method has good robustness to different-sized images. Besides, the method
Automatic detection does not require any input parameters or any adjustment of thresholds, therefore the method does not
Optical glass require any prior knowledge of either mechanical grinding process or brittle material behaviors relat-
Image processing ing with subsurface cracks. Based on above, the proposed method is expected to be meaningful to both
Subsurface damage metrology equipment companies and optical glass manufacturers.
Grinding
© 2017 Elsevier Ltd. All rights reserved.
1. Introduction • Material flaws might also interfere with the SSD measurement.
However, it should also bear in mind that, human measurement
As a key kind of optical materials, manufacturing of optical
of SSDs might be only feasible when a small quantity of operations
glass is considered as the foundation of many industries includ-
are required. Therefore a more advanced automated measurement
ing optics, telecommunication, electronics, and mechanotronics [1].
of SSDs is highly in-demand.
The mechanical grinding process of optical glass, however, has
On the other hand, intelligent recognition and measurement
been reported closely related with the generation of subsurface
based on image processing technique has been recently found as a
cracks [2–4] due to the unstable grain-workpiece interactions in-
powerful tool in many fields containing mechanical, civil and agri-
duced by stochastic grinding wheel topography [5–7], although
culture engineering. This technique can be used for not only detec-
more advanced grinding tools with uniformly-protruded mono-
tion of a certain macro/micro feature, but also quantification of a
layer abrasives were produced [8–10].
certain process to provide a more in-depth understanding.
With this, substantial studies relating with the quantification
In mechanical and manufacturing engineering, both Zatočilová
of subsurface crack depths have been reported so far. Although
et al. [11] and Du et al. [12] proposed an image-based method
many measurement methods have been provided, nearly all of
to on-line measure both the dimension and the axis straightness
them have been suggested based on the cross-section micrographs
of the hot forgings. Experiments for both unheated and heated
observed by an optical microscope, where many human involve-
samples showed the method accuracy of up to 97%. Zhao et al.
ment/operations have been required, because, as seen in Fig. 1,
[13] used an image-processing-based method to detect the defects
• In most measurement cases, the ground surfaces of optical glass in the cold rolling process with the consideration of the influence
have been obliquely placed, therefore the subsurface damage of industrial liquids and surface textures. The defect detection ac-
(SSD) depth should be the tilted distance labeled by “SSD” in curacy achieved 91% although some defects were covered by in-
Fig. 1; dustrial liquids. A similar method was also reported in the mon-
• Due to the polishing operation during the creation of sample itoring of the brittle material grinding process [14], enabling the
cross sections, many noise points have been introduced (see automation of observations of process details. The method was
“noise” in Fig. 1); also employed to in-process and in-situ monitor ground surface
morphologies [15], where the brittle and ductile regions can be
achieved during the machining process, providing the reference
∗
Corresponding author. of the process statuses. Besides, Gadelmawla [16] employed the
E-mail address: lhnlwfb@163.com (H.N. Li). image-processing method to measure the screw thread features.
http://dx.doi.org/10.1016/j.advengsoft.2017.08.008
0965-9978/© 2017 Elsevier Ltd. All rights reserved.
18 Y.J. Zhao et al. / Advances in Engineering Software 115 (2018) 17–25
Fig. 3. (a) Illustration of the Non-Local Means Denoising (NLMD), (b) the original and (c) denoised micrographs containing subsurface cracks.
Fig. 5. Basic principle of morphological dilation for (a) a certain pixel and (b) a certain region, (c) illustration of the result by subtracting the original image from the dilated
image, and image examples of (d) the dilated image and (e) the final result where the subsurface crack edges are highlighted.
Fig. 6. Image results (a) before and (b) after the morphological erosion-reconstruction is performed.
are properly kept while nearly all the material flaws are detected servation of the ground sample cross sections, therefore the SSD
and removed. depth would be an inclined distance from the deepest subsurface
Here it needs to explain that, although a white layer is pre- crack tip to the ground surface, rather than the vertical distance
sented on the top of the ground surface (see Fig. 6), it would not (see Fig. 1).
influence the detection of the subsurface cracks, because subsur-
face damage refers to the deepest crack depth therefore only the
2.3. Calculation of the SSD depths
deepest pixel within the detected subsurface crack region would
affect the method accuracy.
When both the subsurface cracks and the ground surface are
detected, the SSD depth can be easily obtained based on the point-
2.2. Recognition and reconstruction of the ground specimen surface
to-line distance in the analytic geometry, i.e.
As stated in the Introduction, even though subsurface cracks |tanβ · xmax − ymax + b|
can be recognized by the above steps, it is also important to recog-
SSD = (with the unit of pixels) (9)
(tanβ )2 + (−1 )2
nize the tilted ground surface, because in most cases, the sample
placement can not be ideally horizontal. where (xmax ,ymax ) is the coordinate of the deepest pixel of the de-
It can also be observed from Fig. 7 that, the detailed recognition tected subsurface cracks.
process is: (1) the Canny edge detection [31] is firstly performed to Please note that, all the above calculation is based on the unit
highlight all the potential edges including the ground surface (see of pixels. Therefore to obtain SSD depths in the length unit, unit
Fig. 7a); (2) the top pixel of the highlighted edges are kept while conversion needs to perform. Assuming the scale bar length is
others are removed (see Fig. 7b); (3) the mathematical express of Slength (with the unit of μm) and is expressed by using Spixel pix-
the ground surface can be obtained by fitting the left pixels with els, the realistic subsurface crack depth SSDlength would be
the basic fitting function form of y = tanβ • x + b (see Fig. 7c).
Here the slope is calculated because the proposed method con-
Slength
SSDlength = · SSD. (10)
siders the tilted sample placement during optical microscope ob- S pixel
Y.J. Zhao et al. / Advances in Engineering Software 115 (2018) 17–25 21
Fig. 7. The image results after (a) the Canny edge detection is performed, (b) the top pixel of the highlighted edges are kept while others are removed, and (c) the ground
surface fitted by using the left pixels with the basic fitting function form of y = tanβ · x + b.
Table 1 is induced by the lateral cracks, rather than the median cracks,
Grinding parameters.
meaning the proposed method can also be applicable to various
Parameters Values subsurface damage situations. Besides, Fig. 9(d) and (e) as well as
Depth of cut, ap (μm) 0.1, 0.5, 1.0, 1.5, 2.0, 2.5, 3.0, 3.5, Fig. 9(g) and (h) indicate that, even though the subsurface cracks
4.0, 5.5, 6.0, 8.0, 10.0, 12.0, 14.0, induced by the median cracks are shallow, the proposed method
15.0 can also successfully recognize and accurately measure the crack
Grinding wheel speed, vs (m/s) 12.5, 14, 15.5, 17, 18.5, 20, 21.5, 23, depths.
24.5, 26
Workpiece feed rate, vw (mm/min) 2, 5, 10, 15, 20, 25, 30, 40, 50, 60
4.2. Method speed
3. Experimental validation of the methodology Because the aim of the proposed method is to automatically de-
tect and measure the subsurface crack depths so that when a large
As seen in Fig. 8, grinding trials of optical glass blocks (25 mm ∗ quantity of measurement tasks are required measurement speed
25 mm ∗ 5 mm) have been performed by using a grinder machine would not be the problem, the proposed method speed is there-
tool in this section to validate the method. The optical glass sam- fore evaluated in this section.
ples have been mounted on the jig, which then has been mounted Fig. 10 shows the original images and the images processed by
on the dynamometer. The used grinding parameters are given in the proposed method. For all the twelve micrographs, the total
Table 1, and the SSD observation after the grinding trials have been subsurface crack recognition and measurement time is 19.23 sec-
the same as Ref. [3,4]. onds when a PC is used (InterCore i7-4500U 3.2GHz). This means
the average speed of the proposed method is around 1.6 seconds
4. Validation and discussion per micrographs, which would be hard for manual operators to be
faster, even for the skilled operators. It can also expect that, the
4.1. Method accuracy proposed method would largely facilitate the measurement effi-
ciency, and be specially interesting for metrology equipment com-
To validate the method accuracy, the SSD depths automatically- panies.
assessed by the proposed method are compared with the
manually-measured ones, and the results are presented in Fig. 9. 4.3. Method robustness to different-sized images
It can find that, among all the four sets of comparisons, the
biggest relative error is only 3.53% while the smallest one even Except for method accuracy and speed, the method robustness
reaches 1.09%, indicating the method accuracy to a large extent. to different-sized images is also evaluated in this section, because
It should note that, in Fig. 9(a) and (b), the subsurface damage different optical microscopes usually output images with different
22 Y.J. Zhao et al. / Advances in Engineering Software 115 (2018) 17–25
Fig. 9. SSD depth comparison between the automatically-assessed and manually-measured ones.
resolutions. As seen in Fig. 11, although different-sized images are For the failure case 1 (see Fig. 12a1 for the input image and
employed as the input images, the proposed method can success- Fig. 12a2 for the failure detection result), the failure detection of
fully recognize and accurately measure nearly all the images, prov- subsurface cracks might probably be because of the overexposure
ing the wide method applicability to a large extent. during the microscope observation. In fact, it might be also hard
for human raw eyes to clearly recognize the subsurface cracks in
Fig. 12(a1), especially the crack edges and tips. Given that this fail-
ure can be avoided by adjusting the microscope observation illumi-
5. Failure case analysis
nation, this kind of failure detections is believed to be acceptable.
For the failure case 2 (see Fig. 12b1 for the input image and
Although the proposed method can successfully recognize the
Fig. 12b2 for the failure detection result), the scratch marks during
subsurface cracks for most micrographs, there are still some failure
the cross section polishing process interfere with the subsurface
cases and three typical examples are presented in Fig. 12.
Y.J. Zhao et al. / Advances in Engineering Software 115 (2018) 17–25 23
6. Conclusions
Fig. 11. Method robustness to different-sized input images (i.e. images with different resolutions).
24 Y.J. Zhao et al. / Advances in Engineering Software 115 (2018) 17–25
Fig. 12. Failure case analysis: orignal images and failure results because of (a1, a2) overexposure during the observation, (b1, b2) scratch marks during the cross section
polishing process, and (c1, c2) optical performance inhomogeneity due to the large-scaled fracture during the cross section polishing process.
ical features in the original image. This also means that, the [9] Ding W, Zhang L, Li Z, Zhu Y, Su H, Xu J. Review on grinding-induced residual
method did not require any prior knowledge of either mechan- stresses in metallic materials. Int J Adv Manuf Technol 2017;88(9):2939–68.
[10] Xi X, Ding W, Li Z, Xu J. High speed grinding of particulate reinforced titanium
ical grinding process or brittle material behaviors relating with matrix composites using a monolayer brazed cubic boron nitride wheel. Int J
subsurface cracks; Adv Manuf Technol 2017;90(5):1529–38.
[11] Zatočilová A, Paloušek D, Brandejs J. Image-based measurement of the
Based on above, the proposed method is expected to be mean- dimensions and of the axis straightness of hot forgings. Measurement
2016;94:254–64.
ing to both metrology equipment companies and optical glass [12] Du Z, Wu Z, Yang J. 3D measuring and segmentation method for hot heavy
manufacturers. forging. Measurement 2016;85:43–53.
[13] Zhao YJ, Yan YH, Song KC. Vision-based automatic detection of steel surface
defects in the cold rolling process: considering the influence of industrial liq-
uids and surface textures. Int J Adv Manuf Technol 2016;90(5):1–14.
Acknowledgments [14] Zhao YJ, Li HN, Song KC, Yan YH. In-situ and in-process monitoring of optical
glass grinding process based on image processing technique. Int J Adv Manuf
The authors acknowledge the supports from both the National Technol 2017 in Press. doi:10.10 07/s0 0170-017- 0743- x.
[15] Zhao YJ, Li HN, Da Zhu L, Yan YH. Machined brittle material surface
Natural Science Foundation of China in undertaking this research in grinding: modeling, experimental validation, and image-processing-based
work under the grant reference number of 51374063 and the surface analysis. Int J Adv Manuf Technol 2017 In press. doi:10.1007/
Fundamental Research Funds for the Central Universitiesunder s00170-017- 0712- 4.
[16] Gadelmawla ES. Computer vision algorithms for measurement and inspection
the grant reference numbers of N140303008, N141008001 and
of external screw threads. Measurement 2017;100:36–49.
N150308001. [17] Valença J, Puente I, Júlio E, González-Jorge H, Arias-Sánchez P. Assessment of
cracks on concrete bridges using image processing supported by laser scanning
survey. Constr Build Mater 2017;146:668–78.
References [18] Dogan G, Arslan MH, Ceylan M. Concrete compressive strength detection using
image processing based new test method. Measurement 2017;109:137–48.
[1] Hartmann P. Optical glass. USA: SPIE; 2014. [19] Shei H-J, Lin C-S. An optical automatic measurement method for the mois-
[2] King RI, Hahn RS. Handbook of modern grinding technology. USA: Springer; ture content of rough rice using image processing techniques. Comput Electron
2012. Agric 2012;85:134–9.
[3] Li HN, Yu TB, Da Zhu L, Wang WS. Evaluation of grinding-induced sub- [20] Mahdavipour B, Hatami A, Salar Elahi A. Results on plasma temperature mea-
surface damage in optical glass BK7. J Mater Process Technol 2016;229: surement using an image processing technique. Results Phys 2016;6:1008–11.
785–794. [21] Bonilla Riaño A, Rodriguez IH, Bannwart AC, Rodriguez OMH. Film thickness
[4] Yu TB, Li HN, Wang WS. Experimental investigation on grinding characteris- measurement in oil–water pipe flow using image processing technique. Exp
tics of optical glass BK7: with special emphasis on the effects of machining Therm Fluid Sci 2015;68:330–8.
parameters. Int J Adv Manuf Technol 2016;82:1405–19. [22] Mohmmed AO, Nasif MS, Al-Kayiem HH, Time RW. Measurements of transla-
[5] Li HN, Yu TB, Wang ZX, Da Zhu L, Wang WS. Detailed modeling of cut- tional slug velocity and slug length using an image processing technique. Flow
ting forces in grinding process considering variable stages of grain-workpiece Meas Instrum 2016;50:112–20.
micro interactions. International Journal of Mechanical Sciences 2017;126: [23] Kim Y-N, Kim JS, Park GC, Cho HK. Measurement of sliding bubble behavior on
319–339. a horizontal heated tube using a stereoscopic image processing technique. Int
[6] Li HN, Yu TB, Zhu LD, Wang WS. Analysis of loads on grinding wheel binder in J Multiphase Flow 2017;94:156–72.
grinding process: insights from discontinuum-hypothesis-based grinding sim- [24] Yu L, Pan B. Full-frame, high-speed 3D shape and deformation measurements
ulation. Int J Adv Manuf Technol 2015;78:1943–60. using stereo-digital image correlation and a single color high-speed camera.
[7] Li HN, Yu TB, Zhu LD, Wang WS. Modeling and simulation of grinding wheel by Opt Lasers Eng 2017;95:17–25.
discrete element method and experimental validation. Int J Adv Manuf Technol [25] Fu Y, Liu Y. Development of a robust image processing technique for bub-
2015;81(9-12):1921–38. bly flow measurement in a narrow rectangular channel. Int J Multiphase Flow
[8] Ding W, Linke B, Zhu Y, Li Z, Fu Y, Su H, et al. Review on monolayer 2016;84:217–28.
CBN superabrasive wheels for grinding metallic materials. Chin J Aeronaut
2017;30(1):109–34.
Y.J. Zhao et al. / Advances in Engineering Software 115 (2018) 17–25 25
[26] Fu Y, Liu Y. Experimental study of bubbly flow using image processing tech- [29] Jackway PT, Deriche M. Scale-space properties of the multiscale morphological
niques. Nucl Eng Des 2016;310:570–9. dilation-erosion. IEEE Trans Pattern Anal Mach Intell 1996;18(1):38–51.
[27] Manjón JV, Coupé P, Martí-Bonmatí L, Collins DL, Robles M. Adaptive non-lo- [30] Vincent L. Morphological grayscale reconstruction in image analysis: applica-
cal means denoising of MR images with spatially varying noise levels. J Magn tions and efficient algorithms. IEEE Trans Image Process 1993;2(2):176–201.
Reson Imaging 2010;31(1):192–203. [31] Bao P, Zhang L, Wu X. Canny edge detection enhancement by scale multiplica-
[28] Bezdek JC, Ehrlich R, Full W. FCM: the fuzzy c-means clustering algorithm. tion. IEEE Trans Pattern Anal Mach Intell 2005;27(9):1485–90.
Comput Geosci 1984;10(2-3):191–203.