[1]余厚云,王慧青,张辉,等.产品表面质量视觉检测中的相机位姿自动校准[J].东南大学学报(自然科学版),2020,50(5):942-949.[doi:10.3969/j.issn.1001-0505.2020.05.021]
　Yu Houyun,Wang Huiqing,Zhang Hui,et al.Automatic calibration of camera pose in visual inspection of product surface quality[J].Journal of Southeast University (Natural Science Edition),2020,50(5):942-949.[doi:10.3969/j.issn.1001-0505.2020.05.021]
点击复制

产品表面质量视觉检测中的相机位姿自动校准()
分享到：

《东南大学学报(自然科学版)》[ISSN:1001-0505/CN:32-1178/N]

卷:
50
期数:
2020年第5期
页码:
942-949
栏目:
机械工程
出版日期:
2020-09-20

文章信息/Info

Title:
Automatic calibration of camera pose in visual inspection of product surface quality
作者:
余厚云1; 2; 王慧青3; 张辉1; 胡玉坤3
1 南京航空航天大学机电学院, 南京 210016; 2 南京航空航天大学无锡研究院, 无锡 214187; 3 东南大学仪器科学与工程学院, 南京 210096
Author(s):
Yu Houyun1; 2;  Wang Huiqing3;  Zhang Hui1;  Hu Yukun3
1 College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China
2 Wuxi Institute, Nanjing University of Aeronautics and Astronautics, Wuxi 214187, China
3 School of Instrument Science and Engineering, Southeast University, Nanjing 210096, China
关键词:
表面质量;  相机位姿校准;  灰度分布;  视觉检测;  自动对焦;  手眼标定;  机械臂
Keywords:
surface quality;  calibration of camera pose;  gray distribution;  vision detection;  autofocus;  hand-eye calibration;  manipulator
分类号:
TH161.14;TP206
DOI:
10.3969/j.issn.1001-0505.2020.05.021
摘要:
为解决产品表面质量视觉检测中因图像几何特征不足而导致的相机位姿无法校准问题,提出了一种基于图像灰度分布的相机位姿自动校准方法.首先将相机安装于机械臂末端,标定出机械臂末端坐标系与相机坐标系间的转换关系;然后采集相机处于不同位姿下的产品表面图像,在图像感兴趣区域内建立极坐标系,并根据图像灰度与极角之间的分布关系计算出灰度分布轴线的位置,以引导机械臂带动相机作姿态调整;最后再根据图像清晰度评价值控制机械臂沿相机光轴方向平移至正焦位置,最终实现相机位姿校准.以汽车涡轮壳零件为被测对象进行了相机位姿校准试验,图像中感兴趣区域两侧的灰度差值由119降低至4,图像清晰度评价值达到极大值150.90,相机经位姿校准后采集到了准确、清晰的零件表面图像.
Abstract:
To solve the problem that the camera pose cannot be calibrated due to insufficient geometric features of images in the visual inspection of the surface quality, an automatic calibration method of the camera pose is proposed based on the image gray distribution. Firstly, with the camera installed at the end of the manipulator, the transformation relationship between the coordinate system of the manipulator end and the camera coordinate system is calibrated. Then, the product surface images with different camera positions are taken, and the polar coordinate system is established in the region of interest. According to the distribution relationship between image gray and polar angle, the position of the gray distribution axis is calculated to guide the manipulator and drive the camera to make attitude adjustment. Finally, according to the evaluation value of image clarity, the manipulator is controlled to move along the optical axis of the camera to the positive focus position, and the calibration of camera pose is completed. Tests were carried out on automobile turbine housing. The gray difference between two sides of the region of interest is reduced from 119 to 4, and the maximum value of image clarity reaches 150.90. A clear and accurate image of the part surface is obtained after the calibration.

参考文献/References:

[1] Ramalingam B, Manuel V H, Elara M R, et al. Visual inspection of the aircraft surface using a teleoperated reconfigurable climbing robot and enhanced deep learning technique[J].International Journal of Aerospace Engineering, 2019, 2019: 1-14. DOI:10.1155/2019/5137139.
[2] 王冲. 轮胎表面缺陷检测系统的研制[D]. 成都: 电子科技大学, 2019.
　　Wang C.Research of detecting system for tyre surface defect[D]. Chengdu: University of Electronic Science and Technology of China, 2019.(in Chinese)
[3] 雷金周, 曾令斌, 叶南. 工业机器人单目视觉对准技术研究[J]. 光学 精密工程, 2018, 26(3): 733-741. DOI:10.3788/ope.20182603.0733.
Lei J Z, Zeng L B, Ye N. Research on industrial robot alignment technique with monocular vision[J].Optics and Precision Engineering, 2018, 26(3): 733-741. DOI:10.3788/ope.20182603.0733. (in Chinese)
[4] 任梦晴. 自动对接检测定位技术研究[D]. 北京: 北京理工大学, 2015.
　　Ren M Q.Detection technology for positioning in automatic joint[D]. Beijing: Beijing Institute of Technology, 2015.(in Chinese)
[5] Tongloy T, Boonsang S. An image-based visual servo control system based on an eye-in-hand monocular camera for autonomous robotic grasping[C]//2016 International Conference on Instrumentation, Control and Automation. Bandung, Indonesia, 2016: 132-136. DOI:10.1109/ICA.2016.7811489.
[6] Zhan Q, Wang X. Hand-eye calibration and positioning for a robot drilling system[J].The International Journal of Advanced Manufacturing Technology, 2012, 61(5/6/7/8): 691-701. DOI:10.1007/s00170-011-3741-4.
[7] Xue J H, Titterington D M. T-test, F-test and Otsu’s methods for image thresholding[J]. IEEE Transactions on Image Processing, 2011, 20(8): 2392-2396. DOI:10.1109/TIP.2011.2114358.
[8] Kapur J N, Sahoo P K, Wong A K C. A new method for gray-level picture thresholding using the entropy of the histogram[J].Computer Vision, Graphics, and Image Processing, 1985, 29(3): 273-285. DOI:10.1016/0734-189X(85)90125-2.
[9] Sezgin M, Sankur B. Survey over image thresholding techniques and quantitative performance evaluation[J]. Journal of Electronic Imaging, 2004, 13(1): 146-168. DOI:10.1117/1.1631315.
[10] Kim S K, Paik J K. Out-of-focus blur estimation and restoration for digital auto-focusing system[J].Electronics Letters, 1998, 34(12): 1217-1219. DOI:10.1049/el:19980762.
[11] 金雪, 马卫红. 图像调焦过程的清晰度评价函数研究[J]. 光学仪器, 2012, 34(1): 59-64. DOI:10.3969/j.issn.1005-5630.2012.01.012.
Jin X, Ma W H. Study on image definition evaluation function in auto-focusing process[J].Optical Instruments, 2012, 34(1): 59-64. DOI:10.3969/j.issn.1005-5630.2012.01.012. (in Chinese)
[12] 张丰收, 李斯文, 胡志刚, 等. 一种改进的Sobel梯度函数自动对焦评价算法[J]. 光学技术, 2017, 43(3): 234-238. DOI:10.13741/j.cnki.11-1879/o4.2017.03.009.
Zhang F S, Li S W, Hu Z G, et al. An improved auto-focus evaluating algorithm based on Sobel gradient function[J].Optical Technique, 2017, 43(3): 234-238. DOI:10.13741/j.cnki.11-1879/o4.2017.03.009. (in Chinese)
[13] Yang C P, Chen M H, Zhou F F, et al. Accurate and rapid auto-focus methods based on image quality assessment for telescope observation[J].Applied Sciences, 2020, 10(2): 658-671. DOI:10.3390/app10020658.
[14] Yazdanfar S, Kenny K B, Tasimi K, et al. Simple and robust image-based autofocusing for digital microscopy[J].Optics Express, 2008, 16(12): 8670-8677. DOI:10.1364/oe.16.008670.
[15] 姚松, 曹丹华, 吴裕斌. 图像信息量的变化对自动对焦评价函数的影响[J]. 光电工程, 2006, 33(5): 81-84,90.DOI:10.3969/j.issn.1003-501X.2006.05.018.
Yao S, Cao D H, Wu Y B. Performance of autofocus judgements in different quantity of information series images[J].Opto-Electronic Engineering, 2006, 33(5): 81-84,90. DOI:10.3969/j.issn.1003-501X.2006.05.018. (in Chinese)
[16] 赵秋玲, 赵建森, 蒋永华. 改进DCT的自动聚焦算法[J]. 中国图象图形学报, 2007, 12(7): 1206-1208.DOI:10.3969/j.issn.1006-8961.2007.07.011.
Zhao Q L, Zhao J S, Jiang Y H. Auto focus algorithm using modified DCT[J].Journal of Image and Graphics, 2007, 12(7): 1206-1208. DOI:10.3969/j.issn.1006-8961.2007.07.011. (in Chinese)
[17] Ng Kuang Chern N, Neow P A, Ang M H. Practical issues in pixel-based autofocusing for machine vision[C]// Proceedings of 2001 IEEE International Conference on Robotics and Automation. Seoul, South Korea, 2001: 2791-2796. DOI:10.1109/ROBOT.2001.933045.
[18] Angeles J, Soucy G, Ferrie F P. The online solution of the hand-eye problem[J].IEEE Transactions on Robotics and Automation, 2000, 16(6): 720-731. DOI:10.1109/70.897783.
[19] 程玉立. 面向工业应用的机器人手眼标定与物体定位[D]. 杭州: 浙江大学, 2016.
　　Cheng Y L.Hand-eye calibration and object localization for industrial robotic application[D]. Hangzhou: Zhejiang University, 2016.(in Chinese)
[20] Tsai R Y, Lenz R K. A new technique for fully autonomous and efficient 3D robotics hand/eye calibration[J].IEEE Transactions on Robotics and Automation, 1989, 5(3): 345-358. DOI:10.1109/70.34770.
[21] Shiu Y C, Ahmad S. Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX=XB[J]. IEEE Transactions on Robotics and Automation, 1989, 5(1): 16-29. DOI:10.1109/70.88014.

备注/Memo

备注/Memo:
收稿日期: 2020-04-17.
作者简介: 余厚云(1975—),男,博士,讲师,meehyyu@nuaa.edu.cn.
基金项目: 国家自然科学基金资助项目(51975293).
引用本文: 余厚云,王慧青,张辉,等.产品表面质量视觉检测中的相机位姿自动校准[J].东南大学学报(自然科学版),2020,50(5):942-949. DOI:10.3969/j.issn.1001-0505.2020.05.021.
更新日期/Last Update: 2020-09-20