[英]Improve rectangle contour detection in image using OpenCV
I am trying to detect the rectangular boxes in the given image 我试图检测给定图像中的矩形框
Original image: 原始图片:
but the image is not good enough to detect rectangles, how can i improve it and detect all the rectangles in image?
但是图像不足以检测矩形,我如何改进它并检测图像中的所有矩形?
I tried to convert the image into binary image using canny edge detection and applied dilation ,bilateral filter then the output is this: 我尝试使用canny边缘检测并应用扩张,双边滤波器将图像转换为二进制图像,然后输出为:
I tried to apply all the morphologyEx, sobel then to i was not able to detect all rectangles in the image. 我试图应用所有的formaEx,sobel然后我无法检测到图像中的所有矩形。 If i am able to find all the boundary of rectangle then i can detect all rectangles using find countours but how can i improve image to detect all the rectangles.
如果我能够找到矩形的所有边界,那么我可以使用查找计数检测所有矩形,但我如何改善图像以检测所有矩形。
The code for the given conversion is given below 给定转换的代码如下
img = cv2.imread("givenimage.png",0)
img = cv2.resize(img,(1280,720))
edges = cv2.Canny(img,100,200)
kernal = np.ones((2,2),np.uint8)
dilation = cv2.dilate(edges, kernal , iterations=2)
bilateral = cv2.bilateralFilter(dilation,9,75,75)
contours, hireracy = cv2.findContours(bilateral,cv2.RETR_EXTERNAL, cv2.CHAIN_APPROX_NONE)
for i,contour in enumerate(contours):
approx = cv2.approxPolyDP(contour, 0.01*cv2.arcLength(contour,True),True)
if len(approx) ==4:
X,Y,W,H = cv2.boundingRect(approx)
aspectratio = float(W)/H
if aspectratio >=1.2 :
box = cv2.rectangle(img, (X,Y), (X+W,Y+H), (0,0,255), 2)
cropped = img[Y: Y+H, X: X+W]
cv2.drawContours(img, [approx], 0, (0,255,0),5)
x = approx.ravel()[0]
y = approx.ravel()[1]
cv2.putText(img, "rectangle"+str(i), (x,y),cv2.FONT_HERSHEY_COMPLEX, 0.5, (0,255,0))
cv2.imshow("image",img)
cv2.waitKey(0)
cv2.destroyAllWindows()
Output of the following program detects only 8 rectangles: 以下程序的输出仅检测8个矩形:
but i need to detect all the rectangles present in the image 但我需要检测图像中存在的所有矩形
1) Can I increase the thickness of the image for all the black pixels in this: 1)我可以增加所有黑色像素的图像厚度:
2) Can I dilate all the pixel region between the white boundary of the 2)我可以扩大白色边界之间的所有像素区域
Here's a simple approach: 这是一个简单的方法:
Canny edge detection Canny边缘检测
Results 结果
import cv2
image = cv2.imread('1.png')
gray = cv2.cvtColor(image, cv2.COLOR_BGR2GRAY)
blurred = cv2.GaussianBlur(gray, (3, 3), 0)
canny = cv2.Canny(blurred, 120, 255, 1)
# Find contours
cnts = cv2.findContours(canny, cv2.RETR_EXTERNAL, cv2.CHAIN_APPROX_SIMPLE)
cnts = cnts[0] if len(cnts) == 2 else cnts[1]
# Iterate thorugh contours and draw rectangles around contours
for c in cnts:
x,y,w,h = cv2.boundingRect(c)
cv2.rectangle(image, (x, y), (x + w, y + h), (36,255,12), 2)
cv2.imshow('canny', canny)
cv2.imshow('image', image)
cv2.imwrite('canny.png', canny)
cv2.imwrite('image.png', image)
cv2.waitKey(0)
Your thoughts are right, but on first stage you can use threshold
operation. 你的想法是正确的,但在第一阶段你可以使用
threshold
操作。 Then find contours. 然后找到轮廓。 Then
minAreaRect
operation on founded contours. 然后对创建的轮廓进行
minAreaRect
操作。
Edit: 编辑:
Result and code(c++): 结果和代码(c ++):
Mat img = imread("/Users/alex/Downloads/MyPRI.png", IMREAD_GRAYSCALE);
Mat img2;
threshold(img, img2, 220, 255, THRESH_BINARY);
Mat element = getStructuringElement(MORPH_CROSS, Size(3, 3), Point(1, 1));
erode(img2, img2, element); // without it find contours fails on some rects
imshow("img", img);
imshow("img2", img2);
waitKey();
// preprocessing done, search rectanges
vector<vector<Point> > contours;
vector<Vec4i> hierarchy;
findContours(img2, contours, hierarchy, CV_RETR_TREE, CV_CHAIN_APPROX_SIMPLE);
vector<RotatedRect> rects;
for (int i = 0; i < contours.size(); i++) {
if (hierarchy[i][2] > 0) continue;
// capture inner contour
RotatedRect rr = minAreaRect(contours[i]);
if (rr.size.area() < 100) continue; // too small
rr.size.width += 8;
rr.size.height += 8; // expand to outlier rect if needed
rects.push_back(rr);
}
Mat debugImg;
cvtColor(img, debugImg, CV_GRAY2BGR);
for (RotatedRect rr : rects) {
Point2f points[4];
rr.points(points);
for (int i = 0; i < 4; i++) {
int ii = (i + 1) % 4;
line(debugImg, points[i], points[ii], CV_RGB(255, 0, 0), 2);
}
}
imshow("debug", debugImg);
waitKey();
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.