圖像處理-撥碼開關的狀態識別

第一次寫博客，本文主要源於圖像處理大作業，不足之處，還望指正。

1. Introduction (5%)

     The task of the project is to find the dial-code switch in the figure below and calibrate the rectangular box, while displaying the dial code in the lower left corner.

     To solve the problem, first of all the image tilt correction to ensure that the dial code switch and the image edge parallel. The next step is to read the binary image of the dial code switch and calculate the coordinates of the pixel in the center of each binary region, so as to prepare for the next step of analyzing the status of the dial code switch and determine the status of the dial code switch according to the coordinate positions of "0" and "1". Finally, draw the target rectangle box and the bottom left rectangle box, fill in the converted number in the lower left rectangle.

2 Proposed approach (50%)

The proposed approach includes：

①Tilt correction of image.

②Mean filtering plus Binarization.

③The center position matrix of each binary region is calculated.

④Analyze the dial-code status.

⑤Draw rectangle.

⑥Draw the bottom left corner to fill the rectangle box and put in the Switch code.

2.1 Tilt correction of image

Hough transform is used to detect the straight line in the image and calculate the inclination Angle.

I1 = edge(I,'Sobel','horizontal') % Detect image edges

subplot(2,4,2); imshow(I1); title("邊緣檢測");

[H , T, R] = hough(I1,'Theta',-89:89); % Hough transform is used to detect straight lines

ccc = max(H); %Find the most likely inclination Angle of the line

[value, rot_theta] = max(ccc);

if rot_theta~=175                    %Robustness of the algorithm

    rot = rot_theta+270;

else

    rot = rot_theta;

end

I2 = imrotate(I,rot,'bilinear', 'loose'); %Tilt correction

subplot(2,4,3); imshow(I2); title("校正後的圖像");

2.2 Mean filtering plus Binarization

After using mean filtering to blur the edge information, the dial-code switch is separated from the background by binarization.

A=filter2(fspecial('average',9),I2); % Mean filtering

I4 = imbinarize(A,220); % Image binarization, threshold set to 220

subplot(2,4,4),imshow(I4);title("二值化");

2.3 The center position matrix of each binary region is calculated

Use Matlab's own function to find the center point of each dial-code switch area, and prepare for the subsequent 0,1 analysis.

B=bwboundaries(I4); %Find the edge matrix for I4

[L, n]=bwlabel(I4, 4); % Returns an L matrix of the same size as I4

stats = regionprops(L,'all'); %get the properties of region

Cen = cat(1, stats.Centroid);% Construct multidimensional array

b = Cen(:,2); %Returns the ordinate of the center point of each region

2.4 Analyze the dial-code status

According to the coordinates of the center point, the sum of the maximum and minimum values less than half is set as 1, otherwise set as 0.

C = zeros(1,n);

for i = 1:n

if  b(i)<(max(b)+min(b))/2

% Less than the halfway point is 1, and greater than the halfway point is 0

        C(i)=1;

    else

        C(i)=0;

    end

end

2.5 Draw rectangle

First, use the border function to detect the initial target position, and then use the Rectangle function to draw the Rectangle box

I0 = medfilt2(I); %Median filter fuzzy edge information

bw0 = imbinarize(I, graythresh(I0)); %A suitable threshold of the picture is found by using the most large class variance method, that is the threshold of binarization.

bw0= bwareaopen(bw0,50,4); %Delete smaller objects in binary images

B0=bwboundaries(bw0); %Gets the outline of bw0

[L0, n0]=bwlabel(bw0, 4); %Returns an L0 matrix of the same size as bw0

subplot(2,4,5),imshow(I);title("結果");

hold on;

for i=1:1:n0

  boundary1=B0{i};

rectangle('position',[min(boundary1(:,2))-5,min(boundary1(:,1))-2,...

    10+max(boundary1(:,2))-min(boundary1(:,2)),...

    5+max(boundary1(:,1))-min(boundary1(:,1))],'edgecolor','b')

end             %Draws the target rectangle box

2.6 Draw the bottom left corner to fill the rectangle box and put in the Switch code

Draw and fill the bottom left Rectangle using the Rectangle function, and put the transformed code into it.

rectangle('position',[0,432,500,50],'edgecolor','r') %Draws the bottom left rectangle

fill([0,0,520,520],[432,482,482,432],'b')% Fill the rectangle with blue

Switch_code = num2str(C);

str = ['Switch code: ',Switch_code];

text(0,455,str,'FontSize',8)  %Fill in the switch code

3 Experimental results and analysis (40%)

To validate the accuracy of the algorithm, the intermediate process image is shown.

Figure 1 is the image after edge detection. It is obvious to see the two lines in the figure. In addition, Roberts, Prewitt, Log and Canny operators are also tried, and the performance of Prewitt and sobel operators is approximately the same, while other operators perform poorly.

Figure 2 shows a rotated corrected image with the dial code switch in the correct horizontal position. The effect of hough transform on line detection is verified.

In figure 3, gaussian filter is used to blur the edges, which facilitates the next step of extracting the target-dial-code switch.

Figure 4 shows the dial-code switch after binarization. It is obvious to see the status of the dial-code switch.

The processing results of the last four images were all accurate. Meanwhile, see table 1, in order to test the time consumption of the algorithm, I conducted 10 tests on the four images, and the average value obtained was 0.440, 0.117, 0.423 and 0.416 (s), respectively. For general assembly operations, can be fully satisfied to go.

The shortcoming of this algorithm lies in the fact that hough_transform used in the image correction process fails to deal with all images successfully. If the least-square method is used to calculate the inclination Angle, the result may be better.

4 Conclusion (2%)

In order to read the dial-code switch state, this paper proposes a method based on hough transform. The method of image do first tilt correction, make the dial the code switch located at the state level after correction. After using the binary to dial the code switch and background separation, finally successfully read dial the code switch state.

clear;
clc;
close all;
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%修改於2019年11月16日
%作者：指尖琴韻
%目的：識別撥碼開關狀態並顯示
%參考：1、博客：https://blog.csdn.net/Joseph__Lagrange/article/details/96099117
%2、博客：https://blog.csdn.net/qq_27901091/article/details/77878238
%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%%
%%
%原圖對比
tic
I = imread('4.png');
subplot(2, 4, 1); imshow(I);title('原圖');
 
%%
%圖像傾斜校正
I1 = edge(I,'sobel','horizontal');
subplot(2,4,2); imshow(I1); title("邊緣檢測");
[H,T,R] = hough(I1,'Theta',-89:89); %霍夫變換檢測直線
ccc = max(H);
[value, rot_theta] = max(ccc);
if rot_theta~=175
    rot = rot_theta+270;
else
    rot = rot_theta;
end
I2 = imrotate(I,rot,'bicubic', 'loose');%傾斜校正 
subplot(2,4,3); imshow(I2); title("校正後的圖像");
%%
%二值化
A=filter2(fspecial('average',9),I2); %均值濾波
I4 = imbinarize(A,220); %對圖像二值化，閾值設為220
subplot(2,4,4),imshow(I4);title("二值化後的圖像");
%%
%計算每塊二值化區域後的中心位置坐標矩陣
B=bwboundaries(I4); 
[L, n]=bwlabel(I4, 4);
stats = regionprops(L,'all');
Cen = cat(1, stats.Centroid);
b = Cen(:,2);
%%
%0，1分析
C = zeros(1,n);
for i = 1:n
    if  b(i)<(max(b)+min(b))/2
        C(i)=1;
    else
        C(i)=0;
    end
end
%%
%為目標矩形框做參數準備
I0 = medfilt2(I); 
bw0 = imbinarize(I, graythresh(I0));
bw0= bwareaopen(bw0,50,4);
B0=bwboundaries(bw0);
[L0, n0]=bwlabel(bw0, 4);
%%
%繪製矩形框
subplot(2,4,5),imshow(I);title("結果");
hold on;
for i=1:1:n0
  boundary1=B0{i};
rectangle('position',[min(boundary1(:,2))-5,min(boundary1(:,1))-2,...
    10+max(boundary1(:,2))-min(boundary1(:,2)),...
    5+max(boundary1(:,1))-min(boundary1(:,1))],'edgecolor','b')
end
%%
%繪製左下角填充矩形框
rectangle('position',[0,432,500,50],'edgecolor','r')
fill([0,0,520,520],[432,482,482,432],'b')
%%
%繪製Switch code
Switch_code = num2str(C);
str = ['Switch code: ',Switch_code];
text(0,455,str,'FontSize',8)
%%
toc