使用fft2重塑整形RGB滤镜

Question

I want to apply a filter on an image, for example, blurring filter [[1/9.0, 1/9.0, 1/9.0], [1/9.0, 1/9.0, 1/9.0], [1/9.0, 1/9.0, 1/9.0]] .

Also, I'd like to use the approach that convolution in Spatial domain is equivalent to multiplication in Frequency domain.

So, my algorithm will be like.

1. Load Image.
2. Create Filter.
3. convert both Filter & Image to Frequency domains.
4. multiply both.
5. reconvert the output to Spatial Domain and that should be the required output.

The following is the basic code I use, the image is loaded and displayed as cv.cvmat object.

Image is a class of my creation, it has a member image which is an object of scipy.matrix and toFrequencyDomain(size = None) uses spf.fftshift(spf.fft2(self.image, size)) where spf is scipy.fftpack and dotMultiply(img) uses scipy.multiply(self.image, image)

f = Image.fromMatrix([[1/9.0, 1/9.0, 1/9.0],
          [1/9.0, 1/9.0, 1/9.0],
          [1/9.0, 1/9.0, 1/9.0]])
lena = Image.fromFile("Test/images/lena.jpg")
print lena.image.shape
lenaf = lena.toFrequencyDomain(lena.image.shape)
ff = f.toFrequencyDomain(lena.image.shape)
lenafm = lenaf.dotMultiplyImage(ff)
lenaff = lenafm.toTimeDomain()
lena.display()
lenaff.display()

So, the previous code works pretty well, if I told OpenCV to load the image via GRAY_SCALE.

However, if I let the image to be loaded in color ... lena.image.shape will be (512, 512, 3) ..

so, it gives me an error when using scipy.fttpack.ftt2 saying "When given, Shape and Axes should be of same length" .

What I tried next was converted my filter to 3-D .. as

[[[1/9.0, 1/9.0, 1/9.0], 
  [1/9.0, 1/9.0, 1/9.0], 
  [1/9.0, 1/9.0, 1/9.0]],
 [[1/9.0, 1/9.0, 1/9.0], 
  [1/9.0, 1/9.0, 1/9.0], 
  [1/9.0, 1/9.0, 1/9.0]],
 [[1/9.0, 1/9.0, 1/9.0], 
  [1/9.0, 1/9.0, 1/9.0], 
  [1/9.0, 1/9.0, 1/9.0]]]

And, not knowing what the axes argument do, I added it with random numbers as (-2, -1, -1), (-1, -1, -2), .. etc. until it gave me the correct filter output shape for the dotMultiply to work.

But, of course it wasn't the correct value. Things were totally worse.

My final trial, was using fft2 function on each of the components 2-D matrices, and then re-making the 3-D one, using the following code.

# Spiltting the 3-D matrix to three 2-D matrices.
for i, row in enumerate(self.image):
            r.append(list())
            g.append(list())
            b.append(list())
            for pixel in row:
                r[i].append(pixel[0])
                g[i].append(pixel[1])
                b[i].append(pixel[2])
        rfft = spf.fftshift(spf.fft2(r, size)) 
        gfft = spf.fftshift(spf.fft2(g, size)) 
        bfft = spf.fftshift(spf.fft2(b, size))
        newImage.image = sp.asarray([[[rfft[i][j], gfft[i][j], bfft[i][j]] for j in xrange(len(rfft[i]))] for i in xrange(len(rfft))] )
        return newImage

Any help on what I made wrong, or how can I achieve that for both GreyScale and Coloured pictures.

Answer 1

最简单的解决方案是将图像分割成单独的r / g / b图像并独立过滤每个图像。

Answer 2

You are headed in the right direction at the end where you split the 3D matrix into three 2D matrices. Here is how I would do it - obviously this is untested (I don't have your Image class, etc.), but it should give you a good start:

for i, channel in enumerate(self.image):
    channel_ = spf.fftshift(spf.fft2(channel)) # take FFT of each channel (r,g,b) separately
    channel_ = scipy.multiply(channel_,ff) # multiply each channel by the filter (freq. domain)
    filtered_image[:][:][i] = spf.fftshift(spf.ifft2(channel_)) # inverse FFT each channel separately