How to compute Discrete Fourier Transform?
Asked Answered
D

1

6

I've been trying to find some places to help me better understand DFT and how to compute it but to no avail. So I need help understanding DFT and it's computation of complex numbers.

Basically, I'm just looking for examples on how to compute DFT with an explanation on how it was computed because in the end, I'm looking to create an algorithm to compute it.

Dynamiter answered 14/10, 2014 at 5:6 Comment(1)
take a look here paulbourke.net/miscellaneous/dftGigue
P
13

I assume 1D DFT/IDFT ...

All DFT's use this formula:

DFT equation

  • X(k) is transformed sample value (complex domain)
  • x(n) is input data sample value (real or complex domain)
  • N is number of samples/values in your dataset

This whole thing is usually multiplied by normalization constant c. As you can see for single value you need N computations so for all samples it is O(N^2) which is slow.

Here mine Real<->Complex domain DFT/IDFT in C++ you can find also hints on how to compute 2D transform with 1D transforms and how to compute N-point DCT,IDCT by N-point DFT,IDFT there.

Fast algorithms

There are fast algorithms out there based on splitting this equation to odd and even parts of the sum separately (which gives 2x N/2 sums) which is also O(N) per single value, but the 2 halves are the same equations +/- some constant tweak. So one half can be computed from the first one directly. This leads to O(N/2) per single value. if you apply this recursively then you get O(log(N)) per single value. So the whole thing became O(N.log(N)) which is awesome but also adds this restrictions:

All DFFT's need the input dataset is of size equal to power of two !!!

So it can be recursively split. Zero padding to nearest bigger power of 2 is used for invalid dataset sizes (in audio tech sometimes even phase shift). Look here:

Complex numbers

  • c = a + i*b
  • c is complex number
  • a is its real part (Re)
  • b is its imaginary part (Im)
  • i*i=-1 is imaginary unit

so the computation is like this

addition:

c0+c1=(a0+i.b0)+(a1+i.b1)=(a0+a1)+i.(b0+b1)

multiplication:

c0*c1=(a0+i.b0)*(a1+i.b1)
     =a0.a1+i.a0.b1+i.b0.a1+i.i.b0.b1
     =(a0.a1-b0.b1)+i.(a0.b1+b0.a1)

polar form

a = r.cos(θ)
b = r.sin(θ)
r = sqrt(a.a + b.b)
θ = atan2(b,a)
a+i.b = r|θ

sqrt

sqrt(r|θ) = (+/-)sqrt(r)|(θ/2)
sqrt(r.(cos(θ)+i.sin(θ))) = (+/-)sqrt(r).(cos(θ/2)+i.sin(θ/2))

real -> complex conversion:

complex = real+i.0

[notes]

[edit1] Also I strongly recommend to see this amazing video (I just found):

It describes the (D)FT in geometric representation. I would change some minor stuff in it but still its amazingly simple to understand.

Paleogeography answered 14/10, 2014 at 7:59 Comment(4)
Hi! Do you have any ideas for when input size is not a power of 2?Crosby
@ChongxuRen upsize the data set and zero padPaleogeography
I don't think that's right. Adding new data will change $W_N$. More advanced techniques are required in this problem. math.stackexchange.com/questions/77118/non-power-of-2-ffts#Crosby
@ChongxuRen I am using FFT and NTT mostly for arbitrary and big arithmetics and final results (in time domain) using simple zero-padding are correct. Of coarse for different purposes where you need exact value in frequency domain you're right.Paleogeography

© 2022 - 2024 — McMap. All rights reserved.