Nyquist ISI criterion

If we denote the channel impulse response as ${\displaystyle h(t)}$, then the condition for an ISI-free response can be expressed as:

${\displaystyle h(nT_{s})={\begin{cases}1;&n=0\\0;&n\neq 0\end{cases}}}$

for all integers ${\displaystyle n}$, where ${\displaystyle T_{s}}$ is the symbol period. The Nyquist theorem says that this is equivalent to:

${\displaystyle {\frac {1}{T_{s}}}\sum _{k=-\infty }^{+\infty }H\left(f-{\frac {k}{T_{s}}}\right)=1\quad \forall f}$,

where ${\displaystyle H(f)}$ is the Fourier transform of ${\displaystyle h(t)}$. This is the Nyquist ISI criterion.

This criterion can be intuitively understood in the following way: frequency-shifted replicas of ${\displaystyle H(f)}$ must add up to a constant value. This condition is satisfied when ${\displaystyle H(f)}$ spectrum has even symmetry, has bandwidth less than or equal to ${\displaystyle 2/T_{s}}$, and its single-sideband has odd symmetry at the cutoff frequency ${\displaystyle \pm 1/2T_{s}}$.

In practice this criterion is applied to baseband filtering by regarding the symbol sequence as weighted impulses (Dirac delta function). When the baseband filters in the communication system satisfy the Nyquist criterion, symbols can be transmitted over a channel with flat response within a limited frequency band, without ISI. Examples of such baseband filters are the raised-cosine filter, or the sinc filter as the ideal case.

To derive the criterion, we first express the received signal in terms of the transmitted symbol and the channel response. Let the function h(t) be the channel impulse response, x[n] the symbols to be sent, with a symbol period of T_s; the received signal y(t) will be in the form (where noise has been ignored for simplicity):

${\displaystyle y(t)=\sum _{n=-\infty }^{\infty }x[n]\cdot h(t-nT_{s})}$.

Sampling this signal at intervals of T_s, we can express y(t) as a discrete-time equation:

${\displaystyle y[k]=y(kT_{s})=\sum _{n=-\infty }^{\infty }x[n]\cdot h[k-n]}$.

If we write the h[0] term of the sum separately, we can express this as:

${\displaystyle y[k]=x[k]\cdot h[0]+\sum _{n\neq k}x[n]\cdot h[k-n]}$,

and from this we can conclude that if a response h[n] satisfies

${\displaystyle h[n]={\begin{cases}1;&n=0\\0;&n\neq 0\end{cases}}}$,

only one transmitted symbol has an effect on the received y[k] at sampling instants, thus removing any ISI. This is the time-domain condition for an ISI-free channel. Now we find a frequency-domain equivalent for it. We start by expressing this condition in continuous time:

${\displaystyle h(nT_{s})={\begin{cases}1;&n=0\\0;&n\neq 0\end{cases}}}$

for all integer ${\displaystyle n}$. We multiply such a h(t) by a sum of Dirac delta function (impulses) ${\displaystyle \delta (t)}$ separated by intervals T_s This is equivalent of sampling the response as above but using a continuous time expression. The right side of the condition can then be expressed as one impulse in the origin:

${\displaystyle h(t)\cdot \sum _{k=-\infty }^{+\infty }\delta (t-kT_{s})=\delta (t)}$

Fourier transforming both members of this relationship we obtain:

${\displaystyle H\left(f\right)*{\frac {1}{T_{s}}}\sum _{k=-\infty }^{+\infty }\delta \left(f-{\frac {k}{T_{s}}}\right)=1}$

and

${\displaystyle {\frac {1}{T_{s}}}\sum _{k=-\infty }^{+\infty }H\left(f-{\frac {k}{T_{s}}}\right)=1}$.

This is the Nyquist ISI criterion and, if a channel response satisfies it, then there is no ISI between the different samples.

• Nyquist rate
• Pulse shaping
• Root-raised-cosine filter
• Harry Nyquist

• John G. Proakis, "Digital Communications, 3rd Edition", McGraw-Hill Book Co., 1995. ISBN 0-07-113814-5
• Behzad Razavi, "RF Microelectronics", Prentice-Hall, Inc., 1998. ISBN 0-13-887571-5