Information Capacity

INFORMATION
CAPACITY
Prepared by: Mary Jean A. Bantan, ECE
Information Theory
■ Information theorists seek to determine

mathematically the likelihood that a given amount of
data being transmitted under a given set of
circumstances (e.g., medium, bandwidth, speed of
transmission, noise, and distortion) will be
transmitted accurately.
Channel Capacity
Channel
•It is a communication path through
which data or information can be send
from one node to another node.
Channel Capacity
•The maximum rate at which data can
be transmitted over a communication
path or channel.
Channel Capacity
DATA RATE LIMITS

§ The maximum data rate limit over a
medium is decided by following
factors:
1.Bandwidth of channel.
2.Signal levels
3.Channel quality (level of noise)
Channel Capacity
Hartley’s Law
➢ It shows that information capacity is a linear function of bandwidth
and transmission time and is directly proportional to both.
or 𝑰 = 𝒌𝒕𝑩
where:
I = information capacity (bits per second)
k = a constant that depends on the modulation scheme and the signal-to-
noise ratio
B = bandwidth (hertz)
t = transmission time (seconds)
Channel Capacity
Two theoretical formulas were

developed to calculate the data rate:
1.For noiseless channel - Nyquist bit

rate
2.For noisy channel - Shannon capacity.
Nyquist Theorem
■ Nyquist theorem states that “to produce the original analog
signal, the sample rate must be at least twice the highest
frequency in the original signal”.
𝒇𝑵 = 𝟐𝒇𝒎𝒂𝒙
where:
𝒇𝑵 = Nyquist Frequency
𝒇𝒎𝒂𝒙 = highest frequency in the original signal
Nyquist Theorem
Example:
A pure tone at 1kHz is to be sampled at the lowest
possible rate for transmission as pulses. Calculate the
minimum sampling frequency required to ensure that all
components of the wave are restored at the receiver.
Noiseless Channel: Nyquist Bit Rate
■ For a noiseless channel, the Nyquist bit rate formula defines

the theoretical maximum bit rate
𝑪 = 𝟐𝑩𝒍𝒐𝒈𝟐 𝑴
where:
C = information capacity in bits per second (bps)
B = channel bandwidth in hertz (Hz)
M = number of possible states per symbol
Noiseless Channel:
Nyquist Bit Rate
Example:
Consider a noiseless channel with a
bandwidth of 3000 Hz transmitting a
signal with four signal levels. What is
the maximum bit rate?
Noiseless Channel:
Nyquist Bit Rate
Example:
We need to send 265 kbps over a
noiseless channel with a bandwidth
of 20 kHz. How many signal levels do
we need?
Noisy Channel: Shannon Capacity
■ Claude Shannon introduced a formula, called the Shannon

capacity, to determine the theoretical highest data rate for a
noisy channel:
𝑺 𝑺
𝑪 = 𝑩𝒍𝒐𝒈𝟐 𝟏 + or 𝑪 = 𝟑. 𝟑𝟐𝑩𝒍𝒐𝒈𝟏𝟎 𝟏 +
𝑵 𝑵
where:
𝑆
= signal-to-noise power ratio (unitless)
𝑁
Noisy Channel: Shannon
Capacity
Example:
Consider an extremely noisy channel in
which the value of the signal-to-noise
ratio is almost zero. In other words,
the noise is so strong that the signal
is faint. What is channel the
capacity?
Noisy Channel: Shannon
Capacity
Example:
A telephone line normally has a
bandwidth of 3000 Hz (300 to 3300
Hz) assigned for data
communications. The signal- to-noise
ratio is usually 3162. What is the
channel capacity?
Noisy Channel: Shannon Capacity
Example:
The signal-to-noise ratio is often given in decibels.
Assume that S/N(dB) = 36 and the channel bandwidth is 2
MHz. What is the theoretical channel capacity?
M-ary Encoding
■ It is a higher-than-binary encoding where M corresponds to the

number of conditions, levels, or combinations possible for a
given number of binary variables.
■ It is expressed mathematically as:
𝑵 = 𝒍𝒐𝒈𝟐 𝑴 or 𝑴 = 𝟐𝑵
where:
N = number of bits necessary
M =number of conditions, levels, or combinations possible
with N bits
M-ary Encoding
Example:
How many bits would be required to
completely distinguish the 88 keys of
a piano?
Baud Rate
■ Baud refers to the maximum number of signal elements or
carrier states that a device can transmit in one second.
𝟏 𝒃𝒊𝒕 𝒓𝒂𝒕𝒆
𝑩𝒂𝒖𝒅 𝒓𝒂𝒕𝒆 = or 𝑩𝒂𝒖𝒅 𝒓𝒂𝒕𝒆 =
𝒕𝒔 𝑵
where:
Baud rate = symbol rate (baud per seconds)
𝒕𝒔 = time of one signaling element (seconds)
𝑵=number of bits per signal element
Baud Rate
Example:
A system sends a signal that can
assume 8 different voltage levels. It
sends 400 of these signals per
second, what is baud rate?
Baud Rate
Example:
An analog signal carries eight bits in
each signal element. If 1000 signal
elements are sent per second,
calculate the baud rate and the bit
rate.
Baud Rate
Example:
A given signal has a bit rate of 3000. If
each signal element carries four bits,
what is the baud rate?
END

Information Capacity

Uploaded by

Copyright:

Available Formats

Information Capacity

Uploaded by

Document Information

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

Information Capacity

Uploaded by

Copyright:

Available Formats

INFORMATION

■ Information theorists seek to determine

DATA RATE LIMITS

Two theoretical formulas were

1.For noiseless channel - Nyquist bit

■ For a noiseless channel, the Nyquist bit rate formula defines

■ Claude Shannon introduced a formula, called the Shannon

■ It is a higher-than-binary encoding where M corresponds to the

■ It is expressed mathematically as:

You might also like