Coding Theory
This quiz covers the fundamental concepts and techniques of Coding Theory, including error correction, data compression, and information theory.
Questions
In coding theory, what is the primary goal of a code?
- To minimize the number of bits required to represent a message.
- To maximize the number of errors that can be corrected.
- To ensure that the message is received exactly as it was sent.
- To minimize the time required to transmit a message.
What is the difference between a block code and a convolutional code?
- Block codes operate on fixed-length blocks of data, while convolutional codes operate on a continuous stream of data.
- Block codes are more efficient than convolutional codes.
- Convolutional codes are more robust to errors than block codes.
- Block codes are used for error correction, while convolutional codes are used for data compression.
What is the Hamming distance between two binary vectors?
- The number of positions in which the two vectors differ.
- The number of positions in which the two vectors are the same.
- The sum of the values of the two vectors.
- The product of the values of the two vectors.
What is the maximum number of errors that a Hamming code can correct?
- ⌊(n-1)/2⌋
- ⌊(n-1)/3⌋
- ⌊(n-1)/4⌋
- ⌊(n-1)/5⌋
What is the Shannon-Hartley theorem?
- It states that the capacity of a communication channel is given by C = B log2(1 + S/N), where C is the channel capacity, B is the bandwidth, S is the signal power, and N is the noise power.
- It states that the capacity of a communication channel is given by C = B log2(1 + S/N^2), where C is the channel capacity, B is the bandwidth, S is the signal power, and N is the noise power.
- It states that the capacity of a communication channel is given by C = B log2(1 + S/N^3), where C is the channel capacity, B is the bandwidth, S is the signal power, and N is the noise power.
- It states that the capacity of a communication channel is given by C = B log2(1 + S/N^4), where C is the channel capacity, B is the bandwidth, S is the signal power, and N is the noise power.
What is the Nyquist rate?
- The maximum rate at which data can be transmitted over a communication channel without distortion.
- The minimum rate at which data can be transmitted over a communication channel without distortion.
- The rate at which data is transmitted over a communication channel.
- The rate at which data is received over a communication channel.
What is the difference between lossless and lossy data compression?
- Lossless data compression reduces the size of a file without losing any information, while lossy data compression reduces the size of a file by discarding some information.
- Lossless data compression increases the size of a file, while lossy data compression decreases the size of a file.
- Lossless data compression is always better than lossy data compression.
- Lossy data compression is always better than lossless data compression.
What is the Huffman coding algorithm?
- A lossless data compression algorithm that uses a variable-length code to represent symbols.
- A lossy data compression algorithm that uses a variable-length code to represent symbols.
- A lossless data compression algorithm that uses a fixed-length code to represent symbols.
- A lossy data compression algorithm that uses a fixed-length code to represent symbols.
What is the Lempel-Ziv-Welch (LZW) algorithm?
- A lossless data compression algorithm that uses a dictionary to represent symbols.
- A lossy data compression algorithm that uses a dictionary to represent symbols.
- A lossless data compression algorithm that uses a Huffman code to represent symbols.
- A lossy data compression algorithm that uses a Huffman code to represent symbols.
What is the difference between entropy and information?
- Entropy is a measure of the uncertainty of a random variable, while information is a measure of the amount of information contained in a message.
- Entropy is a measure of the amount of information contained in a message, while information is a measure of the uncertainty of a random variable.
- Entropy and information are the same thing.
- Entropy and information are opposite things.
What is the entropy of a random variable?
- H(X) = -∑p(x) log2 p(x)
- H(X) = -∑p(x) log10 p(x)
- H(X) = -∑p(x) log2(1 - p(x))
- H(X) = -∑p(x) log10(1 - p(x))
What is the mutual information between two random variables?
- I(X;Y) = H(X) + H(Y) - H(X,Y)
- I(X;Y) = H(X) - H(Y) - H(X,Y)
- I(X;Y) = H(X) + H(Y) + H(X,Y)
- I(X;Y) = H(X) - H(Y) + H(X,Y)
What is the channel capacity of a communication channel?
- The maximum rate at which data can be transmitted over a communication channel without errors.
- The minimum rate at which data can be transmitted over a communication channel without errors.
- The rate at which data is transmitted over a communication channel.
- The rate at which data is received over a communication channel.