Question
Download Solution PDFThe concept of entropy as used in communication is related to
Answer (Detailed Solution Below)
Detailed Solution
Download Solution PDFEntropy in Communication:
- The entropy was originally created by Shannon as part of his theory of communication, in which a data communication system is composed of three elements: a source of data, a communication channel, and a receiver.
- In Shannon's theory, the "fundamental problem of communication" – as expressed by Shannon – is for the receiver to be able to identify what data was generated by the source, based on the signal it receives through the channel.
- Shannon considered various ways to encode, compress, and transmit messages from a data source, and proved in his famous source coding theorem that the entropy represents an absolute mathematical limit on how well data from the source can be losslessly compressed onto a perfectly noiseless channel
- In information theory, the entropy of a random variable is the average level of "information", "surprise", or "uncertainty" inherent in the variable's possible outcomes.
- Entropy refers to messages which convey highly unpredictable information to the receiver.
Important Points
Conclusion:
- The encode-decode model of communication implies that in order to improve communication two influencing factors should be managed: noise (physical and semantic) should be reduced and capacity (sender-receiver and channel) should be increased.
- In addition, to more effectively transmit a message there should be an appropriate balance between so-called entropy and redundancy.
- Entropy refers to the message that conveys unpredictable information to the receiver. So here entropy is related to the order or sequence in which the message is transferred through a channel to the receiver. Hence, option (3) is correct.
Last updated on Jun 6, 2025
-> The UGC NET Exam Schedule 2025 for June has been released on its official website.
-> The UGC NET Application Correction Window 2025 is available from 14th May to 15th May 2025.
-> The UGC NET 2025 online application form submission closed on 12th May 2025.
-> The June 2025 Exam will be conducted from 21st June to 30th June 2025
-> The UGC-NET exam takes place for 85 subjects, to determine the eligibility for 'Junior Research Fellowship’ and ‘Assistant Professor’ posts, as well as for PhD. admissions.
-> The exam is conducted bi-annually - in June and December cycles.
-> The exam comprises two papers - Paper I and Paper II. Paper I consists of 50 questions and Paper II consists of 100 questions.
-> The candidates who are preparing for the exam can check the UGC NET Previous Year Papers and UGC NET Test Series to boost their preparations.