[sdiy] Information Content of Signals

[Dave Halliday]

My thought is that by going for 24/96, getting the 24-bit data allows
you to mix (synthsesize, process, etc..) several audio streams without
loosing audible data.  16-bits is good but less than 16-bits and we
start to hear it.

Multiply two 16-bit streams and compress the results into a 16-bit
output and you might be hearing something.

Also:  "reverb tail of the Big Bang?"
DAMN!
Swipe  (with credit of course!)



> -----Original Message-----
> From: owner-synth-diy at dropmix.xs4all.nl 
> [mailto:owner-synth-diy at dropmix.xs4all.nl] On Behalf Of Grant Richter
> Sent: Saturday, May 17, 2003 12:37 AM
> To: Magnus Danielson; synth-diy at dropmix.xs4all.nl
> Subject: [sdiy] Information Content of Signals
> 
> 
> As a point of interest, I have been trying to understand the 
> theoretical information content of signals. Contemplation of 
> this has led me to a paradox, and I wonder if anyone can shed 
> light on this.
> 
> Information and thermodynamics are linked together by the 
> expression of an information "bit" in a thermal sense. The 
> best definition I have found uses Boltzman's constant 
> (minimum energy required to create a new thermal state at 
> temperature).
> 
> Using room temperature and the reference of 0 dB = 1 
> milliwatt, the theoretical information content of a 1 
> milliwatt-second signal would be
> (approx) 2^64 bits per second. So for sample rate of 192 kHz 
> (~2^18) theoretical bit depth would not exceed 2^46 (64-18).
> 
> The paradox comes from the idea of over-sampling a thermally 
> maxed out information channel. What information would then be 
> gathered? Would it be merely redundant information, or would 
> the waste heat of the conversion apparatus become a new 
> signal generator?
> 
> Note that from an information theory standpoint, thermal 
> noise is a naturally occurring signal (reverb tail of the Big 
> Bang?) mixed with the human generated signal.
> 
> Any speculation is appreciated.
> 
>