Blog - The stochastic resonance program (part 1) (Rev #67, changes)

Showing changes from revision #66 to #67:
Added | ~~Removed~~ | ~~Chan~~ged

*guest post by David Tanzer*</i>

At the Azimuth Code Project , we are aiming to produce educational software that is relevant to the Earth sciences and the study of climate. Our software takes the form of interactive web pages, which allow you to experiment with the parameters of a model and view its outputs. But~~ in~~~~ order~~ to fully understand the meaning of a program, we need to know about the concepts and theories that inform it. So we will also be writing~~ articles~~ to explain the science, the math, and the programming behind these models.

In this two-part series,~~ I~~ I’ll~~ will~~ cover the Azimuthstochastic resonance example program, by Allan Erskine and Glyn Adgie . Today we’ll look at some of the math and science behind the program, and next time we’ll dissect the~~ program.~~ program itself. By way of introduction, I am a software developer with research training in computer~~ science,~~ science.~~ so~~ This~~ this~~ is a new area for~~ me.~~ me,~~ Any~~ and any amendments or clarifications~~ are~~ will~~ welcome!~~ be welcomed!

Stochastic resonance is a~~ phenomenon~~ phenomenon,~~ in~~ occurring~~ which,~~ under certain~~ conditions,~~ circumstances, in which a noise source may amplify the effect of a weak signal. This concept was used in an early hypothesis about the timing of ice-age cycles, and~~ that~~ has since been applied to a wide range of phenomena, including neuronal detection~~ mechanisms,~~ mechanisms and patterns of traffic congestion.

Suppose~~ that~~ we have a signal detector whose internal, analog state is driven by an input signal, and suppose the analog states are partitioned into two regions, called~~ the~~ “on” and “off”~~ state~~ –~~ so~~ this~~ we~~ is~~ have~~ a digital~~ state~~ state,~~ which~~~~ is~~ abstracted from the analog state. With a light switch, we could take the force as the input signal, the angle as the analog state, and the up/down classification of the angle as the digital state.

~~ Let’s~~ Consider~~ consider~~ the effect of a periodic input signal on the digital state. Suppose~~ that~~ the wave amplitude is not~~ big~~ large enough to change the digital state, yet large enough to drive the~~ detector’s~~ analog state close to the digital state boundary. Then, a bit of random noise, occurring near the peak of an input cycle, may “tap” the system over to the other digital state.~~ We~~ So we will~~ therefore~~ see a probability of state-transitions that is synchronized with the input signal. In a complex way, the noise has*amplified* the input signal.

But it’s a pretty funky amplifier! Here is a picture from the Azimuth library article on stochastic resonance:

Stochastic resonance has been found in the signal detection mechanisms of neurons. There are, for example, cells in the tails of crayfish that are tuned to low-frequency signals in the water~~ arising~~ caused~~ from~~ by~~ the~~ predator~~ motions~~ motions.~~ of~~~~ predators.~~ These signals are too weak to cross the firing threshold for the neurons, but with the right amount of noise, they do trigger the~~ neurons~~ neurons.~~ are~~~~ triggered~~~~ by~~~~ these~~~~ signals.~~

See:

• Stochastic resonance , Azimuth~~ Library~~ Library.

• Stochastic resonance in neurobiology , David~~ Lyttle~~ Lyttle.

Stochastic resonance was originally~~ defined~~ formulated~~ for~~ in terms of systems that are bistable – where each digital state is the basin of attraction~~ for~~~~ a~~~~ point~~ of a stable equilibrium.

An early application of stochastic resonance was to a hypothesis, within the framework of bistable climate dynamics, about the timing of the ice-age cycles. Although it has not been confirmed, it remains of interest (1) historically, (2) because the timing of ice-age cycles remains an open problem, and (3) because the Milankovitch hypothesis upon which it rests is an active part of the current research.

In the bistable model, the climate states are a cold, “snowball” Earth and a hot, iceless Earth. The snowball Earth is stable because it is white, and hence reflects solar energy, which keeps it frozen. The iceless Earth is stable because it is dark, and hence absorbs solar energy, which keeps it melted.

The Milankovitch hypothesis states that the drivers of climate state change are long-duration cycles in the insolation – the solar energy received in the northern latitudes – caused by periodic changes in the Earth’s orbital parameters. The north is significant because that is where the glaciers are concentrated, and so a sufficient “pulse” in northern temperatures could initiate a state change.

Three~~ such~~ relevant astronomical cycles have been identified:

• Changing of the eccentricity of the Earth’s elliptical orbit, with a period of 100 kiloyears

• Changing of the obliquity (tilt) of the Earth’s axis, with a period of 41 kiloyears

• Precession (swiveling) of the Earth’s axis, with a period of 23 kiloyears

In the stochastic resonance hypothesis, the Milankovitch signal is amplified by random events to produce climate state changes. In more recent Milankovitch theories,~~ invoke~~ a deterministic forcing mechanism is used. In a theory by Didier Paillard, the climate is modeled with three states, called interglacial, mild glacial and full glacial, and the state changes depend on the volume of ice as well as the insolation.

See:

• Milankovitch cycle , Azimuth~~ Library~~ Library.

• Mathematics of the environment (part 10), John Baez. This gives an exposition of Paillard’s theory.

• Increasing the Signal-to-Noise Ratio with More Noise, Glyn Adgie and Tim van Beek, Azimuth Blog. Subtitle: Are the Milankovitch Cycles Causing the Ice Ages?

Any smooth function with two local minima can be used to define a bistable system. For instance, consider the function $V(x) = x^4/4 - x^2/2$:

To define~~ a~~ the bistable system, construct a differential equation where the time derivative of x is set to the negative of the derivative of the potential at x:

$dx/dt = -V'(x) = -x^3 + x = x(1 - x^2)$

So, for instance, where the potential graph is sloping upward as x increases, -V’(x) is negative,~~ which~~ and this sends X(t) “downhill” towards the minimum.

The roots of V’(x) yield stable equilibria at 1 and -1, and an unstable equilibrium at 0. The~~ unstable~~ latter~~ equilibrium~~ separates the basins of attraction for the stable equilibria.

~~ Here~~ Now~~ we~~ let’s~~ describe~~ look at a discrete-time model~~ that~~ which exhibits stochastic~~ resonance~~ resonance.~~ –~~ This~~ this~~ is~~ what~~ the~~ is~~ model used in the Azimuth demo program.

We construct~~ a~~ the discrete-time derivative,~~ by~~ using~~ combining~~~~ the~~~~ negative~~~~ of~~~~ the~~~~ derivative~~~~ of~~ the potential function, a sampled sine wave, and a normally distributed random number:

$\Delta {X}_{t}=-V\prime ({X}_{t})*\Delta t+\mathrm{SineWaveWave}(t)+\mathrm{RandomSampleNoise}(t)={X}_{t}(1-{X}_{t}^{2})\Delta t+\alpha *\mathrm{sin}(\omega t)+\beta *\mathrm{GaussianSample}(t)$ \Delta X_t = -V'(X_t) *\Delta t +~~ SineWave(t)~~ Wave(t) +~~ RandomSample(t)~~ Noise(t) = X_t (1 - X_t^2) \Delta t + \alpha * sin(\omega t) + \beta * GaussianSample(t)

where $\Delta t$ is a constant and $t$ is restricted to multiples of $\Delta t$.

~~ Note~~ This~~ that~~~~ this~~~~ difference~~ equation is the discrete-time counterpart to a~~ corresponding~~ continuous-timeStochastic differential equation.

Next~~ time~~ time, we will~~ take~~~~ a~~ look~~ at~~ into the Azimuth demo~~ program:~~ program~~ how~~ itself.~~ to~~~~ use~~~~ it,~~~~ how~~~~ it~~~~ works,~~~~ and~~~~ how~~~~ to~~~~ change~~~~ it~~~~ to~~~~ make~~~~ new~~~~ programs.~~

category: blog