Tensors — again, again, again

“A tensor is something that transforms like a tensor” — and a duck is something that quacks like a duck. If you find this sort of thing less than illuminating, I’ve got the book for you — “An Introduction to Tensors and Group Theory for Physicists” by Nadir Jeevanjee.

He notes that many physics books trying to teach tensors start this way, without telling you what a tensor actually is.  

Not so Jeevanjee — right on the first page of text (p. 3) he says “a tensor is a function which eats a certain number of vectors (known as the rank r of the tensor) and produces a number.  He doesn’t say what that number is, but later we are told that it is either C or R.

Then comes  the crucial fact that tensors are multilinear functions. From that all else flows (and quickly).

This means that you know everything you need to know about a tensor if you know what it does to its basis vectors.  

He could be a little faster about what these basis vectors actually are, but on p. 7 you are given an example explicitly showing them.

To keep things (relatively) simple the vector space is good old 3 dimensional space with basis vectors x, y and z.

His rank 2 tensor takes two vectors from this space (u and v) and produces a number.  There are 9 basis vectors not 6 as you might think — x®x, x®y, x®z, y®x, y®y, y®z, z®x, z®y, and z®z.    ® should be read as x inside a circle

Tensor components are the (real) numbers the tensor assigns to the 9 — these are written T(x®x) , T(x®y) T( x®z), T(y®x), T(y®y), T(y®z), T(z®x), T(z®y), and T(z®z)– note that there is no reason that T(x®y) should equal T(y®x) any more than a function R^2 –> R should give the same values for (1, 2) and (2, 1).

One more complication — where do the components of u and v fit in?  u is really (u^1, u^2, u^3) and v is really (v^1, v^2, v^3)

They multiply each other and the T’s  — so the first term of the tensor (sometimes confusingly called a tensor component)

is u^1 * v^1 * T(x®x)  and the last is u^3 * v^3 T(z®z).  Then the 9 tensor terms/components are summed giving a number. 

Then on pp. 7 and 8 he shows how a change of basis matrix (a 3 x 3 matrix written A^rs where rs, is one of 1, 2, 3) with nonZero determinant) gives the (usually incomprehensible) formula 

 

T^i’j’ = A^ik * A^jl T * (k, l)  where i, j, k, l are one of x, y, and z (or 1, 2, 3 as usually written)

 

So now you have a handle on the cryptic algebraic expression for tensors and what happens to them on a change of basis (e.g. how they transform).  Not bad for 5 pages of work — certainly not everything, but enough to make you comfortable with what follows — dual vectors, invariance, symmetric etc. etc.

 

Just knowing the multilinearity of tensors and just 2 postulates of quantum mechanics is all you need to understand entanglement — yes truly.  Yes, and you don’t need the Schrodinger equation, or differential equations at all, just linear algebra. 

 

Here is an old post to show you exactly how this works

 

How formal tensor mathematics and the postulates of quantum mechanics give rise to entanglement

Tensors continue to amaze. I never thought I’d get a simple mathematical explanation of entanglement, but here it is. Explanation is probably too strong a word, because it relies on the postulates of quantum mechanics, which are extremely simple but which lead to extremely bizarre consequences (such as entanglement). As Feynman famously said ‘no one understands quantum mechanics’. Despite that it’s never made a prediction not confirmed by experiments, so the theory is correct even if we don’t understand ‘how it can be like that’. 100 years of correct prediction of experimentation are not to be sneezed at.

If you’re a bit foggy on just what entanglement is — have a look at https://luysii.wordpress.com/2010/12/13/bells-inequality-entanglement-and-the-demise-of-local-reality-i/. Even better; read the book by Zeilinger referred to in the link (if you have the time).

Actually you don’t even need all the postulates for quantum mechanics (as given in the book “Quantum Computation and Quantum Information by Nielsen and Chuang). No differential equations. No Schrodinger equation. No operators. No eigenvalues. What could be nicer for those thirsting for knowledge? Such a deal ! ! ! Just 2 postulates and a little formal mathematics.

Postulate #1 “Associated to any isolated physical system, is a complex vector space with inner product (that is a Hilbert space) known as the state space of the system. The system is completely described by its state vector which is a unit vector in the system’s state space”. If this is unsatisfying, see an explication of this on p. 80 of Nielson and Chuang (where the postulate appears)

Because the linear algebra underlying quantum mechanics seemed to be largely ignored in the course I audited, I wrote a series of posts called Linear Algebra Survival Guide for Quantum Mechanics. The first should be all you need. https://luysii.wordpress.com/2010/01/04/linear-algebra-survival-guide-for-quantum-mechanics-i/ but there are several more.

Even though I wrote a post on tensors, showing how they were a way of describing an object independently of the coordinates used to describe it, I did’t even discuss another aspect of tensors — multi linearity — which is crucial here. The post itself can be viewed at https://luysii.wordpress.com/2014/12/08/tensors/

Start by thinking of a simple tensor as a vector in a vector space. The tensor product is just a way of combining vectors in vector spaces to get another (and larger) vector space. So the tensor product isn’t a product in the sense that multiplication of two objects (real numbers, complex numbers, square matrices) produces another object of the exactly same kind.

So mathematicians use a special symbol for the tensor product — a circle with an x inside. I’m going to use something similar ‘®’ because I can’t figure out how to produce the actual symbol. So let V and W be the quantum mechanical state spaces of two systems.

Their tensor product is just V ® W. Mathematicians can define things any way they want. A crucial aspect of the tensor product is that is multilinear. So if v and v’ are elements of V, then v + v’ is also an element of V (because two vectors in a given vector space can always be added). Similarly w + w’ is an element of W if w an w’ are. Adding to the confusion trying to learn this stuff is the fact that all vectors are themselves tensors.

Multilinearity of the tensor product is what you’d think

(v + v’) ® (w + w’) = v ® (w + w’ ) + v’ ® (w + w’)

= v ® w + v ® w’ + v’ ® w + v’ ® w’

You get all 4 tensor products in this case.

This brings us to Postulate #2 (actually #4 on the book on p. 94 — we don’t need the other two — I told you this was fairly simple)

Postulate #2 “The state space of a composite physical system is the tensor product of the state spaces of the component physical systems.”

http://planetmath.org/simpletensor

Where does entanglement come in? Patience, we’re nearly done. One now must distinguish simple and non-simple tensors. Each of the 4 tensors products in the sum on the last line is simple being the tensor product of two vectors.

What about v ® w’ + v’ ® w ?? It isn’t simple because there is no way to get this by itself as simple_tensor1 ® simple_tensor2 So it’s called a compound tensor. (v + v’) ® (w + w’) is a simple tensor because v + v’ is just another single element of V (call it v”) and w + w’ is just another single element of W (call it w”).

So the tensor product of (v + v’) ® (w + w’) — the elements of the two state spaces can be understood as though V has state v” and W has state w”.

v ® w’ + v’ ® w can’t be understood this way. The full system can’t be understood by considering V and W in isolation, e.g. the two subsystems V and W are ENTANGLED.

Yup, that’s all there is to entanglement (mathematically at least). The paradoxes entanglement including Einstein’s ‘creepy action at a distance’ are left for you to explore — again Zeilinger’s book is a great source.

But how can it be like that you ask? Feynman said not to start thinking these thoughts, and if he didn’t know you expect a retired neurologist to tell you? Please.

Want to understand Quantum Computing — buy this book

As quantum mechanics enters its second century, quantum computing has been hot stuff for the last third of it, beginning with Feynman’s lectures on computation in 84 – 86.  Articles on quantum computing  appear all the time in Nature, Science and even the mainstream press.

Perhaps you tried to understand it 20 years ago by reading Nielsen and Chuang’s massive tome Quantum Computation and Quantum information.  I did, and gave up.  At 648 pages and nearly half a million words, it’s something only for people entering the field.  Yet quantum computers are impossible to ignore.

That’s where a new book “Quantum Computing for Everyone” by Chris Bernhardt comes in.  You need little more than high school trigonometry and determination to get through it.  It is blazingly clear.  No term is used before it is defined and there are plenty of diagrams.   Of course Bernhardt simplifies things a bit.  Amazingly, he’s able to avoid the complex number system. At 189 pages and under 100,000 words it is not impossible to get through.

Not being an expert, I can’t speak for its completeness, but all the stuff I’ve read about in Nature, Science is there — no cloning, entanglement, Ed Frenkin (and his gate), Grover’s algorithm,  Shor’s algorithm, the RSA algorithm.  As a bonus there is a clear explanation of Bell’s theorem.

You don’t need a course in quantum mechanics to get through it, but it would make things easier.  Most chemists (for whom this blog is basically written) have had one.  This plus a background in linear algebra would certainly make the first 70 or so pages a breeze.

Just as a book on language doesn’t get into the fonts it can be written in, the book doesn’t get into how such a computer can be physically instantiated.  What it does do is tell you how the basic guts of the quantum computer work. Amazingly, they are just matrices (explained in the book) which change one basis for representing qubits (explained) into another.  These are the quantum gates —  ‘just operations that can be described by orthogonal matrices” p. 117.  The computation comes in by sending qubits through the gates (operating on vectors by matrices).

Be prepared to work.  The concepts (although clearly explained) come thick and fast.

Linear algebra is basic to quantum mechanics.  Superposition of quantum states is nothing more than a linear combination of vectors.  When I audited a course on QM 10 years ago to see what had changed in 50 years, I was amazed at how little linear algebra was emphasized.  You could do worse that read a series of posts on my blog titled “Linear Algebra Survival Guide for Quantum Mechanics” — There are 9 — start here and follow the links — you may find it helpful — https://luysii.wordpress.com/2010/01/04/linear-algebra-survival-guide-for-quantum-mechanics-i/

From a mathematical point of view entanglement (discussed extensively in the book) is fairly simple -philosophically it’s anything but – and the following was described by a math prof as concise and clear– https://luysii.wordpress.com/2014/12/28/how-formal-tensor-mathematics-and-the-postulates-of-quantum-mechanics-give-rise-to-entanglement/

The book is a masterpiece — kudos to Bernhardt

Did these guys just repeal the second law of thermodynamics and solve the global warming problem?

Did these guys just repeal the second law of thermodynamics and solve the global warming problem to boot? [ Science vol. 355 pp. 1023 – 1024, 1062 -1066 ’17 ] Heady stuff. But they can put a sheet of metamaterial over water during the day in Arizona and cool it by 8 degrees Centigrade in two hours!

How did they do it? Time for a little atmospheric physics. There is nothing in the Earth’s atmosphere which absorbs light of wavelength between 8 and 13 microns (this is called the atmospheric window). So anything radiating energy in this range sends it out into space. This is called radiative cooling. It doesn’t work during the day because most materials absorb sunlight in the visible and near infrared range (.7 -2.5 microns) heating them up. Solar power density overwhelms the room temperature radiation spectrum shorter than 4 microns. So for daytime cooling you need a material reflecting all the light shorter than 4 microns, while being fully emissive for longer wavelengths.

This work describes a metamaterial– https://en.wikipedia.org/wiki/Metamaterial — in which small (average diameter 4 microns) spheres ofSiO2 (glass) are randomly dispersed in a polymer matrix transparent to visible and infrared light. The matrix is 50 microns thick. The whole shebang is backed by a very thin (.2 micron) silver mirror. So light easily passes through the film and is then bounced back by the mirror without being absorbed.

Chemists have already studied the Carnot cycle, which gives the maximum efficiency of a heat engine. This is always proportional to the temperature difference between phases of the cycle. That’s why the biggest thing about a nuclear power plant is the cooling tower (and almost as important). Well few things are colder than the cosmic microwave background (2.7 degrees Centigrade above absolute zero).

So while the entropy of the universe increases as the heat goes somewhere, locally it looks like the second law of thermodynamics is being violated. No work is done (as far as i can tell) yet the objects spontaneously cool.

Perhaps the physics mavens out there can help. I seem to remember Feynman and Wheeler once saying something to the effect that radiation is impossible without something around to absorb it. If I haven’t totally garbled the physics, it almost sounds like emitter and absorber are entangled.

Anyway beaming heat out into space through the atmospheric window sounds like a good way to combat global warming.

No wonder DARPA supported this research.

How formal tensor mathematics and the postulates of quantum mechanics give rise to entanglement

Tensors continue to amaze. I never thought I’d get a simple mathematical explanation of entanglement, but here it is. Explanation is probably too strong a word, because it relies on the postulates of quantum mechanics, which are extremely simple but which lead to extremely bizarre consequences (such as entanglement). As Feynman famously said ‘no one understands quantum mechanics’. Despite that it’s never made a prediction not confirmed by experiments, so the theory is correct even if we don’t understand ‘how it can be like that’. 100 years of correct prediction of experimentation are not to be sneezed at.

If you’re a bit foggy on just what entanglement is — have a look at https://luysii.wordpress.com/2010/12/13/bells-inequality-entanglement-and-the-demise-of-local-reality-i/. Even better; read the book by Zeilinger referred to in the link (if you have the time).

Actually you don’t even need all the postulates for quantum mechanics (as given in the book “Quantum Computation and Quantum Information by Nielsen and Chuang). No differential equations. No Schrodinger equation. No operators. No eigenvalues. What could be nicer for those thirsting for knowledge? Such a deal ! ! ! Just 2 postulates and a little formal mathematics.

Postulate #1 “Associated to any isolated physical system, is a complex vector space with inner product (that is a Hilbert space) known as the state space of the system. The system is completely described by its state vector which is a unit vector in the system’s state space”. If this is unsatisfying, see an explication of this on p. 80 of Nielson and Chuang (where the postulate appears)

Because the linear algebra underlying quantum mechanics seemed to be largely ignored in the course I audited, I wrote a series of posts called Linear Algebra Survival Guide for Quantum Mechanics. The first should be all you need. https://luysii.wordpress.com/2010/01/04/linear-algebra-survival-guide-for-quantum-mechanics-i/ but there are several more.

Even though I wrote a post on tensors, showing how they were a way of describing an object independently of the coordinates used to describe it, I did’t even discuss another aspect of tensors — multi linearity — which is crucial here. The post itself can be viewed at https://luysii.wordpress.com/2014/12/08/tensors/

Start by thinking of a simple tensor as a vector in a vector space. The tensor product is just a way of combining vectors in vector spaces to get another (and larger) vector space. So the tensor product isn’t a product in the sense that multiplication of two objects (real numbers, complex numbers, square matrices) produces another object of the exactly same kind.

So mathematicians use a special symbol for the tensor product — a circle with an x inside. I’m going to use something similar ‘®’ because I can’t figure out how to produce the actual symbol. So let V and W be the quantum mechanical state spaces of two systems.

Their tensor product is just V ® W. Mathematicians can define things any way they want. A crucial aspect of the tensor product is that is multilinear. So if v and v’ are elements of V, then v + v’ is also an element of V (because two vectors in a given vector space can always be added). Similarly w + w’ is an element of W if w an w’ are. Adding to the confusion trying to learn this stuff is the fact that all vectors are themselves tensors.

Multilinearity of the tensor product is what you’d think

(v + v’) ® (w + w’) = v ® (w + w’ ) + v’ ® (w + w’)

= v ® w + v ® w’ + v’ ® w + v’ ® w’

You get all 4 tensor products in this case.

This brings us to Postulate #2 (actually #4 on the book on p. 94 — we don’t need the other two — I told you this was fairly simple)

Postulate #2 “The state space of a composite physical system is the tensor product of the state spaces of the component physical systems.”

http://planetmath.org/simpletensor

Where does entanglement come in? Patience, we’re nearly done. One now must distinguish simple and non-simple tensors. Each of the 4 tensors products in the sum on the last line is simple being the tensor product of two vectors.

What about v ® w’ + v’ ® w ?? It isn’t simple because there is no way to get this by itself as simple_tensor1 ® simple_tensor2 So it’s called a compound tensor. (v + v’) ® (w + w’) is a simple tensor because v + v’ is just another single element of V (call it v”) and w + w’ is just another single element of W (call it w”).

So the tensor product of (v + v’) ® (w + w’) — the elements of the two state spaces can be understood as though V has state v” and W has state w”.

v ® w’ + v’ ® w can’t be understood this way. The full system can’t be understood by considering V and W in isolation, e.g. the two subsystems V and W are ENTANGLED.

Yup, that’s all there is to entanglement (mathematically at least). The paradoxes entanglement including Einstein’s ‘creepy action at a distance’ are left for you to explore — again Zeilinger’s book is a great source.

But how can it be like that you ask? Feynman said not to start thinking these thoughts, and if he didn’t know you expect a retired neurologist to tell you? Please.