Field of Science

Showing posts with label black holes. Show all posts
Showing posts with label black holes. Show all posts

Black holes and the curse of beauty: When revolutionary physicists turn conservative

This is my latest monthly column for 3 Quarks Daily.

On September 1, 1939, the leading journal of physics in the United States, Physical Review, carried two remarkable papers. One was by a young professor of physics at Princeton University named John Wheeler and his mentor Niels Bohr. The other was by a young postdoctoral fellow at the University of California, Berkeley, Hartland Snyder, and his mentor, a slightly older professor of physics named J. Robert Oppenheimer.

The first paper described the mechanism of nuclear fission. Fission had been discovered nine months earlier by a team of physicists and chemists working in Berlin and Stockholm who found that bombarding uranium with neutrons could lead to a chain reaction with a startling release of energy. The basic reasons for the large release of energy in the process came from Einstein's famous equation, E = mc2, and were understood well. But a lot of questions remained: What was the general theory behind the process? Why did uranium split into two and not more fragments? Under what conditions would a uranium atom split? Would other elements also undergo fission?

Bohr and Wheeler answered many of these questions in their paper. Bohr had already come up with an enduring analogy for understanding the nucleus: that of a liquid drop that wobbles in all directions and is held together by surface tension until an external force that is violent enough tears it apart. But this is a classical view of the uranium nucleus. Niels Bohr had been a pioneer of quantum mechanics. From a quantum mechanical standpoint the uranium nucleus is both a particle and a wave represented as a wavefunction, a mathematical object whose manipulation allows us to calculate properties of the element. In their paper Wheeler and Bohr found that the uranium nucleus is almost perfectly poised on the cusp of classical and quantum mechanics, being described partly as a liquid drop and partly by a wavefunction. At twenty five pages the paper is a tour de force, and it paved the way for understanding many other features of fission that were critical to both peaceful and military uses of atomic energy.

The second paper, by Oppenheimer and Snyder, was not as long; only four pages. But these four pages were monumental in their importance because they described, for the first time in history, what we call black holes. The road to black holes had begun about ten years earlier when a young Indian physicist pondered the fate of white dwarfs on a long voyage by sea to England. At the ripe old age of nineteen, Subrahmanyan Chandrasekhar worked out that white dwarfs wouldn't be able to support themselves against gravity if their mass increased beyond a certain limit. A few years later in 1935, Chandrasekhar had a showdown with Arthur Eddington, one of the most famous astronomers in the world, who could not believe that nature could be so pathological as to permit gravitational collapse. Eddington was a previous revolutionary who had famously tested Einstein's theory of relativity and its prediction of starlight bending in 1919. By 1935 he had turned conservative.

Four years after the Chandrasekhar-Eddington confrontation, Oppenheimer became an instant revolutionary when he worked out the details of gravitational collapse all the way to their logical conclusion. In their short paper he and Snyder demonstrated that a star that has exhausted all its thermonuclear fuel cannot hold itself against its own gravity. When it undergoes gravitational collapse, it would present to the outside world a surface beyond which any falling object will appear to be in perpetual free fall. This surface is what we now call the event horizon; beyond the event horizon even light cannot escape, and time essentially stops flowing for an outside observer.

Curiously enough, the black hole paper by Oppenheimer and Snyder sank like a stone while the Wheeler-Bohr paper on fission gained wide publicity. In retrospect the reason seems clear. On the same day that both papers came out, Germany attacked Poland and started World War 2. The potential importance of fission as a source of violent and destructive energy had not gone unnoticed, and so the Wheeler-Bohr paper was of critical and ominous portent. In addition, the paper was in the field of nuclear physics which had been for a long time the most exciting field of physics. Oppenheimer's paper on the other hand was in general relativity. Einstein had invented general relativity more than twenty years earlier, but it was considered more mathematics than physics in the 1930s. Quantum mechanics and nuclear physics were considered the most promising fields for young physicists to make their mark in; relativity was a backwater.

What is more interesting than the fate of the papers themselves though is the fate of the three principal characters associated with them. In their fate as well as that of others, we can see the differences between revolutionaries and conservatives in physics.

Niels Bohr had pioneered quantum mechanics with his paper on atomic structure in 1913 and since then had been a founding father of the field. He had run an intellectual salon at his institute at Copenhagen which had attracted some of the most original physicists of the century; men like Werner Heisenberg, Wolfgang Pauli and George Gamow. By any definition Bohr had been a true revolutionary. But in his later life he turned conservative, at least in two respects. Firstly, he stubbornly clung to a philosophical interpretation of quantum mechanics called the Copenhagen Interpretation which placed the observer front and center. Bohr and his disciples rejected other approaches to quantum interpretation, including one named the Many Worlds Interpretation pioneered by John Wheeler's student Hugh Everett. Secondly, Bohr could not grasp the revolutionary take on quantum mechanics invented by Richard Feynman called the sum-over-histories approach. In this approach, instead of considering a single trajectory for a quantum particle, you consider all possible trajectories. In 1948, during a talk in front of other famous physicists in which Feynman tried to explain his theory, Bohr essentially hijacked the stage and scolded Feynman for ignoring basic physics principles while Feynman had to humiliatingly stand next to him. In both these cases Bohr was wrong, although the verdict is still out on the philosophical interpretation of quantum mechanics. It seems however that Bohr forgot one of his own maxims: "The opposite of a big truth is also a big truth". For some reason Bohr was unable to accept the opposites of his own big truths. The quantum revolutionary had become an old-fashioned conservative.

John Wheeler, meanwhile, went on to make not just one but two revolutionary contributions to physics. After pioneering nuclear fission theory with Bohr, Wheeler immersed himself in the backwater of general relativity and brought it into the limelight, becoming one of the world's foremost relativists. In the public consciousness, he will probably be most famous for coining the term "black hole". But Wheeler's contributions as an educator were even more important. Just like his own mentor Bohr, he established a school of physics at Princeton that produced some of the foremost physicists in the world; among them Richard Feynman, Kip Thorne and Jakob Bekenstein. Today Wheeler's scientific children and grandchildren occupy many of the major centers of relativity research around the world, and until the end of his long life that remained his proudest accomplishment. Wheeler was a perfect example of a scientist who stayed a revolutionary all his life, coming up with wild ideas and challenging the conventional wisdom.

What about the man who may not have coined the term "black holes" but who actually invented them in that troubled year of 1939? In many ways Oppenheimer's case is the most interesting one, because after publishing that paper he became completely disinterested in relativity and black holes, a conservative who did not think the field had anything new to offer. What is ironic about Oppenheimer is that his paper on black holes is his only contribution to relativity – he was always known for his work in nuclear physics and quantum mechanics after all – and yet today this very minor part of his career is considered to be his most important contribution to science. There are good reasons to believe that had he lived long enough to see the existence of black holes experimentally validated, he would have won a Nobel Prize.

And yet he was utterly oblivious to his creations. Several reasons may have accounted for Oppenheimer's lack of interest. Perhaps the most obvious reason is his leadership of the Manhattan Project and his fame as the father of the atomic bomb and a critical government advisor after the war. He also became the director of the rarefied Institute for Advanced Study and got saddled with administrative duties. It's worth noting that after the war, Oppenheimer co-authored only a single paper on physics, so his lack of research in relativity really reflects his lack of research in general. It's also true that particle physics became the most fashionable field of physics research after the war, and stayed that way for at least two decades. Oppenheimer himself served as a kind of spiritual guide to that field, leading three key postwar conferences that brought together the foremost physicists in the field and inaugurated a new era of research. But it's not that Oppenheimer simply didn't have the time to explore relativity; it's that he was utterly indifferent to developments in the field, including ones that Wheeler was pioneering at the time. The physicist Freeman Dyson recalls how he tried to draw out Oppenheimer and discuss black holes many times after the war, but Oppenheimer always changed the subject. He just did not think black holes or anything to do with them mattered.

In fact the real reason for Oppenheimer's abandonment of black holes is more profound. In his later years, he was afflicted by a disease which I call "fundamentalitis". As described by Dyson, fundamentalitis leads to a belief that only the most basic, fundamental research in physics matters. Only fundamental research should occupy the attention of the best scientists; other work is reserved for second-rate physicists and their graduate students. For Oppenheimer, quantum electrodynamics was fundamental, beta decay was fundamental, mesons were fundamental; black holes were applied physics, worthy of second-rate minds.

Oppenheimer was not the only physicist to be stricken by fundamentalitis. The malady was contagious and in fact had already infected the occupant of the office of the floor below Oppenheimer's – Albert Einstein. Einstein had become disillusioned with quantum mechanics ever since his famous debates with Bohr in the 1920s and his belief that God did not play dice. He continued to be a holdout against quantum mechanics; a sad, isolated, often mocked figure ignoring the field and working on his own misguided unification of relativity and electromagnetism. Oppenheimer himself said with no little degree of scorn that Einstein had turned into a lighthouse, not a beacon. But what is less appreciated is Einstein's complete lack of interest in black holes, which in some sense is even more puzzling considering that black holes are the culmination of his own theory. Einstein thought that black holes were a pathological example of his relativity, rather than a general phenomenon which might showcase deep mysteries of the universe. He also wrongly thought that the angular momentum of the particles in a purported black hole would stabilize its structure at some point; this thinking was very similar to Eddington's rejection of gravitational collapse, essentially based on faith that some law of physics would prevent it from happening.

Unfortunately Einstein was obsessed with the same fundamentalitis that Oppenheimer was, thinking that black holes were too applied while unified field theory was the only thing worth pursuing. Between them, Einstein and Oppenheimer managed to ignore the two most exciting developments in physics – black holes and quantum mechanics – of their lives until the end. Perhaps the biggest irony is that the same black holes that both of them scorned are now yielding some of the most exciting, and yes – fundamental – findings in cosmology, thermodynamics, information theory and computer science. The children are coming back to haunt the ghosts of their parents.

Einstein and Oppenheimer's fundamentalitis points to an even deeper quality of physics that has guided the work of physicists since time immemorial. That quality is beauty, especially mathematical beauty. Perhaps the foremost proponent of mathematical beauty in twentieth century physics was the austere Englishman Paul Dirac. Dirac said that an equation could not be true until it was beautiful, and he had a point. Some of the most important and universal equations in physics are beautiful by way of their concision and universal applicability. Think about E= mc2, or Ludwig Boltzmann's equation relating entropy to disorder, S=klnW. Einstein's field equations of general relativity and Dirac's equation of the electron that marries special relativity with quantum mechanics are both prime examples of elegance and deep beauty. Keats famously said that "Beauty is truth and truth is beauty", and Dirac and Einstein seem to have taken his adage to heart.

And yet stories of Dirac and Einstein's quest for beauty are misleading. To begin with, both of them and particularly their disciples seem to have exaggerated the physicists' reliance on beauty as a measure of reality. Einstein may have become enamored of beauty in his later life, but when he developed relativity, he was heavily guided by experiment and stayed very close to the data. He was after all the pioneer of the thought experiment. As a patent clerk in the Swiss patent office at Bern, Einstein gained a deep appreciation for mechanical instrumentation and its power to reveal the secrets of nature. He worked with his friend Leo Szilard on that most practical of gadgets – a refrigerator. His later debates with Bohr on quantum mechanics often featured ingenious thought experiments with devices that he had mentally constructed. In fact Einstein's most profoundly emotional experience came not with a mathematical breakthrough but when he realized that his theory could explain deviations in the perihelion of Mercury, an unsolved problem for a century; this realization left him feeling that "something had snapped" inside him. Einstein's success thus did not arise as much from beauty as from good old-fashioned compliance with experiment. Beauty was a sort of secondary effect, serving as a post-facto rationalization for the correctness of the theory.

Unfortunately Einstein adopted a very different attitude in later years, trying to find a unified field theory that was beautiful rather than true. He started ignoring the experimental data that was being collected by particle physicists around him. We now know that Einstein's goal was fundamentally flawed since it did not include the theory of the strong nuclear force, a theory which took another thirty years to evolve and which could not have progressed without copious experimental data. You cannot come up with a complete theory, beautiful or otherwise, if you simply lack one of the key pieces. Einstein seems to have forgotten a central maxim of doing science, laid down by the sixteenth century natural philosopher Francis Bacon, one of the fathers of the scientific method: "All depends on keeping the eye steadily fixed upon the facts of nature and so receiving their images simply as they are. For God forbid that we should give out a dream of our own imagination for a pattern of the world". In his zeal to make physics beautiful, Einstein ignored the facts of nature and pursued the dreams of his once-awesome imagination.

Perhaps the biggest irony in the story of Einstein and black holes comes from the words of the man who started it all. In 1983, Subrahmanyan Chandrasekhar published a dense and authoritative tome called "The Mathematical Theory of Black Holes" which laid out the complete theory of this fascinating object in all its mathematical glory. In it Chandra (as he was called by his friends) had the following to say:

"In my entire scientific life, extending over forty-five years, the most shattering experience has been the realization that an exact solution of Einstein's equations of general relativity, discovered by the New Zealand mathematician, Roy Kerr, provides the absolutely exact representation of untold numbers of massive black holes that populate the universe. This shuddering before the beautiful, this incredible fact that a discovery motivated by a search after the beautiful in mathematics should find its exact replica in Nature, persuades me to say that beauty is that to which the human mind responds at its deepest and most profound."

Black holes and beauty had come full circle. Far from being a pathological outlier as believed by Einstein and Oppenheimer, they emerged as the epitome of austere mathematical and physical beauty in the cosmos.

Dirac seems to have been guided by beauty to an even greater extent than Einstein, but even there the historical record is ambiguous. When he developed the Dirac equation, he was very closely aware of the experimental results. His biographer Graham Farmelo notes, "Dirac tried one equation after another, discarding each one as soon as it failed to conform to his theoretical principles or to the experimental facts". Beauty may have been a criterion in Dirac's choices, but it was more a way of serving as an additional check rather than a driving force. Unfortunately Dirac did not see it that way. When Richard Feynman and others developed the theory of quantum electrodynamics – a framework that accounts for almost all of physics and chemistry except general relativity - Dirac was completely unenthusiastic about it. This was in spite of quantum electrodynamics agreeing with experiment to a degree unprecedented in the history of physics. When asked why he still had a problem with it, Dirac said it was because the equations were too ugly; he was presumably referring to a procedure called renormalization that got rid of infinities that had plagued the theory for years.

He continued to believe until the end that those ugly equations would somehow metamorphose into beautiful ones; the fact that they worked spectacularly was of secondary importance to him. In that sense beauty and utility were opposed in Dirac's mind. Dirac continued to look for beauty in his equations throughout his life, and this likely kept him from making any contribution that was remotely as important as the Dirac equation. That's a high bar, of course, but it does speak to the failure of beauty as a primary criterion for scientific discovery. Later in his life, Dirac developed a theory of magnetic monopoles and dabbled in finding formulas relating the fundamental constants of nature to each other; to some this was little more than aesthetic numerology. Neither of these ideas has become part of the mainstream of physics.

It was the quest for beauty and the conviction that fundamental ideas were the only ones worth pursuing that turned Einstein and Dirac from young revolutionaries to old conservatives. It also led them to ignore most of the solid progress in physics that was being made around them. The same two people who had let experimental facts serve as the core of their decision making during their youth now behaved as if both experiment and the accompanying theory did not matter.

Yet there is something to be said for making beauty your muse, and ironically this realization comes from the history of the Dirac equation itself. Perhaps the crowning achievement of that equation was to predict the existence of positively charged electrons or positrons. This discovery seemed so alien and unsettled Dirac so much at the beginning that he thought positrons had to be protons; it wasn't until Oppenheimer showed this could not be the case that Dirac started taking the novel prediction seriously. Positrons were finally found by Carl Anderson in 1932, a full three years after Dirac's prediction. This is one of the very few times in history that theory has genuinely predicted a completely novel fact of nature with no experimental basis in the past. Dirac would claim that it was the tightly knit elegance of his equation that logically ordained the existence of positrons, and one would be hard pressed to argue with him. Even today, when experimental evidence is lacking or absent, one has to admit that mathematical beauty is as good a guide to the truth as any other.

Modern theoretical physics has come a long way from the Dirac equation, and experimental evidence and beauty still guide practitioners of the field. Unfortunately physics at the frontiers seems to be unmoored from both these criteria today. The prime example of this is string theory. According to physicist Peter Woit and others, string theory has made no unique, experimentally testable prediction since its inception thirty years ago, and it also seems that its mathematics is unwieldy; while the equations seem to avoid the infinities that Dirac disliked, they also presents no unique, elegant, tightly knit mathematical structure along the lines of the Dirac equation. One wonders what Dirac would have thought of it.

What can today's revolutionaries do to make sure they don't turn conservative in their later years? The answer might come not from a physicist but from a biologist. Charles Darwin, when explaining evolution by natural selection, pointed out a profoundly important fact: "It is not the strongest of the species that survives, nor the most intelligent that survives. It is the one that is most adaptable to change". The principle applies to frogs and butterflies and pandas, and there is no reason why it should not apply to theoretical physicists.

What would it take for the next Dirac or Einstein to make a contribution to physics that equals those of Einstein and Dirac themselves? We do not know the answer, but one lesson that the lives of both these physicists has taught us – through their successes as well as their failures – is to have a flexible mind, to always stay close to the experimental results and most importantly, to be mindful of mathematical beauty while not making it the sole or even dominant criterion to guide your thought processes, especially when an "uglier" theory seems to agree well with experiment. Keep your eye fixed on the facts of nature, not just on the dream of your imagination.

When Einstein was wrong: Black holes

In today's New York Times physicist Lawrence Krauss has a rundown of the myriad cases in which even Albert Einstein was wrong about physical reality. His opposition to quantum mechanics was famous, but there were several others including gravitational lensing and  - at the beginning - even gravitational waves.

Curiously however, Krauss does not list what I believe was Einstein's biggest failure after quantum mechanics: his refusal to accept the reality of black holes. This failure is especially staggeringly ironic, since the gravitational waves which were discovered this week (which he did predict and which further confirmed his theory) came from the collision of two black holes (entities whose existence he explicitly rejected).

Months after Einstein put the capstone on his general theory of relativity, a German mathematical physicist serving in the First World War named Karl Schwarzschild applied his theory to the simple case of spacetime around a spherical star. Schwarzschild found that as you approached closer to the star, for a star massive enough you would encounter a region where gravity was so strong that you could not escape from it unless you were moving at the speed of light. Schwarzschild sent his calculations to Einstein who curiously accepted them without protest; they seemed simple and logical.

And yet Einstein never really explored the physical structure of Schwarzschild's solution, nor did he ever accept its profound implications. He regarded the solution mainly as a mathematical abstraction, much as some who did not quite believe in Copernicus's heliocentric model and regarded it only as a mathematical construction. Schwarzschild sadly died of an autoimmune disease on the Russian front in 1916. Einstein himself did not return to Schwarzschild's discovery, and it fell to a succession of young physicists unaffected by the biases of the old guard to investigate it to its logical conclusion.

The most famous among these were Subrahmanyan Chandrasekhar and Robert Oppenheimer. Chandrasekhar's (or Chandra as everyone called him) story is well known. While crossing the ocean from India to England in 1930, the 19 year old Chandra worked out what would happen when white dwarfs exceed a certain mass. This mass, now called the Chandrasekhar limit, would be the limiting mass for a white dwarf to support itself against its internal gravitational pull. Chandra found his own skeptical Einstein in the famous English astronomer Arthur Eddington, who in a meeting in 1935 excoriated him for developing a model of a star which did not make physical sense (to Eddington). Chandra who knew better than to waste his time battling the establishment wisely moved on, seeing his ideas vindicated half a century later.

Oppenheimer turned to gravitational collapse almost as a temporary diversion when he wanted to explore the ramifications of a theory of neutron cores set forth by the Soviet physicist Lev Landau. It was Oppenheimer who first worked out the full implications of a star which was so massive that it could not achieve any kind of steady state against gravitational collapse. In a seminal paper in 1939, Oppenheimer also introduced the now familiar idea of an observer falling past the so-called event horizon. Without calling them as such, Oppenheimer had discovered black holes and singularities, regions of spacetime where gravitational fields becomes infinite.

Ironically, in the same year that Oppenheimer published his calculations Einstein wrote a paper in the journal Annals of Mathematics titled "A Stationary System with Spherical Symmetry Consisting of Many Gravitational Masses". The paper - published only a month after Oppenheimer's - argued against Schwarzschild's conception of singularities. In it he tried to get away from the idea that a single body could create a gravitational field strong enough to cause such a prohibitive warping of spacetime. Instead he tried to replace such a single body with a collection of bodies exhibiting spherical symmetry. The crux of Einstein's argument that such a system would have to rotate at the speed of light in order to exhibit singularities. Needless to say Einstein was deeply mistaken, and the 1939 paper displayed exactly the kind of mathematical modeling free of physical reality that he thought Schwarzschild's equations for singularities did.

After the war both Oppenheimer and Einstein worked together at the Institute for Advanced Study in Princeton. There is no evidence indicating that they ever discussed black holes or their respective papers from 1939; there is no evidence that Oppenheimer objected to Einstein's paper or that Einstein explicitly told Oppenheimer that he rejected his conclusions. But what was happening was worse than opposition: it was indifference. Just like Einstein Oppenheimer lost all interest in black holes after 1939 and refused to have any discussion about them, although as their inventor he putatively at least believed in them. The two physicists who had been scientific revolutionaries in their younger days became arch conservatives in their older years.

It is a delicious reversal of fortune that the same black holes that Einstein explicitly rejected have been found to contain some of the deepest mysteries of physics, encompassing not just relativity but also quantum mechanics, thermodynamics and information theory. And now with the discovery of gravitational waves from colliding black holes, the scientific children which Einstein disowned have come back to smile at their father and say, "I told you so." This is irony of the highest order, and I suspect that Einstein with his great sense of irony about science and history would actually have enjoyed it.

Einstein, Oppenheimer, relativity and black holes: The curse of fundamentalitis

J. Robert Oppenheimer and Albert Einstein at the
Institute for Advanced Study in Princeton
A hundred years ago, in November, 1915, Albert Einstein sent a paper to the Prussian Academy of Sciences which was to become one of the great scientific papers of all time. In this paper Einstein published the full treatment of his so-called field equations which present the curvature of spacetime by matter; the paper heralded the culmination of his general theory of relativity.

Forty years later when Einstein died, the implications of that paper had completely changed our view of the cosmos. They had explained the anomalous precession of Mercury, predicted the bending of starlight and most importantly, the expansion of the universe. Einstein enthusiastically accepted all these conclusions. One conclusion that he did not however accept and which in fact he did not seem interested in was the implications of the equations in areas of the cosmos where the force of gravity is so strong that it does not allow even light to escape - a black hole. Today we know that black holes showcase Einstein's general theory of relativity in all its incandescent glory. In addition black holes have become profound playgrounds for some of the deepest mysteries of the universe, including quantum mechanics, information theory and quantum gravity.

And yet Einstein seemed almost pathologically uninterested in them. He had heard about them from many of his colleagues; in particular his Princeton colleague John Wheeler had taken it upon himself to fully understand these strange objects. But Einstein stayed aloof. There was another one of the same persuasion whose office was only one floor away from him - J. Robert Oppenheimer, the architect of the atomic bomb and the Delphic director of the Institute for Advanced Study where Einstein worked. Oppenheimer in fact had been the first to mathematically describe these black holes in a seminal paper in 1939. Unfortunately Oppenheimer's paper was published on the same day that Hitler attacked Poland. In addition its importance was eclipsed by another article in the same issue of the journal Physical Review: an article by Niels Bohr and John Wheeler describing the mechanism of nuclear fission, a topic that would soon herald urgent and ominous portents for the fate of the world.

The more general phenomena of gravitational contraction and collapse that black holes exhibit were strangely phenomena that seemed doomed to obscurity; in a strange twist of fate, those who truly appreciated them stayed obscure, while those who were influential ignored them. Among the former were Subrahmanyan Chandrasekhar and Fritz Zwicky; among the latter were Oppenheimer, Einstein and Arthur Eddington. In 1935, Chandrasekhar had discovered a limiting formula for white dwarfs beyond which a white dwarf could no longer thwart its inward gravitational pull. He was roundly scolded by Eddington, one of the leading astronomers of his time, who stubbornly refused to believe that nature would behave in such a pathological manner. Knowing Eddington's influence in the international community of astronomers, Chandrasekhar wisely abandoned his pursuit until others validated it much later.

The Swiss-born Fritz Zwicky was a more pugnacious character, and in the 1930s he and his Caltech colleague Walter Baade published an account of what we now call a neutron star as a plausible explanation for the tremendous energy powering the luminous explosion of a supernova. Zwicky's prickly and slightly paranoid personality led to his distancing from other mainstream scientists and his neutron stars were taken seriously by only a few scientists, among them the famous Soviet physicist Lev Landau. It was building on Landau's work in 1938 and 1939 that Oppenheimer and his students published three landmark papers which pushed the envelope on neutron stars and asked what would be the logical, extreme conclusion of a star completely unable to support itself against its own gravity. In the 1939 paper in particular, Oppenheimer and his student Hartland Snyder presented several innovations, among them the difference between time as measured by an external observer outside a black hole's so-called event horizon and a free falling observer inside it.

Then World War 2 intervened. Einstein got busy signing letters to President Franklin Roosevelt warning him of Germany's efforts to acquire nuclear weapons while Oppenheimer got busy leading the Manhattan Project. When 1945 dawned both of them had forgotten about the key theoretical insights regarding black holes which they had produced before the war. It was a trio of exceptional scientists - Dennis Sciama in the UK, John Wheeler at Princeton and Yakov Zeldovich in the USSR - who got interested in black holes after the war and pioneered research into them.

What is strangest about the history of black holes is Einstein and Oppenheimer's utter indifference to their existence. What exactly happened? Oppenheimer’s lack of interest wasn’t just because he despised the free-thinking and eccentric Zwicky who had laid the foundations for the field through the discovery of black holes' parents - neutron stars. It wasn’t even because he achieved celebrity status after the war, became the most powerful scientist in the country and spent an inordinate amount of time consulting in Washington until his carefully orchestrated downfall in 1954. All these factors contributed, but the real reason was something else entirely – Oppenheimer simply wasn’t interested in black holes. Even after his downfall, when he had plenty of time to devote to physics, he never talked or wrote about them. He spent countless hours thinking about quantum field theory and particle physics, but not a minute thinking about black holes. The creator of black holes basically did not think they mattered.

Oppenheimer’s rejection of one of the most fascinating implications of modern physics and one of the most enigmatic objects in the universe - and one he sired - is documented well by Freeman Dyson who tried to initiate conversations about the topic with him. Every time Dyson brought it up Oppenheimer would change the subject, almost as if he had disowned his own scientific children.

The reason, as attested to by Dyson and others who knew him, was that in his last few decades Oppenheimer was stricken by a disease which I call “fundamentalitis”. Fundamentalitis is a serious condition that causes its victims to believe that the only thing worth thinking about is the deep nature of reality as manifested through the fundamental laws of physics.
As Dyson put it:
“Oppenheimer in his later years believed that the only problem worthy of the attention of a serious theoretical physicist was the discovery of the fundamental equations of physics. Einstein certainly felt the same way. To discover the right equations was all that mattered. Once you had discovered the right equations, then the study of particular solutions of the equations would be a routine exercise for second-rate physicists or graduate students.”
Thus for Oppenheimer, black holes, which were particular solutions of general relativity, were mundane; the general theory itself was the real deal. In addition they were anomalies, ugly exceptions which were best ignored rather than studied. As Dyson mentions, unfortunately Oppenheimer was not the only one affected by this condition. Einstein, who spent his last few years in a futile search for a grand unified theory, was another. Like Oppenheimer he was uninterested in black holes, but he also went a step further by not believing in quantum mechanics. Einstein’s fundamentalitis was quite pathological indeed.
History proved that both Oppenheimer and Einstein were deeply mistaken about black holes and fundamental laws. The greatest irony is not that black holes are very interesting, it is that in the last few decades the study of black holes has shed light on the very same fundamental laws that Einstein and Oppenheimer believed to be the only things worth studying. The disowned children have come back to haunt the ghosts of their parents.
As mentioned earlier, black holes took off after the war largely due to the efforts of a handful of scientists in the United States, the Soviet Union and England. But it was experimental developments which truly brought their study to the forefront. The new science of radio astronomy showed us that, far from being anomalies, black holes litter the landscape of the cosmos, including the center of the Milky Way. A decade after Oppenheimer’s death, the Israeli theorist Jacob Bekenstein proved a very deep relationship between thermodynamics and black hole physics. Stephen Hawking and Roger Penrose found out that black holes contain singularities; far from being ugly anomalies, black holes thus demonstrated Einstein’s general theory of relativity in all its glory. They also realized that a true understanding of singularities would involve the marriage of quantum mechanics and general relativity, a paradigm that’s as fundamental as any other in physics.
In perhaps the most exciting development in the field, Leonard Susskind, Hawking and others have found intimate connections between information theory and black holes, leading to the fascinating black hole firewall paradox that forges very deep connections between thermodynamics, quantum mechanics and general relativity. Black holes are even providing insights into computer science and computational complexity. The study of black holes is today as fundamental as the study of elementary particles in the 1950s.
Einstein and Oppenheimer could scarcely have imagined that this cornucopia of discoveries would come from an entity that they despised. But their wariness toward black holes is not only an example of missed opportunities or the fact that great minds can sometimes suffer from tunnel vision. I think the biggest lesson from the story of Oppenheimer and black holes is that what is considered ‘applied’ science can actually turn out to harbor deep fundamental mysteries. Both Oppenheimer and Einstein considered the study of black holes to be too applied, an examination of anomalies and specific solutions unworthy of thinkers thinking deep thoughts about the cosmos. But the delicious irony was that black holes in fact contained some of the deepest mysteries of the cosmos, forging unexpected connections between disparate disciplines and challenging the finest minds in the field. If only Oppenheimer and Einstein had been more open-minded.
The discovery of fundamental science in what is considered applied science is not unknown in the history of physics. For instance Max Planck was studying blackbody radiation, a relatively mundane and applied topic, but it was in blackbody radiation that the seeds of quantum theory were found. Similarly it was spectroscopy or the study of light emanating from atoms that led to the modern framework of quantum mechanics in the 1920s. Scores of similar examples abound in the history of physics; in a more recent case, it was studies in condensed matter physics that led physicist Philip Anderson to make significant contributions to symmetry breaking and the postulation of the existence of the Higgs boson. And in what is perhaps the most extreme example of an applied scientist making fundamental contributions, it was the investigation of cannons and heat engines by French engineer Sadi Carnot that led to a foundational law of science – the second law of thermodynamics.
Today many physicists are again engaged in a search for ultimate laws, with at least some of them thinking that these ultimate laws would be found within the framework of string theory. These physicists probably regard other parts of physics, and especially the applied ones, as unworthy of their great theoretical talents. For these physicists the story of Oppenheimer and black holes should serve as a cautionary tale. Nature is too clever to be constrained into narrow bins, and sometimes it is only by poking around in the most applied parts of science that one can see the gleam of fundamental principles.
As Einstein might have said had he known better, the distinction between the pure and the applied is often only a "stubbornly persistent illusion". It's an illusion that we must try hard to dispel.
This is a revised version of an old post which I wrote on occasion of the one-hundredth anniversary of the publication of Einstein's field equations.

Oppenheimer’s Folly: On black holes, fundamental laws and pure and applied science

Einstein and Oppenheimer: Both men in their later years
dismissed black holes as anomalies, unaware that they contained
some of the deepest mysteries of physics
(Image: Alfred Eisenstaedt, LIFE magazine)
On September 1, 1939, the same day that Germany attacked Poland and started World War 2, a remarkable paper appeared in the pages of the journal Physical Review. In it J. Robert Oppenheimer and his student Hartland Snyder laid out the essential characteristics of what we today call the black hole. Building on work done by Subrahmanyan Chandrasekhar, Fritz Zwicky and Lev Landau, Oppenheimer and Snyder described how an infalling observer on the surface of an object whose mass exceeded a critical mass would appear to be in a state of perpetual free fall to an outsider. The paper was the culmination of two years of work and followed two other articles in the same journal.
Then Oppenheimer forgot all about it and never said anything about black holes for the rest of his life.
He had not worked on black holes before 1938, and he would not do so ever again. Ironically, it is this brief contribution to physics that is now widely considered to be Oppenheimer’s greatest, enough to have possibly warranted him a Nobel Prize had he lived long enough to see experimental evidence for black holes show up with the advent of radio astronomy.
What happened? Oppenheimer’s lack of interest wasn’t just because he became the director of the Manhattan Project a few years later and got busy with building the atomic bomb. It also wasn’t because he despised the free-thinking and eccentric Zwicky who had laid the foundations for the field through the discovery of black holes’ parents – neutron stars. It wasn’t even because he achieved celebrity status after the war, became the most powerful scientist in the country and spent an inordinate amount of time consulting in Washington until his carefully orchestrated downfall in 1954. All these factors contributed, but the real reason was something else entirely – Oppenheimer just wasn’t interested in black holes. Even after his downfall, when he had plenty of time to devote to physics, he never talked or wrote about them. The creator of black holes basically did not think they mattered.
Oppenheimer’s rejection of one of the most fascinating implications of modern physics and one of the most enigmatic objects in the universe – and one he sired – is documented well by Freeman Dyson who tried to initiate conversations about the topic with him. Every time Dyson brought it up Oppenheimer would change the subject, almost as if he had disowned his own scientific children.
The reason, as attested to by Dyson and others who knew him, was that in his last few decades Oppenheimer was stricken by a disease which I call “fundamentalitis”. Fundamentalitis is a serious condition that causes its victims to believe that the only thing worth thinking about is the deep nature of reality as manifested through the fundamental laws of physics.
As Dyson put it:
“Oppenheimer in his later years believed that the only problem worthy of the attention of a serious theoretical physicist was the discovery of the fundamental equations of physics. Einstein certainly felt the same way. To discover the right equations was all that mattered. Once you had discovered the right equations, then the study of particular solutions of the equations would be a routine exercise for second-rate physicists or graduate students.”
Thus for Oppenheimer, black holes, which were particular solutions of general relativity, were mundane; the general theory itself was the real deal. In addition they were anomalies, ugly exceptions which were best ignored rather than studied. As Dyson mentions, unfortunately Oppenheimer was not the only one affected by this condition. Einstein, who spent his last few years in a futile search for a grand unified theory, was another. Like Oppenheimer he was uninterested in black holes, but he also went a step further by not believing in quantum mechanics. Einstein’s fundamentalitis was quite pathological indeed.
History proved that both Oppenheimer and Einstein were deeply mistaken about black holes and fundamental laws. The greatest irony is not that black holes are very interesting, it is that in the last few decades the study of black holes has shed light on the very same fundamental laws that Einstein and Oppenheimer believed to be the only thing worth studying. The disowned children have come back to haunt the ghosts of their parents.
Black holes took off after the war largely due to the efforts of John Wheeler in the US and Dennis Sciama in the UK. The new science of radio astronomy showed us that, far from being anomalies, black holes litter the landscape of the cosmos, including the center of the Milky Way. A decade after Oppenheimer’s death, the Israeli theorist Jacob Bekenstein proved a very deep relationship between thermodynamics and black hole physics. Stephen Hawking and Roger Penrose found out that black holes contain singularities; far from being ugly anomalies, black holes thus demonstrated Einstein’s general theory of relativity in all its glory. They also realized that a true understanding of singularities would involve the marriage of quantum mechanics and general relativity, a paradigm that’s as fundamental as any other in physics.
In perhaps the most exciting development in the field, Leonard Susskind, Hawking and others have found intimate connections between information theory and black holes, leading to the fascinating black hole firewall paradox that forges very deep connections between thermodynamics, quantum mechanics and general relativity. Black holes are even providing insights into computer science and computational complexity. The study of black holes is today as fundamental as the study of elementary particles in the 1950s.
Einstein and Oppenheimer could scarcely have imagined that this cornucopia of discoveries would come from an entity that they despised. But their wariness toward black holes is not only an example of missed opportunities or the fact that great minds can sometimes suffer from tunnel vision. I think the biggest lesson from the story of Oppenheimer and black holes is that what is considered ‘applied’ science can actually turn out to harbor deep fundamental mysteries. Both Oppenheimer and Einstein considered the study of black holes to be too applied, an examination of anomalies and specific solutions unworthy of thinkers thinking deep thoughts about the cosmos. But the delicious irony was that black holes in fact contained some of the deepest mysteries of the cosmos, forging unexpected connections between disparate disciplines and challenging the finest minds in the field. If only Oppenheimer and Einstein had been more open-minded.
The discovery of fundamental science in what is considered applied science is not unknown in the history of physics. For instance Max Planck was studying blackbody radiation, a relatively mundane and applied topic, but it was in blackbody radiation that the seeds of quantum theory were found. Similarly it was spectroscopy or the study of light emanating from atoms that led to the modern framework of quantum mechanics in the 1920s. Scores of similar examples abound in the history of physics; in a more recent case, it was studies in condensed matter physics that led physicist Philip Anderson to make significant contributions to symmetry breaking and the postulation of the existence of the Higgs boson. And in what is perhaps the most extreme example of an applied scientist making fundamental contributions, it was the investigation of cannons and heat engines by French engineer Sadi Carnot that led to a foundational law of science – the second law of thermodynamics.
Today many physicists are again engaged in a search for ultimate laws, with at least some of them thinking that these ultimate laws would be found within the framework of string theory. These physicists probably regard other parts of physics, and especially the applied ones, as unworthy of their great theoretical talents. For these physicists the story of Oppenheimer and black holes should serve as a cautionary tale. Nature is too clever to be constrained into narrow bins, and sometimes it is only by poking around in the most applied parts of science that one can see the gleam of fundamental principles.
As Einstein might have said had he known better, the distinction between the pure and the applied is often only a “stubbornly persistent illusion”. It’s an illusion that we must try hard to dispel.
First published on SciAm

The Pope of Cosmology 'very ill'

For a 67 year old man with ALS who has already defied medical science, this is not good news at all. Remember what happened to Christopher Reeve. When you are in a condition like this, even otherwise normal ailments may become life-threatening.

I have been recently reading a lot about Hawking in Leonard Susskind's splendid book "The Black Hole War: My Battle with Stephen Hawking to Make the World Safe for Quantum Mechanics". The rather grandiose title of the book obscures a perfectly entertaining and informative romp through the world of black holes; this is about as close as possible to black hole thermodynamics, string theory and quantum mechanics that we laymen can get without being drowned in a whirlpool of math. Susskind who is a professor at Stanford tells the story of the paradox of information falling into a black hole and supposedly disappearing with lots of verve, hilarious personal anecdotes and tributes to famous physicists. Being a prime participant in the debate with Hawking on the other side, he is in a unique position to tell the story. His recounting of the way the physicist Jacob Bekenstein used high-school math to derive the formula for the entropy of black holes is astounding; very rarely has someone used such simple physics and mathematics to discover such profound relationships and the act reminded me of Bell's Theorem, another spectacular twentieth-century physics result that can essentially be derived using high-school mathematics.

But more than anyone else, it is Hawking's figure that looms large in the book. Susskind describes how his physical disability, his strange disembodied computer voice and his astonishingly brilliant and creative mind guarantees the kind of reverence and silence wherever he appears that otherwise only seems to be reserved for the Pope. Susskind vividly describes a typical Q & A session after a Hawking lecture; Hawking's physical condition means that he can compose even a "yes/no" answer only after several minutes, and what's striking is that during such times Susskind has witnessed audiences of thousands maintain stand-still silence with not a whisper spoken for sometimes fifteen minutes while the great man painfully communicates himself. Hawking may be the only living scientist whose presence provokes utter and rapt silence and attention that one would observe only during religious prayer. No wonder Hawking is compared to God by many, a comparison which only makes him uncomfortable. Susskind describes a particular time in a restaurant where a passerby went to his knees and virtually kissed Hawking's feet. Needless to say Hawking was embarrassed and galled.

In any case, we can only hope that Hawking feels better. However in one way we can rest assured; Stephen Hawking's name has been etched in the annals of science forever. That's the power of ideas. Their timelessness assures us that they remain youthful and vibrant, irrespective of the age and condition of their source. But let's all hope Hawking springs back from this illness to his mischievous, witty self.