Field of Science

Modeling magic methyls


Shamans have their magic mushrooms, we medicinal chemists have our magic methyls. The 'magic methyl effect' refers to the sometimes large and unexpected change in drug potency resulting from the addition of a single methyl group to a molecule (for laymen, a methyl group is a single carbon with three hydrogens, and you don't expect spectacular effects from the addition of such a small modification to a drug). This is part of a broader paradigm in chemistry in which small changes in molecular structure can bring about large changes in properties, especially biological activity.

In this study, researchers from Bill Jorgensen's group at Yale ask what exactly it is that a methyl group can do to a biologically active molecule. They look at more than 2000 cases of purported activity changes induced by methyl groups from two leading medicinal chemistry journals, and their work highlights some unexpected effects of methyls. The techniques used are free-energy perturbation, Monte-Carlo and molecular dynamics simulations to compare methylated and non-methylated versions of published inhibitors in an effort to gain insight into the factors dictating potency.

Firstly, they find that for all their reputation, methyls mostly confer a modest increase in potency. The greatest increase is about 3 kcal/mol in free energy, which considering the exponential relationship between free energy and binding constant, is actually quite substantial. But this happens in a negligible minority of cases; as they find, a 10 fold boost in potency with a methyl is seen in only 8% of the cases, while a 100 fold difference is seen in only 0.4%.

So what does a methyl do? For starters, a methyl is simply a nice, small, lipophilic group so you would expect it to give you some advantage simply by snugly fitting in in an otherwise unoccupied binding pocket. But the real advantage of a methyl is thought to come from kicking out 'unhappy' water molecules; often a small protein pocket is occupied by a highly constrained water molecule that is desperate to join its free brethren in the bulk. A methyl group is usually only too happy to oblige and kick the water out. Now, as the crystallographer Jack Dunitz demonstrated more than a decade back, the maximum free energy gain you could estimate from displacing a water molecule is about 2 kcal/mol. Considered in this light, you would expect a gain of at least that much from a hydrogen to methyl change, but the very rare 3 kcal/mol cases seen seem to call this belief into question. Clearly the common wisdom about methyls displacing waters is not telling us the entire story.

As the authors demonstrate, the common wisdom may indeed point to uncommon cases. They look at five cases where methyls give the greatest potency boost, and in no case do they find evidence for displacement of a water molecule. So where's the potency gain coming from? It turns out that it may be coming from a common but often underappreciated factor; conformational reorganization. When a ligand binds to a protein, it exists in several - often hundreds - of conformations in solution. How tightly the protein can bind the ligand depends on how much energy the protein can expend to twist and turn these conformations into the single bound conformation. You would expect that the more similar a molecule's unbound conformation in solution is to its protein-bound conformation, the easier it would be for the protein to latch on to it.

And indeed, that's what they find. Most of the cases they look at concern potency gains coming from putting methyls at the ortho position of a biaryl ring. Organic chemists are quite familiar with the steric, planarity-disrupting effects of ortho substituents on biaryl rings; in fact it's a tried and tested strategy to improve solubility by disrupting crystal packing effects. It turns out that the bound structures of the molecules present a twisted, non-planar conformation. In the absence of methyls, the rings would prefer to stay almost coplanar (or at least less non-planar) in the unbound conformation. But putting methyl groups on twists the rings in the unbound conformation into a form that's similar to the bound one; basically there's more overlap between the solution and bound conformations in case of the methylated versions compared to the non-methylated ones. Consequently, the protein has to expend less energy to turn an already similar conformation into its bound counterpart. This becomes clear simply by comparing the single dihedral angle bridging the two rings in the bound and unbound conformations of one particular molecule (as shown in the figure above).

The study seems to impart what is part of an important general lesson; when designing ligands or drugs to bind a protein, it is as important to take the solution conformations into account. It's not just how the protein interacts with the drug, but it's what the drug is doing before it meets the protein that's equally important.

A citation against citations

In the latest issue of Angewandte Chemie, Stanford chemistry professor Richard Zare has some cogent words of advice for assessing young faculty members when they are up for tenure. Zare has written the article partly as a response to what he sees as an excessive use and abuse of citation indices throughout the world in judging tenure-worthy achievements.

As Zare notes, the h-index which has been adopted in part because it seems to measure both quality and quantity is particularly ill-equipped to measure early success in research. This is mostly because (and this is one of the biggest arguments against any citation metric) the significance of most research does not become obvious until much later. Zare cites the example of physicist Steven Weinberg's paper unifying the electroweak force; while it was cited only a few times in the first few years, it is now one of the most highly cited papers in the history of physics. Another obvious example is Watson and Crick's DNA paper which gathered very few citations in its fledgling years. Thus citations, if they make sense at all, make much more sense in one's later career.

Yet there is a disturbing trend of universities worldwide adopting citation statistics to drive tenure decisions. In some countries like China, researchers are even awarded cash prizes for trying to publish large numbers of papers in both leading and minor science journals. As a recent article bemoaned, this has led to journals like Nature and Science being flooded by papers of dubious quality from certain countries. Not only can such practices create bias against papers from these countries, but they harm the global enterprise of science as a whole by emphasizing publication at the expense of genuinely interesting work.

Far better is to try to objectively judge the promise of young investigators by evaluating their impact on specific subfields. To this end Zare describes the system adopted by the Stanford chemistry department which puts the highest emphasis on 10 to 15 letters of recommendation from around the world. The letter writers are essentially asked to answer the simple question, "Has the investigators' work in his/her chosen area led to new understanding and directions in the field?". Everything else comes second, including the number and authorship rank of papers along with various indices. As Zare says,

We do not look into how much funding the candidate has brought to the university in the form of grants. We do not count the number of published papers ; we also do not rank publications according to authorship order. We do not use some elaborate algorithm that weighs publications in journals according to the impact factor of the journal. We seldom discuss h-index metrics, which aim to measure the impact of a researcher's publications. We simply ask outside experts, as well as our tenured faculty members, whether a candidate has significantly changed how we understand chemistry.


I find it very surprising - and encouraging - that the amount of money brought in does not play a major role in determining tenure. If true, this seems to go against disturbing current trends that are geared toward evaluating professors similar to sales managers at Macy's or hedge fund managers on Wall Street.


There is one caveat to what seems to be an otherwise cogent and role model-worthy tenure policy adopted by the Stanford chemistry department. Just as the true impact of research does not become clear until years later, the true value of ideas also does not become clear by asking 10, 15 or even 100 referees. Although this helps, it can mask the fact that most original scientific contributions at least partly challenge conventional wisdom, and keepers of the faith are almost always reluctant in endorsing such contributions. What should really matter is not whether a young scientist's work has led to new truths, but whether it has been interesting enough to spark a flurry of research activity that in turn may lead to minor or major truths. In science, being interesting is more important than being right, and tenure committees should take this fact into account.

On Freeman Dyson, cadmium estimation and the joy of chemistry

Freeman Dyson who is a hero of mine is someone who has done lots of interesting things during a long and fruitful life. If you look at his writings or talks it is easy to mistake him as a philosopher of science. But as he himself said to me during a long, one-on-one, intellectually sparkling lunch discussion two years ago, a lot of people think that talking about the big picture automatically makes one a philosopher. Dyson has indeed written about a lot of big picture topics, from the origins of life to the colonization of space. But he also maintains that he has always been first and foremost a problem solver, someone who is much more interested in details than in grand theorizing. Whatever philosophy he manages to weave is built on a foundation of solving specific technical problems. This is partly evidenced by his work on highly technical engineering projects ranging from nuclear spaceships to nuclear reactors.

This quality would make Dyson quite comfortable in the company of chemists, since chemistry by its very nature is more a problem-solving discipline rather than a philosophical pursuit like cosmology. I was curious to know Dyson's views on chemistry since he has not really written anything of note on the subject except a review in Physics Today of Roald Hoffmann's fine book "The Same and Not the Same".

Then I remembered a great collection of interviews with Dyson that I found a few years ago on a website called Web of Stories. This website is a must-see for history of science enthusiasts. It features interviews with scores of famous scientists, humanists and artists from diverse disciplines. The best thing about these interviews is that they are long and detailed instead of two minute sound bytes; each interview lasts in total for a few hours and covers most significant events in the interviewees's life, so you really get a close look at the thought processes of leading thinkers. In one of Dyson's interviews I was delighted to find this:

"I was going to say about chemistry that Roald Hoffmann whom I got to know quite recently, who is a chemist who writes poetry and is a great character, he has the same attitude toward chemistry that I do. I mean it is the beauty of the details rather than any over-arching theory. In that way it's very different from physics, and I had a taste for it. My taste is always more for the details than for the big picture...

...I learned chemistry from Christopher Longuet-Higgins who was already much more of an expert and more excited about chemistry than Eric James. And I remember Christopher bringing to Winchester some crystals of stannic iodide which he had made, which is the most marvelous stuff. It is a brilliant scarlet colour and it makes these beautiful scarlet crystals, and they're also extremely heavy. If you have a little bottle full of it, it feels like lead. So that kind of chemistry I found delightful, just the sort of details of the actual stuff, rather than the theory that lay behind it.

I remember the joy when, here in Princeton, Willard Libby came on a visit once and brought along another little bottle of chemicals, which also was very heavy, and that was barium xenate, which was barium xenon oxide, which of course was an absolute revelation because nobody imagined that xenon could have compounds, being an inert gas. And it was sometime in the 1950s these compounds were discovered, and barium xenate is just such an ordinary stuff. It's a sort of heavy white crystals which are completely stable, they don't show any signs of anything strange and there it is. If you heat them up of course the xenon comes bubbling off..."

So there, I think Dyson would have felt right at home as a chemist. And the point he makes is an obvious and important one that is often lost among the cliched caricatures of chemists bubbling frothy liquids and crystallizing colorful solids that one often sees in literature and cinema. But it's precisely these bubbling liquids and colorful solids that provide chemistry with a palpable reality that's often missing from more theoretical sciences.

A personal digression. I remember an episode from an undergraduate chemistry lab where we were supposed to estimate two unknown metal ions from a solution. After trying out every test in the book we could only detect copper. The other ion remained a mystery and we finally threw up our hands. That's when the instructor revealed his trick. It turns out that the method of copper estimation that we were using involved turning the solution highly acidic with hydrochloric acid. With a smile on his face, the instructor put a single drop of the concentrated acidic solution in a large flask and then filled the flask to the brim with water, diluting the initial solution by at least a factor of ten thousand. Our eyes were glued to the flask as he passed hydrogen sulfide gas into the solution. And then, starting from the bottom and rising to the top, the flask filled up with the most beautiful yellow color that I have ever seen; it's a sight that I will never forget. What happens is that cadmium is precipitated as cadmium sulfide only in dilute acidic solutions while for copper it's the opposite. All our tests for detecting copper in concentrated acid missed the hidden cadmium, until it was ready to be unmasked by simple dilution.

Every chemist among us is familiar with this feeling of discovering something unknown, no matter how trivial or important, that actually exists; all the better if it has a brilliant scarlet or full-throated yellow color, as is often the case in chemistry. Dyson is right that there is something unmistakably reassuring, in-your-face - real - about holding a vial of something that was previously considered impossible.

Physicists often like to tell the story of how Einstein felt that "something had snapped inside" him when he saw the predictions of general relativity confirmed by observations of the perihelion of mercury. He surely must have felt the rare, once-in-a-lifetime satisfaction of a great theoretical construct being validated by a real observation that could be boiled down to a single number. We tend to think of Einstein as the great scientist-philosopher, but there he was, being ecstatic about a technical detail that was a crucial part of his magnum opus. Observing barium xenate or cadmium is not quite as momentous as confirming the theory of relativity, but I can readily imagine feeling a shiver down my spine if I had been presented with that sort of chemical evidence. Evidence that seemed to defy the impossible but which I could nonetheless hold in my hand and keep in my closet. That's the joy of chemistry.

A molecular modeler's view of molecular beauty

The last few months have seen discussion on the definition of "beauty" as applied to molecular structures. As a molecular modeler, I ended up ruminating on what I think are the features of molecules that I would call beautiful.

This kind of exercise may seem pointless since it's highly subjective. And yet I think that exploring these definitions is valuable because at least a few of the conflicts that occasionally erupt between groups of interdisciplinary scientists seem to reside in divergent definitions of molecular beauty. A typical scenario is when a modeler designs a molecule that seems to fit perfectly in a protein binding pocket, only to have it dismissed by the medicinal chemist because it's too hard to make. Or because it looks like a detergent. In this case, structural beauty has not necessarily translated to practical beauty- always a consideration when one is talking about molecules which ultimately have to be synthesized. In fact, projects can often progress when different scientists agree - often unconsciously - on a notion of beauty or utility and they can falter when these ideas lead different scientists down very different paths.

So what kind of molecules does a modeler find pleasing? Let's first look at structure-based design which in its broadest sense entails acquiring crystal structures of proteins and finding and tailoring molecules to fit the binding site of those proteins. Beauty in structure-based design is not hard to appreciate since it inherently involves protein structures, paragons of symmetry and parsimonious elegance. In this sense the modeler has much more in common with crystallographers than medicinal chemists. He or she is always struck by how precisely oriented the amino acid residues in a protein's binding site are. Concomitantly, it's not surprising that for a modeler, a particularly beautiful molecule may be one that makes interactions with most or all of the residues, especially in the form of hydrogen bonds with geometries so perfect that they might have fallen from the sky. This preference for geometric complementarity is extremely general. A particular pleasing manipulation for a modeler may be one that leads to a perfect fit for a given protein cavity, with the contours of the molecular surface of the molecule following those of the protein.

Yet there are limits to how far this beauty-from-complementarity can take you. Designing a molecule with interactions that are too tightly knit and precise may leave very little room for error. And considering the inherent inaccuracy of many modeling algorithms, it may be best to always be forgiving and give the design some space to move around in the binding site, so that slight reorganizations of both protein and ligand can still result in reasonably tight binding.

While we are on the subject of shape complementarity, let's not forget a factor which has only recently been started to be taken into account - water molecules filling the active site. These water molecules which are often highly constrained can have a perverse beauty of their own; they are sometimes trapped in both an entropic (no freedom of movement) and enthalpic (unable to satisfy their optimal four hydrogen bonds) cage, and yet they are the only things keeping the protein from what technically must be called a vacuum. These water molecules deserve to be freed, and there is a particularly deep kind of satisfaction in adding a functional group to a ligand that would displace them from the protein's tight embrace and enable them to join the ranks of their hydrogen-bonded brethren. A modeler could regard a modification precisely tailored to improve affinity by freeing up a water molecule as a particular beautiful case of molecular engineering.

Yet as we have sometimes seen, the beauty of filling protein pockets with perfectly matched shapes may lead to a conflict with other practitioners of the art. For starters, a relentless march toward adding functionality can detract from at least two important features - size and lipophilicity - both of which are often casualties of "molecular obesity". Dents in beauty can come from too many chiral centers, aromatic rings or quaternary carbons. Real beauty in structure-based design arises from a precise balance of complementarity and simplicity in the design. And of course there is the always important consideration of synthetic accessibility, which is why every modeler should ideally take a basic course in organic synthesis.

Beyond structure-based design, there are other considerations that endear molecules to modelers. Protein structures are not always available, and in the absence of such structures, molecular similarity alone is sometimes used to find novel active molecules. The question is simple; given a known molecule of high potency, how will you discover molecules similar to it in structure. The answer is complicated. The key to realize here is that this similarity must be defined in three dimensions since all molecular interactions are in 3D. Conformational similarity is one of the most elegant considerations for a modeler, and one that synthetic chemists often don't contemplate. Very few things provide as much satisfaction to a modeler as the observation that two molecules with very different 2D structures seem to adopt the same biologically active 3D conformation in solution and in the binding pocket. And a particularly gratifying and rare find - for both modelers and synthetic chemists - is a molecule which nature has sterically constrained to a single dominant conformation by the judicious placement of certain functional elements. Discodermolide, a microtubule binding agent which I worked on in graduate school, belongs to this category.

Those then are the criteria that come to my mind for defining molecular elegance - perfect (but not too perfect) shape complementarity to a precisely structured binding site, a well-defined 3D conformation often similar to a completely different molecule and simplicity in structure in spite of these other demanding features. Conflicts arise when modelers' and chemists' notions of molecular pulchritude diverge. And it's a happy coincidence when these sensibilities overlap, which is more often than you might think.

On physics envy and drug discovery

In a recent New York Times article, two prominent social scientists lament the epidemic of physics envy that has infected their ranks, and they implore their colleagues to take a more observation-based, utilitarian approach to addressing the most pressing problems of social science.

We natural scientists should empathize. Physics envy is the name of a disease that afflicts many scientists at various stages of their careers. Its main symptom is an overwhelming desire to see their science - whatever it may be - become as precise and predictable as particle physics. The victim of physics envy thinks wistfully of the glorious days of quantum mechanics and molecular biology and believes that his or her science can achieve the same six-decimal precision in its measurements and predictions. The victims may be natural or social scientists, although the disease takes on a particularly nasty form when it affects economists, as recounted by the physicist-turned-financial modeler Emanuel Derman.

Physics envy is so widespread that even physicists are affected by it. Some theoretical physicists for instance want to reduce all the world's complexities to an all-encompassing theory of "everything", preferably a single equation that would describe everything from black holes to romantic love. Presumably this will help us truly understand, from first principles, why nations go to war or why election outcomes depend on Ohio. This is in part because physics envy is closely tied to its cousin reductionism which provided untold dividends in twentieth century science. But the scientific world in the twenty-first century is a different creature. Physics envy during our times can cause tunnel vision, an exaggerated belief in the power of mathematics, and not infrequently, the loss of billions of dollars. Perhaps the worst thing about this malady may be its focused transmission to new generations of students and scientists, thus ensuring its long life and continued dominance.

Sadly, this disease is not unknown among drug discovery scientists, and I dare say that I have suffered from it myself. Drug discovery is a complex, multidisciplinary field where luck and intuition play as great a role as any rational approach. Drug hunters study complex systems that are almost always refractory to any one approach from any one science. Yet physics envy exists, implicitly or explicitly. You see it in the modeler who thinks he can find the next revolutionary drug simply by optimizing his compound's affinity for his protein, or the synthetic chemist who thinks that he can produce an army of molecular analogs that can dissect a complete biological pathway, or the biologist who thinks that inhibiting his pet protein will be all that it takes to disable a complicated biochemical pathway.

A more serious case is the scientist who thinks that if only we had knowledge of every single biological and chemical building block, if only we could map out every gene, every protein, every small molecule interacting with all these genes and proteins and present these interactions on a wall like a subway map, we will be able to understand and treat all diseases. These scientists who often but not always go by the name of systems biologists, try to produce precisely this kind of map and predict the output from an input. The output can be in the form of an upregulated protein or the manifestation of a phenotype. The input may be the activation of a gene or inhibition of a protein by a small molecule. The systems biologists think that what's necessary (and perhaps sufficient) for predicting responses in a biological system is a map.

Yet as the Nobel Prize winning biologist Sydney Brenner once wrote in a very readable article, he has been practicing "systems biology" all his life, except that in his time it was called "physiology". Brenner is supposedly practicing systems biology without a license, and yet he and many of his fellow classical physiologists seem to have been both remarkably successful and strangely immune to physics envy. Their job was to study the responses of biological systems using every tool at their disposal. It did not matter if they didn't have an overwhelming theoretical framework to tie together their diverse observations. As the authors of the NYT article indicate, the lack of deep theory does not preclude either understanding or utility. An example of this principle would be the school of pharmacology starting with Steve Brodie at the NIH and culminating with Solomon Snyder at Johns Hopkins. As illustrated in Robert Kanigel's book, these scientists made important discoveries in basic pharmacology even when detailed knowledge of genes and proteins was unavailable. They did not need the pharmacological equivalent of a "theory of everything" to proceed. In fact they did not even need a theory in some cases.

The same goes for drug discovery in general. Think of the currently fashionable paradigm of phenotypic screening which involves discovering new compounds by looking at their effects on simple phenotypic traits like locomotion or heart rate. These approaches hark back to the old days of drug discovery when the responses could be purely clinical, anything from increased urination to dry mouth to flushed faces. This approach is very far from the target-based reductionist approaches that have become popular in the last twenty years, yet nobody can deny its value.

But neither are target-based approaches useless. If you are dealing with HIV protease which can yield copious crystal structures, a structure-based approach might be, and indeed was, very fruitful. But think of a protein whose binding pocket is unknown, which is full of flexible regions and whose functional form consists of oligomers of unknown composition, and structure-based approaches might be completely useless. It might then be best to proceed based on the biology alone or by educated guesswork guided by SAR trends.

The point is, it all depends on the specific case. And therein lies the rub of drug discovery and the problem of physics envy. As I mentioned in a previous post, physics searches for general principles while drug discovery largely thrives on exceptions. The question in drug discovery is not what overarching principle can be applied to all cases, but what exact mix of different techniques would work for a given case. It's very different from physics, where the goal is to search for one equation to rule them all.

Fortunately physics envy has a potent antidote, both in physics and in drug discovery. It goes by the name of "nature". Whenever physics envy tries to go on a rampage, nature invariably steps in and straps on the straitjacket. In just the last few years we have seen nature generously cutting us down to size. From resveratrol-based SIRT inhibitors for aging to recently tainted PARP inhibitors for cancer, we have seen how nature (which in most of these cases means "biology") is smarter than us. Every time we break down a system into its constituent parts and pin down what we think is the operative entity, nature keeps reminding us that there's something else out there which is equally important which we have missed. In some sense nature is mocking us for bringing our biases to bear on what in her scheme of things is only one important component of a grand dance. In nature's eyes the rule is simple; if we want to participate, we better make sure we know who our partner is. And leave physics envy at the door.

On Michael Dewar, Robin Collingwood and models in chemistry

If you want to read memoirs by famous organic chemists that describe the pleasures and pains of doing real science, you can do no better than reach for historian Jeff Seeman's marvelous and unique set of edited autobiographies published in the 1990s by the ACS, titled "Pathways, Profiles and Dreams". These include volumes penned by such bigwigs as Jack Roberts, Derek Barton, Ernest Eliel, William Johnson, Carl Djerassi and Vladimir Prelog. All of them are eminently informative, inspiring and readable and chart out half a century of organic chemistry during its golden age.

Even among these volumes Michael Dewar's memoirs stand out. Dewar was a truly brilliant man with a vast and in-depth knowledge of not just many fields of chemistry but of other branches of human knowledge. He had an illustrious career starting out at Winchester and Oxford and ending at the University of Texas at Austin. A man who was equally at home with dense mathematical calculations and the intricacies of organic synthesis, Dewar contributed many ideas to chemistry but two in particular demonstrate the breadth of his abilities. Firstly, when he was still doing synthesis, he was the first to propose the existence of an aromatic tropone ring in the structure of colchicine, opening the door to the world of non-benzenoid aromatic hydrocarbons. Secondly, he was the father of semi-empirical molecular orbital theory which he described in a remarkable set of back-to-back, highly mathematical papers in JACS and then in a book. His autobiography (aptly titled "A Semiempirical Life") is the thickest of the lot and provides him with an opportunity to hold forth on a variety of topics, from vitamin C to the expansion of the universe.

Unfortunately Dewar's undoubtedly substantial scientific reputation was somewhat blemished by his pugnacious personality and stubbornness, qualities that enraged his enemies and delighted his friends (and he was nothing if not a fiercely loyal friend). Dewar was quick to engage in argument and generally would not give up until he convinced his opponents of his views. In addition he was rather willing to take credit for ideas that were ascribed to others and enthusiastic to insert himself in controversies; for instance he claims to be the only scientist who changed his views (wrongly, as it later turned out) in the infamous non-classical ion debate largely waged by Herbert Brown and Saul Winstein. A past advisor of mine once had lunch with Dewar, and about the only thing he remembers is Dewar railing against the Nobel committee for not awarding him a prize. All this led Jack Roberts to label Dewar the "Peck's Bad Boy of Chemistry".

But Dewar's undoubtedly valuable and prolific contributions to chemistry cannot be denied, and the book contains much of value. Here I want to focus on a section where Dewar describes his take on the philosophy of chemistry and of science in general. In this he was greatly inspired by the now largely forgotten British philosopher Robin Collingwood; in fact he says that Collingwood's works were the single-most important influence on his intellectual development. The reason Collingwood's work is important for chemistry is because of its special relevance to chemical reasoning. This separates it from the traditional philosophy of science that was largely developed by physicists and applied to physics.

Here's Dewar on models:

A model is a simple mechanism that simulates the behavior of a more complex one. A scientific model must simulate the behavior of the universe, or some part of it, while remaining simple enough for us to understand. The test of such a model is purely operational. Does it in fact simulate the behavior of the system being modeled? If not, we have to modify it or replace it with a better one, better in the sense that it simulates the parent system more effectively. There is of course no question of a model being true or false. The same rule applies to scientific theories, which are simply definitions of scientific models. The question, "Is it true?" is meaningless in science. The correct question to ask is "Does it work?"

That there is one of the most accurate encapsulations of the philosophy of chemistry that I have come across. It enunciates all the main features of good chemical models. Chemistry as a science is based much more on models than physics. Crucially, chemical models must be simple enough to be understood by experimentalists while remaining general enough to describe a wide range of situations. This is one reason why reductionism does not work so well in chemistry on a practical basis. Chemists also are more easily reconciled to the value of models as utilitarian constructs rather than representations of some deep and ultimate reality. Physicists worry much more about such things, and the fact that chemists don't does not make them any less scientific or any less enamored of the pursuit of truth. Chemistry much more than physics is about special cases rather than general phenomena. Chemists certainly care about general explanatory frameworks like chemical bonding, steric effects and electron transfer, but even there the thrust is not necessarily to uncover deep reality but to find something that works. The chemist is the perpetual tinkerer, and it is through tinkering that he or she is led to "the truth".

Image source

How it came from bit: Review of George Dyson's "Turing's Cathedral"

The physicist John Wheeler who was famous for his neologisms once remarked that the essence of the universe could be boiled down to the phrase "it from bit", signifying the creation of matter from information. This description encompasses the digital universe which now so completely pervades our existence. Many moments in history could lay claim as the creators of this universe, but as George Dyson marvelously documents in "Turing's Cathedral", the period between 1945 and 1957 at the Institute for Advanced Study (IAS) in Princeton is as good a candidate as any.

The title is somewhat misleading. Dyson's book focuses on the pioneering development of computing during the decade after World War II and essentially centers on one man- John von Neumann; lover of fast cars, noisy parties and finely tailored suits (as the photo above shows, he shared this sartorial taste with IAS director Robert Oppenheimer). A man for whom the very act of thinking was sacrosanct, Von Neumann is one of the chosen few people in history to whom the label "genius" can authentically be applied. His central talent was an unsurpassed ability to take apart any problem from any field and put it back together so that the answer was usually staring you in the face. The sheer diversity of fields to which he made important contributions beggars belief- Wikipedia lists at least twenty ranging from the mathematical foundations of quantum mechanics to game theory to biology. As one of the IAS's first permanent members, his mind ranged across a staggeringly wide expanse of thought, from the purest of mathematics to the most applied nuclear weapons physics.

Dyson's book recounts the path breaking efforts of von Neumann and his team to build a novel computer at the IAS in the late 1940s. Today when we are immersed in a sea of computer-generated information it is easy to take the essential idea of a computer for granted. That idea was not the transistor or the integrated circuit or even the programming language but the groundbreaking notion that you could have a machine where both data AND the instructions for manipulating that data could be stored in the same place by being encoded in a common binary language. That was von Neumann's great insight which built upon the idea of Alan Turing's basic abstract idea of a computing machine. The resulting concept of a stored program is at the foundation of every single computer in the world. The IAS computer practically validated this concept and breathed life into our modern digital universe. By present standards its computing power was vanishingly small (as Dyson poignantly puts it, there were a total of 53 bytes of memory in the world in 1953), but the technological future it unleashed has been limitless. The one thing that von Neumann got wrong was that he envisioned computers getting bigger and bigger, but apart from this miscalculation he seems to have seen it all.

Dyson's book excels mainly in three ways. Firstly, it presents a lively history of the IAS, the brilliant minds who worked there and the culture of pure thought that often looked down on von Neumann's practical computational tinkering; it describes the pure mathematicians' "undisguised horror" at a bunch of engineers getting their hands dirty with real machinery at so close to their offices. Secondly, it discusses the provenance of von Neumann's ideas which partly arose from his need to perform complex calculations of the events occurring in a thermonuclear explosion. These top-secret calculations were quietly run at night on the IAS computer and in turn were used to tweak the computer's workings; as Dyson pithily puts it, "computers built bombs, and bombs built computers". Von Neumann also significantly contributed to the ENIAC computer project at the University of Pennsylvania. Thirdly, Dyson brings us evocative profiles of a variety of colorful and brilliant characters clustered around von Neumann who contributed to the intersection of computing with a constellation of key scientific fields that are now at the cutting edge.

There was the fascinating Stan Ulam who came up with a novel method for calculating complex processes - the Monte Carlo technique - that is used in everything from economic analysis to biology. Ulam who was one of the inventors of thermonuclear weapons originally used the technique to calculate the multiplication of neutrons in a hydrogen bomb. Then there was Jule Charney who set up some of the first weather pattern calculations, early forerunners of modern climate models. Charney was trying to implement von Neumann's grand dream of controlling the weather, but neither he nor von Neumann could anticipate chaos and the fundamental sensitivity of weather to tiny fluctuations. Dyson's book also pays due homage to an under-appreciated character, Nils Barricelli, who used the IAS computer to embark on a remarkable set of early experiments that sought to duplicate evolution and artificial life. In the process Barricelli discovered fascinating properties of code, including replication and parasitism that mirrored some of the great discoveries taking place in molecular biology at the time. As Dyson tells us, there were clear parallels between biology and computing; both depended on sequences of code, although biology thrived on error-prone duplication (leading to variation) while computing actively sought to avoid it. Working on computing and thinking about biology, von Neumann anticipated the genesis of self-reproducing machines which have fueled the imagination of both science fiction fans and leading researchers in nanotechnology.

Finally, Dyson introduces us to the remarkable engineers who were at the heart of the computing projects. Foremost among them was Julian Bigelow, a versatile man who could both understand code and fix a car. Bigelow's indispensable role in building the IAS computer brings up an important point; while von Neumann may have represented the very pinnacle of abstract thought, his computer wouldn't have gotten off the ground had Bigelow and his group of bright engineers not gotten their hands dirty. Great credit also goes to the two lead engineers on the ENIAC project, J. Presper Eckert and John Mauchly, who were rather unfairly relegated to the shadows and sidetracked by history. Dyson rightly places as much emphasis on discussing the nitty-gritty of the engineering hurdles behind the IAS computer as he does on its lofty mathematical underpinnings. He makes it clear that the ascendancy of a revolutionary technology requires both novel theoretical ideas as well as fine craftsmanship. Unfortunately in this case, the craftsmanship was ultimately trampled by the institute's mathematicians and humanists, which only added to its reputation as a refuge for ivory tower intellectuals who considered themselves above pedestrian concerns like engineering. At the end of the computing project the institute passed a resolution which forbade any kind of experimentation from ever taking place; perhaps keeping in line with his son's future interest in the topic, Freeman Dyson (who once worked on a nuclear spaceship and genuinely appreciates engineering details) was one of the few dissenting voices. But this was not before the IAS project spawned a variety of similar machines which partly underlie today's computing technology.

All these accounts are supplemented with gripping stories about weather prediction, the US thermonuclear program, evolutionary biology, and the emigration of European intellectuals like Kurt Godel and von Neumann to the United States. The books does have its flaws though. For one thing it focuses too heavily on von Neumann and the IAS. Thus Dyson says relatively very little about Turing himself, about pioneering computing efforts at Manchester and Cambridge (the first stored-program computer in fact was the Manchester "Baby" machine) and about the equally seminal development of information theory by Claude Shannon. James Gleick's "The Information" and Andrew Hodges's "Alan Turing: The Enigma" might be useful complements to Dyson's volume. In addition, Dyson often meanders into one too many digressions that break the flow of the narrative; for instance, do we really need to know so much about Kurt Godel's difficulties in obtaining a visa?

Notwithstanding these gripes, the book is beautifully written and exhaustively researched with copious quotes from the main characters. It's certainly the most detailed account of the IAS computer project that I have seen. If you want to know about the basic underpinnings of our digital universe, this is a great place to start even with its omissions. All the implications, pitfalls and possibilities of multiple scientific revolutions can be connected in one way or another to that little machine running quietly in a basement in Princeton.

UNC physics professor held on cocaine smuggling charges

Here's a story that's strange and intriguing. Paul Frampton, a well-known theoretical physicist at UNC-Chapel Hill, has been jailed in Argentina for trying to leave the country with no less than 2 kilos of cocaine smuggled in his baggage. He faces the rather horrific prospect of 16 years in jail if convicted.

The story's strange for several reasons. Frampton seems to be a rather distinguished physicist who has published 73 papers in just Physical Review and Physical Review Letters, the two leading journals in physics. I have never personally interacted with him but know someone who was a graduate student with him in the 80s. That person tells me that Frampton was a helpful and gracious advisor who would take care of his students. I find it very unlikely that a 68-year old theoretical physicist at a leading university who has long since had an excellent reputation in his field would risk it all by brazenly trying to commit such an ill-concealed and obvious crime. Even if he wanted to pull it off it would be rather stupid of someone to just try to smuggle such a large amount of cocaine in his baggage. I don't have any evidence pointing either way, but this just seems to be one of those cases where your gut-feelings (as flawed as they are) point in a preferred direction.

UNC also doesn't seem to be particularly helpful in supporting Frampton. They have suspended his pay for one semester which I find extremely disappointing and unworthy of an institution of UNC's caliber. Yes, it's true that he will be unavailable to teach spring semester, but it seems unfair to blame that on him when the details of the case are not clear. At the very least I would have expected them to offer him a percentage of his current salary, but ideally they should have stuck behind an old and distinguished colleague. What happened to the whole "innocent until proven guilty" adage? There also seems to be some kind of rivalry between Frampton and the provost, also a physicist. Frampton claims that the provost has had a role to play in his arrest and possible framing, perhaps out of sheer jealousy. Some parts of the story seem straight out of a bad Disney movie.

Hopefully the air will clear soon. Until then Frampton will have to stay in Argentina, and we can only hope that he will be exonerated of these rather bizarre charges.

Book review: The Idea Factory: Bell Labs and the Great Age of American Innovation

During its fifty odd years of existence, Bell Labs was the most productive scientific laboratory on the planet. It won seven Nobel Prizes, contributed innumerable practical ideas underlying our modern way of life and, whether by accident or design, also managed to make some spectacular basic scientific discoveries that expanded our understanding of the universe. How did it possibly accomplish all this? In this authoritative and intensely engaging book, Jon Gertner tells us exactly how.

Gertner's book about this great American institution excels in three ways. Firstly, it describes in detail the genesis of what was then an unlikely research institution. Until then most communications related work was considered to be squarely within the domain of engineering. Bell Labs arose from a need to improve communications technology pioneered by its parent organization AT&T. But the real stroke of genius was to realize the value that basic scientists - mainly physicists and chemists - could bring to this endeavor along with engineers. This was largely the vision of two men - Frank Jewett and Mervin Kelly. Jewett who was the first president of Bell Labs had the foresight to recruit promising young physicists who were proteges of his friend Robert Millikan, a Nobel Prize winning physicist and president of Caltech. Kelly in turn was Millikan's student and was probably the most important person in the history of the laboratory. It was Kelly who hired the first brilliant breed of physicists and engineers including William Shockley, Walter Brittain, Jim Fisk and Charles Townes and who would set the agenda for future famous discoveries. During World War II Bell gained a reputation for taking on challenging military projects like radar; at the end of the war it handled almost a thousand of these. The war made the benefits of supporting basic science clear. It was Kelly again who realized that the future of innovation lay in electronics. To this end he moved Bell from its initial location in New York City to an expansive wooded field in New Jersey near Murray Hill and recruited even more brilliant physicists, chemists and engineers. This added further fuel to the fire of innovation started in the 1930s, and from then on the laboratory never looked back.

Secondly, Gertner gives a terrific account of the people who populated the buildings in Murray Hill and their discoveries which immortalized the laboratory. Kelly instituted a policy of hiring only the best minds, and it did not matter whether these were drawn from industry, academia or the government. In some cases he would go to great lengths to snare a particularly valuable scientist, offering lucrative financial incentives along with unprecedented freedom to explore ideas. This led to a string of extraordinary discoveries which Gertner describes in rich and accessible detail. One feature of the book that stands out is Gertner's efforts in describing the actual science instead of skimming over it; for instance he pays due attention to the revolution in materials chemistry that was necessary for designing semiconductor devices. The sheer number of important things Bell scientists discovered or invented beggars belief; even a limited but diverse sampling includes the first transatlantic cable, transistors, UNIX, C++, photovoltaic cells, error-corrected communication, charged-coupled devices and statistical process control that now forms the basis of the six-sigma movement. The scientists were a fascinating, diverse lot and Gertner brings a novelist's eye in describing them. There was Bill Shockley, the undoubtedly brilliant, troubled, irascible physicist whose sin of competing against his subordinates led to his alienation at the lab. Gertner provides a fast-paced account of those heady days in 1947 when John Bardeen, Brittain and Shockley invented the transistor, the truly world-changing invention that is Bell Labs's greatest claim to fame. Then there was Claude Shannon, the quiet, eccentric genius who rode his unicycle around the halls and invented information theory which essentially underlies the entire modern digital world. Described also are Arno Penzias and Robert Wilson, whose work with an antenna that was part of the first communications satellite - also built by Bell - led to momentous evidence supporting the Big Bang. The influence of the laboratory was so formative that even the people who left Bell Labs later went on to greatness; several of these such as John Bardeen and future energy secretary Steven Chu joined elite academic institutions and won Nobel Prizes. It's quite clear that the cast of characters that passed through the institution will probably never again be concentrated in one place.

But perhaps the most valuable part of the book deals not with the great scientific personalities or their discoveries but with the reasons that made Bell tick. When Kelly moved the lab to Murray Hill, he designed its physical space in ways that would have deep repercussions for productive thought and invention. Most crucially, he interspersed the basic and applied scientists together without any separation. That way even the purest of mathematicians was forced to interact with and learn from the most hands-on engineer. This led to an exceptional cross-fertilization of ideas, an early precursor of what we call multidisciplinary research. Labs and offices were divided by soundproof steel partitions that could be moved to expand and rearrange working spaces. The labs were all lined along a very long, seven-hundred foot corridor where everybody worked with their doors open. This physical layout ensured that when a scientist or engineer walked to the cafeteria, he or she would "pick up ideas like a magnet picks up iron filings".

Other rules only fed the idea factory. For instance you were not supposed to turn away a subordinate if he came to ask you for advice. This led to the greenest of recruits learning at the feet of masters like Bardeen or Shannon. Most importantly, you were free to pursue any idea or research project that you wanted, free to ask anyone for advice, free to be led where the evidence pointed. Of course this extraordinary freedom was made possible by the immense profits generated by the monopolistic AT&T, but the heart of the matter is that Bell's founders recognized the importance of focusing on long-term goals rather than short-term profits. They did this by gathering bright minds under one roof and giving them the freedom and time to pursue their ideas. And as history makes clear, this policy led not only to fundamental discoveries but to practical inventions greatly benefiting humanity. Perhaps some of today's profitable companies like Google can lift a page from AT&T and channel more of their profits into basic, broadly defined, curiosity-driven research.

Gertner's highly readable book leaves us with a key message. As America struggles to stay competitive in science and technology, Bell Labs still provides the best example of what productive industrial research can accomplish. There are many lessons that modern organizations can learn from it. One interesting lesson arising from the cohabitation of research and manufacturing under the same roof is that it might not be healthy beyond a point to isolate one from the other, a caveat that bears directly on current offshoring policies. It is important to have people involved in all aspects of R&D talking to each other. But the greatest message of all from the story of this remarkable institution is simple and should not be lost in this era of short-term profits, layoffs and declining investment in fundamental research: the best way to generate ideas still is to hire the best minds, put them all in one place and give them the freedom, time and money to explore, think and innovate. You will be surprised how much long-term benefit you get from that policy. As they say, mighty trees from little acorns grow, and it's imperative to nurture those little seeds.

If you want them to collaborate, you should let them collaborate

The past few months have seen a string of stories about major drug makers shutting down their neuroscience research, a move that seems to be the exact opposite of what they should be doing, even in times of economic distress. Many neurological disorders are the very definition of unmet needs, and one would think that pharma would pump in massive, long-term resources into Alzheimer's disease research with alacrity. But such are the times we live in.

A recent commentary in Nature brought this topic to my attention. The authors are from the ETH in Zurich and, after lamenting the withdrawal of drug companies from neuroscience research, they try to propose a way forward in the form of increased industry-academia collaboration. Whether this increasingly fashionable brainwave will work is still unknown. But one paragraph in particular caught my attention:

To reinvigorate the field and avoid repeating past problems, more exchange should be fostered between basic and clinical scientists. When spinal-cord researchers began organizing retreats and workshops to bring together basic researchers and clinicians, they saw first-hand how little each side knows about how the other works. The mutual lack of knowledge was huge; each side had completely different language to describe the same scenario.


But this is exactly what the drug companies should have been doing, putting the basic and clinical scientists under one roof. It's lamentable that they need to have special retreats for bringing these folks together. The reason why this part jumped out at me was because I have just started reading Jon Gertner's great new book about Bell Labs. Many reasons contributed to the institution's phenomenal success, but one notable factor was the concentration of the purest and the most applied scientists under one roof. The firm's pioneering research director Mervin Kelly carefully planned the physical layout of the lab so that everyone, irrespective of specialty or research level, was a stone's throw from everyone else. That way even the purest mathematician was forced to interact and learn from the most hands-on engineer. Research and manufacturing were geographically indistinguishable. There was a very long seven-hundred foot corridor with open offices and labs on each side. It was impossible to walk down the hall and not learn something from someone working in a very different field.

That formula still seems entirely relevant, especially when research has become highly complex and multidisciplinary, and it just seems relatively unproductive to hold special workshops and retreats so that the pure folks can talk to the applied folks. Sure, retreats and workshops can help, but as Bell demonstrated, there's nothing more productive than having the guy who wrote the book on spinal cord injury surgery just down the hall from the guy who wrote the book on dopamine antagonists. Startups and small companies can do this to some extent but they certainly don't have Big Pharma's resources.

Big Pharma of course seems to have stopped listening.

Image source
(Update: As a commentator points out, the photo is not from Bell Labs but from Allied Chemicals. I can imagine the corridor at Bell looking quite similar though).