Hammers and Nails
If all you have is a hammer, everything looks like a nail.
The most important idea I’ve blogged about so far is Taking Ideas Seriously, which is itself a generalization of Zvi’s More Dakka. This post is an elaboration of how to fully integrate a new idea.
I draw a dichotomy between Hammers and Nails:
A Hammer is someone who picks one strategy and uses it to solve as many problems as possible.
A Nail is someone who picks one problem and tries all the strategies until it gets solved.
Human beings are generally Nails, fixating on one specific problem at a time and throwing their entire toolkit at it. A Nail gets good at solving important problems slowly and laboriously but can fail to recognize the power and generality of his tools.
Sometimes it’s better to be a Hammer. Great advice is always a hammer: an organizing principle that works across many domains. To get the most mileage out of a single hammer, don’t stop at using it to tackle your current pet problem. Use it everywhere. Ideas don’t get worn down from use.
Regardless of which you are at a given moment, be systematic because Choices are Bad.
Only a Few Tricks
I am reminded of a classic speech of the mathematician Gian-Carlo Rota. His fifth point is to be a Hammer (emphasis mine):
A long time ago an older and well known number theorist made some disparaging remarks about Paul Erdos’ work. You admire contributions to mathematics as much as I do, and I felt annoyed when the older mathematician flatly and definitively stated that all of Erdos’ work could be reduced to a few tricks which Erdos repeatedly relied on in his proofs. What the number theorist did not realize is that other mathematicians, even the very best, also rely on a few tricks which they use over and over. Take Hilbert. The second volume of Hilbert’s collected papers contains Hilbert’s papers in invariant theory. I have made a point of reading some of these papers with care. It is sad to note that some of Hilbert’s beautiful results have been completely forgotten. But on reading the proofs of Hilbert’s striking and deep theorems in invariant theory, it was surprising to verify that Hilbert’s proofs relied on the same few tricks. Even Hilbert had only a few tricks!
The greatest mathematicians of all time created vast swathes of their work by applying a single precious technique to every problem they could find. My favorite book of mathematics is The Probabilistic Method, by Alon and Spencer. It never ceases to amaze me that this same method applies to:
- (The Erdős–Kac Theorem) The number of distinct prime factors of a random integer between and behaves like a normal distribution with mean and variance .
- (Heilbronn’s Triangle Problem) What is the maximum for which there exist points in the unit square, no three of which form a triangle with area less than ?
- (The Erdős-Rényi Phase Transition) A typical random graph where each edge exists with probability has connected components of size . A typical random graph where each edge exists with probability has a giant component of size linear in .
It’s amusing to note that in the same speech, Rota expounded the benefits of being a Nail just two points later:
Richard Feynman was fond of giving the following advice on how to be a genius. You have to keep a dozen of your favorite problems constantly present in your mind, although by and large they will lay in a dormant state. Every time you hear or read a new trick or a new result, test it against each of your twelve problems to see whether it helps. Every once in a while there will be a hit, and people will say: “How did he do it? He must be a genius!”
Both mindsets are vital.
To be a Nail is to study a single problem from every angle. It is often the case that each technique sheds light on only one side of the problem, and by circumambulating it via the application of many hammers at once, one corners the problem in a deep way. This remains true well past a problem’s resolution – insight can continue to be drawn from it as other methods are applied and more satisfying proofs attained.
Usually even the failure of certain techniques sheds light on shape of the difficulty. One classic example of an enlightening failure is the consistent overcounting (by exactly a factor of two!) of primes by sieve methods. This failure is so serious and unfixable that it has its own name: the Parity Problem.
Dually, to be a Hammer is to study a single technique from every angle. In the case of the probabilistic method, a breadth of cheap applications were found immediately by simply systematically studying uniform random constructions. However, particularly adept Hammers like Erdős upgraded the basic method into a superweapon by steadfastly applying it to harder and harder problems. Variations of the Probabilistic Method like the Lovász Local Lemma, Shearer’s entropy lemma, and the Azuma-Hoeffding inequality are now canon due to the persistence of Hammers.
The upshot is not that Hammers are better than Nails. Rather, there is a place for both Hammers and Nails, and in particular both mindsets are far superior to the wishy-washy blind meandering that characterizes overwhelmed novices. There may be an endless supply of advice – even great advice – on the internet, and yet any given person should organize their life around systematically applying a few tricks or solving a few problems.
Taking an idea seriously is difficult and expensive. You’ll have to tear down competing mental real estate and build a whole new palace for it. You’ll have to field test it all over the place without getting superstitious. You’ll have to gently titrate for the amount you need until you have enough Dakka.
Therefore, be a Hammer and make that idea pay rent. Hell, you’re the president, the emperor, the king. There’s no rent control in your head! Get that idea for all its got.
Exercise for the reader: all things have their accustomed uses. Give me ten unaccustomed uses of your favorite instrumental rationality technique! (Bonus points for demonstrating intent to kill.)
The skill to integrate these concepts is valuable indeed, however one that seems far more valuable on the margin (and eludes me all the same) is that of sifting through the concepts available to integrate. After all, you said it yourself, fully realizing an idea is very expensive and trying them all is completely unfeasible. So how does one find the most beneficial concepts when sifting through the mass currently available? You tangentially caught the edge of this point with your posts about babble and specifically pruning. But I’m left wondering what heuristics and techniques would be useful in the simulated annealing of the rationalist concept-space. Especially given evidence about what one’s current situation is like. This seems like it would make an excellent follow up to the last few posts of yours.
[…] post is Part 5 of the sequence on Babble. After writing Hammers and Nails, I figured out that my favorite Hammer is […]
[…] Hammers and Nails, I suggested that rationalists need to be more systematic in the practice of our craft. In this […]