It is sometimes hard for a layman to separate well-researched history from the writings of kooks (or what Mark Twain called "inspired idiots").

For example: my local library carries "A Secret History of the English Language". This book attempts to make reasoned claims that English is not descended from Anglo-Saxon and that French descends from English rather than from Latin. One could begin to be suspicious of its revisionism based on the sensational title, but then, prominently displayed on the cover is a quote from Norman Cantor, who I have read and do respect as a serious historian. The quote reads:

Fascinating and deeply learned… I read it twice.

— Norman F. Cantor, Professor Emeritus, Medieval Studies, Columbia University.

What!! Did he read it a second time to locate all the factual errors and bad assumptions? Does he actually believe this unusual take on linguistics? Did he have fun comparing the author's hysteria with his own measured tone? More to my general question: How can one differentiate legitimate overturning of outdated assumptions (a necessary part of any scientific endeavor), from kooks who want to kick over the anthill because its fun?

  • 3
    We need a history version of the crackpot index. – yannis Feb 17 '14 at 15:17
  • 1
    Perhaps he found it funny. I used to read the crackpot papers at Physics convocations with interest. – Oldcat Feb 20 '14 at 23:46
  • A related question that might be of interest. – Artem Kaznatcheev Feb 21 '14 at 5:39
  • A related research effort attempts to classify the reliability of information on the internet. – Mark C. Wallace Feb 21 '14 at 18:41
  • 1
    "and that French descends from English rather than from Latin" Yes this is how supremacists of any ideology try to create pseudo-history. And this holds true of Bible and Koran both, which are full of myths but both claim to be historical truths. I have even read that Sanskrit descended from English. In future we might also read Chinese also descended from English and first human civilisation started somewhere in the present day United States. – Rolen Koh Oct 5 '17 at 6:50

To the particular point of Norman Cantor's credit on the book you're looking at, I too am a big Cantor fan but he also kind of had a really bad drop-off at the end of his life. The Last Knight in particular was not terribly well researched and lacked a lot of the panache that Cantor's other work had. Perhaps this accolade came from that twilight era of his career? It's hard to say. I do think that knowing that a good historian liking a particular book is a good use of appeal to authority; sadly, it sounds like that may be one of the times where that heuristic might have done you wrong.

Anyway, generally speaking it's not easy and I don't think there's a perfect solution, but here are a few guidelines...

Extraordinary claims require extraordinary proof.

This in my opinion ought to be the first maxim you hold on any subject, be it history, medicine, physics, or whatever. If someone writes a book about how King Tut had blue eyes rather than brown, that's not (I don't think, anyway) a particularly extraordinary claim so you can probably let it slide. If the author says that the ancient Greeks and Romans stole democracy from the Egyptians, that's a bit more extraordinary of a claim. That doesn't mean that you ought to dismiss it outright, but neither should it be accepted without evidence, even as a premise.

Does the subject matter conform to current opinion on the subject?

I'm not saying that if it's not mainstream, it's crap, but that should be your first question. If you're reading about, I don't know, the historicity of Jesus (note: I present this only as an example, not as a personal opinion on the subject) and the author says there's no proof, then you would behoove yourself to do a quick Google or Wikipedia search to learn that in this case, the vast majority of Biblical scholars do consider Christ to have probably been an actual person. This in and of itself shouldn't be enough for you to put the work down, but it is a question which IMO needs to be ticked off.

The flip side there is that it's entirely possible that you're reading a work and your skeptical buzzer was set off by that first question. "This guy thinks the world thought the Earth was round when Columbus sailed to the West, and he was thought of a crank primarily because of the (correct) viewpoint that the world was far, far larger than what he'd thought it was?", for instance, could be a question you ask yourself when reading a particular book. In that case, a search of the 'Net will discover that yes, this is in fact largely established history.

If it's not the popular opinion, does the historian acknowledge this? How does the historian explain this?

Bob Breyer, an Egyptologist who teaches at Long Island University and who appeared on the History Channel every now and then before the History Channel turned into Space Alien Central, has a lot of, shall we say, not commonly held opinions about his subject matter. For instance, he holds the opinion that it's possible, perhaps even the most likely scenario available, that King Tut was murdered by his vizier, who then became Pharoah. Breyer goes into this in some depth in his The Great Courses Entry on the subject. I highly recommend this series of lectures, by the way.

The way Breyer approaches this is exactly the way that a historian holding a minority opinion ought to approach it: he tells you straight out "this is not the dominant opinion by any means". He talks a little bit about why others might be led down a different path without calling them fools or marking them as part of a giant conspiracy of thought. He also acknowledges the faults in his idea (namely, the sheer lack of evidence). In this case, he uses it as an example of just how little we know about ancient Egypt, but even if that wasn't the point, the important bit there is how it was handled.

How well-sourced is the evidence? Is it available to review?

I remember around a decade ago arguing with someone about whether or not Lord Amherst gave Native Americans smallpox-infested blankets. In that case, it was very easy to win this argument: there's a letter he wrote advocating for it which has since been scanned and is available online. That's about as open and shut as you can get. Well, open and shut if I was actually right in my assertion; there's actually no evidence that he literally gave the Native Americans the blankets, just talked about how "inoculating" them was a good idea. But we did get an answer, and that answer was based on that letter.

Of course, not every document ever written is going to be available online or even by the layperson (for instance, for a historical novel I've written but not published about a particular 19th century person, I had to fly to New York City and convince the librarian of the school of journalism at Columbia University to let me read a 1930s era master's thesis on this person which was composed by talking to their friends and relatives). However, the fact that it's even available to someone means that there is at least an avenue for this historian to be proven wrong.

On the other hand, if the person's primary sources consist of unsourced "personal research", well, it's entirely possible that person is completely on the up and up but how would you ever be able to vet them?

I think the key phrase to remember here is trust but verify. Unfortunately it's not always possible to verify, but noting that the historian at least let the door open for others to verify their work is at least a good start (ideally, you might want to then take a look to see if, indeed, their work has been verified and if so, did anyone think the author was full of hot gas, but again, we don't always have the time).

How reliable is the historian?

This one is potentially dangerous, as there are a couple potential faults:

  1. Every historian can have a bad day. Cantor is a great example but a lot of people enjoy Stephen Ambrose's writing, too, and he produced some real stinkers as well (and he appears to have been a chronic plagiarist, but that's another matter altogether).
  2. A person who is an expert on one subject is not necessarily any more likely to be an expert on another subject than me or you. This isn't history, but towards the end of his life the great molecular biochemist Linus Pauling became convinced that taking massive quantities of Vitamin C was the key to living a long and healthy life. Since then this has been utterly refuted and, frankly, there was little evidence to support Pauling in the first place, but it lives on because he was such a smart guy in other fields.

That being said, "has this guy done me wrong before" is a pretty useful heuristic in my book. If you come across a weird fact you hadn't heard before in one of Barbara Tuchmann's books, I think you're probably better off accepting its veracity (again, trust but verify) than if, say, Dan Brown had some weird little snippet.

Use your resources! And ask around!

SE.History is still in its youth but by no means is it the only place on the Internet or for that matter in real life where you can ask around about this kind of thing. If you're going to school, by all means ask your history professor or teacher what they think (trust but verify them too!). If you've got a school near you, you might try emailing someone - my experience is that as long as you don't sound like a crank yourself, a lot of academics love to talk about their field of expertise (some may even say that's why they became an academic!). Depending on your particular subject matter, places like the James Randi Educational Foundation, the Skeptics' Guide to the Universe forums, or even that old standby Snopes might have either a published essay on the thing you're looking up or a helpful group of fans who can help steer you in the right direction.

| improve this answer | |
  • 3
    What an incredibly good answer. – Felix Goldberg Feb 18 '14 at 11:47
  • 2
    I thought so too. I'd vote it up 10 times if I could. – Mike Feb 19 '14 at 2:09
  • Y'know, in a generally great post about citing sources and such, it would help if you didn't propagate a (I'll be generous here) unsupported conclusion as an example. Much as the man's ideas are repulsive, Amhurst did not "brag" about having given the blankets. As a matter of fact, if you read the letters, there's zero proof they were given in the letters aside from proposing the idea: straightdope.com/columns/read/1088/… – DVK Feb 21 '14 at 2:38
  • 1
    "It is accurate to say that Lord Jeffery Amherst advocated biological warfare against Indians, but there is no evidence that any infected blankets were distributed at his command. For more about Lord Jeffery Amherst's military career, see Professor Kevin Sweeney's article "The Very Model of a Modern Major General." For a detailed examination of Amherst's role in the Fort Pitt smallpox episode, see "The British, the Indians, and Smallpox: What Actually Happened at Fort Pitt in 1763?" by Philip Ranlet." (src: amherst.edu/library/archives/faq#lordjeff) – DVK Feb 21 '14 at 2:39
  • 2
    I would add a quick test for a book. Check the bibliography (no bibliography = not history). Check some footnotes. Sometimes you have a reference but when you follow through it's completely useless. This is generally a good test for all books even if you don't know the subject. Scholarly apparatus is not everything but it's a pre-condition of serious research (in principle...) – Gil Oliveira Jul 29 '15 at 13:46

For books, I find it useful to look it up on Amazon and read all the negative reviews.

In this book's case, there are only 3 reviews. Of the two that can't be considered positive, one starts off like this:

You might be a crank if:

...and the other is titled "Bizzare screed"

| improve this answer | |
  • Bizzare screed is a great description of this book. It is kind of fun to follow him down the rabbit hole, if you can contain your indignation. – Mike Feb 19 '14 at 2:17
  • Another useful indicator I've found, much to my surprise, is the price of used copies of the book. A reliable out-of-print history book is often offered at well over $100: I've seen two I bought years ago for $50-$100 priced on Amazon for around $1000! Contrast that to this book, which can be bought on Amazon for less than $10. – llywrch Apr 23 at 18:32

Lay people sadly have two options:

  1. Trust historians
  2. Become a historian

Let's eliminate number 2 as financially and personally unfeasible for the lay person. If the answer to "how do I determine expertise" is always "become an expert" we'll run out of lay people rapidly!

How to trust historians is a more difficult question. I assume strongly that historiography and the historical community of professional and academic historians are adequate to police their own profession. I trust this is true because I'm a historian (trust me!), but also because we win libel cases when we accuse non-historians of being non-historians. ( http://en.wikipedia.org/wiki/Irving_v_Penguin_Books_and_Lipstadt )

But where to find historians talking about other historians in a way lay people can readily understand?

Wikipedia has a pretty good policy essay on this. They need lay people to be able to identify which historical sources are good. http://en.wikipedia.org/wiki/Wikipedia:HISTRS

To summarise the essay: follow the scholarly press; look for reviews of works in scholarly presses; look for citations of works in scholarly presses; check to see if the press publishing a work is scholarly.

For example: Melville House who published the book in question are a vanity fiction press gone indie. Not where I expect major works of history to come from. The work in question has no reviews or citations in Google Scholar (a quick test, but I'm not wasting time on it), and is old enough to have been reviewed if it was scholarly. Thus, given the bad publisher and the lack of reviews or citations in the scholarly press I'd consider the work "junk."

If I were an expert in history of the English language, I might read it compared with my past reading. If I were a lay person interested in the history of the English language, I'd read scholarly works first, and then possibly read this much later after I'd developed a lay context for what the scholars think the history is and make a lay judgement on the value of the text.

| improve this answer | |

In a more technical approach, here are a few things that are helpful to me are to look for.

As a general disclaimer, I do not know of any foolproof method, so these are more things to look for or consider than any absolute test.

Who published the book? Is it from an academic press? Most of the time (but not always) if the publisher includes BLANK University Press, that means the book has been reviewed and approved by other historians, typically in the field. So that tells you that there is at least some consensus within the field that the book is worthy of consideration.

Two caveats:

  1. Peer review has its issues, but it is by an large a good indicator that the book has been thoroughly considered.
  2. There are presses that do not have University Press in the title but are still good, so this is by no means a universal test.

On a similar note, is the author a professional historian? Look for the author's bio. Are they a professional historian in the sense that they work at a school or institution where their main job puts them in the field of historical research or education? I've known plenty of crackpot academics, but, again, it's a fairly good indicator. I have read very compelling historical works by non-academics, but they tend to have pretty clear flaws that would rule them out as being convincing arguments.

Is the evidence clearly presented? Since history (as has been noted above) is the business of using evidence to make an argument, how clearly is the evidence displayed? Are there footnotes or endnotes? Is there a bibliography or works cited? Take an important detail or assumption that they make: is there a source that you can look up to verify it? Not all claims are sourced by an author, but good history tends to source most of them.

When in Doubt Historians never promise any grand theory. They have boring titles to their work!

| improve this answer | |
  • "Who published the book" - often a great filter. Was the book published in a small country in the time of an oppressive dictatorship, and does it claim that their civilization is the greatest and most ancient one, that they discovered all important inventions and others just stole them, and that their glorious past (of which no one else ever heard because other nations are evil and are suppressing the "truth") entitles them to much more than what they currently own? Is the book full of subjective descriptive terms, like "good", "evil", "glorious", "hateful", etc? Highly likely to be bogus. – vsz Jun 30 '19 at 10:42

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.