The Skeptical Teacher

Musings of a science teacher & skeptic in an age of woo.

Posts Tagged ‘peer review’

Alien Life in a Meteorite? Ummm, Not So Much

Posted by mattusmaximus on March 13, 2011

Last week the media was all abuzz about a story that a NASA scientist had discovered “definitive evidence” of alien life in a meteorite.  In fact, they apparently even had photos of the little critters…

Here’s the headline:

NASA scientist finds evidence of alien life

Aliens exist, and we have proof.

That astonishingly awesome claim comes from Dr. Richard B. Hoover, an astrobiologist at NASA’s Marshall Space Flight Center, who says he has found conclusive evidence of alien life — fossils of bacteria found in an extremely rare class of meteorite called CI1 carbonaceous chondrites. (There are only nine such meteorites on planet Earth.) Hoover’s findings were published late Friday night in the Journal of Cosmology, a peer-reviewed scientific journal.

“I interpret it as indicating that life is more broadly distributed than restricted strictly to the planet earth,” Hoover, who has spent more than 10 years studying meteorites around the world, told FoxNews.com in an interview. “This field of study has just barely been touched — because quite frankly, a great many scientist [sic] would say that this is impossible.” …

The “field of study” to which Dr. Hoover is referring is astrobiology, and it is a legitimate scientific endeavor that attempts to study the question of life beyond Earth.  Unfortunately, Dr. Hoover is somewhat of a crank, and his claims are quite overblown, as evidenced by the ruthless criticism he and the “peer-reviewed” Journal of Cosmology received from the wider scientific community.  Here are just a few samples of how these trumped up claims of “alien life” simply wither under scrutiny…

Read the rest of this entry »

Posted in aliens & UFOs, scientific method, space | Tagged: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , | 6 Comments »

The Importance of Being Wrong

Posted by mattusmaximus on January 26, 2009

I was initially planning on titling this post “The Importance of Being Right” – but then I thought that we all pretty much already knew that. We all know that if you don’t do the engineering calculations correctly, for instance, the car engine doesn’t work. Or if you don’t really know what you’re doing with biochemistry, the drug/vaccine/antibiotic you’re making doesn’t cure disease effectively. Clearly, because the universe functions according to a set group of natural laws we must make sure that our science & technology fits with those laws. To insist the universe adhere to our own preconceptions while ignoring how it really behaves is a sure path to self-delusion. Taken to its logical extreme, such thinking leads towards solipsism – also known as the philosophical idea that “My mind is the only thing that I know exists.”

Aside: I like to ask those espousing solipsism whether or not they look both ways before crossing the street – strangely enough, the answer has always been “yes.” The following cartoon also illustrates the silliness of taking solipsism too seriously…

solipsism

So, we all know that because there is an external reality beyond our own mind that functions independently of that mind, the importance of being right is unquestionable.

But what about the importance of being wrong? I will tell you this… it is very important to not only be wrong (to a certain degree) but, more importantly, how to learn about why we were wrong. I had the idea for this post because I was at my martial arts dojo today, and I was trying to help a less-experienced student with a technique which is a defense against mae-giri, also known as a front kicking attack. As I attacked him, he had a hard time avoiding my kicks, and he grew frustrated that he wasn’t able to perform the technique easily. I responded by telling him not to let it bother him, because he’ll do it wrong 100 times before he gets it right once. Hopefully, throughout the process of doing it wrong so many times, my junior student will learn how to do it correctly. We learn by making mistakes.

It is no different in my classroom – I’ve dealt with many a frustrated student who was having trouble learning how to do a physics problem or attempting to work their way through a lab. Only with constant practice, and by making a plethora of errors, can most students effectively learn what not to do. As I tell my students, the reason why I’m so good at physics is because I’ve had so many experiences making mistakes! 🙂

There is another issue – many students are stuck on always getting the “right” answer in science class, and sometimes teachers (myself included) are guilty of overly reinforcing this attitude. But to get the process – and not merely the facts – of science across to our students properly, I think we have to walk a fine line as educators. And this is where the importance of experimental lab work in science classes cannot be overstated.

In my classes I require my students to do a lot of lab work. Many times I purposefully set up scenarios in which the students are to draw conclusions from their data. A perfect example is when I ask them to make a series of measurements on the period of a simple pendulum, and they are to isolate three variables in the process – mass of the pendulum bob, amplitude of the swing, and the pendulum’s length. I then ask them to, based upon their data, determine how (or even if) each of these variables affects the period of the pendulum as it swings to and fro.

pendulum

The responses I get from my students are interesting, because despite the fact that they’ve collected the data, many answer the question incorrectly. Many will say that the more massive the pendulum bob or the smaller the amplitude, the shorter the period of the pendulum. And this is incorrect – under controlled conditions, the period of a simple pendulum is only affected by its length! That is, the longer the pendulum, the longer its period, and the mass & amplitude don’t affect the period.

Often, when I point this out to students, they don’t believe me at first. But then I point to the data which they collected, and then they see it – they allowed their preconceived biases of how they thought the pendulum should behave to creep into the scientific process. In so doing, they were giving me what they thought ahead of time to be the “right” answer, instead of gleaning out the proper answer from their data in a non-biased manner. Their conclusions were wrong, but when it comes to such a lesson I want them to understand why they were wrong – experimenter bias.

I mention all of this because it should be noted that science cannot be done in a vacuum – this is why we often speak of a scientific community. Scientists are just as human as anyone, and we all come to the process with our own biases & preconceptions, and – just like my students – we sometimes see what we want to see. But the scientific endeavor is different from all others in one critical way – peer-review. Peer-review is necessary in science precisely to make sure that our biases, preconceptions, mistakes, and sometimes outright fraud do not unduly influence the results of our explorations. Through peer-review we often catch each others mistakes, we demand that proposed hypotheses be falsifiable, we insist that experiments be repeatable and verifiable. As such, we get things wrong all the time in science, but we figure out why we get it wrong – and this puts us closer to the path of getting things right. Through this rigorous peer-review process, we see that science is self-correcting.

And that is a major distinction between science and pseudoscience. The scientific community does peer-review, learns from its collective mistakes, and employs a largely self-correcting process in its search for our understanding of the universe. Pseudoscientists of all stripes – astrologers, homeopaths, creationists, and conspiracy theorists to name a few – make this one fatal flaw: lacking adequate peer-review, they don’t learn from being wrong. Rather, they insist upon molding the universe to fit with their worldview, and in so doing they delude themselves & others. This cartoon illustrates the point rather well…

science vs. pseudoscience

Now I’m off to grade some exams. Hopefully my students have learned from earlier mistakes.

Posted in scientific method | Tagged: , , , , , , , , , , , , , , , | 2 Comments »

 
%d bloggers like this: