Even the BBC didn't let this scoop get away.
A segment on the Dec. 3 broadcast of BBC's "Newsnight," showed the implications of the story behind the so-called "ClimateGate" scandal are more than just e-mails concealing data, but an incompetence analyzing the data by way of faulty computer code.
John Graham-Cumming, a British programmer known for the open source "POPFile email filtering program" explained how the University of East Anglia's Climatic Research Unit (CRU) had wholesale problems with its computer programming analyzing climate change data, with billion, if not even trillions of dollars, on the line.
"This is the source code from the Climatic Research Unit," Susan Watts, science editor at the BBC explained. "John Graham-Cumming is a software engineer. He's not a skeptic on climate change, but he is shocked by what he's seen in the programming. He compared it with the code in the same language written by NASA."
Graham-Cumming criticized the CRU programming for its lack of professionalism and showed faults with it.
"Well, if you look at the NASA stuff, it's really professional," Graham-Cumming said. "You can look at it, you can see the history. If you look at -- what's done here by these alleged CRU files - it's not the thing you'd expect to see in certainly a commercial industry. You would not see this sort of source code because it's not clearly documented. There's not audit history of what's happened to it. So it would be below the standard in any commercial software. "
According to the author of "The Geek Atlas," the programmer even included steps to skip over errors, which shows some of the data analyzed by the East Anglia CRU is completely neglected.
"The programming language actually has a problem," Graham-Cumming said. "And they put in some code to deal with that error. Unfortunately, in doing so they produced another error. And the upshot of this is the error occurs - the underlying error, they will skip over data that they're trying to plot without any warning to the end user. So in some sense there is data that is being lost."
The programmer, unnamed in the BBC segment, even documented his lack of programming skills.
"So in here, he says some things like, ‘Something is very wrong - it's my programming ability, isn't it,'" Graham-Cumming explained. "‘You know, once again, it's further confirmation my abilities are below what is required here.'"
Watts questioned if someone was betting billions or trillions of dollars, should they "be comfortable with" it and Graham-Cumming explained it wasn't.
"I don't think I would be comfortable with that because it is not obvious what it is doing, why it is doing it," Graham-Cumming said. "It needs to be made clear."
Coming soon: A brand-new NewsBusters design. But we need your help!























Editor at Large
Comments Policy
I got one problem...
Sat, 12/05/2009 - 12:57 ET by ChristianRebelHis claim that NASA's stuff is organized...
On Thursday Fox News broke a story of a researcher looking to sue NASA for data they may have messed with to support the climate nonsense.
http://www.foxnews.com/politics/2009/12/03/researcher-reportedly-threatens-sue-nasa-climate-data/
"For we wrestle not against flesh and blood, but against principalities, against powers, against the rulers of darkness of this world, against spiritual wickedness in high places." -Ephesians 6:12
Almost two years since his
Sat, 12/05/2009 - 13:03 ET by GregEAlmost two years since his request under the Freedom of Information Act. So it's taking them a full 2 years (so far) to scrub the data? I wonder if they'll produce it for him on day 729.
Anyone seen or heard from Sandy Berger lately? Perhaps he's got a 2 yr covert NASA gig going.
"So it's taking them a full
Sat, 12/05/2009 - 13:18 ET by ChristianRebel"So it's taking them a full 2 years (so far) to scrub the data?"
I was thinking that...but the problem is that many papers, books, and internet reports have been written in the 20 years of global warming existance that the numbers are going to live on some how.
At least I hope.
"For we wrestle not against flesh and blood, but against principalities, against powers, against the rulers of darkness of this world, against spiritual wickedness in high places." -Ephesians 6:12
This actually isn't a big
Sat, 12/05/2009 - 13:07 ET by optimistThis actually isn't a big deal from the scandal's standpoint. I originally thought that they wrote spaghetti code as a form of obfuscation, but it turns out that the coder just sucked.
The NASA code could very well be profesionally written, but that doesn't mean that the rules GIGO don't apply. Professional code doesn't necessarily mean that it was written with correct (or in this case ethical) requirements.
I see this report as a sly red herring, which is why I believe that the BBC had no problem running it.
Well to an amateur ...
Sat, 12/05/2009 - 13:10 ET by Forest for the TreesWell to an amateur ... NASA's data would look professional - that doesn't mean that there are not errors and cover-ups at NASA too.
Remember that Hansen at NASA has been touting al kinds of wild claims, on behalf of NASA, for years now - and like many corporations that have an embarrassing & very vocal employee, they keep promoting him and giving him wide berth, yet keep him employed for fear of law suits.
Anyone that has spent any time in large corpoations knows these kinds of guys - we used to call the worst offender at ours, who was ultimately promoted to a useless VP position with no powers or authority, "Captain Zero" - he was a career "Captain Zero" - just like NASA's Hansen.
Re Captain Zero
Sat, 12/05/2009 - 15:26 ET by slickwillie2001Ha. I've seen that. Sometimes they call them 'Chief Technical Officer' or 'Special Advisor to the President'. Keep them from going to the competition but out of trouble at the same time. Not to imply that all with that title are so.
No data, no science
Sat, 12/05/2009 - 14:48 ET by Edward LeeIt is a tautology that refusing to release the raw data implies, as was the case with CRU, NASA has something to hide. To a real scientist (one who adheres to the scientific method), the situation is even simpler. Motives and other ad hominum information are mute. If the results cannot be independently confirmed, whatever they have published cannot be considered science.
Two different issues
Sat, 12/05/2009 - 15:27 ET by marvlThe fellow in the video was commenting on the quality of the programming style, not the data or the correctness of the program or its algorithms. It should be noted that scientists make some of the lousiest software engineers on earth. I know this from having dealt with code written by scientists at various times during my 25 years as a software engineer.
There is no doubt that these "scientists" are rank amateurs when it comes to software development. Further, I seriously doubt that they do the kind of regression testing one would expect of professionally developed code, nor, as the fellow in the video pointed out, do they have any kind of version control system or any of the accouterments now taken for granted in serious software development.
The thought that countries of the world might be making significant economic and political decisions based on this dreck is at once comical and profoundly disturbing.
Yes if NASA is so much better
Sat, 12/05/2009 - 15:35 ET by 10ksnookerThen what are they afraid of in responding to the FOIAs? Are they re-writing as we chat?
As this whole fraud uncovers, if it's not open science, it's not science.
ALgore #2
Sat, 12/05/2009 - 13:06 ET by iveseenitallI see that Arnie is out their with his maps now. SF will be under water in 100 years. Where did you get that information Mr. actor, governor, scientist? Besides, EVERYONE knows it'll happen in only 99 years! Scheeze! These guys make me sick!
NEVER,NEVER trust a "liberal"
Absolutely right!
Sat, 12/05/2009 - 13:12 ET by Forest for the TreesNever trust a liberal, especially when they claim to be a Conservative and their actions are clearly showing they are liberal all the way.
out "there"
Sat, 12/05/2009 - 13:30 ET by iveseenitall(sp) oops! sorry.
NEVER,NEVER trust a "liberal"
consensus
Sat, 12/05/2009 - 13:13 ET by newstogodI'm convinced that very few in the scientific community have actually looked at the data. They simply bought into the idea. Now they have to agree or admit they too were tricked by this group. This always was a game by scientists to get money and leftist politicians to get public support -- Kind of like welfare programs for the earth that lots of tax dollars could be wasted on.
In spite of this, obama
Sat, 12/05/2009 - 13:41 ET by ThisnThatIn spite of this, obama insists upon going to Copenhagan to commit the U.S. to 3rd nation status based upon the "science".
__________
"mmm, mmm, mm. Barrack-Hussain-Øbama↓." - The liberals coolaid drinking song
That programmer had me
Sat, 12/05/2009 - 14:24 ET by eaglewingz08That programmer had me until he said he didn't know what the code was supposed to be doing or why. Even us non experts know the code was supposed to show a drastic man made increase in global warming and the
why, for such programming, is to impose a trillion dollar transfer of wealth from western (primarily USA) capitalist economies, to third world and fourth world socialist kleptocracies.
If the programmer couldn't see this, it is likely that he missed even more in the the programming and climategate scandal.
garbage, bet on it
Sat, 12/05/2009 - 15:00 ET by rfpzzzzzGarbage in , filter through more garbage , garbage out.....no one in their right mind would put money on this crap ...in fact I wonder if Gore et al would wager their homes , boats etc on some specific benchmarks and timetables based on the "settled science".
NASA has its own problems.
Sat, 12/05/2009 - 15:23 ET by JWFThey have been using the faulty weather station data as has been documented here at Newsbusters. You have a weather station that has historically been in the middle of a forest, and moved closer to mankind to save money. Or weather stations close to mankind that have had mankind encroach on them.
How do you account for the change in temperature when an asphalt parking lot is built nearby? Add 2 degrees? Add 5 degrees? Add 4.7765 degrees? And still account for a general cooling or warming of the area? You can't. It's garbage.
Sincerely,
a Veteran of a 1000 psychic wars.
The Smoking Code
Sat, 12/05/2009 - 16:29 ET by acumenThe following article explains the data "tricks" in a reader-friendly (for program writing illiterates such as myself) format.
Bold are authors/editors --
The Proof Behind the CRU Climategate Debacle: Because Computers Do Lie When Humans Tell Them To
From Cube Antics, by Robert Greiner
I’m coming to you today as a scientist and engineer with an agnostic stand on global warming.
If you don’t know anything about “Climategate” (does anyone else hate that name?) Go ahead and read up on it before you check out this post, I’ll wait.
Back? Let’s get started.
First, let’s get this out of the way: Emails prove nothing. Sure, you can look like an unethical asshole who may have committed a felony using government funded money; but all email is, is talk, and talk is cheap.
Now, here is some actual proof that the CRU was deliberately tampering with their data. Unfortunately, for readability’s sake, this code was written in Interactive Data Language (IDL) and is a pain to go through.
NOTE: This is an actual snippet of code from the CRU contained in the source file: briffa_Sep98_d.pro
[Commenter note -- Go here to see snippet and/or whole article]
What does this Mean? A review of the code line-by-line
Starting off Easy
Lines 1-3 are comments
Line 4
yrloc is a 20 element array containing:
1400 and 19 years between 1904 and 1994 in increments of 5 years…
findgen() creates a floating-point array of the specified dimension. Each element of the array is set to the value of its one-dimensional subscript
Pretty straightforward, right?
Line 5
valadj, or, the “fudge factor” array as some arrogant programmer likes to call it is the foundation for the manipulated temperature readings. It contains twenty values of seemingly random numbers. We’ll get back to this later.
Line 6
Just a check to make sure that yrloc and valadj have the same number of attributes in them. This is important for line 8.
Line 8
This is where the magic happens. Remember that array we have of valid temperature readings? And, remember that random array of numbers we have from line two? Well, in line 4, those two arrays are interpolated together.
The interpol() function will take each element in both arrays and “guess” at the points in between them to create a smoothing effect on the data. This technique is often used when dealing with natural data points, just not quite in this manner.
The main thing to realize here, is, that the interpol() function will cause the valid temperature readings (yrloc) to skew towards the valadj values.
What the heck does all of this mean?
Well, I’m glad you asked. First, let’s plot the values in the valadj array.
[Commenter note - As above - Go here to see snippet (graph) and/or whole article]
As you can see, (potentially) valid temperature station readings were taken and skewed to fabricate the results the “scientists” at the CRU wanted to believe, not what actually occurred.
Where do we go from here?
It’s not as cut-and-try as one might think. First and foremost, this doesn’t necessarily prove anything about global warming as science. It just shows that all of the data that was the chief result of most of the environmental legislation created over the last decade was a farce.
This means that all of those billions of dollars we spent as a global community to combat global warming may have been for nothing.
If news station anchors and politicians were trained as engineers, they would be able to find real proof and not just speculate about the meaning of emails that only made it appear as if something illegal happened.
Conclusion
I tried to write this post in a manner that transcends politics. I really haven’t taken much of an interest in the whole global warming debate and don’t really have a strong opinion on the matter. However, being part of the Science Community (I have a degree in Physics) and having done scientific research myself makes me very worried when arrogant jerks who call themselves “scientists” work outside of ethics and ignore the truth to fit their pre-conceived notions of the world. That is not science, that is religion with math equations.
The smoking code indeed - Will skeptics now be accused of commiting character assassination of computer codes? Or scientific fraud apologists simply state that the questionable code was taken out of context? As if doing either was even possible....who are the deniers now?
Excellent Post!
Sat, 12/05/2009 - 21:58 ET by stratmanThank you.
Will America re-examine their data now as the Brits are going to do?
(probably just a rhetorical question)
Not Sure What he is Saying
Sun, 12/06/2009 - 02:56 ET by majorI guess I am not sure if he is saying the code is poorly written, hence not reliable for the intended results, or deliberately miswritten to obscure the results they would expect to get, that is NO Global Warming.
Either way its another nail in the coffin of the Global Warming Religion.
it's worse
Sun, 12/06/2009 - 04:43 ET by sudmufHe's saying that the CRU wrote a mathmatical calculation into their computer code that would skew the data (make it appear that temperatures were rising). That way they got the result they wanted instead of the truth.
kicking and screaming
Sun, 12/06/2009 - 07:37 ET by spepperif the BBC had to be dragged kicking and screaming in order for them to finally recognize the reality of Climategate, so be it-- it is significant to recognize their negligent attitude towards the situation, but it is refreshing to know that they finally show an ability to "come up out of the sand"-- there is a lot more evidence yet to be discovered about the subject-- thus, there's a lot more work to be done in the discovery process--
Saving energy is good no
Tue, 03/23/2010 - 15:35 ET by paulssSaving energy is good no matter what anyone says use less the savings goes in to your pocket less gas you save money thats what matters to me. I know earth hour does a lot with a publisher network to promote it and we do support it. Just those cover up emails are ridiculous.
sick that day.
Tue, 03/23/2010 - 21:32 ET by JWFYou musta been out sick the day the teacher explained run-on sentences.
At Least
Tue, 03/23/2010 - 21:39 ET by countmein5050WE DIDN'T GET YELLED AT THROUGHOUT ALL OF IT...