[Chris Noble]

Originally Posted by Larry Boy

The claimant doesn't necessarily know what's a reasonable scientific benchmark. Usually they think they think they're much better than they really are (if they have any ability at all, that is).

This is where I have a problem. Accordingly to Sheldrake we are supposed to attach a great weight to peoples personal beliefs of they think they (or their dogs) can do.

The benchmark is way too high for the results to be scientifically useful. In ordinary research it's usually 20:1.

And every 20th study would get statistically significant results by pure chance.

Most scientists know that it takes more than a single positive study to provide sufficient evidence for a novel claim.

Why Most Published Research Findings Are False

You are not going to get a Nobel prize and a million dollars for one study with a p<.05.

Paranormal proponents attach far too much importance to single positive studies rather than the totality of the research program.

I'm skeptical of her ability, but the fact a lot of the applicants probably are a bit self-deluded doesn't make the challenge valid.

You still haven't come up with any valid reasons why it isn't valid.

No. What's the point?

The point is that you don't have any valid criticisms.

No, I don't think Nature would be an appropriate journal. I do think a parapsychology journal perhaps could accept it though. They sometimes have
such papers detailing tests of persons claiming extraordinary abilities. But a parapsychology journal perhaps doesn't count in your view? If that's the case, just let me remind you that skeptics regularly contribute to such journals. They're not that biased.

What would the peer-review by the parapsychology journals possibly add to the process. The applicants have agreed to the protocols and the interpretation of the results in advance. You haven't answered this.

According to Randi's FAQ

Some of the application information is available on the JREF?s forum, but the majority of it is on file at the JREF. You can make an appointment to visit the Foundation and view the applications by contacting a JREF representative.

This is actually more open than most scientific research.