One of the biggest complaints on Helium – besides rating of course – is the leapfrog feature. The common argument is that the articles are yours and you should be able to edit them as you see fit. I’m going to state something that will likely be misinterpreted and unpopular – they are not.
First, yes, you own own rights to the article – we license it non-exclusively. What I mean to say is that we license the first draft you give us – if you decide to change the article, it is necessary for us to make sure that it is deserving of the merits it has received to date.
Why? Simple – spam and vandalism. Because of the auto approve policy of items we have very little control over what goes on Helium. Our rating and flagging systems are used to rank quality and to weed out any offensive articles that are submitted.
Now, we realized early on that we had a need for an edit feature – but we had the conundrum based on the fact that we had passed on certain status and recognition to an article based off it’s current version. So allowing another version to simply assume that status and recognition without some sort or review process was a no go – the simple fact was it would make it too easy for someone to get a #1 article and then simply swap it out for something offensive, self-promoting, and/or spam. Would it eventually be auto-corrected by the rating and flagging systems naturally – yes. But until it was, it would look extremely bad for the site and the community.
We also realized that just as with submissions there would be a ton of revisions posted and we simply didn’t have the manpower to review each manually. We are a very small shop and the community was growing exponentially in relation to our size – the problem would only get worse.
Hence, the birth of leapfrog.
We already had a system – rating – that sorted for quality. We could use that as a peer review. Originally, it was a very stringent process but has since been simplified to the point that it’s basically a check for abuse by a minimum number of the community.
So in answer to the question to “Why can’t I just edit my article as I see fit, it is my work after all!” the fact is, again, the copy on Helium is not – we licensed that copy. And by putting our name and reputation on it along with the status we’ve conveyed via rating and ranking we have to maintain that quality level by peer review – leapfrog.
Can it be a pain sometime? Yes. Does it fail when it shouldn’t sometimes? Yes. Is it perfect? No. But nothing is. We’ve seen – the last numbers I’ve seen at least – that something like 90% of leapfrogs pass.
Might it be replaced someday by a real peer review if we had members of the community willing to do that? Sure. But that’s not something we can count on just yet. It would be a huge workload.
I hope that helps.
January 13, 2010 at 3:33 pm
Key question is …..does leap frog acceptance trigger additional rating?
If so….which would only seem logical……then the rating process is (or is it?) just the same as if you do not have leap frog.
If not……then the rating process could be grossly flawed.
I submit that a frequency limit (which could be quite conservative) on article revisions would go a long way to resolving this problem.
Also……for highly rated articles (epecially in high volume categories)…..more intensive rating could be automatically implemented to ensure that adequate rating begins soon enough to ensure that “rogue” articles are not on the site any longer than if they were submitted through the “normal” rating process.
January 19, 2010 at 9:48 am
Leapfrog does trigger additional rating however it is not the same as normal rating.
Normally, if you submit an article to a title you enter at 50%. If your article is ranked higher than that, you submit a leapfrog and it’s accepted, it stays at the higher ranking.
In other words it has a natural advantage by having been previously rated. Hence the need for leapfrog.
Even intense rating after the fact does not get rid of the natural advantage of being inserted at a higher rank without the leapfrog process.
July 1, 2010 at 9:05 pm
Nice Posting 😀
I Like Your Blog
August 3, 2010 at 5:28 pm
Hello Eric, it is a good post. In your next to the last paragraph you wrote:
” Does it fail when it should sometimes? Yes.”
Did you mean to write shouldn’t or should not?
Just letting you know in case you would like to make the minor adjustment for such
an important post.
Regards