*Sigh*. And yet another benchmark

General discussion and chat (archived)
stravinsky

*Sigh*. And yet another benchmark

Unread post by stravinsky » 2012-08-22, 05:24

and yet another benchmark : google octane . By google, the same company that knows exactly what you are doing right now.

http://octane-benchmark.googlecode.com/svn/latest/index.html

predictable results :
chrome is the best here.
IE9 doesnt even start the benchmark.
Opera cant complete all the tests.
Firefox is slower than chrome.

Even before starting the tests, i knew this would be the results.

it does provide the code for all to see. So someone more technical may want to see what they are doing.

User avatar
Moonchild
Pale Moon guru
Pale Moon guru
Posts: 35627
Joined: 2011-08-28, 17:27
Location: Motala, SE
Contact:

Re: *Sigh*. And yet another benchmark

Unread post by Moonchild » 2012-08-22, 07:40

stravinsky wrote:it does provide the code for all to see. So someone more technical may want to see what they are doing.
The thing is, even if open source, it can appear to be completely unbiased when you look at how the test was written from a completely blank point of view. But you can write tests that have a specific bias towards a specific browser without cheating, if you know exactly how the browser handles specific code, and how the competition does it.

It's the reason why I don't write a benchmark for Pale Moon myself, because either consciously or subconsciously I can bias it to score better on my own browser than the competition by knowing the specific code paths used for certain functions.

It's like writing a scientific theory to prove a result that has already been found, instead of the other way around (and trying to disprove it). It can be plausible, and look 100% correct, with all evidence supporting the theory - and still be completely wrong.
"Sometimes, the best way to get what you want is to be a good person." -- Louis Rossmann
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite

stravinsky

Re: *Sigh*. And yet another benchmark

Unread post by stravinsky » 2012-08-30, 14:29

https://bugzilla.mozilla.org/show_bug.cgi?id=785079

bug discussing whether to add Octane benchmark to "areweslimyet.com"

stravinsky

Re: *Sigh*. And yet another benchmark

Unread post by stravinsky » 2012-08-30, 14:33


Locked