How Reliable Are Benchmarks? Error Margins & Standard Deviation
898We talk about standard deviation and error margins in gaming benchmarks (specifically, for now), as a part of our new Bench Theory series.
Ad: Buy the Thermaltake View 71 on Amazon (https://goo.gl/XeV1Vu)
Article: https://www.gamersnexus.net/guides/3240-bench-theory-reliability-standard-deviation-of-game-benchmarks
This content piece continues our Bench Theory series, which previously asked the question of whether benchmark duration matters. Today, we're looking at error margins, standard deviation, and run-to-run variance in framerate testing (FPS), establishing the performance behaviors of a few popular benchmark titles. This also allows us to open the discussion on methodological solutions to inaccuracies in some benchmarks, and philosophical questions of whether we're testing the software or testing the hardware.
We have a new GN store: https://store.gamersnexus.net/
Like our content? Please consider becoming our Patron to support us: http://www.patreon.com/gamersnexus
** Please like, comment, and subscribe for more! **
Follow us in these locations for more gaming and hardware updates:
t: http://www.twitter.com/gamersnexus
f: http://www.facebook.com/gamersnexus
w: http://www.gamersnexus.net/
Editorial: Steve Burke
Video: Andrew Coleman
Links to Amazon and Newegg are typically monetized on our channel (affiliate links) and may return a commission of sales to us from the retailer. This is unrelated to the product manufacturer. Any advertisements or sponsorships are disclosed within the video ("this video is brought to you by") and above the fold in the description. We do not ever produce paid content or "sponsored content" (meaning that the content is our idea and is not funded externally aside from whatever ad placement is in the beginning) and we do not ever charge manufacturers for coverage.