can someone explain how bug-testing works please?
it seems as though a lot of people are experiencing a number of bugs in SoD. i've noted a few myself.
i understand that programming and scripting etc is very complex and i have no idea how it works, but i am curious about one thing:
how do so many bugs manage to slip under the radar? i mean, as a bug tester, do you not try every possible party combination, every outcome to every quest, try running the game on every type of computer?
i'm not hating or complaining, just genuinely curious to see how this works. i reckon there are probably a ton of factors weighing in that i don't even know about, so please enlighten me!
i understand that programming and scripting etc is very complex and i have no idea how it works, but i am curious about one thing:
how do so many bugs manage to slip under the radar? i mean, as a bug tester, do you not try every possible party combination, every outcome to every quest, try running the game on every type of computer?
i'm not hating or complaining, just genuinely curious to see how this works. i reckon there are probably a ton of factors weighing in that i don't even know about, so please enlighten me!
1
Comments
After you report a bug, developers try to reproduce it and if all is ok, the bug is "submitted". But then the most difficult part happens - to implement a fix. It may take some time.
So, for example, a lot of bugs that were found during the beta testing of 2.0 version, while they had been submitted, haven't found their fix in the build yet. Add to that the fact people continue to report new bugs (which appear in newer builds), and you get a picture that it's a long process, and it takes time to implement all fixes.
The slow process is also connected to the developers' wish to fix things properly, so that we get less situations when a new build introduces a new bug.
Not only do you have to replicate the bug, and then have to figure what's actually causing it, and then come up with a workaround, you need to make sure that your fix doesn't cause a new problem elsewhere.
https://www.youtube.com/watch?v=d1CYncXkCv4
99 reported bugs.
Take one down fix it all up.
128 reported bugs in production.
In sum, a game is a very dynamic beast with essentially infinite states. It is literally not possible to test every possible cause of a bug.
One time when I was testing BGEE's main path (as well as the importing of a party from BGEE to SoD) and I was in the process of leaving candlekeep. I heard the shrill cry of "Heya its me Imoen" and immediately used Ctrl+Y on her just so I didn't have to deal with her. When I realized awhile later that I actually should test Imoen so I consoled her in and added her to my group (its safe to say this experience made me learn my lesson about using the console). But at this point the game had already labeled her as being permanently dead. So once I had beaten BGEE this caused a rather interesting situation of there being two different Imoens present in SoD.
It doesn't have to involve a lax use of the console. You could be the type of person who makes Khalid go for one naked jaunt in the woods. Maybe you play the game with certain settings on and others off. Maybe you previously made your games in multiplayer and then transfered them over to single player. Maybe you bring drow equipment with you to the surface in BG2 (I personally wouldn't bother since I know its going to turn to dust, but players who might not know that might bring it). We all play the games a bit differently.
(and this is all not to say that the major bugs right now are the obscure ones, only that some bugs just come up because people play the game differently)