tag:blogger.com,1999:blog-4193297034681066259.post8248397720807638413..comments2024-03-04T09:16:25.999+01:00Comments on Mediocre Chess: [Test] Gauntlet engine test doneJonatan Petterssonhttp://www.blogger.com/profile/03152085169762414586noreply@blogger.comBlogger3125tag:blogger.com,1999:blog-4193297034681066259.post-17247262035473713112011-10-27T01:12:37.438+02:002011-10-27T01:12:37.438+02:00I meant instances where the gain might depend on t...I meant instances where the gain might depend on the approximate depth of the engine. Consider a highly cooked up example where you implement some move ordering change that makes the entire code run 10% slower (i.e. irrespective of depth), but the branching factor is decreased by 2%.<br /><br />So if you play at very fast controls to test this change, where depths reached are around 4-6, you might not notice any difference. But then at longer controls, the branching factor reduction will overcome the flat slowdown.Johnnoreply@blogger.comtag:blogger.com,1999:blog-4193297034681066259.post-81033269552770019392011-10-26T14:02:47.887+02:002011-10-26T14:02:47.887+02:00It seems most programmers of the highend engines u...It seems most programmers of the highend engines use these super fast time controls for most testing.<br /><br />And from what I've seen (and read) they mimic longer time controls very well.<br /><br />The only case where you shouldn't use fast time controls is when you have a good reason to assume that there would be a difference (say when you change time management for example).<br /><br />Not sure what you mean by tweaks that affect the branching factor.. changing the evaluation can result in completely different trees as well.<br /><br />However, the point is if you play enough games it will all even out.<br /><br />If you messed up the search tree and now can't reach as deep anymore, this will show with 0.25sec per move as well as 20minutes per move.Jonatan Petterssonnoreply@blogger.comtag:blogger.com,1999:blog-4193297034681066259.post-24617207590577297762011-10-26T05:56:43.141+02:002011-10-26T05:56:43.141+02:00Have you done any tests (or read any tests) about ...Have you done any tests (or read any tests) about how closely short time control results mimic long time control results?<br /><br />I suppose tuning the evaluation function should be fairly similar. But once tweaks start affecting the branching factor, it seems the gain/loss will depend on the time controls used, right?Johnnoreply@blogger.com