ChessUSA.com TalkChess.com
Hosted by Your Move Chess & Games
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Time control comparison between engines
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions Flat
View previous topic :: View next topic  
Author Message
Ed Schroder



Joined: 18 Aug 2011
Posts: 3823

PostPost subject: Time control comparison between engines    Posted: Wed Jan 01, 2014 9:57 pm Reply to topic Reply with quote

I wrote a (PGN) utility that compares the time control of engines.

Example (1) taken from the tournament & matches section.

Code:
Engine                 Depth       Time   Games     Moves  Average Forfeit
Arminius 2013-08-10    17.07    6:25:18      40      2771    8.34     0
Naraku 1.4 [1c]        17.05    6:16:24      40      2769    8.16     0
Delfi 5.4 [2c]         15.50    5:48:23      40      2693    7.76     0
Chronos 1.9.9 [1c]     15.76    6:58:13      40      3268    7.68     0
Zappa 1.1 [4c]         17.52    5:41:00      40      2668    7.67     2
Djinn 1.008 [1c]       22.62    6:37:22      40      3141    7.59     0
Atlas 3.60 [1c]        18.96    5:23:34      40      2582    7.52     0
Frenzee 3.5.19 [1c]    15.84    5:52:04      40      2897    7.29     0
NirvanaChess 1.3 [1    18.73    6:01:39      40      2985    7.27     0
Hamsters 0.7.1 [4c]    18.96    6:54:46      40      3447    7.22     0
Deuterium 13.1.31.1    18.02    5:46:11      40      2883    7.20     0
Nebula 2.0 [1c]        20.49    6:40:41      40      3355    7.17     0
Naum 2.0 [1c]          14.89    6:34:05      40      3352    7.05     0
Rodent 1.1 [1c]        22.54    6:45:03      40      3461    7.02     0
Bison 9.11 w32 [1c]    15.73    6:06:41      40      3183    6.91     0
Rodent 1.2 [1c]        25.04    6:07:26      40      3206    6.88     0
Alfil 13.1 [4c]        16.75    5:58:46      40      3157    6.82     1
Pro Deo 1.87 [1c]      15.47    6:10:08      40      3475    6.39     0
Pro Deo 1.86 [1c]      15.32    5:48:23      40      3292    6.35     0
Jonny 4 [4c]           18.74    4:49:25      40      2894    6.00     0
Thinker 5.4d Active    0.00    0:00:00      40        15    0.00     0


Time control comparison between engines

Depth     : Average search depth
Time      : Total time engine used
Moves     : Total moves engine played
Average   : Average time per move
Forfeit   : Games engine lost due to time forfeit

List is sorted on Average Time indicating the engine that uses the most time tops.


The list seems to indicate Arminius spends its time best (not saying it has the best time control, that's something else) and mine likely needs an update after 20+ years.

Example (2) taken from a recent CEGT (40/20) download.

Code:
Engine                 Depth       Time   Games     Moves  Average Forfeit
Delphil 3.1 x64 1CP    13.62   20:52:22     100      5454    13.78     0
Naum 4.2 x64 4CPU      19.39   25:31:28     100      6714    13.69     0
Naum 4.2 x64 2CPU      18.49    6:24:08      25      1700    13.56     0
WildCat 5              14.77   21:17:23     100      5689    13.47     0
Stockfish 4.0 x64 4    27.80    6:10:09      20      1658    13.40     0
Naum 4.2 x64 1CPU      18.77   23:04:10     100      6211    13.37     0
Stockfish DD x64 1C    29.47   23:03:47     100      6294    13.19     0
Cheng4 v0.36 x64 1C    22.50   20:05:20     100      5636    12.83     0
Hannibal 1.4a x64 1    23.75   21:08:06     100      6034    12.61     0
Deep Rybka 4 x64 2C    18.02    4:30:48      20      1299    12.51     0
Onno 0.12.0 x64        18.33   19:33:14     100      5656    12.45     0
Gull 2.2 x64 1CPU      21.46   25:51:45     100      7604    12.24     0
Critter 1.6 x64 1CP    19.70   21:12:56     100      6590    11.59     0
Houdini 3 x64 1CPU     29.93   23:01:15     100      7181    11.54     0
Houdini 4.0 x64 1CP    26.95   20:50:30     100      6862    10.93     0
Komodo TCEC x64 1CP    18.00  188:08:56    1000     67569    10.02     0

Time control comparison between engines

Depth     : Average search depth
Time      : Total time engine used
Moves     : Total moves engine played
Average   : Average time per move
Forfeit   : Games engine lost due to time forfeit

List is sorted on Average Time indicating the engine that uses the most time tops.


Oddly Houdini & Komodo leave quite some time on the clock but perhaps this is due to a different time control (40/8) the CEGT guys used. Things are not so clear from the PGN.

Anyway, I will double check the tool for bugs and then release it.
Back to top
View user's profile Send private message
Display posts from previous:   
Subject Author Date/Time
Time control comparison between engines Ed Schroder Wed Jan 01, 2014 9:57 pm
      Re: Time control comparison between engines Robert Hyatt Wed Jan 01, 2014 10:04 pm
            Re: Time control comparison between engines Ed Schroder Wed Jan 01, 2014 10:25 pm
Post new topic    TalkChess.com Forum Index -> Computer Chess Club: Programming and Technical Discussions

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum




Powered by phpBB © 2001, 2005 phpBB Group
Enhanced with Moby Threads