Matrix Games Forums

War in the West gets its first update!Flashpoint Campaigns: Red Storm version 2.08 is now available!Command gets huge update!Order of Battle: Pacific Featured on Weekly Streaming SessionA new fight for Battle Academy!Buzz Aldrin's Space Program Manager is out for Mac!The definitive wargame of the Western Front is out now! War in the West gets teaser trailer and Twitch Stream!New Preview AAR for War in the West!War in the West Manual preview
Forums  Register  Login  Photo Gallery  Member List  Search  Calendars  FAQ 

My Profile  Inbox  Address Book  My Subscription  My Forums  Log Out

Take the BFTB performance test!

 
View related threads: (in this forum | in all forums)

Logged in as: Guest
Users viewing this topic: none
  Printable Version
All Forums >> [Current Games From Matrix.] >> [Discontinued Games] >> Command Ops Series >> Take the BFTB performance test! Page: [1] 2 3   next >   >>
Login
Message << Older Topic   Newer Topic >>
Take the BFTB performance test! - 5/29/2010 7:28:53 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
NOTE: This is an unofficial exercise just because, I was curious. :)

* Introduction *

Want to take the BFTB performance test? Here is how to play.

I have created three save games (2 BFTB & 1 COTA).

In general, the series simulation rate performance is dominated by available CPU.

* Other Factors *

On screen messages are known to slow things down.

The number of units selected can slow things down.

Of course, AI replans and heavy contacts can slow things down.

* Methodology *

Three test saves. One BFTB save reflecting the max number of units. One BFTB save reflecting the average number of units. One COTA save reflecting the BFTB average number of units.

The saves were created after all reinforcements would have arrived.

The side which was on defense was choosen for the player. Thus, guaranteeing without any orders issued that the forces would collide.

* Other Considerations *

Actual play with a multitude of orders given would probably contribute to CPU overhead.

It is not simply the number of units that solely impact performance, but more probably also influenced by the number of units in contact.

Although I was shooting for a certain number of units, beside reinforcements arriving units were also expiring from unnatural causes.

* Methodology to Generate Your Score *

Run BFTB/COTA at 1024x768 (the LCD res).

Load the test save.

Turn off on screen messages using the bottom toolbar.

Do NOT have any map units selected.

Make sure your machine is quiescent. If you have a multi-core, make sure, at least, two are allocated to BFTB/COTA.

Get a watch. Run the game at >>> for exactly one minute and see how many simulated minutes you get.

* Download *

http://home.comcast.net/~markshot/tempimages/BFTBPerfTest.zip

(my results to follow)

NEW STUFF

I have added a new test save to the performance benchmark zip. An HTTR save reflecting the BFTB average number of units. See next post for those results as well.

MORE NEW STUFF

I've add a new file to the benchmark, BFTB120.

This represents the coming demo. 120 units is relatively on the low end for BFTB.

So, if you run the demo to 3D 10HR, you will have all the units on map. Then, if you conduct the benchmark as described here, you can apply the following ratios to your demo score to infer your probable BFTB performance for the retail game.

BFTB250 (average scenario size) = [your BFTB120] * 60%

BFTB600 (largest scenario size) = [your BFTB120] * 17%

It would be good if some other folks could also generate their score for BFTB120 and update their posts here. Thanks.

< Message edited by MarkShot -- 6/9/2010 8:12:46 PM >


_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester
Post #: 1
RE: Take the BFTB performance test! - 5/29/2010 7:29:53 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
Here are my results. This represents number of minutes simulated in one actual wall clock minute.

BFTB600: 37 - the max scenario size you are going to see in BFTB.

BFTB250: 129 - the average scenario size for BFTB.

BFTB120: 214 - the demo scenario size for BFTB.

COTA250: 127 - intentionally chosen to match the above BFTB scenario size. For COTA, this is very close to the max scenario size.

HTTR250: 162 - intentionally chosen to match the above BFTB scenario size. For HTTR, this is also close to the average scenario size.

What you can do with this?

If you have a marginal machine (CPU), it is likely that even though the mega scenarios are beyond you that the average ones or below are still quite playable. As you can see that the performance drop off due to unit count increase is non-linear.

It's possible, but not enough real testing was done to be sure that COTA and BFTB performance are relatively comparable. For those, who already have been running COTA, this might give you some idea how BFTB might run. Of course, COTA has a greater number of smaller (less unit count) scenarios than BFTB.

One other thing to be aware when playing is that unit counts tend to climb during play due to reinforcements. So, simulation rate usually starts faster and trails off later in the scenarios.

Remember there will be a BFTB demo which should prove an excellent vehicle to test with. You can reference the test scenario's unit count and performance with what I have already posted already. (meaning the XLS of scenario stats)

My test system:

2007 Top End
Intel QX6700 Quad Core 2.66GHz OC'ed 3.20GHz
4Gb RAM
BFG NVidia 8800 GTX OC'ed
WinXP Pro SP3 32 bit

PS: Dave & Paul I would be interested in your comments. Thanks.

< Message edited by MarkShot -- 6/9/2010 8:07:58 PM >


_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to MarkShot)
Post #: 2
RE: Take the BFTB performance test! - 5/29/2010 8:20:28 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
I just corrected my file names in the Zip.

If you want the real story, it was either this or test a new vacuum as my wife asked.

Now, I've run out of excuses and have to test vacuum! :(

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to MarkShot)
Post #: 3
RE: Take the BFTB performance test! - 5/29/2010 8:24:26 PM   
James Sterrett

 

Posts: 1619
Joined: 7/7/2004
Status: offline
BFTB600: 40 minutes

BFTB250: 133 minutes

Intel i7-860 (quad core)
4GB RAM
Radeon 4850/500MB
Win7 Home Premium

(in reply to MarkShot)
Post #: 4
RE: Take the BFTB performance test! - 5/29/2010 8:28:38 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
James,

That's very interesting. I would have expected more from your later CPU.

I am pretty sure that the simulation rates in the engine are free floating relative to machine cycles and not capped or scaled.

Thanks.

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to James Sterrett)
Post #: 5
RE: Take the BFTB performance test! - 5/29/2010 8:31:17 PM   
James Sterrett

 

Posts: 1619
Joined: 7/7/2004
Status: offline
Well, keep in mind that I'm not a ninja at making sure everything is set up correctly!

When running multiplayer vs a Win XP box with an Athlon x64 3700+, the older Athlon box will move steadily along, i7 box will scream through 3 minutes in about 2 seconds, then stops and waits for the Athlon to catch up, then screams forward again -- it's weird to watch.

(in reply to MarkShot)
Post #: 6
RE: Take the BFTB performance test! - 5/29/2010 8:35:01 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
BTW, you didn't post your clock speed which be relevant within processor family comparisons.

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to James Sterrett)
Post #: 7
RE: Take the BFTB performance test! - 5/29/2010 8:36:40 PM   
James Sterrett

 

Posts: 1619
Joined: 7/7/2004
Status: offline
Picky, picky...

2.8 GHz

(in reply to MarkShot)
Post #: 8
RE: Take the BFTB performance test! - 5/29/2010 8:39:48 PM   
Fallschirmjager


Posts: 6392
Joined: 3/18/2002
From: Chattanooga, Tennessee
Status: offline
BFTB250: 158
BFTB600: 42

I don't have COTA on this new machine yet or I would try that.
Your two year old machine is hanging on well Mark. I built mine back in February and it is top of the line.

Edit
I forgot my specs
Intel Core i7-920 Bloomfield 2.66GHz overclocked to 3.4 GHZ
12 GB of 1333 Mhz Ram
Nvidia 295 1.8 GB Gpu x2 in SLi (probably useless or this test )




< Message edited by Fallschirmjager -- 5/29/2010 8:43:17 PM >

(in reply to MarkShot)
Post #: 9
RE: Take the BFTB performance test! - 5/29/2010 8:41:26 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
Machine specs please.

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to Fallschirmjager)
Post #: 10
RE: Take the BFTB performance test! - 5/29/2010 8:44:35 PM   
Fallschirmjager


Posts: 6392
Joined: 3/18/2002
From: Chattanooga, Tennessee
Status: offline
I noticed Zoom level makes a difference in sim speed too. It is small but noticable. If I zoom in all the way the game simulates a little bit faster. Like 6%

(in reply to MarkShot)
Post #: 11
RE: Take the BFTB performance test! - 5/29/2010 8:52:45 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
Interesting. Well, I was using the standard zoom level at loading.

In past testing of this engine, video cards have turned out to be largely irrelevant along with display resolution. As such, this is a very good war game for laptops, since usually the video subsystem tends to be the most underpowered component.

Also, the memory foot print of this engine is pretty small compared to most games. Probably less than 200Mb in most cases.


_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to Fallschirmjager)
Post #: 12
RE: Take the BFTB performance test! - 6/4/2010 1:24:49 AM   
JaguarUSF

 

Posts: 261
Joined: 7/31/2003
From: Jacksonville, FL
Status: offline
BFTB250: 109
BFTB600: 30

AMD Athlon II X3 440 (3.0 GHz)
4 GB RAM
ATI Radeon HD 4670 1 GB

(in reply to MarkShot)
Post #: 13
RE: Take the BFTB performance test! - 6/4/2010 8:13:31 AM   
Motomouse

 

Posts: 240
Joined: 4/1/2005
Status: offline
BFTB250: 120
BFTB600: 33
COTA250: 115

AMD Phenom II X4 3,20 GHz
4 GB RAM
NVIDIA 8800 GT
WIN 7 64 Bit

And for reference:

Ubuntu 10.04 (via Wine)
BFTB250: 107
BFTB600: 30
(Interesting on Linux: Processor speed set to "Performance": BFTB250: 107, "On Demand": BFTB250: 60 only)



< Message edited by Motomouse -- 6/4/2010 9:45:58 AM >

(in reply to JaguarUSF)
Post #: 14
RE: Take the BFTB performance test! - 6/4/2010 11:41:02 AM   
boogada

 

Posts: 353
Joined: 8/17/2007
From: Germany
Status: offline
Ok this test reveals the ugly truth of my old laptop.

BftB600: 8
BrtB250: 25
COTA250: 26

2Ghz Dualcore 2Gigs Ram

Guess that means that the big scenarios are almost unplayable as they would take days to finish, even at the highest speed. Talk about value for money. But the smaller ones are just fine. I'd like to add that the game might be running slow, but its absolutely running fine. No problems at all. I guess with this machine it would be impossible to play any graphics heavy game in 2010 at a good rate at all.

(in reply to Motomouse)
Post #: 15
RE: Take the BFTB performance test! - 6/4/2010 12:07:36 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
Folks,

Please remember to list your processor model and clock speed as that is the most important yard stick for comparison of these results.

Boogada,

Well, as you can see the CPU overhead increase is not a linear curve. So, a good number of lesser BFTB scenarios look well within your grasp. In fact, through much of HTTR's and COTA's development, I was also in that situation.

You probably find the UI smooth despite the slow simulation speed due to the way the engine uses two separate threads for each. That's why an AI replan can halt the simulation clock for a minute or two and yet the map interface is not jerky at all.

I also have an old 2004 laptop which is getting slower with each year. :(

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to boogada)
Post #: 16
RE: Take the BFTB performance test! - 6/6/2010 8:28:05 PM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
Bump

I updated the first two posts with comparative information about HTTR as well.

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to MarkShot)
Post #: 17
RE: Take the BFTB performance test! - 6/6/2010 9:39:52 PM   
IDontThinkSo


Posts: 64
Joined: 5/28/2010
Status: offline
I can only offer my machine's performance at HTTR, since I haven't bought BFTB yet (still waiting for the stipend, and frankly, with the issue of COTA possibly not being rebuilt in the engine, contemplating that game before BFTB, as I am genuinely interested in the theater).

So here goes:

HTTR250: 148

Machine:
Core 2 Duo Mobile 2.53 GHz
4GB DDR-II
Ati Mobility Radeon 3650 256 MB
Windows 7 Professional 64 bit


< Message edited by IDontThinkSo -- 6/6/2010 9:40:21 PM >

(in reply to MarkShot)
Post #: 18
RE: Take the BFTB performance test! - 6/7/2010 12:17:08 AM   
Prince of Eckmühl


Posts: 2453
Joined: 6/25/2006
From: Texas
Status: offline
BFTB250: 147
BFTB600: 40
COTA250: 116

Intel Core2Duo 3.33Ghz + 3GB RAM + Windows 7 Home Premium

Edit: Fat-fingered BFTB600; corrected.


< Message edited by Prince of Eckmühl -- 6/7/2010 12:29:10 AM >


_____________________________

Government is the opiate of the masses.

(in reply to IDontThinkSo)
Post #: 19
RE: Take the BFTB performance test! - 6/7/2010 12:26:45 AM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
Nevermind ... PoE corrected his posting error.

< Message edited by MarkShot -- 6/7/2010 12:48:31 AM >


_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to Prince of Eckmühl)
Post #: 20
RE: Take the BFTB performance test! - 6/7/2010 12:31:19 AM   
Treale


Posts: 1280
Joined: 8/10/2003
From: Central Florida
Status: offline
So what's the numbers mean? High number of minutes good or bad??

_____________________________

Tony

(in reply to Prince of Eckmühl)
Post #: 21
RE: Take the BFTB performance test! - 6/7/2010 12:44:54 AM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
XXXX250 999 means:

XXXX - The particular game engine.

250 - The approximate number of units (both sides) active at that moment in the scenario.

999 - The maximum number of simulated minutes that the player's system can compute in one minute of wall clock time.

---

250 is the average unit count for BFTB scenarios.

600 is the maximum unit count for BFTB scenarios.

I did this for a number reasons. First, I was curious for myself whether my existing desktop would handle BFTB reasonably. Second, I thought others might find this useful in getting a sense of how BFTB runs compared to the other games, and what they might expect from BFTB if they buy it. Combined with my XLS, you should be able determine if you'll be satisfied with BFTB's performance. There is not right or wrong answer to that question, since one player's tedious wait is another's immersive experience. Of course, those with concerns can and should perhaps wait for the demo, but it is not yet clear just how sizeable the demo scenario(s) will be.

However, I suppose if the demo only has 100 units, then I can do a BFTB100 benchmark. Then, potential customers can use the ratios found in this thread for BFTB100:BFTB250:BFTB600 to extrapolate what they will see if they buy the game.

Well, I hope that answers your question.

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to Treale)
Post #: 22
RE: Take the BFTB performance test! - 6/7/2010 12:45:47 AM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
In case I wrote too much, higher is better.

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to MarkShot)
Post #: 23
RE: Take the BFTB performance test! - 6/7/2010 12:56:18 AM   
Treale


Posts: 1280
Joined: 8/10/2003
From: Central Florida
Status: offline
I ran the HTTR scenario on my "OLD" desktop. Don't laugh at it! I'll have to try it on my laptop. It's a lot stronger machine, and newer..

174 minutes
Pentium 4
3.06 ghz
1 gig of shared Ram
XP Service pack3

_____________________________

Tony

(in reply to MarkShot)
Post #: 24
RE: Take the BFTB performance test! - 6/7/2010 1:04:16 AM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
That's a very respectable score. Higher is better.

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to Treale)
Post #: 25
RE: Take the BFTB performance test! - 6/7/2010 1:06:40 AM   
MarkShot


Posts: 6606
Joined: 3/29/2003
Status: offline
I'm not a PC hardware guru, but it is beginning to look like clock speed is the key factor even more than CPU model despite L1|L2 cache sizes, pipelines, predictive execution, scalar processors, etc...

_____________________________

Panther Games (RDOA/HTTR/COTA/BFTB) Beta Tester

(in reply to MarkShot)
Post #: 26
RE: Take the BFTB performance test! - 6/7/2010 1:16:20 AM   
Treale


Posts: 1280
Joined: 8/10/2003
From: Central Florida
Status: offline

quote:

ORIGINAL: MarkShot

That's a very respectable score. Higher is better.


My pc specs is the largest drawback to picking up BFTB now. That's why I was waiting for the demo and buying the earlier titles first!!

_____________________________

Tony

(in reply to MarkShot)
Post #: 27
RE: Take the BFTB performance test! - 6/7/2010 1:49:19 AM   
oldspec4

 

Posts: 690
Joined: 11/1/2004
Status: offline
Mark..scored an 87 for CotA250.

Am running an AMD quad at 2.8Ghz, 8GB DDR3 ram, 9800gt, and Win 7(64).



< Message edited by oldspec4 -- 6/7/2010 3:26:10 AM >

(in reply to Treale)
Post #: 28
RE: Take the BFTB performance test! - 6/7/2010 2:42:08 AM   
Prince of Eckmühl


Posts: 2453
Joined: 6/25/2006
From: Texas
Status: offline
Markshot,

Are you wanting to know what it would take to open the game up to larger forces, to bust the 600-unit barrier?


_____________________________

Government is the opiate of the masses.

(in reply to oldspec4)
Post #: 29
RE: Take the BFTB performance test! - 6/7/2010 3:06:28 AM   
Prince of Eckmühl


Posts: 2453
Joined: 6/25/2006
From: Texas
Status: offline

quote:

ORIGINAL: Prince of Eckmühl

BFTB250: 147
BFTB600: 40
COTA250: 116

Intel Core2Duo 3.33Ghz + 3GB RAM + Windows 7 Home Premium

Edit: Fat-fingered BFTB600; corrected.


Out of curiosity for how the numbers would scale with processor speed, I upped the system bus from 166mhz to 200mhz. That increased my system speed to 4ghz. I got these results at that setting:

BFTB250: 175
BFTB600: 48
COTA250: 140

The game's ability to churn through the game clock is definitely CPU dependent. The twenty-percent increase in processor speed generates proportionately similar improvements in game performance.



_____________________________

Government is the opiate of the masses.

(in reply to Prince of Eckmühl)
Post #: 30
Page:   [1] 2 3   next >   >>
All Forums >> [Current Games From Matrix.] >> [Discontinued Games] >> Command Ops Series >> Take the BFTB performance test! Page: [1] 2 3   next >   >>
Jump to:





New Messages No New Messages
Hot Topic w/ New Messages Hot Topic w/o New Messages
Locked w/ New Messages Locked w/o New Messages
 Post New Thread
 Reply to Message
 Post New Poll
 Submit Vote
 Delete My Own Post
 Delete My Own Thread
 Rate Posts


Forum Software © ASPPlayground.NET Advanced Edition 2.4.5 ANSI

0.109