Understanding Cargo/Your resources

Distant Worlds is a vast, pausable real-time, 4X space strategy game which models a "living galaxy" with incredible options for replayability and customizability. Experience the full depth and detail of large turn-based strategy games, but with the simplicity and ease of real-time, and on the scale of a massively-multiplayer online game. Now greatly enhanced with the new Universe release, which includes all four previous releases as well as the new Universe expansion!

Moderators: elliotg, Icemania

User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

You see that colony directly northwards of the cross, about 1/2 to 2/3 of the way to my homeworld?  That system has a 50+% terralion source with a mine with double extractors.  Some freighters are going there but more to other places (independent and Boskara).  The colony out east, the one sort of in the middle, third from the right is also a terralion source, I forget the percent.  No one is going there.
 
All sorts of dumbness is going on when I've watched the freighters in this game.  For example there are two Iridium sources within a sector of my homeworld.  There were none at game start but basically they have been keeping pace, or even increasing the homeworld stores a bit.  Back to 1500 was down to 1000 before the first source kicked in.  Between them, when I looked about the time of these pictures, they had 2500 unreserved.  But a freighter just decided to get Iridium from the Boskar homeworld.  The mines have been operating for much longer than I have known about the Boskara, let alone where their homeworld is.  Can't make any sense of that one, for example.
 
Another great one is that I developed a Wiconium source early on, about half a sector southwest of my homeworld within its influence circle.  There was at the time of the pictures over 2000 unreserved units there.  My homeworld has been demanding it all game (hence why I built the mine) but has not received a single unit.  But three freighters had just decided to get Wiconium from the Wekkarus, their mine being on the western edge of their influence circle.     (I have played on a little bit and 1000 of the Wiconium from my source has just been reserved so I guess that's something...)
 
I have been a bit tight on variety.  Currently I have 11 luxuries plus 2 ultra-rares available.  The ultra-rares are quite new only about 100 Loros and 650 Zentabia mined.  You've heard a bit about the Zentabia... currently two freighters going there but their reservations were cleared a week or two after they were made.  Sure they will still pick up, in fact if it remains at 2 it will work nicely since it is a decent trip but it worked like this - first freighter reserves 400 then a week later no reservations showing again... maybe two weeks later the second freighter reserves 450-500 but most of this is the same stock!...  a couple of weeks later no reservations are showing apart from 10 for local population... all will be good this time since there may well be 800-900 by the time they get there and they will each get a good load but if a few more freighters had reserved in the following couple of months, well, maybe we would have something like in the pictures (assuming  independent freighters or another empire cleaned out the terralion source before I got there).
 
I've got a fleet on the way to conquer the independent giving the troublesome supply (bloody Naxxilians - never trust a dinosaur with a comlink [:D]).  They also have Jakanta which a lot of my colonies are demanding but no freighters are going to collect it.  And I've a colony ship on the way to an Ekarus source which I don't have yet.  Three luxuries (Caguar, Dantha, Bifurian) I have not yet found anywhere.  There is one source of Yarras up on the northern edge of the map above my most eastern colony on a colonisable world.  It's protected by pirates so I doubt that the Wekkarus will get it.  But first I'm intent on snatching a 600+ million Wekkarus independent out from under their, um, err, noses?  It's between the Yarras and that eastern colony. I found a good source of Nepyths somewhere but no one is demanding it and I have not had a constructor handy to develop it.  There are a couple of low quality sources of Aquasian in out of the way troublesome locations.  One of my miners is onto one but it's low down on my priorities. 
 
So that's the situation, not great but far from terrible.  My constructors are all building fuel (surprise, surprise) and I've finally discovered a decent (i.e. greater than scientist bonus) location for weapons research.  And if I get one free I'll be building steel before luxuries.  I'm already swimming in money (built Bakuras and Rusan is 1/3 of the way at my homeworld) but finding the steel to load my constructors with is currently a massive problem.
User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

Pipewrench, our posts crossed.

Yes I see that too, but this is somewhat different, I think. Those are the first and second freighters of mine to go to that source. If they were further down the line, yes that is not that uncommon. But the first there usually gets at least 50 or 100 (and often 400ish if it is a new source).

So I think the question remains - did they reserve that tiny amount and make the trip on that basis, or did they reserve more and not get it for some reason?

[p.s. As far as I can tell no other empire has yet explored that region. The Boskara have at least 3 ice world mines of their own (and I'm buying from them) so I don't think that they would be interested even if they found it. I've just encountered a Ketarov explorer but about 3 sectors south of there and not their territory yet, so I would guess that they are still another sector or so away.]
Bingeling
Posts: 5186
Joined: Thu Aug 12, 2010 11:42 am

RE: Understanding Cargo/Your resources

Post by Bingeling »

I always find it a problem to muster motivation to start a game. And figure out the settings.

Maybe a game with only constructor control and watching freighters at work is where the real entertainment lies?

Btw, in your images above, both were transporting not only terralion down, but also tyderios. You should not happen to have a tyderios shortage? That does not seem very likely, though.

I think some old notes (legends notes, a patch?) mention higher priority to fuel mines. Maybe that is why your constructors are so busy?
User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

Oh, I should add, that although my demand has blown way out for steel I still have something like 20k of it sitting in mines unreserved because all my freighters are... well see above.  [;)]
User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

Bingeling, I play fully manual usually and am in this game.  My constructors are busy to keep up with the fuel demand being created predominantly by freighters flying all over the place.  Wish they would pick up a couple of full loads of fuel and deliver them to my spaceport; when they are transporting resources they seem determined to get the things I need least (Emeros, Osalia for example) from my far off colonies.  Now if they had taken loads to build the spaceports rather than flying out there empty my ports would have been built ages ago and my freighters would have much shorter trips.  But they have other priorities...
 
One of my more amusing games a while ago was played with me only controlling research and ship design (and the diplomacy you have to do).  Gee the automation gets up to some shenanigans if you let it. [:)]  It was funny to watch how even with much better designs the cpu could balls things up.  A win was finally had but soooo much longer than it usually takes me.
User avatar
Pipewrench
Posts: 453
Joined: Tue Jan 05, 2010 1:38 am

RE: Understanding Cargo/Your resources

Post by Pipewrench »

lol[;)]
and yes your giving me a headache......

so here is some speculation

Was the Wiconium a major luxury resource that your race needs at the game start?

The Nepyths, once a mine is put in place, will become a luxury wanted. The trade network just needs that commerce center to start the ball rolling. Always mine a brand new luxury if found, unless it is too far.

I have found that most new colonies tie up freighters because they need their happiness raised as soon as possible. That is why the auto build for star ports is not enabled until the population rises and the luxuries can be established with some infrastructure put in place. If I build too many star ports at one time and colonize too fast a major backlog can seriously mess things up until constructors have had time to build more infrastructure.

I totally agree that the Iridium makes no sense. The query must be confused unless the AI believes trade is more important to preserve current stocks??


Wtfwknows?[&:][;)]

You have a soap opera on your hands...
edit...
OR
Inefficiency is WAD and with more corruption comes more inefficiency?! Need a slider [:D]
“We are limited only by our imagination and our will to act.”
– Ron Garan
Bingeling
Posts: 5186
Joined: Thu Aug 12, 2010 11:42 am

RE: Understanding Cargo/Your resources

Post by Bingeling »

From the little test I did watching a gas mine at startup, I am puzzled by your fuel use. Because my gas mine was not busy :)

Do you run a lot of automated navy ships?

I generally don't use automated ships until a good way into the game. In early game my ships are in fleets, where they either.

1: Sitting idle
2: Travelling towards a target (pirate)
3: Fighting a target.
4: Travelling back from fighting a target.

I had the pleasure of watching a mine for ages (see tech forum). I noticed AI ships coming to patrol it (even a captured pirate capital, it values gas mines). They travelled a triangle with one point straight above the main. Going around in circles for ages.

And what do the AI do with automated ships? Mostly patrols and escorts. Both which spend fuel doing it. My main activity is "sitting idle" which spends no fuel.

Btw, I think that in my next game from scratch, I will run manual single ships, and park them at mines. I guess fleet postures won't work in single ships, which is a shame, because that "return to base" feature is sweet.
User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

Pipewrench, most of those colonies have not had any luxuries delivered yet. Well, okay, some is more like it, perhaps an average of one luxury per colony. Given some more time though I think that what you say is what will happen.

No on the Wiconium as racial bonus, I'm playing Kiadian (didn't realise how easy they were before) so the specials are Rephidium and Natarran.

Three of them are lost colonies (2 pushing 4 billion already) and most of the rest 200-600 million from independents so the autopopulation triggers would cause this anyway even though I am not using them.

I think you are half right when you say
If I build too many star ports at one time and colonize too fast a major backlog can seriously mess things up until constructors have had time to build more infrastructure.

I'm certainly (deliberately) doing the first half colonising + conquering and 'building' (scarequotes because they are not actually building but just sitting the queues at 0%) as quick as possible. The infrastructure is not the limitation however but the transport. It will soon grind to a halt as the private sector orders ships which send me into reservations which will take a long long time to clear. Currently 80+ in the construction queue at the homeworld even though I have Bakuras there, and another 20 odd at my other spaceport. Adding construction yards won't help as the bottleneck is the supply of the strategic resources, which are needed to produce the freighters to carry the strategic resources. I figure that my colonies near my neighbours will get things built first from materials bought from my neighbours whereas my inner colonies will remain unbuilt for ages.

So some of it I expect, but there is freighter madness going on beyond this. I think the algorithm is nowhere near robust enough since it does not appear to be able to cope. My constructors won't build me out of this because they will not be able to get materials, steel in particular, to build with since whenever it arrives at my two spaceports it will be turned into components for freighters. I might occasionally be able to sneak a little bit on board if I get the constructor to the dock quick enough that all the fresh steel has not been used by manufacture. Or I might be able to get a freighter supplying an unfinished job after many years except that I'm so unconfident of this happening in any realistic time frame that I will not even try.

Mining Nephys would probably make my situation worse I think. One more thing prioritised ahead of transporting the strategic resources my empire really needs from the mines to the spaceport(s).
Bingeling
Posts: 5186
Joined: Thu Aug 12, 2010 11:42 am

RE: Understanding Cargo/Your resources

Post by Bingeling »

I wonder what decides who will get the next freighter (for a task).

If it is first come first serve, your steel shortage could wait through old "small needs" to be served. If you are really lucky that will make you run out of fuel and never recover :-P. Of course, freighters can always travel to the mines to refuel...

The full info on a freight order should be

Items and amounts
From
To

The issue with figuring out what freighters are up to is that you get to know the info late in the trip. The freighter will say in its order what it is transporting, but there is only room for a few items. You have to watch it vector to see where it is heading, won't know how much and exactly what is picked up until it leaves the pickup point, and won't know where it is to be delivered until the freighter has finished "aiming" into its hyperspace entry and the vector becomes visible.

Up to some 30s freighters it could be possible to log all freight movements, and watch colony needs, but since you have to keep tracking a freighter to see its full order, it is not feasible.

Writing a really good freighter algorithm is probably hard. Really hard. Various "needers" would have to bid for the task, and distance traveled to distance must have a price. And also, those waiting "forever" must be able to get higher priority. To mess things up further, the algorithm should know in which areas more or less freighters are needed, and order more if "global backlog" is too large...

If you have 80 freighters in a construction backlog, it could be because you need those 80 to serve your needs. And instead they just assist in creating the current jam.

In the resource thread on the tech forum I wrote that my 45-50 colony mature empire had "224 small freighters, 177 medium freighters, and 100 large freighters". 80 freighters is a significant part of that fleet (and you do not have 30+ 1000M+++ colonies). Yet :)
User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

Bingeling, no not my navy. It's manual anyway but it only uses a small fraction of my fuel. Whatever military I have is constantly busy with pirates and monsters at this point in the game except for my minimal system defence forces which sit still guarding their targets and getting their energy from solar. But I don't have much - which is why they are so busy. And I usually refuel them straight from the mines.

Its my freighters chewing through the fuel. Not just the flying around, although that doesn't help (300 fuel for 12 resources is not a good conversion rate is it?) but the fact that I am building new ones. And if I ever manage to catch up and get some in stock at my ports I'll go for enhanced storage and send myself dry again.

Part of the reason is that it is an irregular map and hence very spread out (average of less than 7 systems per sector), and because I started on the edge it's all out and back. But although the settings are up the fuel intensive end of the spectrum it is also the silliness of the transports. If my freighter makes a 10 sector round journey to the Boskars instead of the less than 2 sector round journey to my mine that's a lot of extra fuel, maybe 300-400 extra for the one freighter for the one load. A single journey like that doesn't matter much but when most of your freighters are doing that all of the time you need to keep building fuel. And where do they fill up? Predominantly at your spaceport.
User avatar
Pipewrench
Posts: 453
Joined: Tue Jan 05, 2010 1:38 am

RE: Understanding Cargo/Your resources

Post by Pipewrench »

feelotraveller

sorry to elaborate

Wiconium not as racial bonus but needed when a colony is first settled. I believe every empire has ,because of base colony type, a certain set of base luxuries it desires. Any new luxury is a bonus that is on a lower priority. Wiconium may not of been on that original must have rsvd list at the beginning of the game. I hope that clears up what I was thinking and again this is specuguessing.

Sorry also for hijacking the thread. Have fun fellotraveller and I hope the frustration just keeps you on a slow boil.[;)]
“We are limited only by our imagination and our will to act.”
– Ron Garan
User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

Ah, okay.  That is an interesting suggestion.  Wiconium was demanded from the very beginning... I think.  But, and now your headache grows  , Terraliion was not.  I'm pretty sure it appeared later and is lower down on the list (in default order of appearance).  Will check tomorrow just in case I have it wrong.
 
I take all of this with a grain of salt.  The freighters have definitely improved.  I'm sure that it is hard to design a good algorithm for this.  One way to make it better is to see how it breaks down in limit cases.  In this case the limit seems to be doing too well.  I guess what fundamentally bothers me is that it seems like the better you do in the game the worse the private sector copes. 
 
I would be surprised if it was working as designed though.  It would mean that the game is 'cheating' on a fundamental level (refusing to supply you Terralion which would normally be there, or deliberately sending your freighters to the further source when they usually choose the closer), something it does not do elsewhere as far as I have seen.
 
Don't worry I am having lots of fun.  [:D]
Bingeling
Posts: 5186
Joined: Thu Aug 12, 2010 11:42 am

RE: Understanding Cargo/Your resources

Post by Bingeling »

Do you have an idea of what appeared first?

Knowledge about foreign sources?
Your own sources?

If colonies (I assume it is them) decide it should have a resource and figures out the source early, it could give a situation where it prefers the far source (the one it knew back then) instead of closer sources.
User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

I think there is a bit of that with the Terralion supply.  The independent was discovered shortly before I finished my Terralion/Tyderios/Vodkol mine.  It certainly makes sense for the first couple of freighters to go there given a simple algorithm which does not anticipate the completion of my mine and there are good reasons for keeping it simple.  Fine.  Even once my mine is operating I can handle the traffic being split between the two sources.  But to be going to a source for so little when that source is at that distance does not sit well with me.  The later mission to the Boskara, who were not discovered until much later than the above is also a worry, particularly since I have another source (colony) at much the same or slightly less distance which is not being accessed.
 
The Iridium and the Wiconium, however, were both well stocked before I discovered either of my neighbours.  In fact with the Wiconium I had been waiting and waiting for a reservation to be made.  My homeworld had been demanding it for a long time, if not from the beginning of the game.  And yet it is only after 3 freighters make reservations with the Wekkarus that two others finally getting around to making a reservation from it.  It is maybe a sector at most to my mine and 5 or 6 to the Wekkarus.  The Iridium on the other hand had frequently been transported.  One is a steel/iridium mine, the other a steel/gold/iridium mine.  (Both gold and steel during this period were slowly sinking lower and below their starting amounts at my homeworld, not that it should really matter.)
User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

Okay Pipewrench I got it a bit wrong. 
 
Going back to the initial save both Terralion an Wiconium are demanded, but - and I'm not sure how significant this is - Terralion is the fifth demanded luxury, first one without any stock, and Wiconium is the eighth.  By the time of the screenshots the sixth in the list has its demand satisfied and the demand for the seventh has disappeared a long time ago.
 
Food for thought. 
User avatar
Jeeves
Posts: 940
Joined: Mon Sep 27, 2010 9:37 pm
Location: Arlington TN U.S.A
Contact:

RE: Understanding Cargo/Your resources

Post by Jeeves »

I designed a game back in 91-92 which had freighters moving cargo. Supplying the fuel and deciding what cargos to ship was a major headache. I expect that distant worlds 2 will have a new algorithm for the private sector, from lessons learned with the current one. The classic case is called the traveling salesman algorithm, expanded to a shipping network. 80 freighter spaceport queue? LOL, the worst I ever had was 400 freighters in queue at Bakuras shipyards homeworld, with a shortage of 40k steel and 15k aculon. But eventually they all got built and the homeworld shipyard was idle. From experience the less demanded resources get short, then ships arrive for a year carrying them even though the shortage is long gone. Want a tooth grinder? In my current game the homeworld has been short less than 2k of dilithium for over six months, and the queue backlog has grown from 60 to 140 ships. I have two dilithium mines about a sector and a half away with no reserved and several k of stock. The spaceport closest to them has over 5k in stock and about as much reserved as the homeworld needs. THAT is where I get it, from that spaceport not directly from the mines, which is AS DESIGNED. So instead of getting a roundtrip for a new freighter from my homeworld to a mine, it goes to the mine, then to the spaceport, unloads then undocks and another freighter docks, loads and comes to my homeworld, which takes a LONG time.

Lonnie Courtney Clay
Live long and prosper!

Lonnie Courtney Clay
Bingeling
Posts: 5186
Joined: Thu Aug 12, 2010 11:42 am

RE: Understanding Cargo/Your resources

Post by Bingeling »

I have a past in optimizing search... And I have suggested a trade network between spaceports... Managing 50 colonies, 300 mines, scattered across space, with point to point transport of freighters is hard.

I had around 500 freighters for some 50 colonies in my latest game. The empire was 7-8 sectors long along the ring of a circle galaxy, which is a bit special shape due to the galaxy type.

Set up main trade hubs along a line. You want items to travel in your trade network. That empire would need 7-8 hubs max. Have 4 large freighters travel between each neighbor pair of hubs. That should be some 30 assigned. They should carry full loads.
Give each colony two medium freighters to travel to and from the hub. Never light on loads. That is 100 medium freighters. Give each colony 4 small freighters to serve nearby mines. To bring full loads to the colony. That is 200 small ones. 200 medium, 200 small, 30 large. And there are still 70 to spare in the 500 current freighters of that empire.

Of course, needs would have to propagate. A colony needs to know what is a shortage (pretty obvious), low level, suitable level, and excess. Or something along that line. When new colony A books its small spaceport, it asks the hub for the missing materials (and everything else it thinks it should need (luxuries). So the hub should know its real stock is lower, and keep track of "stock after subtractions". Which it could in part get from its own "sub colonies", or ask from the next hub. If asking the next hub, treat things the same, have needs propagate. Any freighter travelling a trip, should fill up according to what the destination needs, and what the current station got a surplus of.

If you colonize a loros source, every colony should want some, and ask its hub for it. The hubs have nothing, they should ask in both directions (and make sure it does not reinforce itself), which finally ends up at the "loros" hub giving a huge demand and priority. Two medium freighters (or more if not as locked as above), shuffling the loros there is to the local hub. The large freighters shifting loros along the line of hubs. Mediums picking up and bringing the 124 requested from hub to each colony, along other wares the colony requests...

But in a game of this it is not necessary to optimize the freighters much, you can just balance the game around the inefficiencies, and avoid the worst stupidities. Like it is today, the freighters work, mostly.

A fun effect of this would be feeling a need for bigger space ports at the hubs (more docking bays, faster cargo handling). Large amounts of freighters coming and going. And if the nasty human player comes and conquers a hub? Find a nearby colony to be the new hub, you just lost a rather big store, but there is enough stuff at the other hubs to boost this one quite fast (not to mention the colonies in the area). The hub should not be a giant store, just bigger than average, and where the goods flows through.

User avatar
feelotraveller
Posts: 1040
Joined: Mon Sep 12, 2011 10:08 am

RE: Understanding Cargo/Your resources

Post by feelotraveller »

Yes, just getting my two cents worth about where I think the problems lie or at least start. 
 
Agreed, 80 is not much.  In relative terms though I had more ships in the queue than on the map.  And at that point there were still 120 ships the private sector would order once it had the cash.  I've added three more colonies since the last ship building order, and have another 3 colony ships on the way and a couple of independent invasions lined up, although I think the real glut - beacons, found colony ships and lost colonies mainly - has passed.  Still the private sector will be ordering another 200 ships for the colonies I already have as soon as it has the cash.  Figure that's about a year and half's worth of private sector income, although it could well turn into merely a year with ultra-rares/Rusan kicking in.  But the backlog has been growing - Bakuras with 12 yards - and the resources not being shipped.
 
I am swearing off normal homeworlds.  They are more trouble than it's worth and that is a worry.  [:-]  This one had no fuel and all up only 9 different resources so I thought that it might be okay.  I went back to normal to have a fun game and it has caused me headaches.  Maybe there is something wrong with that...
Bingeling
Posts: 5186
Joined: Thu Aug 12, 2010 11:42 am

RE: Understanding Cargo/Your resources

Post by Bingeling »

I would guess it could be galaxy settings (too much goodies) and too much exploration early on. I don't see how the difficulty setting matters too much.

Also, imagine you find that lost colony right away, you suddenly almost double your colony ship output. If you have quick research, colonization tech arrives quite fast, giving more colony opportunities...

You can also have hit a nasty random occurrence of "too early contact with foreign power with resources, and certain lack of other things". Things that makes your freighters go belly up.
User avatar
Pipewrench
Posts: 453
Joined: Tue Jan 05, 2010 1:38 am

RE: Understanding Cargo/Your resources

Post by Pipewrench »

feelotraveller,

your food for thought is going to drive me to drink. If I have a hangover tomorrow it is because of you..

Bingeling,

Totally agree and with the fruit does it go to the unhappiest colony first?

Jeeves,

Love your post and yes I have had toothgrinding as well. No head smashed into keyboard as of yet....[;)]

Speculation babble

I still have a hunch that freighters work on happiness. The faster you expand the more pressure is put on the freighter network to feed the new colonies with enough luxuries and basic resources to bring them up to a smile. As you grow some developed colonies fall behind not because of location but because they are happy and are not a priority. I am not near the game today but if someone has time move the colony governor to another planet and raise taxes to create unhappiness. If soon after freighters show up to fill the rsvd request it might help explain some things.

Very good discussion people. Lets hope that the intelligence of the race is not a factor in the supply network as that would create pages of speculation.[:D]

I still cannot come to any sane conclusion about small shipments unless crews are drinking or selling the product on-route or a large freighter is dispatched instead of a small freighter because of fuel considerations?

Edit: Need to revise happiness to colony development. Speculative at best.....


“We are limited only by our imagination and our will to act.”
– Ron Garan
Post Reply

Return to “Distant Worlds 1 Series”