Since Update Server Has Continued to Crash

Conan Exiles PC Discussion
1

Game mode: Online Private
Type of issue: Crash
Server type: PvE
Region: US-East

I am renting a server through g-portal. Ever since the update yesterday, the server continues to crash after just a few moments of logging in, and then refuses further connections. Here is a dump of the log from start to finish:

[2019.12.03-14.20.46:802][845]LogServerStats: Sending report: exiles-stats?players=0&=6.00%3A16.81%3A27.90&uptime=15408&memory=92203282432%3A136976379904%3A5098741760%3A5160034304&cpu_time=0.981626%3A11.779508&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.21.46:795][407]LogServerStats: Sending report: exiles-stats?players=0&=10.91%3A16.84%3A104.05&uptime=15466&memory=97557778432%3A136976379904%3A5098409984%3A5160034304&cpu_time=2.072314%3A24.867762&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.22.46:806][994]LogServerStats: Sending report: exiles-stats?players=0&=5.57%3A16.73%3A28.28&uptime=15525&memory=91852042240%3A136976379904%3A5098827776%3A5160034304&cpu_time=1.489238%3A17.870855&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.23.46:801][613]LogServerStats: Sending report: exiles-stats?players=0&=5.93%3A16.58%3A36.56&uptime=15584&memory=79776157696%3A136976379904%3A5098921984%3A5160034304&cpu_time=0.974299%3A11.691583&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.24.02:906][585]Performance:Display: [ItemDistributorController BaseGameMode_C_0] Finished item distributor processing; 0 handled this frame.
[2019.12.03-14.24.46:804][213]LogServerStats: Sending report: exiles-stats?players=0&=13.97%3A16.67%3A19.31&uptime=15643&memory=77215027200%3A136976379904%3A5098958848%3A5160034304&cpu_time=1.472438%3A17.669262&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.25.46:800][804]LogServerStats: Sending report: exiles-stats?players=0&=8.87%3A16.71%3A25.01&uptime=15701&memory=73984856064%3A136976379904%3A5099032576%3A5160034304&cpu_time=0.514002%3A6.168025&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.26.46:799][396]LogServerStats: Sending report: exiles-stats?players=0&=7.27%3A16.70%3A25.91&uptime=15760&memory=74339532800%3A136976379904%3A5099114496%3A5160034304&cpu_time=1.040286%3A12.483428&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.27.46:807][997]LogServerStats: Sending report: exiles-stats?players=0&=13.94%3A16.66%3A18.81&uptime=15819&memory=66875867136%3A136976379904%3A5101703168%3A5160034304&cpu_time=0.515016%3A6.180193&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.28.46:807][598]LogServerStats: Sending report: exiles-stats?players=0&=12.90%3A16.66%3A19.93&uptime=15878&memory=59447111680%3A136976379904%3A5101780992%3A5160034304&cpu_time=0.336920%3A4.043046&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.29.46:801][206]LogServerStats: Sending report: exiles-stats?players=0&=13.03%3A16.63%3A20.92&uptime=15936&memory=52450836480%3A136976379904%3A5101834240%3A5160034304&cpu_time=1.040294%3A12.483523&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.30.46:804][817]LogServerStats: Sending report: exiles-stats?players=0&=7.28%3A16.62%3A27.89&uptime=15995&memory=46060789760%3A136976379904%3A5101916160%3A5160034304&cpu_time=0.494532%3A5.934383&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.31.20:970][868]GameEventTelemetryDebug:Display: 0 events (0.0 kb) reported, next flush scheduled at 0001.08.04-04.22.24.
[2019.12.03-14.31.46:795][403]LogServerStats: Sending report: exiles-stats?players=0&=5.99%3A16.73%3A117.99&uptime=16054&memory=2502160384%3A136976379904%3A3830312960%3A5160034304&cpu_time=1.560452%3A18.725428&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.32.46:797][972]LogServerStats: Sending report: exiles-stats?players=0&=11.99%3A16.81%3A21.92&uptime=16113&memory=6019096576%3A136976379904%3A3828060160%3A5160034304&cpu_time=1.036157%3A12.433881&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.33.46:792][548]LogServerStats: Sending report: exiles-stats?players=0&=5.94%3A16.78%3A27.92&uptime=16171&memory=4398395392%3A136976379904%3A3828158464%3A5160034304&cpu_time=1.028004%3A12.336049&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.34.15:678][263]Performance:Display: [ItemDistributorController BaseGameMode_C_0] Finished item distributor processing; 0 handled this frame.
[2019.12.03-14.34.46:807][115]LogServerStats: Sending report: exiles-stats?players=0&=7.35%3A16.82%3A25.92&uptime=16230&memory=4438286336%3A136976379904%3A3828191232%3A5160034304&cpu_time=1.032068%3A12.384818&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.35.28:325][582]SpawnTable:Error: Data: USpawnTableComponent::SpawnNPCFromWeightedTable - could not find weighted table with id: we
[2019.12.03-14.35.28:325][582]SpawnTable:Error: Data: UAsyncSpawnNPCProxy - could not spawn NPC with SpawnTableID: we, at location: X=-82677.680 Y=128953.852 Z=-5491.875
[2019.12.03-14.35.46:803][680]LogServerStats: Sending report: exiles-stats?players=0&=10.97%3A16.83%3A22.52&uptime=16289&memory=4439556096%3A136976379904%3A3828269056%3A5160034304&cpu_time=0.772524%3A9.270289&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.36.46:792][246]LogServerStats: Sending report: exiles-stats?players=0&=6.05%3A16.82%3A27.89&uptime=16348&memory=4442587136%3A136976379904%3A3828322304%3A5160034304&cpu_time=1.028004%3A12.336049&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.37.46:792][813]LogServerStats: Sending report: exiles-stats?players=0&=8.80%3A16.82%3A25.00&uptime=16408&memory=4445151232%3A136976379904%3A3828633600%3A5160034304&cpu_time=0.515014%3A6.180170&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.38.46:804][379]LogServerStats: Sending report: exiles-stats?players=0&=10.99%3A16.83%3A21.94&uptime=16469&memory=4437704704%3A136976379904%3A3828719616%3A5160034304&cpu_time=0.518078%3A6.216940&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.39.46:799][944]LogServerStats: Sending report: exiles-stats?players=0&=10.93%3A16.83%3A22.93&uptime=16531&memory=4440502272%3A136976379904%3A3828744192%3A5160034304&cpu_time=1.036165%3A12.433975&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.40.46:806][511]LogServerStats: Sending report: exiles-stats?players=0&=11.99%3A16.82%3A21.91&uptime=16593&memory=4441219072%3A136976379904%3A3828797440%3A5160034304&cpu_time=0.526440%3A6.317283&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.41.46:794][ 73]LogServerStats: Sending report: exiles-stats?players=0&=13.97%3A16.84%3A95.76&uptime=16655&memory=4445499392%3A136976379904%3A3828461568%3A5160034304&cpu_time=0.513998%3A6.167978&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.42.46:793][639]LogServerStats: Sending report: exiles-stats?players=0&=5.88%3A16.83%3A27.99&uptime=16717&memory=4448174080%3A136976379904%3A3828830208%3A5160034304&cpu_time=1.016009%3A12.192109&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.43.46:800][203]LogServerStats: Sending report: exiles-stats?players=0&=6.95%3A16.84%3A26.92&uptime=16778&memory=4449202176%3A136976379904%3A3828781056%3A5160034304&cpu_time=1.023972%3A12.287663&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.44.07:514][433]Performance:Display: [ItemDistributorController BaseGameMode_C_0] Finished item distributor processing; 0 handled this frame.
[2019.12.03-14.44.46:797][769]LogServerStats: Sending report: exiles-stats?players=0&=12.92%3A16.82%3A20.95&uptime=16840&memory=4453134336%3A136976379904%3A3828920320%3A5160034304&cpu_time=1.028004%3A12.336049&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.45.46:795][335]LogServerStats: Sending report: exiles-stats?players=0&=6.92%3A16.82%3A26.95&uptime=16902&memory=4470530048%3A136976379904%3A3828985856%3A5160034304&cpu_time=0.516038%3A6.192456&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.46.46:797][899]LogServerStats: Sending report: exiles-stats?players=0&=13.92%3A16.84%3A19.97&uptime=16964&memory=4456640512%3A136976379904%3A3829080064%3A5160034304&cpu_time=0.514002%3A6.168025&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.47.46:806][466]LogServerStats: Sending report: exiles-stats?players=0&=9.94%3A16.82%3A23.97&uptime=17025&memory=4457648128%3A136976379904%3A3829116928%3A5160034304&cpu_time=0.520147%3A6.241762&npcailods=0%3A0%3A0%3A6434&buildingailods=0%3A0%3A0%3A41&placeableailods=0%3A0%3A0%3A443&ipv4=172.107.197.103&sport=28500
[2019.12.03-14.48.24:465][705]LogMemory:Warning: Freeing 33554432 bytes from backup pool to handle out of memory.
[2019.12.03-14.48.24:465][705]LogMemory:Warning: MemoryStats:
	AvailablePhysical 4369686528
	 AvailableVirtual 140727470989312
	     UsedPhysical 3827974144
	 PeakUsedPhysical 5160034304
	      UsedVirtual 5312978944
	  PeakUsedVirtual 5377806336
[2019.12.03-14.48.24:465][705]Allocator Stats for binned2: (not implemented)
[2019.12.03-14.48.24:466][705]LogWindows: Windows GetLastError: The operation completed successfully. (0)
[2019.12.03-14.58.24:474][705]LogWindows:Error: === Critical error: ===
[2019.12.03-14.58.24:474][705]LogWindows:Error: 
[2019.12.03-14.58.24:474][705]LogWindows:Error: Fatal error: [File:C:\B\branch_exiles-live-dod-p1\code\Engine\Source\Runtime\Core\Private\GenericPlatform\GenericPlatformMemory.cpp] [Line: 171] 
[2019.12.03-14.58.24:474][705]LogWindows:Error: Ran out of memory in app state 'WorldPersistenceDone' allocating 13500416 bytes with alignment 0
[2019.12.03-14.58.24:474][705]LogWindows:Error: 
[2019.12.03-14.58.24:474][705]LogWindows:Error: 
[2019.12.03-14.58.24:474][705]LogWindows:Error: 
[2019.12.03-14.58.24:478][705]LogExit: Executing StaticShutdownAfterError
[2019.12.03-14.58.24:557][705]LogPhysics:Error: PHYSX: (C:\Funcom\ConanSandbox\4.15-dw-LiveBranch\Engine\Source\ThirdParty\PhysX\PhysX_3.4\Source\PhysX\src\NpScene.cpp 226) eINVALID_OPERATION : PxScene::release(): Scene is still being simulated! PxScene::fetchResults() is called implicitly.
[2019.12.03-14.58.24:953][705]LogWindows: FPlatformMisc::RequestExit(1)
[2019.12.03-14.58.24:953][705]Log file closed, 12/03/19 09:58:24

Please provide a step-by-step process of how the bug can be reproduced. The more details you provide us with the easier it will be for us to find and fix the bug:

  1. Restart server
  2. Login
  3. Wait/do anything
  4. Server crashes within minutes

I have tried removing all mods, I have tried limiting thralls/pets, and I have tried restoring an old save. Eventually it continues to creep up, and this only began to happen after the update yesterday.

Any more information can be provided upon request!

Thank you!

2

Hey mochokoy,

I just took a look at the trace for this file : GenericPlatformMemory.cpp on line 171, I can see the following:

1. void FGenericPlatformMemory::OnOutOfMemory(uint64 Size, uint32 Alignment)
2. {
3. 	// Update memory stats before we enter the crash handler.
4. 	OOMAllocationSize = Size;
5. 	OOMAllocationAlignment = Alignment;

6. 	// only call this code one time - if already OOM, abort
7. 	if (bIsOOM)
8. 	{
9. 		return;
10. 	}
11. 	bIsOOM = true;

12. 	FPlatformMemoryStats PlatformMemoryStats = FPlatformMemory::GetStats();
13. 	if (BackupOOMMemoryPool)
14. 	{
15. 		FPlatformMemory::BinnedFreeToOS(BackupOOMMemoryPool, FPlatformMemory::GetBackMemoryPoolSize());
16. 		UE_LOG(LogMemory, Warning, TEXT("Freeing %d bytes from backup pool to handle out of memory."), FPlatformMemory::GetBackMemoryPoolSize());
17.         
18. 		LLM(FLowLevelMemTracker::Get().OnLowLevelFree(ELLMTracker::Default, BackupOOMMemoryPool));
19. 	}

20. 	UE_LOG(LogMemory, Warning, TEXT("MemoryStats:")\
21. 		TEXT("\n\tAvailablePhysical %llu")\
22. 		TEXT("\n\t AvailableVirtual %llu")\
23. 		TEXT("\n\t     UsedPhysical %llu")\
24. 		TEXT("\n\t PeakUsedPhysical %llu")\
25. 		TEXT("\n\t      UsedVirtual %llu")\
26. 		TEXT("\n\t  PeakUsedVirtual %llu"),
27. 		(uint64)PlatformMemoryStats.AvailablePhysical,
28. 		(uint64)PlatformMemoryStats.AvailableVirtual,
29. 		(uint64)PlatformMemoryStats.UsedPhysical,
30. 		(uint64)PlatformMemoryStats.PeakUsedPhysical,
31. 		(uint64)PlatformMemoryStats.UsedVirtual,
32. 		(uint64)PlatformMemoryStats.PeakUsedVirtual);
33. 	if (GWarn)
34. 	{
35. 		GMalloc->DumpAllocatorStats(*GWarn);
36. 	}

37. 	// let any registered handlers go
38. 	FCoreDelegates::GetOutOfMemoryDelegate().Broadcast();

39. 	UE_LOG(LogMemory, Fatal, TEXT("Ran out of memory allocating %llu bytes with alignment %u"), Size, Alignment);
40. }

Breaking this down:

From line 1 above and continuing through to line 40 is what you are seeing in your log file. It is generating a log, informing you that your server has ran out of memory.

Also from your log file :

LogPhysics:Error: PHYSX: (C:\Funcom\ConanSandbox\4.15-dw-LiveBranch\Engine\Source\ThirdParty\PhysX\PhysX_3.4\Source\PhysX\src\NpScene.cpp 226) eINVALID_OPERATION : PxScene::release(): Scene is still being simulated! PxScene::fetchResults() is called implicitly.

^This made its way into your log file as it was what your server was doing at the time of the crash.

If I were to look at this log file, and only this log file, I would assume that during the scene generation when the server is starting, or has been running, the PHYSX third party runtime is having an issue during the generation of the “WorldPersistenceDone” state.

What this means:
You can possibly remedy this temporarily by increasing the memory you have on your server from 4GB to 8GB as per the recommended server technical specifications for Conan Exiles Dedicated Servers.

I would wait for official statement from Funcom on this issue, as it appears to be more widespread than singled on yourself.

A quick question for you:
On the repeated crashes, do you notice the same results/log entries every time during the crash?

Hope this helps!

3

Hello @mochokoy, welcome to the community!

Can you confirm that this only began to occur after the recent hotfix and even after disabling all the mods? Could you provide one or more logs with all mods disabled and with one client connected and staying idle?

Also, which mods were you using before you’ve started getting this issue?

4

Hello everyone,

Thank you for the help and replies!

It recently started only after the hotfix, yes. And it applied to saves made before the hotfix. We were using…

  1. Emberlight
  2. Improved Quality of Life
  3. RP Aesthetics
  4. Spiders to Scorpions
  5. Hidden Hats
  6. Kefi Cubs RP
  7. Pickup+
  8. Less Building Placement Restrictions

After speaking to my server members, we decided to wipe the server clean (after a backup) and I just gave them all of their materials via admin mode to rebuild. The issue has not happened since we did a full wipe.

Thank you again!

5

And yes, they are the same errors every time in the log.

6

Thank you for reporting back to us and sharing further information, we apologize for the inconvenience this issue has caused and will look into it.

7

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.