Fourth Fatal Server Crash in 2 days - same error each time

Private Dedi Server. Yes mods. Just logging this to see if others are experiencing the same error in the hope of getting to the bottom of it.


[2020.05.08-22.17.27:765][588]
Script stack log unavailable (DO_BLUEPRINT_GUARD_BASE==0)!

[2020.05.08-22.17.28:383][588]LogThreadingWindows:Error: Runnable thread TaskGraphThreadNP 2 crashed.
[2020.05.08-22.17.28:383][588]LogWindows:Error: === Critical error: ===
[2020.05.08-22.17.28:383][588]LogWindows:Error:
[2020.05.08-22.17.28:383][588]LogWindows:Error: Fatal error!
[2020.05.08-22.17.28:383][588]LogWindows:Error:
[2020.05.08-22.17.28:383][588]LogWindows:Error: Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0x000000b8
[2020.05.08-22.17.28:383][588]LogWindows:Error:
[2020.05.08-22.17.28:383][588]LogWindows:Error: !0x0000000000000000
[2020.05.08-22.17.28:383][588]LogWindows:Error:
[2020.05.08-22.17.28:383][588]LogWindows:Error: Crash in runnable thread TaskGraphThreadNP 2
[2020.05.08-22.17.28:424][588]LogExit: Executing StaticShutdownAfterError
[2020.05.08-22.17.28:424][588]LogWindows: FPlatformMisc::RequestExit(1)
[2020.05.08-22.17.28:424][588]Log file closed, 05/08/20 17:17:28

[Describe the bug here]


Please provide a step-by-step process of how the bug can be reproduced. The more details you provide us with the easier it will be for us to find and fix the bug:
1.
2.
3.
4.

Thanks Narelle. Im not interested in your modlist. I want to know if others have had this exact same crash.

Regardless of their modlist. Thank you :slight_smile:

If you are not interested in my modlist, then I will delete it. Hope you find which mod crashes your server.

Thank you

[2020.05.08-19.47.54:759][685]LogStreamableManager:Error: RequestAsyncLoad called with empty or only null assets!
[2020.05.08-19.47.54:760][685]LogStreamableManager:Error: RequestAsyncLoad called with empty or only null assets!
[2020.05.08-19.47.54:938][686]Network:Warning: Data: BasePlayerChar_C_43 (server) sent 1040.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.08-19.47.54:939][686]Network:Warning: Data: BasePlayerChar_C_33 (server) received 1436.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.08-19.47.54:939][686]Network:Warning: Data: Control (server) sent 1027.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.08-19.47.54:939][686]Network:Warning: Data: BP_PL_Crafting_Station_AnimalPen_Onestall_C_3 (server) sent 1893.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.08-19.47.54:945][686]LogStreamableManager:Error: RequestAsyncLoad called with empty or only null assets!
[2020.05.08-19.47.55:183][686]
Script stack log unavailable (DO_BLUEPRINT_GUARD_BASE==0)!

[2020.05.08-19.47.55:430][686]LogThreadingWindows:Error: Runnable thread TaskGraphThreadNP 0 crashed.
[2020.05.08-19.47.55:430][686]LogWindows:Error: === Critical error: ===
[2020.05.08-19.47.55:430][686]LogWindows:Error: 
[2020.05.08-19.47.55:430][686]LogWindows:Error: Fatal error!
[2020.05.08-19.47.55:430][686]LogWindows:Error: 
[2020.05.08-19.47.55:430][686]LogWindows:Error: Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0x000000b8
[2020.05.08-19.47.55:430][686]LogWindows:Error: 
[2020.05.08-19.47.55:430][686]LogWindows:Error: !0x0000000000000000
[2020.05.08-19.47.55:430][686]LogWindows:Error: 
[2020.05.08-19.47.55:430][686]LogWindows:Error: Crash in runnable thread TaskGraphThreadNP 0
[2020.05.08-19.47.55:469][686]LogExit: Executing StaticShutdownAfterError
[2020.05.08-19.47.55:469][686]LogWindows: FPlatformMisc::RequestExit(1)
[2020.05.08-19.47.55:469][686]Log file closed, 05/08/20 21:47:55

That’s what we are experiencing right now.

Now way to reproduce it at the moment, appears randomly. Sometimes after a short period of time, sometimes it runs smooth for hours.

Causes a server crash.

Running on Windows Server 2019.

Yes, we got mods.

Best wishes,
Grumps

1 Like

Thats where Im at with this. Sorry to @Narelle but this is what Im experiencing too, there is no repro, there is no pattern. At some random time crashes happen and what proceeds the crash is different each time. I sure have logs and if it seems appropriate I’ll discuss modlists.

Ive seen this crash posted all over various discord servers for various mods/admins united/ etc etc

Im interested in getting a discussion going here so maybe we can get some dev help in investigating the matter, rather than going in circles trying to figure out if some random mod is doing it.

This isnt a crash on boot situation. Those are very easy to work through by comparing modlists and removing items from the load order to test. There is no means to test this one out. Yet, at least.

We are also getting the same crash in our server as well with mods…

[2020.05.10-01.41.05:124][846]Network:Warning: Data: FunCombat_PlayerController_C_28 (server) sent 3626.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-01.41.05:124][846]Network:Warning: Data: BasePlayerChar_C_111 (server) sent 1231.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-01.41.06:733][862]ItemInventory:Warning: Data: PersistentHumanoidNPC_C_191 tried to unequip left fist weapon to 0:1
[2020.05.10-01.41.06:976][862]
Script stack log unavailable (DO_BLUEPRINT_GUARD_BASE==0)!

[2020.05.10-01.41.07:064][862]LogThreadingWindows:Error: Runnable thread TaskGraphThreadNP 0 crashed.
[2020.05.10-01.41.07:064][862]LogWindows:Error: === Critical error: ===
[2020.05.10-01.41.07:064][862]LogWindows:Error:
[2020.05.10-01.41.07:064][862]LogWindows:Error: Fatal error!
[2020.05.10-01.41.07:064][862]LogWindows:Error:
[2020.05.10-01.41.07:064][862]LogWindows:Error: Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0x000000b8
[2020.05.10-01.41.07:064][862]LogWindows:Error:
[2020.05.10-01.41.07:064][862]LogWindows:Error: !0x0000000000000000
[2020.05.10-01.41.07:064][862]LogWindows:Error:
[2020.05.10-01.41.07:064][862]LogWindows:Error: Crash in runnable thread TaskGraphThreadNP 0
[2020.05.10-01.41.07:105][862]LogExit: Executing StaticShutdownAfterError
[2020.05.10-01.41.07:105][862]LogWindows: FPlatformMisc::RequestExit(1)
[2020.05.10-01.41.07:105][862]Log file closed, 05/09/20 20:41:07

This is what im getting with my server. also, o never hada mod installed.

[2020.05.10-00.16.32:049][811]ItemInventory:Warning: Code: [BP_EncumbranceSystem BasePlayerChar_C_147] Hello
[2020.05.10-00.16.32:939][837]Network:Warning: Data: FunCombat_PlayerController_C_16 (server) sent 50.0 parts per second > 40 (sample window size: 2.00 seconds)
[2020.05.10-00.16.32:939][837]Network:Warning: Data: FunCombat_PlayerController_C_11 (server) sent 1080.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.32:940][837]Network:Warning: Data: FunCombat_PlayerController_C_15 (server) sent 1090.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.34:920][895]Network:Warning: Data: BasePlayerChar_C_145 (server) sent 1032.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.34:920][895]Network:Warning: Data: BasePlayerChar_C_145 (server) sent 44.0 parts per second > 40 (sample window size: 2.00 seconds)
[2020.05.10-00.16.36:935][954]Network:Warning: Data: BP_NPC_Wildlife_RocknoseIce_C_20 (server) sent 1539.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.38:916][ 12]Network:Warning: Data: BP_NPC_Wildlife_RocknoseKing2_C_7 (server) sent 1940.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.40:916][ 70]Network:Warning: Data: PersistentHumanoidNPC_C_839 (server) sent 1902.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.42:915][128]Network:Warning: Data: BasePlayerChar_C_1 (server) received 1260.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.42:915][128]Network:Warning: Data: FunCombat_PlayerController_C_5 (server) sent 1079.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.42:915][128]Network:Warning: Data: AILODSystem_0 (server) sent 1227.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.42:915][128]Network:Warning: Data: AILODSystem_0 (server) sent 46.0 parts per second > 40 (sample window size: 2.00 seconds)
[2020.05.10-00.16.46:923][244]Network:Warning: Data: FunCombat_PlayerController_C_11 (server) sent 1372.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.46:923][244]Network:Warning: Data: FunCombat_PlayerController_C_6 (server) sent 1793.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-00.16.47:332][256]LogServerStats: Sending report: exiles-stats?players=15&=22.37%3A34.88%3A439.50&uptime=2760&memory=13018140672%3A25650810880%3A10779422720%3A10841505792&cpu_time=23.390009%3A93.560036&npcailods=106%3A103%3A64%3A7456&buildingailods=147%3A28%3A134%3A1720&placeableailods=906%3A988%3A502%3A22339&ipv4=187.95.73.196&sport=7774
[2020.05.10-00.16.48:528][278]
Script stack log unavailable (DO_BLUEPRINT_GUARD_BASE==0)!

[2020.05.10-00.16.48:668][278]LogThreadingWindows:Error: Runnable thread TaskGraphThreadNP 0 crashed.
[2020.05.10-00.16.48:668][278]LogWindows:Error: === Critical error: ===
[2020.05.10-00.16.48:668][278]LogWindows:Error:
[2020.05.10-00.16.48:668][278]LogWindows:Error: Fatal error!
[2020.05.10-00.16.48:668][278]LogWindows:Error:
[2020.05.10-00.16.48:668][278]LogWindows:Error: Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0x000000b8
[2020.05.10-00.16.48:668][278]LogWindows:Error:
[2020.05.10-00.16.48:668][278]LogWindows:Error: !0x0000000000000000
[2020.05.10-00.16.48:668][278]LogWindows:Error:
[2020.05.10-00.16.48:668][278]LogWindows:Error: Crash in runnable thread TaskGraphThreadNP 0
[2020.05.10-00.16.48:710][278]LogExit: Executing StaticShutdownAfterError
[2020.05.10-00.16.48:710][278]LogWindows: FPlatformMisc::RequestExit(1)
[2020.05.10-00.16.48:710][278]Log file closed, 05/09/20 21:16:48

You post the error, but don’t want to see peoples mod lists to compare notes?

It’s more then likely mod related, but will be impossible and pointless to determine which mods so long as your ask people not to post their mod lists.

2 Likes

[2020.05.10-04.00.53:637][ 68]Network:Warning: Data: BasePlayerChar_C_116 (server) received 1429.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:637][ 68]Network:Warning: Data: BasePlayerChar_C_16 (server) sent 1182.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:637][ 68]Network:Warning: Data: BasePlayerChar_C_23 (server) sent 1032.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:637][ 68]Network:Warning: Data: BasePlayerChar_C_221 (server) received 1219.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:637][ 68]Network:Warning: Data: BasePlayerChar_C_206 (server) received 1030.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:637][ 68]Network:Warning: Data: FunCombat_PlayerController_C_34 (server) sent 2872.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:637][ 68]Network:Warning: Data: FunCombat_PlayerController_C_32 (server) sent 2872.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:637][ 68]Network:Warning: Data: FunCombat_PlayerController_C_31 (server) sent 2884.5 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:638][ 68]Network:Warning: Data: AILODSystem_0 (server) sent 1972.0 bytes per second > 1024 (sample window size: 2.00 seconds)
[2020.05.10-04.00.53:720][ 68]
Script stack log unavailable (DO_BLUEPRINT_GUARD_BASE==0)!

[2020.05.10-04.00.53:786][ 68]LogThreadingWindows:Error: Runnable thread TaskGraphThreadNP 2 crashed.
[2020.05.10-04.00.53:786][ 68]LogWindows:Error: === Critical error: ===
[2020.05.10-04.00.53:786][ 68]LogWindows:Error:
[2020.05.10-04.00.53:786][ 68]LogWindows:Error: Fatal error!
[2020.05.10-04.00.53:786][ 68]LogWindows:Error:
[2020.05.10-04.00.53:786][ 68]LogWindows:Error: Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0x000000b8
[2020.05.10-04.00.53:786][ 68]LogWindows:Error:
[2020.05.10-04.00.53:786][ 68]LogWindows:Error: !0x0000000000000000
[2020.05.10-04.00.53:786][ 68]LogWindows:Error:
[2020.05.10-04.00.53:786][ 68]LogWindows:Error: Crash in runnable thread TaskGraphThreadNP 2
[2020.05.10-04.00.53:823][ 68]LogExit: Executing StaticShutdownAfterError
[2020.05.10-04.00.53:823][ 68]LogWindows: FPlatformMisc::RequestExit(1)
[2020.05.10-04.00.53:823][ 68]Log file closed, 05/09/20 23:00:53

Did you read the guy above you?

Ritual, just to clarify (looks like a typo) you never had a mod installed on the current database that created that crash log?

Crashed twice tonight with the same exact error.

[2020.05.09-22.40.29:966][899]LogThreadingWindows:Error: Runnable thread TaskGraphThreadNP 2 crashed.
[2020.05.09-22.40.29:966][899]LogWindows:Error: === Critical error: ===
[2020.05.09-22.40.29:966][899]LogWindows:Error: 
[2020.05.09-22.40.29:966][899]LogWindows:Error: Fatal error!
[2020.05.09-22.40.29:966][899]LogWindows:Error: 
[2020.05.09-22.40.29:966][899]LogWindows:Error: Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0x000000b8
[2020.05.09-22.40.29:966][899]LogWindows:Error: 
[2020.05.09-22.40.29:966][899]LogWindows:Error: !0x0000000000000000
[2020.05.09-22.40.29:966][899]LogWindows:Error: 
[2020.05.09-22.40.29:966][899]LogWindows:Error: Crash in runnable thread TaskGraphThreadNP 2
[2020.05.09-22.40.30:013][899]LogExit: Executing StaticShutdownAfterError
[2020.05.09-22.40.30:013][899]LogWindows: FPlatformMisc::RequestExit(1)
[2020.05.09-22.40.30:013][899]Log file closed, 05/09/20 18:40:30

Modlist (since it IS relevant and helpful) is:
image

I’d be interested to see everyone else’s modlists as well for the sake of comparison. Could be there’s a common thread.

3 Likes

we got the same error since last hotfix. our server crashs 4-5 a day and he is modless (vanilla). checked serverfiles, they are not corrupt.

[2020.05.09-20.44.11:312][506]
Script stack log unavailable (DO_BLUEPRINT_GUARD_BASE==0)!

[2020.05.09-20.44.11:935][506]LogThreadingWindows:Error: Runnable thread TaskGraphThreadNP 0 crashed.
[2020.05.09-20.44.11:935][506]LogWindows:Error: === Critical error: ===
[2020.05.09-20.44.11:935][506]LogWindows:Error: 
[2020.05.09-20.44.11:935][506]LogWindows:Error: Fatal error!
[2020.05.09-20.44.11:935][506]LogWindows:Error: 
[2020.05.09-20.44.11:935][506]LogWindows:Error: Unhandled Exception: EXCEPTION_ACCESS_VIOLATION reading address 0x000000b8
[2020.05.09-20.44.11:935][506]LogWindows:Error: 
[2020.05.09-20.44.11:935][506]LogWindows:Error: !0x0000000000000000
[2020.05.09-20.44.11:935][506]LogWindows:Error: 
[2020.05.09-20.44.11:935][506]LogWindows:Error: Crash in runnable thread TaskGraphThreadNP 0
[2020.05.09-20.44.11:988][506]LogExit: Executing StaticShutdownAfterError
[2020.05.09-20.44.11:988][506]LogWindows: FPlatformMisc::RequestExit(1)
2 Likes

Since it happens to vanilla servers without mods too, it does not sound like a mod problem.

Best wishes,
Grumps

2 Likes

Did a little bit of log scanning. Can’t seem to determine a pattern (not that I’m an expert in log analysis or anything).

I thought maybe related to mods that edit BasePlayerChar or other similar blueprints that have been showing in these posted logs, but the server logs I looked at used mods that didn’t edit any of those.

Two users now report they are seeing this crash error without using mods, so that’s something to consider. Though the vast majority of error reports I’ve seen come back with this error (10-15) are all modded servers. Maybe something with particular mods that causes the error to be more frequent maybe? Will continue to keep an eye out.

4 Likes

I’d like to bring up a funny anecdote here.

I once spent a solid 6 hours trying different modlists, comparing with whomever I could find, while trying to figure out why pets refused to eat directly after the first follower leveling update. It was incredibly frustrating. I loaded a duplicate database in singleplayer to start testing and the follwers all ate. “Great.” I thought. “I’m going to have to reboot a server and attaching client so many times to get to the bottom of this,” I lamented.

I booted a test server with the same database with no mods and they ate. I tried a clean database and the same pattern held – No mods? Ate. Mods? No eating. So the issue must be some rogue-code with a bad reference to a thrall component or something, right? By conventional wisdom? Obviously its a modder’s fault. I removed mods one-by-one until finally all that was left was Pippi. I went to their discord and politely, albeit morosely, suggested that given they were the only mod l had left loading on that database, its possible that Pippi was somehow interfering with followers’ eating habits. After posting, I sat and thought a bit and concluded that I hadn’t fully tested every possibility yet. I followed a gut instinct and booted up the same database without Pippi, but with some other random mod on it. Sure enough, pets didnt eat.

I came here and posted this:

After tons of testing (literally everything one might think to try - different modlists, .ini settings, fresh wipe, etc) I’ve come to the realization that if you have any mod at all loaded on a private server, minions will not consume food. This, of course, means they cannot reap any of the benefits associated with eating (healing, strength buff, stat gain buff)

Repro:

1.pick a mod and load it on a multiplayer server
2.place the proper food in your minion’s inventory
3.note that no food is consumed from their inventory and that there are no buffs applied in their stats panel

And the response I got from Ignasis?

Hey there,

As is the case with mod, please contact each mod author and inform about this issue so they can work on it.

I then had to struggle to get people to come here and post their experiences so that I would be taken seriously by the devs, who would ultimately come to realize “OH DAYM all of our most populated servers that run mods cant utilize a key aspect of our brand-new follower system because there is, in fact, an internal issue that’s not caused by a mod!”

(not salty still, I promise, but <3 you anyway Ignasis) :stuck_out_tongue:


Anyway.

Please read through the rest of these posts here. Ive been running a semi-busy server for a year and a half now. While I don’t expect anyone to know that offhand, and I’m not nearly narcissistic enough to expect others here who I’ve had multiple past conversations with to remember me, please don’t patronize me. Not quite sure why some in this community assume they automatically know better than the next person. I’m sure I’ve done it a time or two as well, but lately you see this kind of anti-productive response all-to-often.

Yes, information is power and should be shared, but I was trying to get the crashlogs and the testimonials because I knew people would dogpile in with a canned response and then walk away and wait for some mystery modder to be found culpable later.

I have already done extensive searching around all over discord and after noticing myself that many posted similar crash logs with disparate modlists and/or NO MODS AT ALL I wanted to get the ball rolling here.

Maybe it comes to pan out that I’m completely wrong here, but now that we’ve identified a strong possibility that there is an issue that is not directly caused by an out-of-date mod, but something going on with baseplayerchar (funcombat controller is also frequently present right before the crashes in my logs) sure I’ll compare modlists.

I suspect (like Multi most recently said) that there might be an actor or component reference that is issue-prone, which is more commonly called in the presence of certain mods. Its a shame that most mods that do anything more than a datatable merge are attaching a component to baseplayerchar… going to be very hard to pick things apart and establish any correlation there.

I’ll note a pattern that I’m only getting semi-frequent (every couple of hours, maybe less) crash instances when I have over 30 connected. Had a crash around 11pm and again at midnight and given that usually my US-based pop stays rather low (15-20 tops) over night haven’t had one again (roughly 10 hours without crashing)

2 Likes

As promised:

880454836 - Pippi-User & Server Management
1393280692 - Barbarism and armors
1565975019 - Hyborian Body/Armor
925197087 - DyeMoreBetterer
1652553970 - OSH weapon plus
1367404881 - Savage Steel
1369802940 - Emberlight
1159180273 - Fashionist (1.0 and DLC Compatible)
1402835318 - WARRIOR Mutator for Conan Exiles
1509797057 - Admin Skelos Collector for WARRIOR Mutator
901911361 - Glass Constructions and more…
880177231 - Pythagoras
1629644846 - Kerozard’s Paragon Leveling - A Multigun Refresh
931088249 - Better Thralls (Pickup & More followers)
1396310739 - Stacksize Plus
877108545 - Unlock Plus (with Pickup)
1369743238 - Less Building Placement Restrictions
1503527082 - All The Little Things
1657730588 - Improved Quality Of Life