Server crashing, with following error NOONE KNOWS WHAT IT IS! DO YOU?

Discussion in 'Bukkit Help' started by SupaYoshi, Mar 18, 2012.

Thread Status:
Not open for further replies.
  1. Offline

    SupaYoshi

    Hi I am running my server and at random times, (sometimes one time in a week, sometime 3-4 times, sometimes 2 times in 1 day, this has been happening since 1.2.3, and I have been working on the newest builds, it happens on different builds. also on the beta, R01, and R02, doesn't matter.

    Its completly random happens after 4 hours or something sometimes MORE!
    It's really annoying, happenign randomly I have no idea what plugin is causing it, and I just need help from some experts I think. I've been asking around on Bukkit IRC, friends like developers, everyone is giving a different answer and most call it a Minecraft error.

    Bukkit 1.2.3, Build 2067 Dev build and before. - Bukkit beta 2060 and below had this too

    PLUGINS:
    Orebfuscator,
    GroupManager,
    Minequery,
    WorldEdit,
    Buycraft,
    SpamGuard,
    Vault,
    Multiverse-Core,
    PvPToggle,
    WorldGuard,
    TreeAssist,
    ObsidianDestroyer,
    LotteryPlus,
    Permissions,
    ObsidianFlow,
    BattleWarp,
    OpenInv,
    mcbans,
    UnderWaterTNT,
    NoCheat,
    Votifier,
    mcMMO,
    Essentials,
    WorldBorder,
    Citizens,
    SimpleRegionMarket,
    EssentialsProtect,
    EssentialsSpawn,
    Multiverse-Portals,
    dynmap,
    NoPortals,
    ChestShop,
    EssentialsChat,
    Factions

    SERVER.LOG
    2012-03-18 07:28:36 [INFO] FactionChat Awesomeness: **nickfinklea lonely srry
    2012-03-18 07:28:36 [INFO] [Factions v1.6.7] lonelyfarmer joined the faction Awesomeness.
    2012-03-18 07:28:36 [INFO] [PLAYER_COMMAND] lonelyfarmer: /f join Awesomeness
    2012-03-18 07:28:37 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
    2012-03-18 07:28:38 [INFO] Connection reset
    2012-03-18 07:28:38 [INFO] bigpapajr5 lost connection: disconnect.quitting
    2012-03-18 07:28:38 [INFO] [MCBans] bigpapajr5 has disconnected!
    2012-03-18 07:28:39 [INFO] FactionChat Awesomeness: *waffle1221 u mean u will watch him closely
    2012-03-18 07:28:39 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
    2012-03-18 07:28:40 [INFO] Umenyiora1234 lost connection: disconnect.quitting
    2012-03-18 07:28:40 [INFO] Connection reset
    2012-03-18 07:28:40 [INFO] [MCBans] Umenyiora1234 has disconnected!
    2012-03-18 07:28:40 [INFO] FactionChat Owls: **DecisionMaker NigerAng scorpius is inside
    2012-03-18 07:28:40 [INFO] [PLAYER_COMMAND] lonelyfarmer: /f home
    2012-03-18 07:28:41 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
    2012-03-18 07:28:43 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
    2012-03-18 07:28:44 [INFO] FactionChat Owls: **DecisionMaker NigerAng crizmikk also
    2012-03-18 07:28:46 [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
    2012-03-18 07:28:46 [SEVERE] java.util.ConcurrentModificationException
    2012-03-18 07:28:46 [SEVERE] at java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372)
    2012-03-18 07:28:46 [SEVERE] at java.util.AbstractList$Itr.next(AbstractList.java:343)
    2012-03-18 07:28:46 [SEVERE] at java.util.AbstractCollection.removeAll(AbstractCollection.java:336)
    2012-03-18 07:28:46 [SEVERE] at net.minecraft.server.World.tickEntities(World.java:1116)
    2012-03-18 07:28:46 [SEVERE] at net.minecraft.server.MinecraftServer.w(MinecraftServer.java:545)
    2012-03-18 07:28:46 [SEVERE] at net.minecraft.server.MinecraftServer.run(MinecraftServer.java:452)
    2012-03-18 07:28:46 [SEVERE] at net.minecraft.server.ThreadServerApplication.run(SourceFile:490)
    2012-03-18 07:28:46 [SEVERE] Unexpected exception
    java.util.ConcurrentModificationException
    at java.util.AbstractList$Itr.checkForComodification(AbstractList.java:372)
    at java.util.AbstractList$Itr.next(AbstractList.java:343)
    at java.util.AbstractCollection.removeAll(AbstractCollection.java:336)
    at net.minecraft.server.World.tickEntities(World.java:1116)
    at net.minecraft.server.MinecraftServer.w(MinecraftServer.java:545)
    at net.minecraft.server.MinecraftServer.run(MinecraftServer.java:452)
    at net.minecraft.server.ThreadServerApplication.run(SourceFile:490)
    2012-03-18 07:28:49 [INFO] Connection reset
    2012-03-18 07:29:22 [INFO] Connection reset


    After that noone can login until I reboot, no chunk errors nothing everything works again then.
     
  2. Offline

    TheBeast808

    One of your plugins is using a thread to access not-thread-safe data.
     
  3. Offline

    SupaYoshi

  4. Offline

    TnT

    Have you seen it happen when you have removed all plugins?
     
  5. Offline

    Epsilon55

    Try removing the Orebfuscator plugin. If that does not help, I'll try to see what else it could be.
     
  6. Offline

    Vittek

    Ugh. Had the exact error. I ran the world through region-fixer and made sure it removes all entities. It did help and eventually it went completely away.
     
  7. Offline

    SupaYoshi

  8. Offline

    bergerkiller

    SupaYoshi it's caused by roque plugins accessing the world entity list from another thread. Be it kicking players, removing entities, teleporting entities or even directly editing it. Most commonly it is caused by plugins loading chunks on another thread, or worse, generating them.

    I blame Orebfuscator; it has had this issue before. It tends to load chunks on another thread, causing that error in the long run. Not sure if he is going to fix it, or even can, cause I too know it is a bit of a problem area.
     
  9. Offline

    SupaYoshi

    Well, I heard that before, and told him the error but I have a worldborder and new chunks aren't being generated anymore basicly. But I can understand what your saying.
     
  10. Offline

    lishid

    I'm not loading chunks any more. It will consider it as a stone chunk if the chunk is not loaded. This has been implemented since beta8. Orebfuscator does not interact with entity list at all. I even keep my own player list.
     
    bergerkiller likes this.
  11. Offline

    SupaYoshi

    Ugh so who is causing this? xD

    EDIT: Btw glad to hear its not you :p
     
  12. Offline

    lishid

    It's sad that it doesn't say WHERE it is being accessed concurrently...
     
  13. Offline

    SupaYoshi

    Is there ANYTHING i can do? :)
     
  14. Offline

    douglas_srs

    Try removing NoCheat, I got this error too then I downgradaded it to this version http://dev.bukkit.org/server-mods/nocheat/files/63-3-0-2/ and the crash stopped! Another thing that may be causing this issue is RemoteToolKit that I have completely abolished from my server :p
     
  15. Offline

    SupaYoshi

    Mhm okay, i will try this perhaps, Im waiting for EvenPrime85 to reply on this :)
     
  16. Offline

    TnT

    Try removing all plugins. This issue looks to be plugin caused. You can add in your plugins one by one until you find the problem.
     
  17. Offline

    SupaYoshi

    The thing is the error only happens RANDOM - In like after 8 hours, or 3, or 5 or even 3 days without any errors ;)
    Then it happens all of a sudden again. So removing plugins and adding them back is going to take around 40 weeks to find the issue :) This method is really not interesting for abug that appears random :(

    Its impossible to do with a random crash like this.
    But I understand this is the standard answer around. =/
     
  18. Offline

    gablank

    Do a binary search then, remove half the plugins.
    If it crashes:
    Remove another half of them
    If it doesn't crash:
    Try one half of the ones you removed etc...
     
  19. Offline

    SupaYoshi

    Binary search? explain pls, second. I can't really remove half of these plugins, i think it only happens under heavy load perhaps? Or doesn't that matter?
     
  20. Offline

    gablank

    You're getting can't keep up messages before the crash, not sure if that might be heavy load. It can be caused by setting the time though.

    1. Remove half the plugins
    2. Does it crash?
    2a - Yes: Go to 1
    2b - No: Go to 3
    3. Remove all plugins and add those you removed at 1
    4. Go to 2
     
  21. Offline

    SupaYoshi

  22. Offline

    SupaYoshi

    FOR THE RECORD IM NOT RUNNING IT ON WINDOWS 95! ITS JUST REMINDING
    ME OF WINDOWS 95 THIS CRASH :)



    Update: Atm I have 26 Plugins stripped down everything, eveyrthing is the latest build, or dev build :)
    So no confusing there:

    :) Anyway
    Still crashing ;) http://pastebin.com/bcnYMMbT

    Orebfuscator, WorldBorder, GroupManager, Minequery, WorldEdit, Buycraft, SpamGuard, Vault, Multiverse-Core, CombatTag, WorldGuard, ObsidianDestroyer, Permissions, ObsidianFlow, NoCheat, Votifier, mcMMO, Essentials, EssentialsProtect, EssentialsSpawn, Multiverse-Portals, NoPortals, ChestShop, EssentialsChat, Factions, SimpleRegionMarket

    Another update:

    Comments by EvenPrime95

    @UnitedFactions: Go
    My best bet is that "dynmap" is the problem. Loading and unloading Chunks takes potentially a lot of time and modifies the entityList of the world heavily. If the synchronization is somewhere not perfectly done and the server under heavy load (meaning e.g. dynmap doesn't get to finish mapping of chunks immediatly), it may result in such rare race conditions.
    But I don't know how exactly dynmap ensures correct locking etc, so it's really just a wild guess.
    Forget that. The problem may very well be Minecraft/Bukkit itself. Google:
    Click me
    Many different setups, sometimes ranging back to rather old Bukkit versions.
    To my knowledge NoCheat never interacts with that list directly, and all calls that may internally reference that entityList are done from within a Bukkit "scheduleSynchDelayedTask" and therefore should not overlap with any server operations.

    EDIT by Moderator: merged posts, please use the edit button instead of double posting.
     
    Last edited by a moderator: May 24, 2016
  23. Offline

    Nathan C

    Code:
    [WARNING] Can't keep up! Did the system time change, or is the server overloaded?
    Means the server is getting overloaded.........and there is a bottleneck somewhere.

    I am willing to bet your server specs are too weak. What are they?
     
  24. Offline

    SupaYoshi

    I can't believe you just wrote that anyway:

    You owe me 100 dollar now ok? :p

    i7 2600
    32 GB of ram
    RAMdisk of 12 GB (8 gb free)
    3 TB RAID
    100 mbits connection upspead
    200 slots

    03:23:26 [SEVERE] java.lang.NullPointerException
    03:23:26 [SEVERE] at lishid.orebfuscator.hook.NetServerHandlerProxy.getPlayer(NetServerHandlerProxy.java:55)
    03:23:26 [SEVERE] at org.bukkit.craftbukkit.CraftServer.getOnlinePlayers(CraftServer.java:284)
    03:23:26 [SEVERE] at org.bukkit.craftbukkit.CraftServer.getPlayer(CraftServer.java:291)
    03:23:26 [SEVERE] at com.sk89q.worldedit.bukkit.SessionTimer$1.isOnlinePlayer(SessionTimer.java:41)
    03:23:26 [SEVERE] at com.sk89q.worldedit.WorldEdit.flushExpiredSessions(WorldEdit.java:1057)
    03:23:26 [SEVERE] at com.sk89q.worldedit.bukkit.SessionTimer.run(SessionTimer.java:48)
    03:23:26 [SEVERE] at org.bukkit.craftbukkit.scheduler.CraftWorker.run(CraftWorker.java:34)
    03:23:26 [SEVERE] at java.lang.Thread.run(Thread.java:662)

    Could this have anything to do with it?

    Didnt make it crash though

    EDIT by Moderator: merged posts, please use the edit button instead of double posting.
     
    Last edited by a moderator: May 24, 2016
  25. Offline

    SupaYoshi

    Removed SpamGuard, just had the same crash :) I think its world related almost certain :)
     
  26. Offline

    Sayshal

    Have you tried it with no plugins...? Just let the server run for like 3 days with no plugins and see if anything happens. I know it sucks for online time but it may solve/find the solution.
     
  27. Offline

    SupaYoshi

  28. Offline

    SupaYoshi

    Some news, I runned the region-file-checker, there was no single map or file that was corrupted. So the corrupted world cause should not be it.

    However I have found people experiencing the exact same problems in the past week on the internet they might be using Craftbukkit++ but I am not I am having this issue since 1.2.3:
    http://forums.spout.org/threads/craftbukkit.938/page-54
    As they also use Orebfuscator I am going to do something drastical.
     
  29. Offline

    syonxwf

    I posted that I am having a very similar issue in this thread.

    I posted all my specs and plugins there as well, I have plenty of specs to handle the server, but I do not have orebfuscator.

    Edit: I just copied all my files to a new test server, opened it up on a new port with 0 plugins but the same world file and everything else.

    My server has been crashing every few hours (between 2 and 12 hours) so I should know for sure by tomorrow morning or tomorrow afternoon if it's a plugin or if it's bukkit/minecraft.

    I will keep this updated.
     
  30. Offline

    SupaYoshi

    Good! I am very pleased with your comment! I see more and more users having these issues on the internet. especially on that spout forum.

    EDIT: Em syonxwf, remove Logblock, and test again. This seems very different from my crash in my opinion. You are having a badpacket error. ;) the only commen issue we have is that after an error people can't join. Your issue is different then just saw your topic. If anyone wants to proove me wrong do so ;) But this seems very unlikely to be the same case.
     
Thread Status:
Not open for further replies.

Share This Page