[Request] Clean out common errors to reduce side of server.log on archive!

Discussion in 'Bukkit Tools' started by Stragis, May 26, 2012.

?

Do you like this idea?

  1. Yes

    66.7%
  2. No

    33.3%
Thread Status:
Not open for further replies.
  1. Offline

    Stragis

    Also posted at stackexchange ( http://gaming.stackexchange.com/questions/70282/can-someone-make-a-log-cleanup-script-for-minecraft ) Hoping someone from either site picks up the idea

    I am just teaching myself some scripting (main focus is command helpers Compiled scripting language to fix plugins, its alot based on java)

    I know it is possible to do what I want but I dont know how.
    I think many people could benefit from a script which would cleanup 'useless' errors out of a RAW server.log so when they archive, its not going to take up a ton of space.

    I just went through an edited a server log file with had over 246 million lines in it. Mostly from an error spam of "IO: Connection reset" The file went from over a gig in size, to about 7mb. I had to use several programs to do this, including **Gsplit**(Split the 1 gig file to smaller because gvim was crashing on issueing the command to find and delete the error lines), **gVim** (*:g/IO: Connection reset/d*), (tried to use **010Editor**, but it wouldn't do what i wanted it to do).

    Here is what I need:

    - Common Errors removed from server.log files
    - make it drag and drop able *

    * user would drag server(or w/e the name they put on it).log files and drop them on the icon we have. It would auto output the 'fixed' file to the same directory)

    I'd like to be able to package this idea for distribution. If its possible to do this with a java script that would be best as ALL users of minecraft have java installed to be able to play the game.

    Obviously I would like it to be free because I am 'releasing' this idea to the public.
    If i'm not the first one to have this idea, or its already been done (packaged) let me know or even better toss me a link!
     
  2. Offline

    Fuzzlr

    I think they should be directly omitted from the console, if that's possible.
    I usually use 010Editor for files over 1 gb.
     
  3. Offline

    mbaxter ʇıʞʞnq ɐ sɐɥ ı Retired Staff

    What errors do you find useless?
     
  4. Offline

    Stragis

    Specifically IO: Connection Reset. It runs about 40 times per second and tells me nothing useful. A server restart stops the errors, but the logs are still flooded.

    Though the creator claims specifically that his program does not cause these issues, I suspect mcrcon to be the culprit http://forums.bukkit.org/threads/ad...aft-servers-ver-0-0-4-new-mac-binaries.70910/.

    Socket closures
    Show Spoiler
    2012-05-29 11:25:26 [SEVERE] java.net.SocketException: Socket closed
    2012-05-29 11:25:26 [INFO] Connection reset
    2012-05-29 11:25:26 [SEVERE] at java.net.SocketOutputStream.socketWrite(Unknown Source)
    2012-05-29 11:25:26 [SEVERE] at java.net.SocketOutputStream.write(Unknown Source)
    2012-05-29 11:25:26 [SEVERE] at java.io.BufferedOutputStream.flushBuffer(Unknown Source)
    2012-05-29 11:25:26 [SEVERE] at java.io.BufferedOutputStream.flush(Unknown Source)
    2012-05-29 11:25:26 [SEVERE] at java.io.DataOutputStream.flush(Unknown Source)
    2012-05-29 11:25:26 [SEVERE] at net.minecraft.server.NetworkWriterThread.run(SourceFile:103)


    Socket Write errors
    Show Spoiler
    2012-05-29 11:12:37 [SEVERE] java.net.SocketException: Connection reset by peer: socket write error
    2012-05-29 11:12:37 [INFO] Connection reset
    2012-05-29 11:12:37 [SEVERE] at java.net.SocketOutputStream.socketWrite0(Native Method)
    2012-05-29 11:12:37 [SEVERE] at java.net.SocketOutputStream.socketWrite(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at java.net.SocketOutputStream.write(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at java.io.BufferedOutputStream.flushBuffer(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at java.io.BufferedOutputStream.flush(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at java.io.DataOutputStream.flush(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at net.minecraft.server.NetworkWriterThread.run(SourceFile:103)
    2012-05-29 11:12:37 [SEVERE] java.net.SocketException: Connection reset by peer: socket write error
    2012-05-29 11:12:37 [SEVERE] at java.net.SocketOutputStream.socketWrite0(Native Method)
    2012-05-29 11:12:37 [SEVERE] at java.net.SocketOutputStream.socketWrite(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at java.net.SocketOutputStream.write(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at java.io.BufferedOutputStream.flushBuffer(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at java.io.BufferedOutputStream.flush(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at java.io.DataOutputStream.flush(Unknown Source)
    2012-05-29 11:12:37 [SEVERE] at net.minecraft.server.NetworkWriterThread.run(SourceFile:103)


    Ideally since each server admin my find different errors useless (identifies issue, is waiting on a dev to fix issue) perhaps the errors it removes could be configurable?

    Even reducing these errors to a simple one line error would reduce log sizes.
     
  5. Offline

    Stragis

    For posterity:
    The IO: Connection reset error was removed by the bukkit team with the 1.2.5 R4 update.
     
Thread Status:
Not open for further replies.

Share This Page