tool for analyzing apache logs [closed]

we are having issues with high connection and first byte times from our apache web server. I need a tool to go through and analyze the logs and tell me whether we were receiving high traffic at the time, patterns around the time of slowness, etc.

I am familiar with awstats but wanted to know if there are any other newer tools out there for something like this.


Solution 1:

few of very popular tools:

  • AWStats - Free log file analyzer for advanced statistics (GNU GPL).
  • Home of The Webalizer

as far as I know the best/newest tool is Google Analytics Official Website - Web Analytics & Reporting – Google Analytics, but it doesnt really do anything with logs it works through JavaScript (so this may not work for you)

Solution 2:

Just in case you have a Hadoop/Hive deployment -

For all the time I just load apache logs to hive and run HQL for analysis, that gives me far more flexibility than any other existing tools as I can do almost all I want by just issue a SQL-like command.

Check https://cwiki.apache.org/Hive/gettingstarted.html#GettingStarted-ApacheWeblogData, it's a good start point.