You can use a combination of terminal commands like awk, sort, uniq, and cut to analyze an Apache log file and find out which files are called the most and the bandwidth they are using.
To see which files are called the most:
awk '{print $7}' access.log | sort | uniq -c | sort -nr | head -n 10
This command does the following:
awk '{print $7}' access.log: Extracts the seventh column from the log file, which typically contains the requested file.sort: Sorts the output alphabetically.uniq -c: Counts the occurrences of each unique line.sort -nr: Sorts the counted occurrences numerically in reverse order (to get the most accessed files first).head -n 10: Displays the top 10 most accessed files.
To find out the bandwidth used by each file, you’ll need to calculate the total bytes transferred for each file:
awk '{sum[$7]+=$10} END {for (i in sum) print i, sum[i]}' access.log | sort -nrk2 | head -n 10
This command does the following:
awk '{sum[$7]+=$10} END {for (i in sum) print i, sum[i]}' access.log: Calculates the sum of bytes transferred for each unique file requested (seventh column) and prints the result.sort -nrk2: Sorts the output based on the second column (the sum of bytes transferred) in reverse numerical order.head -n 10: Displays the top 10 files by bandwidth usage.
Replace access.log with the actual name of your Apache log file.