简体繁体中英

Managing large log files

原文 2010-06-28 06:53:19 7 2 php/ debugging/ logging

We have a crawler that persistently crawls our target sites, it's log files are turning out to be quite huge. Over 1 GB in some cases, I'm not too comfortable with deleting or overwriting them. Any examples of how you managed large log files?

2 answers

Use a cron script to rotate the log files on a daily basis. Basically, you rename your logfile.log to logfile-YYYY-MM-DD.log . This way, instead of one huge logfile, you have smaller ones and are able to find logged messages from a certain time period easily. If you also compress your rotated logs, you will save even more disk space.

You can also use log4net, log4j, or other logging frameworks that automatically change the file names based on file size or date. http://logging.apache.org/log4net/

Tips for managing a large number of files?

Managing Large Datasets

Managing user files on Yii

Writing large dynamic arrays/objects to text formatted log files

PHP permission denied for managing files

Managing files on VMs using PHP

Managing images and other media for large website

Managing permissions in a large Laravel project using Exceptions?

PHP and SQL: managing log-in via databases

Architecture for managing files within a specific web application

暂无

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

Related Question Tips for managing a large number of files? Managing Large Datasets Managing user files on Yii Writing large dynamic arrays/objects to text formatted log files PHP permission denied for managing files Managing files on VMs using PHP Managing images and other media for large website Managing permissions in a large Laravel project using Exceptions? PHP and SQL: managing log-in via databases Architecture for managing files within a specific web application

Related Tags

Managing large log files

Question

2 answers

solution1
6 ACCPTED 2010-06-28 06:57:36

solution2
1 2012-12-07 16:38:12

Managing large log files

Question

2 answers

solution1 6 ACCPTED 2010-06-28 06:57:36

solution2 1 2012-12-07 16:38:12

solution1
6 ACCPTED 2010-06-28 06:57:36

solution2
1 2012-12-07 16:38:12