w3c_extended2dlf - convert W3C Extended Log file to DLF

w3c_extended2dlf file

w3c_extended2dlf converts web server log files in the W3C Extended Log Format to the www DLF. This log format is defined at http://www.w3.org/TR/WD-logfile.html

It is used by IIS 4.0 and IIS 5.0. This is a customizable format which contains an header specifying which information is present in the log.

To have the maximum information in you reports, we suggests that you log the following fields :

date, time, c-ip, c-dns, cs-uri, cs-method, sc-bytes, sc-status, cs(User-Agent), cs(Referer) and cs-username

We also support the cs-uri-stem field.

Other fields will be ignored.

The converter doesn't handle aggregation (record with count field) and will refuse to process those logs. Also it doesn't support changing the fields in the middle of the log file. It will ignore records that don't have the same schema than the first one defined.

To process a log as produced in the W3C Extended Log Format:

 $ w3c_extended2dlf < extended.log

w3c_extended2dlf will be rarely used on its own, but is more likely called by lr_log2report:

 $ cat /var/log/httpd/extended.log | lr_run lr_log2report w3c_extended

Francis J. Lacoste <flacoste@logreport.org>

$Id: w3c_extended2dlf.in,v 1.12 2004/01/21 07:22:59 wsourdeau Exp $

Copyright (C) 2001, 2002 Stichting LogReport Foundation LogReport@LogReport.org

This program is part of Lire.

Lire is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program (see COPYING); if not, check with http://www.gnu.org/copyleft/gpl.html or write to the Free Software Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111, USA.