mysql2dlf - convert mysql logfiles to dlf format

mysql2dlf

mysql2dlf converts a MySQL query log file to DLF format. Information on MySQL can be found on http://www.mysql.org/. The query log file is defined by the --log[=file] option of mysqld, or the log=file setting in MySQL configuration file.

Such a log file looks like e.g.

 /usr/sbin/mysqld, Version: 3.23.43-debug-log, started with:
 Tcp port: 3306  Unix socket: /var/run/mysqld/mysqld.sock
 Time                 Id Command    Argument
 011218 15:02:58       1 Connect     root@localhost on
                       1 Query       SHOW VARIABLES LIKE 'pid_file'
                       1 Shutdown
 011226 21:35:59       6 Connect     joe@localhost on
                       6 Init DB     nmrshiftdb
                       6 Query       SHOW VARIABLES

or

                  42401 Query       SELECT
                  bannerID,
                  banner,
                  format,
                  width,
                  height,
                  alt,
                  url
              FROM
                  banners
              WHERE

                  act = 'true'  AND (keyw = 'fullsize' OR keyw = 'global')

The generic database dlf format is described in database.xml.

To process a log as produced by MySQL:

 $ mysql2dlf < mysql-log

mysql2dlf will be rarely used on its own, but is more likely called by lr_log2report:

 $ lr_run lr_log2report mysql < /var/log/mysql-log

The parser has been tested for query log files for MySQL 3.23.46 only.

This converter stores all log files information in one big nested array in memory, before writing. Therefore, memory consumption is linear with the size of the log.

mysql(1), mysqld(1)

$Id: mysql2dlf.in,v 1.9 2004/01/21 07:23:00 wsourdeau Exp $

Copyright (C) 2001, 2002 Stichting LogReport Foundation LogReport@LogReport.org

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program (see COPYING); if not, check with http://www.gnu.org/copyleft/gpl.html or write to the Free Software Foundation, Inc., 59 Temple Place - Suite 330, Boston, MA 02111, USA.

Egon Willighagen <egonw@logreport.org>