<?xml version="1.0" encoding="ISO-8859-1"?>
<!DOCTYPE refentry PUBLIC "-//OASIS//DTD DocBook XML V4.1.2//EN" "http://www.oasis-open.org/docbook/xml/4.1.2/docbookx.dtd">
<refentry id="bogolexer.1">
  <refmeta>
    <refentrytitle>bogolexer</refentrytitle>
    <manvolnum>1</manvolnum>
    <refmiscinfo class="manual">Bogofilter Reference Manual</refmiscinfo>
    <refmiscinfo class="source">Bogofilter</refmiscinfo>
  </refmeta>
  <refnamediv id="name">
    <refname>bogolexer</refname>
    <refpurpose>Utility program for separating email messages into tokens</refpurpose>
  </refnamediv>
  <refsynopsisdiv id="synopsis">
    <cmdsynopsis>
      <command>bogolexer</command>
        <arg choice='opt'>-p</arg>
        <arg choice='opt'>-q</arg>
        <arg choice='opt'>-h</arg>
        <arg choice='opt'>-n</arg>
        <arg choice='opt'>-v</arg>
	<arg choice='opt'>-x <replaceable>flags</replaceable></arg>
	<arg choice='opt'>-c <replaceable>file</replaceable></arg>
        <arg choice='opt'>-C</arg>
        <arg choice='opt'>-D</arg>
	<arg choice='opt'>-I <replaceable>file</replaceable></arg>
	<arg choice='opt'>-O <replaceable>file</replaceable></arg>
	<arg choice='opt'>-V</arg>
    </cmdsynopsis>
  </refsynopsisdiv>
  <refsect1 id="description">
    <title>DESCRIPTION</title>
    <para><application>Bogolexer</application> is part of the
	<application>bogofilter</application> Bayesian spam filter package.</para>
    <para>It is used to separate messages into tokens and to test new versions of
	the <filename>lexer.l</filename> code.</para>
  </refsect1>
  <refsect1 id="options">
    <title>OPTIONS</title>
    <para>
       The <option>-p</option> option tells <application>bogolexer</application> to
       print just the tokens read from stdin, without any extra messages.
    </para>
    <para>
	The <option>-q</option> option tells <application>bogolexer</application>
	to print a token count,
	without printing the actual tokens.  </para>
    <para>The <option>-h</option> option prints the help message and exits.</para>
    <para>The <option>-n</option> option tells <application>bogolexer</application>
	to map non-ascii characters to the question point '?'.</para>
    <para>The <option>-v</option> option increases the verbosity level.</para>

<para>The <option>-x <replaceable>flags</replaceable></option> option 
allows setting of debug flags for printing debug messages.</para>

<para>The <option>-c</option><replaceable>filename</replaceable> option
tells <application>bogolexer</application> to read the config file named.
</para>

<para>The <option>-C</option> option prevents <application>bogolexer</application>
    from reading configuration files.</para>
<para>The <option>-D</option> option redirects the debugging output to
    stdout (it defaults to stderr).</para>

<para>The <option>-I </option><replaceable>filename</replaceable> option
tells <application>bogolexer</application> to read its input from the specified file, 
rather than from <emphasis>stdin</emphasis>.</para>

<para>The <option>-O </option><replaceable>filename</replaceable> option
tells <application>bogolexer</application> to write its output to the specified file, 
rather than to <emphasis>stdout</emphasis>.</para>

<para>The <option>-V</option> option prints the version number and 
exits.</para>

</refsect1>

  <refsect1 id="author">
    <title>AUTHOR</title>
    <para>The <application>bogofilter</application> developer team.</para>
    <para>
       For updates, see <ulink url="http://bogofilter.sourceforge.net/">
       the bogofilter project page</ulink>.
    </para>
  </refsect1>

  <refsect1 id="also">
    <title>SEE ALSO</title>
    <para>bogofilter(1), bogotune(1), bogoupgrade(1), bogoutil(1)</para>
  </refsect1>
</refentry>