bogofilter TODO list
**** Solaris: /opt/csw - fix system iconv vs. csw iconv. This fails if for
instance libsqlite3 is taken from /opt/csw --with-libsqlite3-prefix,
because iconv isn't taken from there.
This needs a *general* cleanup of prefixes, because those don't
apply to includes (which probably causes these issues).
**** Documentation: Berkeley DB 4.7, check options (versions for
existing ones, new options), use a list of versions that require a log
format upgrade (or DB format or whatever) for simplicity
**** Database (Berkeley DB): Use auto-recover features of Berkeley DB
4.4+ and give up on our own recovery locking and crash detection.
**** Database (Berkeley DB): Can we use the bulk load feature to our advantage?
**** If insufficient data is present and the default "undecided"
bogosity is added in -p mode, add also a comment stating that
bogofilter needs more training first
**** Add a "reservation lock" (fcntl style on separate file) so that a
writer can prevent new readers from starting, so that busy scoring
systems don't starve registration processes. (Figure out the
details to avoid deadlock.)
**** Drop/fix MAXTOKENLEN: where it is an allocation, it must die.
Where it is a character limit, count characters, not octets, to
support UTF-8.
**** Database (Berkeley DB): Implement Concurrent Data store, quite
similar to Transactional.
**** MIME: Make sure that RFC-2047 decoder runs only once, not recursively.
**** MIME: Implement RFC-2046 section 5.2.2 (message/partial reassembly rules,
Take most headers from enclosing message except Content-*, Subject,
Message-ID, Encrypted, MIME-Version, which are taken from the
enclosed message).
**** Reimplement seeking passthrough mode that got dropped on 2003-08-23
with the switch to bogoreader.*
http://article.gmane.org/gmane.mail.bogofilter.general/9035 and
followups. (MID <20041222105734.GA30574@sela.f4n.org>, by "John"
Subject "Size limit?" on 2004-12-22)
The fseek() code to determine if the input is seekable got removed
when the reader moved out of main.c between 1.66 and 1.67 (CVS) and
has never been in bogoreader.c.
**** New Feature: Token aging. Support for struct data in the wordlists is
already present.
**** New feature: Token merging, based on delta tokens (Andras Salamon,
andras@dns.net on bogofilter-dev, 2005-01-25)
**** Two deletes for kmail? This wouldn't be a patch for bogofilter
itself, but a change to give kmail delete-as-spam and delete-as-
nonspam buttons. Similarly for other MUAs.
**** New Feature: Make it a milter?
**** New Feature: Multiple list file support with weights and rules. Wordlist verfification.
Eric Seppanen:
> Allow use of a variable number of list files, each with their
> own weights and rules.
> Possible uses:
> - hand-maintained "whitelist" or "blacklist" files, with massive
> weighting to override everything else.
> - allow users to use system-wide list files and their own files.
>
Shared-database version based on the autodaemon code,
In the shared-database version (which doesn't yet exist) worldlist
verification to avoid attacks on posters (thanks, Barry!).
Emulate the Vipul's Razor reputation scheme for people reporting tokens?
http://razor.sourceforge.net/
**** What this software is probably heading towards is a scheme in which
there's a general notion of tagged categories (spam being one) with
cluster analysis being applied to categorize which categories a
message belongs to at above 0.9 confidence level.
**** New Feature: Web based tool for wordlist management. Allow message
registration and whitelist management. HTML Templatized for easy
integration with existing web mail systems.
**** New Feature: Add support for a user configurable list of headers that
should be used to ignore (single or multi-line) headers that appear
in the list. The list should be used to ignore headers both during
the message registration and evaluation procedures.