rendered paste bodyThis is fetchmail getting a message list from the Cyrus IMAP server, so this verifies that only one copy of the message exists on the server:
fetchmail: 7 messages for tlyons at smtp.ivenue.com.
fetchmail: IMAP> A0007 FETCH 1:7 RFC822.SIZE
fetchmail: IMAP< * 1 FETCH (RFC822.SIZE 7525)
fetchmail: IMAP< * 2 FETCH (RFC822.SIZE 23151)
fetchmail: IMAP< * 3 FETCH (RFC822.SIZE 29022)
fetchmail: IMAP< * 4 FETCH (RFC822.SIZE 16353)
fetchmail: IMAP< * 5 FETCH (RFC822.SIZE 23434)
fetchmail: IMAP< * 6 FETCH (RFC822.SIZE 2916844)
fetchmail: IMAP< * 7 FETCH (RFC822.SIZE 6793)
fetchmail: IMAP< A0007 OK Completed
This is fetchmail getting message #2 from the server (message #1 above has already been retrieved and purged by fetchmail). When it makes an SMTP connection, it's connecting to postfix at 127.0.0.1:25.
fetchmail: IMAP> A0012 FETCH 1 RFC822.HEADER
fetchmail: IMAP< * 1 FETCH (RFC822.HEADER {1024}
fetchmail: reading message tlyons@smtp.ivenue.com:2 of 7 (1024 header octets)
fetchmail: SMTP> MAIL FROM:<fileWatcher@sql52.ivenue.local> BODY=8BITMIME SIZE=23151
fetchmail: SMTP< 250 2.1.0 Ok
fetchmail: SMTP> RCPT TO:<todd@localhost>
fetchmail: SMTP< 250 2.1.5 Ok
fetchmail: SMTP> DATA
fetchmail: SMTP< 354 End data with <CR><LF>.<CR><LF>
#
fetchmail: IMAP< )
fetchmail: IMAP< A0012 OK Completed
fetchmail: IMAP> A0013 FETCH 1 BODY.PEEK[TEXT]
fetchmail: IMAP< * 1 FETCH (BODY[TEXT] {22127}
***********************.*********************.*****************.********************.*********************.*********************.**********************.**********************.*******************.*****************.*****************.*****************.******************.***********************.***********************.**********************.************************.************************.*********************.***************.*****************.************
fetchmail: (22127 body octets) (log message incomplete)fetchmail: IMAP< )
fetchmail: IMAP< A0013 OK Completed
fetchmail: SMTP>. (EOM)
fetchmail: SMTP< 250 2.0.0 Ok: queued as 0C609114001
fetchmail: flushed
Here is postfix delivering the message. Notice how it delivers it twice, same message-id. fetchmail above only says it connected once.
Dec 11 09:50:18 tlyons postfix/smtpd[4167]: 0C609114001: client=localhost[127.0.0.1]
Dec 11 09:50:18 tlyons postfix/cleanup[4170]: 0C609114001: message-id=<200712111750.lBBHo4gK001598@sql52.ivenue.net>
Dec 11 09:50:18 tlyons postfix/smtpd[4176]: connect from localhost[127.0.0.1]
Dec 11 09:50:18 tlyons postfix/smtpd[4176]: 26DA01140D4: client=localhost[127.0.0.1]
Dec 11 09:50:18 tlyons postfix/cleanup[4177]: 26DA01140D4: message-id=<200712111750.lBBHo4gK001598@sql52.ivenue.net>
Dec 11 09:50:18 tlyons postfix/qmgr[23485]: 0C609114001: from=<fileWatcher@sql52.ivenue.net>, size=23458, nrcpt=1 (queue active)
Dec 11 09:50:18 tlyons postfix/local[4171]: 0C609114001: to=<todd@localhost>, relay=local, delay=0.2, delays=0.18/0/0/0.02, dsn=2.
0.0, status=sent (delivered to command: /usr/bin/procmail -Y /etc/procmail/$LOCAL.procmailrc -a $EXTENSION)
Dec 11 09:50:18 tlyons postfix/qmgr[23485]: 0C609114001: removed
Dec 11 09:50:18 tlyons postfix/qmgr[23485]: 26DA01140D4: from=<fileWatcher@sql52.ivenue.net>, size=23458, nrcpt=1 (queue active)
Dec 11 09:50:18 tlyons postfix/smtpd[4167]: 584B2114001: client=localhost[127.0.0.1]
Dec 11 09:50:18 tlyons postfix/local[4171]: 26DA01140D4: to=<todd@localhost>, relay=local, delay=0.23, delays=0.21/0/0/0.02, dsn=2
.0.0, status=sent (delivered to command: /usr/bin/procmail -Y /etc/procmail/$LOCAL.procmailrc -a $EXTENSION)
Dec 11 09:50:18 tlyons postfix/qmgr[23485]: 26DA01140D4: removed
What's odd about this:
1) The message before this (#1) one was not duplicated. It was filtered by my procmailrc to the same folder with the same regex.
2) The messages after this one (#3,#4,#5,#6 and #7) *were* duplicated, with #3,#4, and #5 again by the same procmailrc to the same folder with the same regex. The other two were filtered off to each separate folders (an AOL SCOMP submission and an LKML email).
Postfix delivers the message using procmail:
root@tlyons:~# postconf mailbox_command
mailbox_command = /usr/bin/procmail -Y /etc/procmail/$LOCAL.procmailrc -a $EXTENSION
Procmail logs (showing that it was told to deliver it twice):
From fileWatcher@famblog51.ivenue.net Tue Dec 11 09:50:17 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395417.4173_1.tlyons 7774
From fileWatcher@sql52.ivenue.net Tue Dec 11 09:50:18 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395418.4179_1.tlyons 23099
From fileWatcher@sql52.ivenue.net Tue Dec 11 09:50:18 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395418.4183_1.tlyons 23099
From fileWatcher@smtp1.ivenue.com Tue Dec 11 09:50:18 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395418.4187_1.tlyons 28882
From fileWatcher@smtp1.ivenue.com Tue Dec 11 09:50:18 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395418.4191_1.tlyons 28882
From fileWatcher@mail1.ivenue.net Tue Dec 11 09:50:18 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395418.4195_1.tlyons 16468
From fileWatcher@mail1.ivenue.net Tue Dec 11 09:50:18 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395418.4199_1.tlyons 16468
From fileWatcher@rp51a.ivenue.net Tue Dec 11 09:50:18 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395418.4203_1.tlyons 23406
From fileWatcher@rp51a.ivenue.net Tue Dec 11 09:50:18 2007
Subject: FileWatcher Notice
Folder: Ivenue.FileWatcher/new/1197395418.4207_1.tlyons 23406
From scomp@aol.net Tue Dec 11 09:50:38 2007
Subject: Client TOS Notification
Folder: /usr/sbin/sendmail -oi spamstore@admin51.ivenue.net 2877786
From linux-kernel-owner+tlyons=40ivenue.com-S1754578AbXLKRqR@vger.kernel.org Tue Dec 11 09:50:38 2007
Subject: Re: 2.6.24-rc4-mm1: acpi reboots machine... solved
Folder: LKML/new/1197395438.4231_1.tlyons 7070
From linux-kernel-owner+tlyons=40ivenue.com-S1754578AbXLKRqR@vger.kernel.org Tue Dec 11 09:50:39 2007
Subject: Re: 2.6.24-rc4-mm1: acpi reboots machine... solved
Folder: LKML/new/1197395439.4241_1.tlyons 7070
From scomp@aol.net Tue Dec 11 09:50:38 2007
Subject: Client TOS Notification
Folder: /usr/sbin/sendmail -oi spamstore@admin51.ivenue.net 2877786
From linux-kernel-owner+tlyons=40ivenue.com-S1755260AbXLKRsQ@vger.kernel.org Tue Dec 11 09:50:39 2007
Subject: RE: 2.6.22.14 oops msg with commvault galaxy ?
Folder: LKML/new/1197395439.4249_1.tlyons 60815
From linux-kernel-owner+tlyons=40ivenue.com-S1755260AbXLKRsQ@vger.kernel.org Tue Dec 11 09:50:39 2007
Subject: RE: 2.6.22.14 oops msg with commvault galaxy ?
Folder: LKML/new/1197395439.4253_2.tlyons 60815
Here is my entire procmailrc (/etc/procmail/todd.procmailrc referenced in the procmail commandline)
SHELL=/bin/bash
LINEBUF=4096
PATH=/bin:/usr/bin:/usr/local/bin
VERBOSE=on
MAILDIR=$HOME/Maildir
LOGFILE=$HOME/tmp/procmaillog
FORMAIL=/usr/bin/formail
SENDMAIL=/usr/sbin/sendmail
purgatory=/dev/null
#:0 Wh: msgid.lock
#| $FORMAIL -D 8192 .cache/msgid.cache
:0 fhw
| $FORMAIL -I "From " -a "From "
:0
* ^(From|To|Cc):.*av8\.com
${purgatory}
:0
* ^(From|To|Cc):.*dennispe\@inetnw\.com
${purgatory}
:0
* ^X-Loop.*scomp
{
:0 c
Ivenue.AOL-Feedback-Loop/
# Extract IP of sender and headers for database record
:0 c
!spamscompheaders@admin51.ivenue.local
# Put in a separate mailbox in case need to see whole message
:0 A
!spamstore@admin51.ivenue.local
}
:0:
* ^From.*alerts@alertsite.com
Ivenue.Alertsite/
# Have to put first since is a more explicit pattern than eWatcher
:0:
* ^From:.*fileWatcher
Ivenue.FileWatcher/
:0:
* ^From:.*eWatcher
Ivenue.eWatcher/
:0:
* ^Subject.*fm-news.*Newsletter
Ivenue.Freshmeat/
:0:
* ^X-BeenThere.*linuxusers@socallinux
909LUG/
:0:
* ^To:.*indexer@ivenue
Ivenue.Indexer/
:0:
* ^X-BeenThere.*cisco-nsp@
Cisco-NSP/
:0:
* ^X-BeenThere.*clamav-devel
ClamAV-Devel/
:0:
* ^X-BeenThere.*clamav-users
ClamAV-Users/
:0:
* ^X-BeenThere.*clamav-virusdb
ClamAV-VirusDB/
:0:
* ^X-BeenThere.*courier-imap@
Courier-Imap/
:0:
* ^X-BeenThere: cyrus-devel@
Cyrus-Devel/
:0:
* ^X-BeenThere: info-cyrus@
Cyrus-Users/
:0:
* ^X-BeenThere.*dkim-milter-beta@
DKIM-Milter-Beta/
:0:
* ^X-BeenThere.*dkim-milter-discuss@
DKIM-Milter/
:0:
* ^List-Id.*domainkeys-interop.yahoogroups.com
DKInterOp/
:0:
* ^X-BeenThere.*dns-operations
DNS-Operations/
:0:
* ^X-BeenThere.*devel-spam@
FuzzyOCR/
:0:
* ^X-BeenThere.*jocr-devels@
GOCR/
:0:
* ^X-BeenThere.*hylafax-devel@
HylaFAX-Devel/
:0:
* ^X-BeenThere.*hylafax-users@
HylaFAX-Users/
:0:
* ^X-BeenThere.*linux-ha
Linux-HA/
:0:
* ^X-BeenThere.*linux-poweredge@
Linux-PowerEdge/
:0:
* ^X-Mailing-List.*linux-kernel@
LKML/
:0:
* ^X-BeenThere:.*lula@
LULA/
:0:
* ^X-BeenThere.*lvs-users
LVS-Users/
:0:
* ^X-BeenThere.*courier-maildrop@
Maildrop/
:0:
* ^X-BeenThere:.*mon@
Mon/
:0:
* ^X-BeenThere:.*mon-devel@
Mon-Devel/
:0:
* ^Mailing-List:.*mysql-help@
MySQL-Help/
:0:
* ^X-Loop.*nanog
NANOG/
:0:
* X-BeenThere.*netdisco-users@
NetDisco-Users/
:0:
* ^X-BeenThere.*oclug@
OCLUG/
:0:
* ^X-BeenThere.*openldap-software@
OpenLDAP/
:0:
* ^X-BeenThere.*qdvdauthor-devel
QDVDAuthor-Devel/
:0:
* ^X-BeenThere.*qdvdauthor-users
QDVDAuthor-Users/
:0:
* ^X-BeenThere.*users@lists.rpmforge.net
RPMForge/
:0:
* ^X-BeenThere.*smfs-users@
SMFS-Users/
:0:
* ^X-BeenThere.*spamass-milt-list
Spamass-Milt-List/
:0:
* ^From.*mrtg@
Ivenue.MRTG/
:0:
* ^Subject:.*mysql(check|Check)
Ivenue.MysqlChecks/
:0:
* ^Subject:.*mysqlHotCopy
Ivenue.MysqlDumps/
:0:
* ^From:.*@netapp.com
Ivenue.NetApp/
:0:
* rblremove\@ivenue\.com
Ivenue.RBL/
:0:
* ^Subject:.*Swatch
Ivenue.Swatch/
:0:
* ^(To.*sysadmin@|From.*root@|Subject.*checkDF\.pl)
Ivenue.Sysadmin/
:0:
* ^From:.*@trustkeeper.net
Ivenue.TrustKeeper/
:0:
* ^From:.*@(.*verisign\.(com|net)|atwcorp\.com)
Ivenue.VeriSign/
:0:
* ^From:.*virusalert
Ivenue.VirusAlert/
# Matched nothing else, deliver to Inbox
:0:
Inbox/
Any clues?