I have set up a new system (actually migrated from an older version) using 3.3.1, and I have configured processbounces to run as a cron job, using:
phplistusr /usr/bin/php /var/webs/campaign/www/admin/index.php -pprocessbounces -c/var/webs/campaign/www/config/config.php
I sent a test campaign to an experimental subscriber list with 6 members, one of which is fake (janis.joplin@noa.gr), so as to test bounces. Campaign sender is listsender2@noa.gr
I have configured:
$bounce_mailbox_user = 'noabounce2';
thinking that I am going to receive bounces (non-delivery reports) there, but I don’t seem to get such a report there.
When I send the campaign, I receive the following report from the processqueue job:
Exhibit A:
phpList version 3.3.1 (c) 2000-2017 phpList Ltd, http://www.phplist.com
PHPlist - Maximum time for queue processing: 99999 [0.0008910000] (98)
PHPlist - Recently sent : 0
PHPlist - Started [0.0011130000] (101)
PHPlist - Sending in batches of 200 emails [0.0001830000] (102)
PHPlist - select id from phplist_message where status not in ("draft", "sent", "prepared", "suspended") and embargo [0.0007350000] (103)
PHPlist - Processing has started, [0.0009290000] (106)
PHPlist - One campaign to process. [0.0003680000] (108)
PHPlist - sending of this campaign will stop, if it is still going in 5 minutes 59 seconds [0.0297610000] (123)
PHPlist - Processing message 308 [0.2745230000] (140)
PHPlist - Looking for subscribers [0.1000800000] (145)
PHPlist - User select query select distinct u.id from phplist_listuser as listuser
inner join phplist_user_user as u ON u.id = listuser.userid
inner join phplist_listmessage as listmessage ON listuser.listid = listmessage.listid
left join phplist_usermessage as um ON (um.messageid = 308 and um.userid = listuser.userid)
where
listmessage.messageid = 308
and listmessage.listid = listuser.listid
and u.id = listuser.userid
and um.userid IS NULL
and u.confirmed and !u.blacklisted and !u.disabled
[0.0004240000] (148)
PHPlist - Found them: 6 to process [0.0556750000] (152)
...
<Removed: 5 successful mails are sent>
...
PHPlist - Failed sending to janis.joplin@noa.gr [0.0007980000] (364)
PHPlist - sent 5 ETA Sun 10 Sep 17:24 sending 2329 msg/hrPHPlist - Processed 6 out of 6 subscribers [1.0021790000] (372)
PHPlist - Script stage: 5 [0.0006470000] (374)
PHPlist - 5 messages sent in 7.73 seconds (2328 msgs/hr) [0.0008540000] (377)
PHPlist - 1 failed (will retry later) [0.0005360000] (379)
PHPlist - 1 Campaign
PHPlist - 0 num_users_for_message
PHPlist - 6 batch_count
PHPlist - 200 batch_total
PHPlist - 1 sendemail returned false total
PHPlist - 0 send blocked by domain throttle
PHPlist - 0 add attachment error
PHPlist - 1 sendemail returned false
PHPlist - 0 sentastest
PHPlist - 0 invalid
PHPlist - 1 failed_sent
PHPlist - 5 Sent
PHPlist - 200 num_per_batch
PHPlist - 1 Status
PHPlist - 5 sent_users_for_message 308
PHPlist - 6 total_users_for_message 308
PHPlist - 0 max_users_for_message 308
PHPlist - 6 processed_users_for_message 308
PHPlist - 1 failed_sent_for_message 308
PHPlist - Finished this run [0.0117710000] (436)
In the noabounce2 mailbox I get the following mail message (when the processqueue job has finished):
Exhibit B:
# cat /home/vmail/noabounce2/Maildir/new/1505053449.M749823P3606.vmail2.noa.gr\,S\=6127\,W\=6234
Return-Path: <listsender2@noa.gr>
Delivered-To: noabounce2@noa.gr
Received: from vmail2.noa.gr
by vmail2.noa.gr with LMTP id oOmeLAlLtVkWDgAAcV+qjQ
for <noabounce2@noa.gr>; Sun, 10 Sep 2017 17:24:09 +0300
Received: from campaign.noa.gr (vweb2.noa.gr [IPv6:2001:648:2011:15::164])
(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
(No client certificate requested)
by vmail2.noa.gr (IC-XC-NI-KA) with ESMTPSA id 9F66680004F2F
for <noabounce2@noa.gr>; Sun, 10 Sep 2017 17:24:09 +0300 (EEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=noa.gr; s=default;
t=1505053449; bh=IGd+/Za7UcmVkT9D4PrlXp7MIYcbpYUQ2tw8h8yKw6o=;
h=Date:To:From:Subject:List-Unsubscribe;
b=JkouBUiGW2DYOqtyK5bt5kZP73BnnOdcqhVpXNS0gMDCbFP5Yd60iY6EY3CkOwWSk
FUTlzTcENGLYI1+asqvZb0nwhCuGxhLs3taHWXgGDEzUGV/UEH4wD487J55IgeL9fD
copSYr0TzU3oqzib86kBuVLrR3Qz/1IMZL8BvHqc=
Date: Sun, 10 Sep 2017 17:24:09 +0300
To: noabounce2@noa.gr
From: PHPList Master <listsender2@noa.gr>
Subject: PHPlist Message queue processing report
Message-ID: <0e9d5fb145021e95db489520558576e3@campaign.noa.gr>
X-Mailer: PHPMailer 5.2.22 (https://github.com/PHPMailer/PHPMailer)
X-phpList-version: 3.3.1
X-MessageID: systemmessage
X-ListMember: noabounce2@noa.gr
Precedence: bulk
Bounces-To: listsender2@noa.gr
List-Unsubscribe: <http://campaign.noa.gr/?p=unsubscribe&email=noabounce2@noa.gr&jo=1>
MIME-Version: 1.0
Content-Type: multipart/alternative;
boundary="b1_0e9d5fb145021e95db489520558576e3"
This is a multi-part message in MIME format.
--b1_0e9d5fb145021e95db489520558576e3
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
The following events occured while processing the message queue:
[Sun 10 Sep 2017 17:24] [CL] Started
[Sun 10 Sep 2017 17:24] [CL] Sending in batches of 200 emails
[Sun 10 Sep 2017 17:24] [CL] select id from phplist_message where status
not in ("draft", "sent", "prepared", "suspended") and embargo=20
--b1_0e9d5fb145021e95db489520558576e3
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<div style=3D"margin:0; text-align:center; width:100%; background:#EEE;min-=
width:240px;height:100%;"><br />=0A <div style=3D"width:96%;margin:0 aut=
o; border-top:6px solid #369;border-bottom: 6px solid #369;background:#DEF;=
" >=0A <h3 style=3D"margin-top:5px;background-color:#69C; font-weigh=
t:normal; color:#FFF; text-align:center; margin-bottom:5px; padding:10px; l=
ine-height:1.2; font-size:21px; text-transform:capitalize;">PHPlist Message=
queue processing report</h3>=0A <div style=3D"text-align:justify;ba=
ckground:#FFF;padding:20px; border-top:2px solid #369;min-height:200px;font=
-size:13px; border-bottom:2px solid #369;">The following events occured whi=
le processing the message queue:=0A=0A[Sun 10 Sep 2017 17:24] [CL] Started=
=0A[Sun 10 Sep 2017 17:24] [CL] Sending in batches of 200 emails=0A[Sun 10 =
Sep 2017 17:24] [CL] select id from phplist_message where status not in ("=
draft", "sent", "prepared", "suspended") and embargo <=3D now() order by en=
tered limit 5 =0A[Sun 10 Sep 2017 17:24] [CL] Processing has started,=0A[S=
un 10 Sep 2017 17:24] [CL] One campaign to process.=0A[Sun 10 Sep 2017 17:2=
4] [CL] sending of this campaign will stop, if it is still going in 5 minu=
tes 59 seconds=0A[Sun 10 Sep 2017 17:24] [CL] Processing message 308=0A[Sun=
10 Sep 2017 17:24] [CL] Looking for subscribers=0A[Sun 10 Sep 2017 17:24] =
[CL] User select query select distinct u.id from phplist_listuser as listus=
er=0A inner join phplist_user_user as u ON u.id =3D listuser.userid=
=0A inner join phplist_listmessage as listmessage ON listuser.listid=
=3D listmessage.listid=0A left join phplist_usermessage as um ON (u=
m.messageid =3D 308 and um.userid =3D listuser.userid)=0A where =0A =
listmessage.messageid =3D 308=0A and listmessage.listid =3D l=
istuser.listid=0A and u.id =3D listuser.userid=0A and um.user=
id IS NULL=0A and u.confirmed and !u.blacklisted and !u.disabled=0A =
=0A[Sun 10 Sep 2017 17:24] [CL] Found them: 6 to process=0A[Sun 10 =
Sep 2017 17:24] [CL] Sending 308 to
...<Removed>...
Failed sending to janis.joplin@noa.gr=0A[Sun 10 Sep 2017 17:24] [CL] Pr=
ocessed 6 out of 6 subscribers=0A[Sun 10 Sep 2017 17:24] [CL] Script stage:=
5=0A[Sun 10 Sep 2017 17:24] [CL] 5 messages sent in 7.73 seconds (2328 msg=
s/hr)=0A[Sun 10 Sep 2017 17:24] [CL] 1 failed (will retry later)=0A=0ATo st=
op receiving these reports read: https://resources.phplist.com/system/confi=
g/send_queue_processing_report=0A=0A<div style=3D"clear:both"></div></div>=
=0A <div style=3D"clear:both;background:#69C;font-weight:normal; pad=
ding:10px;color:#FFF;text-align:center;font-size:11px;margin:5px 0px"><br/>=
<div style=3D"clear: both; font-family: arial, verdana, sans-serif; font-si=
ze: 8px; font-variant: small-caps; font-weight: normal; padding: 2px; paddi=
ng-left:10px;padding-top:20px;">powered by <a href=3D"https://www.phplist.c=
om/poweredby?utm_source=3Ddownload3.3.1&utm_medium=3Dpoweredtxt&utm=
_campaign=3DphpList" target=3D"_blank" title=3D"powered by phpList version =
3.3.1, © phpList ltd">phpList</a></div></div>=0A </div>=0A<br /></d=
iv>
--b1_0e9d5fb145021e95db489520558576e3--
When I run the processbounces job, I get the following output from the cron job:
Exhibit C:
phpList version 3.3.1 (c) 2000-2017 phpList Ltd, http://www.phplist.com
PHPlist - bounces to fetch from the mailbox
PHPlist - Please do not interrupt this process
PHPlist - UID0 MSGID0
PHPlist - Deleting message 1
PHPlist - Closing mailbox, and purging messages
PHPlist - reprocessing
PHPlist - 6 bounces to reprocess
PHPlist - 6 out of 6 processed
PHPlist - 0 bounces were re-processed and 0 bounces were re-identified
PHPlist - Identifying consecutive bounces
PHPlist - Nothing to do
PHPlist - total of 0 subscribers processed
(I once had an error, which I reported at: SQL Error when Processing Bounces)
What I understand from the above:
1/ I don’t get a normal bounce at noabounce2 mailbox. Have I configured something wrong or this is because of 2 (see below)?
2/ The processqueue job states “1 failed (will retry later)”. Why shall it try later? The server, while sending the particular mail logged:
Exhibit D:
Sep 10 17:24:08 vmail2 postfix/submission/smtpd[3600]: connect from vweb2.noa.gr[2001:648:2011:15::164]
Sep 10 17:24:08 vmail2 postfix/submission/smtpd[3600]: Anonymous TLS connection established from vweb2.noa.gr[2001:648:2011:15::164]: TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)
Sep 10 17:24:08 vmail2 postfix/submission/smtpd[3600]: NOQUEUE: reject: RCPT from vweb2.noa.gr[2001:648:2011:15::164]: 550 5.1.1 <janis.joplin@noa.gr>: Recipient address rejected: User unknown in virtual mailbox table; from=<listsender2@noa.gr> to=<janis.joplin@noa.gr> proto=ESMTP helo=<campaign.noa.gr>
Sep 10 17:24:08 vmail2 postfix/submission/smtpd[3600]: disconnect from vweb2.noa.gr[2001:648:2011:15::164] ehlo=2 starttls=1 auth=1 mail=1 rcpt=0/1 quit=1 commands=6/7
So, the server has responded that the recipient is non-existent. Why phplist will try later and does not end-up and produce a proper bounce?
3/ Why do I get the “Exhibit B” report at noabounce2 mailbox? I wouldn’t expect to receive such a report there. Specifically, I would only expect to get bounces from campaign mails at that mailbox.
4/ The report received at noabounce2 mailbox is deleted during the processbounces job. I guess this happens because I have configured:
$bounce_mailbox_purge_unprocessed = 1;
Right?
5/ When the campaign is complete, the Campaign stats show “Bounces: 0”. The undelivered mail never gets reported. How can I fix this situation?
Please advise!
Thanks a lot,
Nick