I was happy with phplist version 2.17. However, it stopped to load bounces - just showed the number of bounces, but not the bounces themselves.
I upgraded to v3.3.1. Now the bounces headers are loaded, but not the body. Also, user email is not recognized.
I don’t have rules yet, and they are not auto generated. Please see attached the screenshots.
Advanced BH is not activated, since I don’t know how to use regular expressions in my case. They do not work.
define(‘USE_ADVANCED_BOUNCEHANDLING’, 0);
@leo2 If all bounces are being shown in this way then the problem might be with the mail server used by your hosting company. Possibly it is configured not to include the original email in the bounce, which is what phplist needs to identify the subscriber and message.
You could try looking directly at the pop3 inbox to see how the bounce emails appear there.
In the pop3 mailbox the bodies are in place. And reasons for bounce are written in the body.
So, it is not because of the bounce itself, but because phplist’s reading script for some reason doesn’t write the body into the database.
@leo2 Possibly something odd about the structure of the bounce that makes phplist unable to process it. Can you provide an example of a bounce from the pop3 mailbox, either copy it here or add it as an attachment?
Also if you look at the phplist_bounce table, what is shown for the data column? If it is a BLOB then phplist is processing the bounce body, so take a look at that to see what is present.
Example of bounces
This message was created automatically by mail delivery software.
A message that you sent could not be delivered to one or more of its
recipients. This is a permanent error. The following address(es) failed:
k_resheniya@mail.ru
SMTP error from remote mail server after end of data:
host mxs.mail.ru [94.100.180.150]: 550 Message was not accepted -- invalid mailbox. Local mailbox k_resheniya@mail.ru is unavailable:
account is disabled
------ This is a copy of the message, including all the headers. ------
Return-path: <bounce@solarhome.ru>
Received: from vh283613 by vh09.hostline.ru with local (Exim 4.84_2)
(envelope-from <bounce@solarhome.ru>)
id 1d5aFb-0019E7-Et
for k_resheniya@mail.ru; Tue, 02 May 2017 19:02:07 +0300
To: k_resheniya@mail.ru
Subject: =?UTF-8?B?0KHQutC40LTQutC4INC90LAg0L3QsNGH0LDQu9C+INC80LDRjyAtINC+0YI=?= =?UTF-8?B?0LzQtdGC0LjQvCDQv9GA0LDQt9C00L3QuNC60Lgg0YEg0LLRi9Cz0L7QtNC+?= =?UTF-8?B?0Lkh?=
X-PHP-Originating-Script: 3216:class.phpmailer.php
Received: from ip-176-192-35-206.bb.netbynet.ru [176.192.35.206] by lists.solarhome.ru with HTTP; Tue, 02 May 2017 19:02:00 +0300
Date: Tue, 2 May 2017 19:02:07 +0300
From: "shop@solarhome.ru" <shop@solarhome.ru>
Message-ID: <759df84c8f1b89615ffa8aade4f7ecce@solarhome.ru>
X-Mailer: PHPMailer 5.2.22 (https://github.com/PHPMailer/PHPMailer)
X-phpList-version: 3.3.1
X-MessageID: 98
X-ListMember: k_resheniya@mail.ru
Precedence: bulk
Bounces-To: bounce@solarhome.ru
List-Help: <http://www.solarhome.ru/lists/?p=preferences&uid=edc0c857305d3b8c881a926d4537bb40>
List-Unsubscribe: <http://www.solarhome.ru/lists/?p=unsubscribe&uid=edc0c857305d3b8c881a926d4537bb40&jo=1>
List-Subscribe: <http://www.solarhome.ru/lists/?p=subscribe>
List-Owner: <mailto:info@solarhome.ru>
MIME-Version: 1.0
Content-Type: multipart/alternative;
boundary="b1_759df84c8f1b89615ffa8aade4f7ecce"
This is a multi-part message in MIME format.
--b1_759df84c8f1b89615ffa8aade4f7ecce
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
**=D0=A1=D0=BA=D0=B8=D0=B4=D0=BA=D0=B8 =D0=B2 =D0=BC=D0=B0=D0=B5 2017**
PHPlist record for this bounce is in unrecognised bounces as follows:
ID 2920 Date 2017-05-02 19:02:00 Status unidentified bounce
I can see that phplist writes the failed address to this field
X-Failed-Recipients:
I don’t see it in the original bounce message.
Another example:
This message was created automatically by mail delivery software.
A message that you sent could not be delivered to one or more of its
recipients. This is a permanent error. The following address(es) failed:
aes1@mail.ustu.ru
SMTP error from remote mail server after end of data:
host ironport10.urfu.ru [212.193.87.26]: 550 5.7.1 This message is blocked due to security reason
------ This is a copy of the message, including all the headers. ------
Return-path: <bounce@solarhome.ru>
Received: from vh283613 by vh09.hostline.ru with local (Exim 4.84_2)
(envelope-from <bounce@solarhome.ru>)
id 1d5aZI-001EFn-Jg
for aes1@mail.ustu.ru; Tue, 02 May 2017 19:22:28 +0300
To: aes1@mail.ustu.ru
Subject: =?UTF-8?B?0KHQutC40LTQutC4INC90LAg0L3QsNGH0LDQu9C+INC80LDRjyAtINC+0YI=?= =?UTF-8?B?0LzQtdGC0LjQvCDQv9GA0LDQt9C00L3QuNC60Lgg0YEg0LLRi9Cz0L7QtNC+?= =?UTF-8?B?0Lkh?=
X-PHP-Originating-Script: 3216:class.phpmailer.php
Received: from ip-176-192-35-206.bb.netbynet.ru [176.192.35.206] by lists.solarhome.ru with HTTP; Tue, 02 May 2017 19:22:18 +0300
Date: Tue, 2 May 2017 19:22:28 +0300
From: "shop@solarhome.ru" <shop@solarhome.ru>
Message-ID: <b50ec56f3601cabc2604cc9eacc68bb9@solarhome.ru>
X-Mailer: PHPMailer 5.2.22 (https://github.com/PHPMailer/PHPMailer)
X-phpList-version: 3.3.1
X-MessageID: 98
X-ListMember: aes1@mail.ustu.ru
Precedence: bulk
Bounces-To: bounce@solarhome.ru
List-Help: <http://www.solarhome.ru/lists/?p=preferences&uid=e68a0cd06b8e11e7a539014c5070b1b4>
List-Unsubscribe: <http://www.solarhome.ru/lists/?p=unsubscribe&uid=e68a0cd06b8e11e7a539014c5070b1b4&jo=1>
List-Subscribe: <http://www.solarhome.ru/lists/?p=subscribe>
List-Owner: <mailto:info@solarhome.ru>
MIME-Version: 1.0
Content-Type: multipart/alternative;
boundary="b1_b50ec56f3601cabc2604cc9eacc68bb9"
This is a multi-part message in MIME format.
--b1_b50ec56f3601cabc2604cc9eacc68bb9
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
correspondent record in the phplist:
Bounce details
ID
2922
Date
2017-05-02 19:22:00
Status
unidentified bounce
Comment
not processed
Header
Close
Return-path: <>
Envelope-to: bounce@solarhome.ru
Delivery-date: Tue, 02 May 2017 19:22:30 +0300
Received: from exim by vh09.hostline.ru with local (Exim 4.84_2)
id 1d5aZK-001EGQ-Ia
for bounce@solarhome.ru; Tue, 02 May 2017 19:22:30 +0300
X-Failed-Recipients: aes1@mail.ustu.ru
Auto-Submitted: auto-replied
From: Mail Delivery System <Mailer-Daemon@vh09.hostline.ru>
To: bounce@solarhome.ru
Subject: Mail delivery failed: returning message to sender
Message-Id: <E1d5aZK-001EGQ-Ia@vh09.hostline.ru>
Date: Tue, 02 May 2017 19:22:30 +0300
Body
I have no rules yet. How to create the rules for the bounces I have? I try to press ‘Create new rule from this bounce’ but just move to the rule creation fields. How to create the rules?
Why phplist put the bounces to the Undefined, in spite X-Failed-Recipients: are in the subscribers lists?
Another thing - I have similar to following bounces from host rumbler.ru
This message was created automatically by mail delivery software.
A message that you sent could not be delivered to one or more of its
recipients. This is a permanent error. The following address(es) failed:
voltmaster@rambler.ru
SMTP error from remote mail server after MAIL FROM:<bounce@solarhome.ru> SIZE=61920:
host inmx.rambler.ru [81.19.78.64]: 554 5.7.1 Client host blocked
Seems te delivery is blocked by remote mail server.
But in the phplist I have ‘standard’ record, from which there is no evident that the mailbox exists and I don’t have to remove it from my list (because I have such messages for all emals @rambler.ru)
Bounce details
ID 2939 Date 2017-05-03 08:07:00 Status unidentified bounce
Comment not processed
Header
Close
Return-path: <>
Envelope-to: bounce@solarhome.ru
Delivery-date: Wed, 03 May 2017 08:07:22 +0300
Received: from exim by vh09.hostline.ru with local (Exim 4.84_2)
id 1d5mVV-003xdd-RU
for bounce@solarhome.ru; Wed, 03 May 2017 08:07:22 +0300
X-Failed-Recipients: timurb1972@rambler.ru
Auto-Submitted: auto-replied
From: Mail Delivery System <Mailer-Daemon@vh09.hostline.ru>
To: bounce@solarhome.ru
Subject: Mail delivery failed: returning message to sender
Message-Id: <E1d5mVV-003xdd-RU@vh09.hostline.ru>
Date: Wed, 03 May 2017 08:07:21 +0300
@leo2 Thanks, but I’m not sure what you are showing. Please can you copy a complete email from the POP3 account, so that we can see it before it is processed by phplist.
I need the complete email including headers, so you will have to “view source” or something similar.
I can not load attachments here. I can not copy full email body because it has links and I am not allowed to put >2 links here (I have 3 links in header only)
PS. I opened the bounces in Roundcube, which I use very rarely. So, the header above were not from the bounce, they were from the message sent. I hope the txt in dropboxt reflects full bounce including its headers. There is that field X-Failed-Recipients:
But why phplist doesn’t recognize a user from that field?
@leo2 In Roundcube you can view the source of an email using the More button
Also, I have compared your bounce with one generated in my phplist installation and there is one difference that might be the cause of the problem. The bounce does not have a Content-Type header. That might cause the php imap module, which does the processing of a bounce email, to not recognise it, because it appears that phplist is being given an empty bounce body.
yes, I already found how to see the headers in roundcube. The file in dropbox has that headers.
How to fix that? I have actually 2 phplists instances, first is main and it sends emails. But it has some error in php imap and can not download bounces (no connection to pop mailbox), and it was same for v2.xx. So had to install phplist in another virtual hosting which can download the bounces to database. I wish I moved completely to that new instance, but they have limit for sending emails (100 per hour). Main hosting has restriction 10 per minute, so I use it to send emails. Both instances use same database.
@leo2 I was mistaken about the cause of the problem. I now think that it is a problem with the line endings of the bounce email when phplist processes it. That might indicate a problem with the mail server.
You can try to work around the problem by making two changes to the phplist source code.
file admin/processbounces.php
line 121 is if (preg_match('/(?:X-MessageId|X-Message): (.*)\r\n/iU', $text, $match)) {
remove the two characters \r
line 134 is if (preg_match('/(?:X-ListMember|X-User): (.*)\r\n/iU', $text, $match)) {
Seems I would move to mailchimp for some of my mailing lists.
phplist 3 has GA feature and google shows that effectiveness of phplist mailings from my virtual hosting is not high. Only 20 links were clicked from more than 2000 emails sent to my subscribers. I am afraid that most of my mails go to spam because of lot of bounces I can not track.
I tried to manually remove the bounced emails from my list, but it takes days and is not effective.
I hoped that phplist3 statistics will work for me, but it doesn’t. Emails are not tracked.
What version of php is on your phpList server. for phpList 3.3.1, php v5.4 does not process the bounces properly. When I upgraded to php v.5.6, it started working.
