Campaign finished too early (after 200, 300 or 400 emails out of 2498)

Thanks. But no issue in that, as all my subscribers are set for html and all my campaigns are html.

@bernard.fruga The event log that you sent to me did not include campaign 378. From what you have explained you don’t think that there are any problems with the other three campaigns - 288, 305 and 372. Please can you show the event log for the campaign that you think is not working properly.

Sorry, but I have no idea which campaign is in the Event Log as there is just the list of events with no reference to the campaign number. I took it from the Log of Events (see below). Is there any other place where I could find the log?

@bernard.fruga Look for the entry like this but for campaign 378. There will be a group of entries for that campaign, but in reverse chronological order.

116340 12 June 2017 02:00:02 Processing message 288

@duncanc thanks! I’ve found the relevant part of the log, see below.
I’m sharing the part from 22:40 (when I started) till 23:30 (well after the second attempt to sent out the 378)
If you’ve wish to see more, I’d be glad to share.

100171 10 June 2017 23:30:02 Processing message 378
PAGE: PROCESSQUEUE
Del
100170 10 June 2017 23:30:02 One campaign to process.
PAGE: PROCESSQUEUE
Del
100169 10 June 2017 23:30:02 Processing has started,
PAGE: PROCESSQUEUE
Del
100168 10 June 2017 23:20:07 Finished this run
PAGE: PROCESSQUEUE
Del
100167 10 June 2017 23:20:07 9 failed (will retry later)
PAGE: PROCESSQUEUE
Del
100166 10 June 2017 23:20:07 100 messages sent in 5.74 seconds (62768 msgs/hr)
PAGE: PROCESSQUEUE
Del
100165 10 June 2017 23:20:07 batch limit reached: 100 (100)
PAGE: PROCESSQUEUE
Del
100164 10 June 2017 23:20:02 Found them: 2298 to process
PAGE: PROCESSQUEUE
Del
100163 10 June 2017 23:20:02 Looking for subscribers
PAGE: PROCESSQUEUE
Del
100162 10 June 2017 23:20:02 Processing message 378
PAGE: PROCESSQUEUE
Del
100161 10 June 2017 23:20:02 One campaign to process.
PAGE: PROCESSQUEUE
Del
100160 10 June 2017 23:20:02 Processing has started,
PAGE: PROCESSQUEUE
Del
100159 10 June 2017 23:10:09 Warning: script never reached stage 5 This may be caused by a too slow or too busy server
PAGE: PROCESSQUEUE
Del
100158 10 June 2017 23:10:09 Finished this run
PAGE: PROCESSQUEUE
Del
100157 10 June 2017 23:10:09 It took 30 minutes 07 seconds to send this message
PAGE: PROCESSQUEUE
Del
100156 10 June 2017 23:10:09 Processed 2298 out of 2298 subscribers
PAGE: PROCESSQUEUE
Del
100155 10 June 2017 23:10:01 Found them: 2298 to process
PAGE: PROCESSQUEUE
Del
100154 10 June 2017 23:10:01 Looking for subscribers
PAGE: PROCESSQUEUE
Del
100153 10 June 2017 23:10:01 Processing message 378
PAGE: PROCESSQUEUE
Del
100152 10 June 2017 23:10:01 It took very little time to send this message
PAGE: PROCESSQUEUE
Del
100151 10 June 2017 23:10:01 Processed 44 out of 44 subscribers
PAGE: PROCESSQUEUE
Del
100150 10 June 2017 23:10:01 Found them: 44 to process
PAGE: PROCESSQUEUE
Del
100149 10 June 2017 23:10:01 Looking for subscribers
PAGE: PROCESSQUEUE
Del
100148 10 June 2017 23:10:01 Processing message 372
PAGE: PROCESSQUEUE
Del
100147 10 June 2017 23:10:01 2 campaigns to process.
PAGE: PROCESSQUEUE
Del
100146 10 June 2017 23:10:01 Processing has started,
PAGE: PROCESSQUEUE
Del
100145 10 June 2017 23:00:02 Finished this run
PAGE: PROCESSQUEUE
Del
100144 10 June 2017 23:00:02 No subscribers apply for attributes
PAGE: PROCESSQUEUE
Del
100143 10 June 2017 23:00:02 Looking for subscribers
PAGE: PROCESSQUEUE
Del
100142 10 June 2017 23:00:02 Processing message 356
PAGE: PROCESSQUEUE
Del
100141 10 June 2017 23:00:02 It took very little time to send this message
PAGE: PROCESSQUEUE
Del
100140 10 June 2017 23:00:02 Hmmm, No subscribers found to send to
PAGE: PROCESSQUEUE
Del
100139 10 June 2017 23:00:02 Processed 0 out of 0 subscribers
PAGE: PROCESSQUEUE
Del
100138 10 June 2017 23:00:02 Found them: 0 to process
PAGE: PROCESSQUEUE
Del
100137 10 June 2017 23:00:02 Looking for subscribers
PAGE: PROCESSQUEUE
Del
100136 10 June 2017 23:00:02 Processing message 305
PAGE: PROCESSQUEUE
Del
100135 10 June 2017 23:00:02 It took very little time to send this message
PAGE: PROCESSQUEUE
Del
100134 10 June 2017 23:00:02 Hmmm, No subscribers found to send to
PAGE: PROCESSQUEUE
Del
100133 10 June 2017 23:00:02 Processed 0 out of 0 subscribers
PAGE: PROCESSQUEUE
Del
100132 10 June 2017 23:00:02 Found them: 0 to process
PAGE: PROCESSQUEUE
Del
100131 10 June 2017 23:00:02 Looking for subscribers
PAGE: PROCESSQUEUE
Del
100130 10 June 2017 23:00:02 Processing message 288
PAGE: PROCESSQUEUE
Del
100129 10 June 2017 23:00:02 5 campaigns to process.
PAGE: PROCESSQUEUE
Del
100128 10 June 2017 23:00:02 Processing has started,
PAGE: PROCESSQUEUE
Del
100127 10 June 2017 22:50:07 Finished this run
PAGE: PROCESSQUEUE
Del
100126 10 June 2017 22:50:07 100 messages sent in 5.88 seconds (61249 msgs/hr)
PAGE: PROCESSQUEUE
Del
100125 10 June 2017 22:50:07 batch limit reached: 100 (100)
PAGE: PROCESSQUEUE
Del
100124 10 June 2017 22:50:01 Found them: 2398 to process
PAGE: PROCESSQUEUE
Del
100123 10 June 2017 22:50:01 Looking for subscribers
PAGE: PROCESSQUEUE
Del
100122 10 June 2017 22:50:01 Processing message 378
PAGE: PROCESSQUEUE

EVENTS
DATE
MESSAGE
100121 10 June 2017 22:50:01 One campaign to process.
PAGE: PROCESSQUEUE
Del
100120 10 June 2017 22:50:01 Processing has started,
PAGE: PROCESSQUEUE
Del
100119 10 June 2017 22:40:08 Finished this run
PAGE: PROCESSQUEUE
Del
100118 10 June 2017 22:40:08 100 messages sent in 6.49 seconds (55484 msgs/hr)
PAGE: PROCESSQUEUE
Del
100117 10 June 2017 22:40:08 batch limit reached: 100 (100)
PAGE: PROCESSQUEUE
Del
100116 10 June 2017 22:40:02 Found them: 2498 to process
PAGE: PROCESSQUEUE
Del
100115 10 June 2017 22:40:02 Looking for subscribers
PAGE: PROCESSQUEUE
Del
100114 10 June 2017 22:40:02 Processing message 378
PAGE: PROCESSQUEUE
Del
100113 10 June 2017 22:40:02 One campaign to process.
PAGE: PROCESSQUEUE
Del
100112 10 June 2017 22:40:02 Processing has started,

This message in the event log does not usually appear. What is different about campaign 356?

356 is for the list E-bookxxxxxxxxxxxxx, and is related to the Autoresponder 8:
Campaign 356 | Autoresponder email will be sent 1 day after subscription to "E-bookxxxxxxxxxxxxxxxxxxxxxx"
After sending, add subscriber to 1-xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

and here are the settings of 356:
Stop sending after 2017-11-28 10:00:00
Requeueing every day until 2018-05-29 23:00:00
Autoresponder Autoresponder 8

@bernard.fruga The last set of event log entries almost looks ok for campaign 378.
22:40 sent 100
22:50 sent 100
23:00 did not appear to send anything
23:10 an odd message about having processed all 2298 subscribers
23:20 sent 100

I still do not see your original problem of phplist reporting the campaign to be finished.
The event at 23:00 is a phplist bug caused by using the autoresponder plugin (not in the plugin itself). The event at 23:10 might be a consequence of that, but I don’t really know.

I suggest we treat 372 as a potential suspect of the problem. I will temporarily stop 372 when sending out a new newsletter this week (on Saturday). And then we will see.
As putting together all the pieces I see time coincidence of the problem and the launch of 372 in May.
If that would solve the issue we’d look deeper into the 372 details. Otherwise I’d keep searching.

@duncanc The 372 campaign was the one causing the problem of stopping other campaigns every hour. I know it as I’ve completed the test today. I paused the 372 and sent out a new campaign (379 to the list 1-xxxxxx of 2493 subscribers).
In my understanding the problem was correlated with the usage of the plugin SegmentPlugin (filtering subscribers by Segment conditions).
The settings of the campaign 372 were the following:
(entered at 2017-05-23 08:47:34) is requeueing every hour until 2018-05-23 08:00:00 Segment conditions: Subscribers match all of the following: Entered date is after 2017-05-22 and of the list: E-bookxxxxxxxxxxxxxxxxxx
Do you want me to perform any more tests on SegmentPlugin to confirm or reject the hypothesis of the bug sitting there?

@bernard.fruga I don’t really understand what the problem is but I suggest that you try to setup the repeating campaigns so that phplist processes only one in each run. Instead of all the campaigns repeating each hour at 00 minutes, try to spread them out, say one at 00 minutes, a second at 15 minutes, etc. That is done by altering the embargo date/time on the Scheduling tab.

Hi Bernard
I’m having a similar problem. PHPLIST with the “SegmentPlugin” installed.
Some campaigns are set so that they are sent only to specific user (based on insert date). We have about 12k users and we can’t send a campaign anymore.
After a lot of “not sent to…” the process reached “Warning: script never reached stage 5” and it ends. Did you solve this issue?

I reported this problem last year https://mantis.phplist.org/view.php?id=18544 but it has not been addressed.

I think that you need to manually suspend the campaign then mark it as “sent”. Otherwise phplist will continually try to send it.

@duncanc
thank you for your kind and quick reply. The main issue is that we must send that campaign, if we mark it as “sent” the message will not be worked out.

@daf As you are using the Segment plugin, phplist has already sent to all subscribers who meet the conditions. Can you confirm that is the case?

@duncanc
There are 18 campaign in “Active” status, most of them use the Segment Plugin and it seems that the filtered messages are submitted when the queue is processed and the process reaches the end.
Most of the time however, the process stops before the end and the log says " Warning: script never reached stage 5 This may be caused by a too slow or too busy server".

@daf Sorry but I don’t understand your reply.

If you look at the Active tab then you will see how the number of subscribers that a campaign has been sent. For at least one campaign, and possibly more, that should be the number of subscribers who match the segment conditions. In that case you should suspend the campaign and mark it as sent.

@duncanc

we can’t, unfortunately, mark those campaigns as ‘sent’ because we need they are always in ‘active’ state. We set the segmentation plugin as to select subscriber on the basis of the Entered Date so that the campaign is sent only to new subscibers after a specified number of day after this.
Example: new subscriber receives a message after 1 day, after 7 and after 14. Those campaigns have to stay always active, ready to send message to news subscribers that fulfil the conditions.
We’re being advised to perform a PHPLIST downgrade, could an older version of PHPLIST be more compatible?
Thank you in advance.

Hi Daf,
Yeap, my problem was gone a year ago. Unfortunately I don’t remember the details anymore. I presume solution was the one I described in this discussion a year ago.
Cheers,
Bernard

@daf I might have misunderstood what your problem actually is. Please can you explain exactly what is not working?

I can reproduce the warning “Warning: script never reached stage 5”. The message is marked correctly as “sent”. On the next run of processqueue it is changed to “submitted”, which means that it should be sent again.