IceTV Forum

IceTV Guide for IceTV enabled PVRs => Beyonwiz => Topic started by: csutak40 on November 21, 2018, 09:56:29 PM

Title: Doubled up recording
Post by: csutak40 on November 21, 2018, 09:56:29 PM
Not sure if this is a Wiz or IceTV question.  I ended up with two recordings of Jamie & the Nonnas
What would cause this?
Title: Re: Doubled up recording
Post by: prl on November 21, 2018, 11:04:50 PM
They aren't quite the same - one is 5 minutes longer than the other.

I'd guess that there's been a mishandling of a schedule change, but without more information, it's hard to say even which end was responsible.
Title: Re: Doubled up recording
Post by: grumpy_geoff on November 21, 2018, 11:55:45 PM
This has been seen before.  I've posted about what I saw happening, and I believe the IceTV server "forgets" it has the existing timer to update and creates a new timer for the scheduling change (as in 'Created by Scheduler SERIES' -- it's not an "Updated by").
http://forum.icetv.com.au/iceforum/beyonwiz/17/u4-schedule-change-produces-multiple-timers-for-same-program/5844/msg31214#msg31214
Title: Re: Doubled up recording
Post by: Daniel Hall at IceTV on November 22, 2018, 10:53:22 AM
I have had a look at this one and it looks like a mistake back on the 19th caused the second timer to occur, and for some reason the original timer was not deleted because of this.

The guide team are already aware of what happened and are taking steps to ensure this doesn't happen again, and we will check the keyword handling (as it was in this that the original timer was not deleted) to try and get this one fixed.
Title: Re: Doubled up recording
Post by: prl on November 22, 2018, 02:22:26 PM
I have had a look at this one and it looks like a mistake back on the 19th caused the second timer to occur, and for some reason the original timer was not deleted because of this.

The original Beyonwiz timer will only be deleted if the Beyonwiz gets a "forget" for the original ice_timer_id.
Title: Re: Doubled up recording
Post by: Daniel Hall at IceTV on November 22, 2018, 03:54:14 PM
I have had a look at this one and it looks like a mistake back on the 19th caused the second timer to occur, and for some reason the original timer was not deleted because of this.

The original Beyonwiz timer will only be deleted if the Beyonwiz gets a "forget" for the original ice_timer_id.

Sorry, thats what I meant, for some reason the server did not create the forget timer correctly, I am currently looking into this.
Title: Re: Doubled up recording
Post by: Daniel Hall at IceTV on November 22, 2018, 05:29:58 PM
And this particular bug has been found and fixed on the IceTV server end, but there looks to still be some cases that can cause duplicate timers, but will have to deal with each when we can get examples of each.
Title: Re: Doubled up recording
Post by: prl on November 22, 2018, 07:19:38 PM
Thsnks for the feedback.
Title: Re: Doubled up recording
Post by: csutak40 on November 23, 2018, 01:13:33 AM
Yes, thank you for the feedback from me too
Title: Re: Doubled up recording
Post by: csutak40 on November 26, 2018, 01:10:12 AM
And this particular bug has been found and fixed on the IceTV server end, but there looks to still be some cases that can cause duplicate timers, but will have to deal with each when we can get examples of each.
Here is another example :-)
Title: Re: Doubled up recording
Post by: csutak40 on February 15, 2019, 08:27:37 PM
And this particular bug has been found and fixed on the IceTV server end, but there looks to still be some cases that can cause duplicate timers, but will have to deal with each when we can get examples of each.
And another example.  Seems ti happen about once a week, haven't bothered to write here every time it happens as there was no acknowledgement of the examples given
Title: Re: Doubled up recording
Post by: csutak40 on February 15, 2019, 09:51:34 PM
I didn't even notice on the above that Graham Norton was about to double up as well
Just noticed something else...
C31 doesn't mark things as repeats, so often several versions of the same show get scheduled for recording each week
I noticed last night that Regional Italian Cuisine was set to record several times.  I was sure that I have already deleted the extras, but figured i must have forgotten, so deleted them all last nigh.
I now notice that it hasn't been deleted off the Wiz, even though it is still shown as deleted in IceTV
Title: Re: Doubled up recording
Post by: prl on February 24, 2019, 11:01:20 AM
I am working on this problem with Daniel Hall.
Title: Re: Doubled up recording
Post by: csutak40 on February 24, 2019, 05:11:22 PM
Thank you.  It seems to be getting worse :-)
Do you want me to add each new example as it happens, or are the current examples enough?
Title: Re: Doubled up recording
Post by: prl on February 24, 2019, 06:12:15 PM
Thanks, Judy. What Daniel's given me from your information and logging information from IceTV is enough to go on.

Is your Beyonwiz on a WiFi network connection or on wired Ethernet? The problem appears to be being triggered by network dropouts.
Title: Re: Doubled up recording
Post by: csutak40 on February 24, 2019, 07:34:55 PM
Thanks, Judy. What Daniel's given me from your information and logging information from IceTV is enough to go on.

Is your Beyonwiz on a WiFi network connection or on wired Ethernet? The problem appears to be being triggered by network dropouts.
I am on wired Ethernet
Another question.  Can I delete the  doubled up recordings, or should I keep them until you figure it out?
Title: Re: Doubled up recording
Post by: prl on February 24, 2019, 07:45:19 PM
You can delete any double recordings and any duplicated timers that aren't marked with the blue IceTV "star".
Title: Re: Doubled up recording
Post by: csutak40 on February 24, 2019, 08:27:37 PM
You can delete any double recordings and any duplicated timers that aren't marked with the blue IceTV "star".
Hmm.  This caused me to have a look at the timers.  There ARE some doubled up timers there, where only one has the blue IcetV star, however there are also some single timers without the star.  What does that mean?
Title: Re: Doubled up recording
Post by: IanL-S on February 25, 2019, 11:16:25 AM
I had doubling up on one of my T2 some weeks back. Relatively certain not happening with U4. I have ethernet connection, not wifi, but I recall having some other network issues about the same time (caused by power outage).

Ian
Title: Re: Doubled up recording
Post by: prl on February 25, 2019, 01:24:24 PM
You can delete any double recordings and any duplicated timers that aren't marked with the blue IceTV "star".
Hmm.  This caused me to have a look at the timers.  There ARE some doubled up timers there, where only one has the blue IcetV star, however there are also some single timers without the star.  What does that mean?

One thing it means is that I was missing some information about the problem. I though that the visible issue was that you'd end up with doubled (or multiple) recordings of the same show, with all but one without the "IceTV star". I was puzzled by that because I thought that the underlying cause might also sometimes leave recordings without the star and no duplicates, and now I know that it does.

The problem underlying this is a bit nasty, because it seems to be a two-step thing.

I can easily replicate part 1 of the problem, but I haven't been able to replicate part 2. The hint from the screenshot may help me replicate part 2 of the problem. If I can do that I can be more certain about whether I've fixed the bug completely. Fixing part 1 alone would probably help with reducing how often part 2 happens, but that would leave everyone with this weird bug that happens very infrequently.

Another oddity is that some people seem to see this problem quite a bit (like yourself), but others (like me) pretty much never see it. That means that there's something to do with the particular usage patterns between the two groups that can trigger the problem. One thing that can trigger both part 1 and part 2 of the bug is a network dropout, which is why I asked about whether you have WiFi.

BTW: I'm sure you've worked this out already, but the simplest thing to do in cases where you have a timer for a recording, but it's not marked with the blue star, just leave it to record, unless its times are wrong enough that your padding won't take care of it.
Title: Re: Doubled up recording
Post by: csutak40 on February 25, 2019, 03:21:31 PM


BTW: I'm sure you've worked this out already, but the simplest thing to do in cases where you have a timer for a recording, but it's not marked with the blue star, just leave it to record, unless its times are wrong enough that your padding won't take care of it.
Yeah, that's what I've been doing.
Incidentally, about to change to NBN, wonder if that will improve things?
Title: Re: Doubled up recording
Post by: IanL-S on February 25, 2019, 05:23:53 PM
Incidentally, about to change to NBN, wonder if that will improve things?
[/quote]

Depends on the version of nbn - FTTH is best, and FTTN is the worst (can be worse than ASDL). As far as I can work out FTTC should be better. HFC theoretically should be as good as FTTH (in short term), but some (few?) users are having problems with modem rebooting (and generally causing havoc). The cause can be hard to pin down, making it difficult in some cases to resolve. On the other hand, Telstra HFC is much more reliable and does not exhibit these issues. The only outages I have had recently have been due to power failures or network maintenance (latter probably related to work for nbn).
Title: Re: Doubled up recording
Post by: csutak40 on February 25, 2019, 05:45:06 PM
Incidentally, about to change to NBN, wonder if that will improve things?

Depends on the version of nbn - FTTH is best, and FTTN is the worst (can be worse than ASDL). As far as I can work out FTTC should be better. HFC theoretically should be as good as FTTH (in short term), but some (few?) users are having problems with modem rebooting (and generally causing havoc). The cause can be hard to pin down, making it difficult in some cases to resolve. On the other hand, Telstra HFC is much more reliable and does not exhibit these issues. The only outages I have had recently have been due to power failures or network maintenance (latter probably related to work for nbn).
[/quote]
It will be FTTC  It is ready to be installed, just going through my emails to change all the ones that are registered with my ISP as I intend to go to a different RSP
There is something going on with my current router (and it isn't the router - tested another) when doing a speed test, it often crashes during the upload test.  Spent hours on the phone with TPG, got nowhere. Naturally, it is working fine ATM :-) https://www.speedtest.net/result/8067558958.png
BTW,  I really think it must have something to do with old timers not being deleted.
Just started watching the Blacklist and I saw there were two recordings, which I presumed was correct (they often show two episodes)  Turns out it wasn't :-)
Title: Re: Doubled up recording
Post by: prl on February 25, 2019, 06:22:25 PM
Incidentally, about to change to NBN, wonder if that will improve things?

It may. I don't really have a "smoking gun" for the exact triggers for the problem. The unnecessary delete/recreate of the timers can also be triggered by a Send all timers from the IceTV side, but I don't yet know how it goes from that issue to the messed up timer lists.
Title: Re: Doubled up recording
Post by: csutak40 on February 25, 2019, 09:40:14 PM
Just for something different.  >:(  It is now happening on the T2 as well (hardly record anything on that)
Title: Re: Doubled up recording
Post by: prl on February 25, 2019, 10:48:43 PM
I don't think there's anything about the bug that would restrict it to one Beyonwiz model. The number of IceTV recordings you have for a device may influence how often the problem happens.
Title: Re: Doubled up recording
Post by: csutak40 on March 06, 2019, 11:12:14 PM
Have you gotten any further with this Peter?
It is still happening.  Rather, not so much doubling up as shows being recorded under a different name (the name is the show I had scheduled, but the actual show recorded is something different.)  No way of knowing of course if the show was on at a different time and I've missed it or just got cancelled
For instance (just got around to watching it today) Changing Rooms supposedly recorded on Friday and Saturday at 7.30, but what actually recorded was Graham Norton and Ambulance Australia. (no great loss with this particular show ;D)  Come to think of it, Graham Norton also recorded under its correct title, watched that days ago.
Quite possibly Changing Rooms has been axed (not really surprised  :D) as it is not scheduled at all for this week
Another thing that I am not sure about...  Just watched Counterpart that was on last Thursday.  I am convinced that I've missed an episode, as things just weren't making sense  :P  I seem to remember that one of the "problem" shows the previous week was Counterpart
Title: Re: Doubled up recording
Post by: prl on March 07, 2019, 05:40:33 PM
Hi, Judy.

There are two (probably related) bugs here. One is that there's a bug that whenever IceTV sends all of your current timers (e.g. after a "Resend all timers"), the Beyonwiz does delete/recreate operations with the IceTV server on all timers in the list sent from the server, even ones that are unchanged by the new lot of "set timer" messages. As well as being triggered by "Resend all timers", this can also be triggered if an IceTV update fetch fails (e.g. because of a network problem). This bug is only apparent from looking at the debug logs either on the Beyonwiz or on the IceTV server. You'd normally not see any effect on the Beyonwiz user interface, other than it running a bit slower than it should.

The second bug is that it appears that sometimes when a delete/recreate operation is done for a timer, one or other part of the pair can fail. If the delete fails, you get two recording timers, one with the IceTV "star", and the other (the older one) without it. If the "recreate" fails, then the old timer loses its IceTV "star" and the new timer isn't created. I think you've seen both of those cases. This bug may also be being triggered by a network failure.

The possibility of the cause being a network dropout is why I asked about whether you were using WiFi to connect your T2.

I've been able to replicate the first bug. However, I tried forcing the first bug on a realistic timer load (47 timers - the timer load that was then current on our in-use T4) doing the unnecessary delete/recreate of all those timers 100 times over (yes, it was a bit tedious :)) without seeing any instance of the second bug. It may be that the second bug can only be triggered by a network problem.

My current state on this is that I've fixed the bug that causes unnecessary delete/recreates for IceTV timers on the Beyonwiz on my test version of the Beyonwiz IceTV plugin. That was relatively simple. On the way I also found two other minor and unrelated bugs and fixed them. I could not find any cause for the second bug other than the possibility of a networking error, either by stress-testing (as above), or by examining the code.

However, because the fix of the first bug will remove unnecessary delete/recreates I hope that the likelihood of the second error happening will be much reduced. I'm sorry that I can't promise more.

The current state is that I intended to test my modifications on our in-use T4 today, but other things have intervened. I will try to get that going on tomorrow. I'll also make the new version available to Daniel to try if he wants to.

Once I've run that for a few days without problems, I'll submit the fix to the code repository. From there it will need to wait until peteru accepts the changes and builds a firmware release containing them. He's very busy with other stuff at the moment, but I'll ask him if he could make time. In the short term, you may need to run public beta firmware for a while to take advantage of the changes. It will depend on how long it takes between having the changes in public beta to when they are released as official firmware.

Daniel - please get in touch if you'd like a patch kit with the changes.
Title: Re: Doubled up recording
Post by: csutak40 on March 07, 2019, 07:05:00 PM
Thank you, Peter.  I should be changing to NBN (and a new router) in the next week or two, so will be intrested to see if anything changes (for the better or worse :-\)
Title: Re: Doubled up recording
Post by: prl on March 07, 2019, 07:16:06 PM
Since you're getting FTTC delivery of NBN, you'll probably get reasonably reliable networking.
Title: Re: Doubled up recording
Post by: prl on March 08, 2019, 04:12:06 PM
Hi, Judy.

I just installed a test version of my IceTV fixes on our in-use Beyonwiz T4. I'll submit the changes in a few days if the tests go OK.
Title: Re: Doubled up recording
Post by: csutak40 on March 09, 2019, 01:49:01 AM
Thank you, Peter
Title: Re: Doubled up recording
Post by: prl on March 17, 2019, 12:59:52 PM
I've submitted a fix to eliminate the unnecessary delete/recreate operations that happen when IceTV sends a timer update, but the timer details have not changed.

Daniel, the version number for the updated Beyonwiz IceTV plugin is 20190308. If IceTV sends the Beyonwiz a "record" timer but the timer id already exists and the message from the IceTV server doesn't change the Beyonwiz timer, the Beyonwiz response for the "record" timer is
iceTimer["state"] = "pending"
iceTimer["message"] = "Timer already up to date Show Name"

If the timer is in fact already running, its state will be updated to "running" shortly after this response.
Title: Re: Doubled up recording
Post by: IanL-S on March 18, 2019, 08:53:41 AM
Thanks for the update. Look for to the new version.

Ian
Title: Re: Doubled up recording
Post by: prl on March 18, 2019, 01:56:32 PM
My changes have been merged into the Beyonwiz source code repository, but I'm not sure when they will be available in a release (beta or official).
Title: Re: Doubled up recording
Post by: csutak40 on March 19, 2019, 12:09:43 AM
I am not sure if I am misunderstanding things, or if this is something different.  I was looking at the timers to see if there is anything doubled up and delete one of them. 
Then I did something i haven't done before (I usually only notice something doubling up after it has recorded)  I looked on the IceTV web page and it is doubled up there as well!  Has this always been the case, or is this something new?
Also, it is really weird.  It has been behaving reasonably well lately, then last Thursday there were four shows doubled up.  Then it stopped again
Title: Re: Doubled up recording
Post by: IanL-S on March 19, 2019, 07:37:57 AM
Judy I have seen this before; but my recollection is that it is not always limited to Beyonwiz - I am sure I've had it happen on a Toppy.

Ian
Title: Re: Doubled up recording
Post by: Daniel Hall at IceTV on March 19, 2019, 09:36:28 AM
I am not sure if I am misunderstanding things, or if this is something different.  I was looking at the timers to see if there is anything doubled up and delete one of them. 
Then I did something i haven't done before (I usually only notice something doubling up after it has recorded)  I looked on the IceTV web page and it is doubled up there as well!  Has this always been the case, or is this something new?
Also, it is really weird.  It has been behaving reasonably well lately, then last Thursday there were four shows doubled up.  Then it stopped again

This can happen if there is incorrectly two timers that overlap for a given show, and for this show I can definitely see it was affected by the particular issue that was fixed in the update from prl.

For these ones it would likely be that each of the timers within the IceTV database had to have had different durations (it won't allow having multiple timers for the same channel, start time and duration in the database at once), and it was displaying both of these timers on the website for you.

This one should hopefully fixed when the new plugin is pushed out via a firmware update.