IceTV Forum

IceTV Guide for IceTV enabled PVRs => Beyonwiz => Topic started by: Brainz on October 25, 2024, 10:00:39 AM

Title: Missing ABC Content in EPG
Post by: Brainz on October 25, 2024, 10:00:39 AM
I am currently missing EPG data for Brisbane ABC channels on my V2 & T2.

ABCTV HD - empty until 23:06 today (25/10)
ABC Kids - empty until 19:06 today, then 00:31 tomorrow
ABC Entertains - empty until 00:22 tomorrow
ABC NEWS - empty until 13:33 today, then 00:10 tomorrow

I have disabled IceTV, deleted timers and resent both box's data and re-enabled IceTV.
Info is still missing. All other providers seem OK.

What has happened?
Title: Re: Missing ABC Content in EPG
Post by: GaiO IceTV on October 25, 2024, 10:25:26 AM
Hi there,
The IceTV guide for Brisbane looks fine from our end so I have asked our CTO Dan to look into your issue.
Cheers Gai
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 25, 2024, 12:21:40 PM
Hi Brainz,

As Gai said the guide data is looking good on the server, I have however restarted one of our caches.

Can you try performing a full reboot on the Beyonwiz (not just into standby, you can also just power it off at the wall to be sure, wait 1 minute and then power it back on) as it performs a full download when it starts back up.
Title: Re: Missing ABC Content in EPG
Post by: BazzaG on October 25, 2024, 12:42:13 PM
Melbourne

Just switched my U4 & TV on and realised that I'm still missing ABC EPG data.

Looking at the IceTV log I see:

25/Oct/2024 @ 11:17:28am
Cannot retrieve channel map: HTTPConnectionPool(hosts='api.icetv.com.au',port=80): Read Time Out. (Read Timeout=10.0)

Before & after the above I see plenty of:

25/Oct/2024 @ 12:32:14

Start Update
Timers Updated OK
EPG Downloaded OK
End Update

However, I'm still missing ABC EPG data.

A manual update @ 12:40 also failed to fill in the missing EPG data.

I'll try a reboot shortly.


* A Reboot did NOT fix the problem.
* A Power cycle did NOT fix the problem (and as expected stuffed the CEC link between the U4 & the TV)

The next EPG item listed for ABC HD is Rage @ 4:59am tomorrow morning.


I also see several odd timers on my U4. None of which I have set myself, nor should they be auto-set:

ABC News
Fri 25.10.2024 18:55 - 25.10.2024 19:53
ABCTV HD
Sammy J
waiting

and

Hard Quiz
Fri 25.10.2024 22:14 - 25.10.2024 23:11
ABCTV HD
Series 2024, Episode 37 - Crisis On Campus
waiting

(This correctly shows as a repeat in the IceTV online guide)

ABC Late News
Fri 25.10.2024 22:46 - 25.10.2024 23:28
ABCTV HD
Series 2024, Episode 38
waiting

The Larkins
Fri 25.10.2024 23:03 - 26.10.2024 00:16
ABCTV HD
Series 17, Episode 20 - Health Special
waiting

(Also as a repeat in the IceTV online guide).

And here's 2 more:

Weekend Breakfast
Sun 27.10.2024 06:55 - 27.10.2024 09:22
ABCTV HD
Poh Ling Yeow
waiting

Compass
Sun 27.10.2024 10:56 - 27.10.2024 11:50
ABCTV HD
Beechworth, VIC
waiting

Can I please have a update on this problem.

Thanks Muchly.
Title: Re: Missing ABC Content in EPG
Post by: BazzaG on October 25, 2024, 01:15:05 PM
Another update...

The ABC guide is also bad for Saturday & Sunday, particularly for the ABC HD channel.

From what I can see the ABC EPG data comes "good" from 00:00 Monday 28th.
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 25, 2024, 04:05:55 PM
We are investigating and will have an update asap.
Title: Re: Missing ABC Content in EPG
Post by: BazzaG on October 25, 2024, 04:13:15 PM
Thanks Daniel.

At least I can still add timers from the online EPG guide.
Title: Re: Missing ABC Content in EPG
Post by: Brainz on October 25, 2024, 06:49:34 PM
I have returned home after a few hours out.
I have powered down both boxes and restarted them.  I do this twice a a day at least anyway.
No change to missing data.
See attachment
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 25, 2024, 07:06:52 PM
Hmm, this is definitely weird.

Are you able to grab the DVB Triplets on the box, as at the moment it is looking to be on the Beyonwiz boxes and I can't replicate it on an IceBox right now and checking the feed manually and the guide data is being sent correctly.

Can you please reply with the following ID numbers for each channel on your Beyonwiz, specifically each of the ABC channels.

TSID
ONID
SID

To get these id numbers for each ABC channel please do the following:

First you will need to make sure that you are in Intermediate or Expert mode.

In T4, T2 and recent T3 software versions go to 'Menu > System > GUI Settings' and change the 'Setup Mode' to Expert.
In older T3 software versions go to 'Menu > System > OSD Settings' and change the 'GUI Mode' to Expert.

Now you are ready to write down the TSID, ONID and SID numbers.

Change channel to one of those channels that has no IceTV guide data.
Exit any menus, EPGs and guides etc. i.e. Go to live TV.
Go to 'Menu > Information > Service'.
Once you are in the 'Information > Service' menu, press the Green button.
Now note the TSID, ONID and SID details shown for this channel.
Repeat steps 1 to 5 for all of the ABC channels.

Then reply to this email with the ID numbers, Channel Name and Channel Number that you wrote down from the steps above for each of the ABC channels.
Title: Re: Missing ABC Content in EPG
Post by: BazzaG on October 25, 2024, 07:48:35 PM
Daniel,

Not sure who you were talking to directly but here's my info taken via OpenWebif (so much easier than via the U4 menu):

Name: ABCTV HD    Provider: ABC    Namespace: 4008574976 (eeee0000)
Video Width: 1920    Video Height: 1080    Video Wide: True
Encrypted: 0    Dolby: False    Subservices: False
Teletext: 2322    Recording Status: True    Pmtpid: 263 (0107)
Apid: 2321 (0911)    Vpid: 2320 (0910)    Pcrpid: 2325 (0915)

Tsid: 561 (0231)    Onid: 4112 (1010)    Sid: 565 (0235)

Sref: 1_0_19_235_231_1010_EEEE0000_0_0_0    1:0:19:235:231:1010:EEEE0000:0:0:0:    DVB-T


Name: ABC Kids/ABC Family    Provider: ABC    Namespace: 4008574976 (eeee0000)
Video Width: 720    Video Height: 576    Video Wide: True
Encrypted: 0    Dolby: False    Subservices: False
Teletext: 2310    Recording Status: True    Pmtpid: 257 (0101)
Apid: 2308 (0904)    Vpid: 2307 (0903)    Pcrpid: 2306 (0902)

Tsid: 561 (0231)    Onid: 4112 (1010)    Sid: 562 (0232)

Sref: 1_0_1_232_231_1010_EEEE0000_0_0_0    1:0:1:232:231:1010:EEEE0000:0:0:0:    DVB-T


Name: ABC Entertains    Provider: ABC    Namespace: 4008574976 (eeee0000)
Video Width: 720    Video Height: 576    Video Wide: True
Encrypted: 0    Dolby: False    Subservices: False
Teletext: 2313    Recording Status: True    Pmtpid: 262 (0106)
Apid: 2312 (0908)    Vpid: 2311 (0907)    Pcrpid: 2319 (090f)

Tsid: 561 (0231)    Onid: 4112 (1010)    Sid: 564 (0234)

Sref: 1_0_1_234_231_1010_EEEE0000_0_0_0    1:0:1:234:231:1010:EEEE0000:0:0:0:    DVB-T


Name: ABC NEWS    Provider: ABC    Namespace: 4008574976 (eeee0000)
Video Width: 720    Video Height: 576    Video Wide: True
Encrypted: 0    Dolby: False    Subservices: False
Teletext: 2316    Recording Status: True    Pmtpid: 258 (0102)
Apid: 2315 (090b)    Vpid: 2314 (090a)    Pcrpid: 2309 (0905)

Tsid: 561 (0231)    Onid: 4112 (1010)    Sid: 560 (0230)

Sref: 1_0_1_230_231_1010_EEEE0000_0_0_0    1:0:1:230:231:1010:EEEE0000:0:0:0:    DVB-T

As of Friday, ABC News is the only ABC channel that has any meaningful EPG data.

If I click to look at the EPG for Saturday, then ABC News completely disappears for the whole day. It's back on Sunday.

Cheers
Barry...
Title: Re: Missing ABC Content in EPG
Post by: prl on October 25, 2024, 07:53:49 PM
I'm missing all EPG data for ABC Canberra except ABC News, but I'm not seeing the "channel map" error in the IceTV log.

The only EPG errors I'm seeing are invalid program lengths for the Kelly Carson Show and House Hunters International, which I don't think are ABC shows.
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 25, 2024, 09:20:51 PM
Quote from: BazzaG on October 25, 2024, 07:48:35 PMDaniel,

Not sure who you were talking to directly but here's my info taken via OpenWebif (so much easier than via the U4 menu):

Name: ABCTV HD    Provider: ABC    Namespace: 4008574976 (eeee0000)
Video Width: 1920    Video Height: 1080    Video Wide: True
Encrypted: 0    Dolby: False    Subservices: False
Teletext: 2322    Recording Status: True    Pmtpid: 263 (0107)
Apid: 2321 (0911)    Vpid: 2320 (0910)    Pcrpid: 2325 (0915)

Tsid: 561 (0231)    Onid: 4112 (1010)    Sid: 565 (0235)

Sref: 1_0_19_235_231_1010_EEEE0000_0_0_0    1:0:19:235:231:1010:EEEE0000:0:0:0:    DVB-T


Name: ABC Kids/ABC Family    Provider: ABC    Namespace: 4008574976 (eeee0000)
Video Width: 720    Video Height: 576    Video Wide: True
Encrypted: 0    Dolby: False    Subservices: False
Teletext: 2310    Recording Status: True    Pmtpid: 257 (0101)
Apid: 2308 (0904)    Vpid: 2307 (0903)    Pcrpid: 2306 (0902)

Tsid: 561 (0231)    Onid: 4112 (1010)    Sid: 562 (0232)

Sref: 1_0_1_232_231_1010_EEEE0000_0_0_0    1:0:1:232:231:1010:EEEE0000:0:0:0:    DVB-T


Name: ABC Entertains    Provider: ABC    Namespace: 4008574976 (eeee0000)
Video Width: 720    Video Height: 576    Video Wide: True
Encrypted: 0    Dolby: False    Subservices: False
Teletext: 2313    Recording Status: True    Pmtpid: 262 (0106)
Apid: 2312 (0908)    Vpid: 2311 (0907)    Pcrpid: 2319 (090f)

Tsid: 561 (0231)    Onid: 4112 (1010)    Sid: 564 (0234)

Sref: 1_0_1_234_231_1010_EEEE0000_0_0_0    1:0:1:234:231:1010:EEEE0000:0:0:0:    DVB-T


Name: ABC NEWS    Provider: ABC    Namespace: 4008574976 (eeee0000)
Video Width: 720    Video Height: 576    Video Wide: True
Encrypted: 0    Dolby: False    Subservices: False
Teletext: 2316    Recording Status: True    Pmtpid: 258 (0102)
Apid: 2315 (090b)    Vpid: 2314 (090a)    Pcrpid: 2309 (0905)

Tsid: 561 (0231)    Onid: 4112 (1010)    Sid: 560 (0230)

Sref: 1_0_1_230_231_1010_EEEE0000_0_0_0    1:0:1:230:231:1010:EEEE0000:0:0:0:    DVB-T

As of Friday, ABC News is the only ABC channel that has any meaningful EPG data.

If I click to look at the EPG for Saturday, then ABC News completely disappears for the whole day. It's back on Sunday.

Cheers
Barry...


These ones do match up to what we have, so nothing has changed there which is good.
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 25, 2024, 09:21:53 PM
Quote from: prl on October 25, 2024, 07:53:49 PMI'm missing all EPG data for ABC Canberra except ABC News, but I'm not seeing the "channel map" error in the IceTV log.

The only EPG errors I'm seeing are invalid program lengths for the Kelly Carson Show and House Hunters International, which I don't think are ABC shows.

Is there anything else you can see on the machine, looking at the feed the guide data is there and other recorders are looking fine using the same API.
Title: Re: Missing ABC Content in EPG
Post by: Brainz on October 25, 2024, 09:26:01 PM
Data from OWIF for my missing channels is as follows:

Name: ABCTV HD    Provider: ABC    Namespace: 4008574976 (eeee0000)
Tsid: 577 (0241)    Onid: 4112 (1010)    Sid: 581 (0245)

Name: ABC Kids/ABC Family    Provider: ABC    Namespace: 4008574976 (eeee0000)
Tsid: 577 (0241)    Onid: 4112 (1010)    Sid: 578 (0242)

Name: ABC Entertains    Provider: ABC    Namespace: 4008574976 (eeee0000)
Tsid: 577 (0241)    Onid: 4112 (1010)    Sid: 580 (0244)

Name: ABC NEWS    Provider: ABC    Namespace: 4008574976 (eeee0000)
Tsid: 577 (0241)    Onid: 4112 (1010)    Sid: 576 (0240)

Cheers
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 25, 2024, 10:01:55 PM
Quote from: Brainz on October 25, 2024, 09:26:01 PMData from OWIF for my missing channels is as follows:

Name: ABCTV HD    Provider: ABC    Namespace: 4008574976 (eeee0000)
Tsid: 577 (0241)    Onid: 4112 (1010)    Sid: 581 (0245)

Name: ABC Kids/ABC Family    Provider: ABC    Namespace: 4008574976 (eeee0000)
Tsid: 577 (0241)    Onid: 4112 (1010)    Sid: 578 (0242)

Name: ABC Entertains    Provider: ABC    Namespace: 4008574976 (eeee0000)
Tsid: 577 (0241)    Onid: 4112 (1010)    Sid: 580 (0244)

Name: ABC NEWS    Provider: ABC    Namespace: 4008574976 (eeee0000)
Tsid: 577 (0241)    Onid: 4112 (1010)    Sid: 576 (0240)

Cheers

Thanks for that, and this confirms that nothing has changed in the broadcast details, but it is looking more and more specific to the Beyonwiz T/U/V series devices.
Title: Re: Missing ABC Content in EPG
Post by: prl on October 25, 2024, 10:29:16 PM
Hi, Daniel. I just tried looked at the IceTV EPG on my test V2, and it's the same as our in-use T4: no ABC EPG except for ABC News. I also checked my server-side channel settings on my IceTV account page, and there doesn't seem to be anything haywire there.

There were no errors in the IceTV log apart from the two \show duration errors that I mentioned earlier.

I'll check again in the morning and if the problem's still there, I'll enable IceTV debugging to get a snapshot of the JSON data and see if I can find anything there.
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 26, 2024, 09:17:22 AM
Quote from: prl on October 25, 2024, 10:29:16 PMHi, Daniel. I just tried looked at the IceTV EPG on my test V2, and it's the same as our in-use T4: no ABC EPG except for ABC News. I also checked my server-side channel settings on my IceTV account page, and there doesn't seem to be anything haywire there.

There were no errors in the IceTV log apart from the two \show duration errors that I mentioned earlier.

I'll check again in the morning and if the problem's still there, I'll enable IceTV debugging to get a snapshot of the JSON data and see if I can find anything there.

If you could have a look that would be great, as looking at the json feed in use, the guide data is in it and correct.
Title: Re: Missing ABC Content in EPG
Post by: prl on October 26, 2024, 10:50:44 AM
Hi, Daniel.

I did a wget fetch of the IceTV data for Canberra, and it seems that there is data for all of the ABC channels, but when I look at the EPG on my test V2, it's evident that the data for the ABC channels is incomplete.

I'll send you a copy of the wget fetchs by email, if you like. I'll look at writing a python script to search for gaps if you think that that will help.

The two shows that have bad durations (and are probably due to an unrelated issue) are:
            "channel_id": "2821",
            "id": "187253428",
            "title": "The Kelly Clarkson Show",
            "start": "2024-10-25T21:30:00+00:00",
            "start_unix": "1729891800",
            "stop": "2035-10-28T19:32:00+00:00", <<<<<<<<<
            "stop_unix": "2077212720", <<<<<<<<<

            "channel_id": "2736",
            "id": "187273799",
            "title": "House Hunters International",
            "start": "2024-10-26T16:30:00+00:00",
            "start_unix": "1729960200",
            "stop": "2035-10-28T19:32:00+00:00", <<<<<<<<<
            "stop_unix": "2077212720", <<<<<<<<<

It's interesting that the two incorrect stop times are exactly the same.
Title: Re: Missing ABC Content in EPG
Post by: prl on October 26, 2024, 11:04:50 AM
Hi, Daniel, I've emailed you a copy of the wget fetch of the Canberra IceTV data. You should be able to find the two shows with the bad stop times in the fetch data by using the show ids in my previous post. Both shows have stop times 11 years in the future.
Title: Re: Missing ABC Content in EPG
Post by: MD on October 26, 2024, 11:35:57 AM
Hi everyone and thank you for your help.  Daniel is driving at the moment but will look at the wget etc when he arrives and get back onto a solution hopefully later today
Title: Re: Missing ABC Content in EPG
Post by: prl on October 26, 2024, 12:11:50 PM
Quote from: prl on October 26, 2024, 10:50:44 AMI'll look at writing a python script to search for gaps if you think that that will help.

I've done that now, and while the script finds the bad stop times for the two shows with bad stop times, and it finds a gap if I delete a show from the data, it doesn't find any gaps in the JSON IceTV EPG data for Canberra.
Title: Re: Missing ABC Content in EPG
Post by: IanL-S on October 26, 2024, 12:23:27 PM
@Daniel Hall, I have not noticed anything astray on my T2s, U4 or V2 - but I have been dealing the the consequences of a power failure last night - had to re-enter the password for each unit (and one T2 was being decidedly bloody-minded). I will check and report back.

Other than getting a UPS, is there any way of preserving the password when there is a power failure?

Ian
Title: Re: Missing ABC Content in EPG
Post by: IanL-S on October 26, 2024, 12:41:02 PM
I am missing ABC network EPG data on the V2 and U4 up until at least midnight today. Assume the same for the T2. Fortunately the IceBox is not affected.

Toppys have completely blank EPG probably leftover from power outage.
 
Title: Re: Missing ABC Content in EPG
Post by: prl on October 26, 2024, 12:43:06 PM
Quote from: IanL-S on October 26, 2024, 12:23:27 PMOther than getting a UPS, is there any way of preserving the password when there is a power failure?

The password isn't stored on the Beyonwiz, only the EPG server access token. It should be saved in the settings file (/etc/enigma2/settings) each time it is fetched from IceTV.

If you didn't restore settings, or you restored a very old settings file or one from when IceTV hadn't been set up, you may have had a stale token, or no token in the settings file.

The stored token looks like this:
config.plugins.icetv.member.token=XXXXXXXX-XXXX-XXXX-XXXX-XXXXXXXXXXXX
Where the Xs are (lower-case) hexadecimal digits.
Title: Re: Missing ABC Content in EPG
Post by: prl on October 26, 2024, 12:56:33 PM
Quote from: prl on October 26, 2024, 12:11:50 PMI've done that now, and while the script finds the bad stop times for the two shows with bad stop times, and it finds a gap if I delete a show from the data, it doesn't find any gaps in the JSON IceTV EPG data for Canberra.

I've now also grabbed a copy of the raw IceTV JSON from my test V2 and checked it for gaps in the ABC data and found none. Both the script and the IceTV log still show the stop time/duration error on the Kelly Clarkson episode, but not the House Hunters International episode that previously had the bad stop time/duration.
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 26, 2024, 01:52:36 PM
Quote from: prl on October 26, 2024, 12:56:33 PM
Quote from: prl on October 26, 2024, 12:11:50 PMI've done that now, and while the script finds the bad stop times for the two shows with bad stop times, and it finds a gap if I delete a show from the data, it doesn't find any gaps in the JSON IceTV EPG data for Canberra.

I've now also grabbed a copy of the raw IceTV JSON from my test V2 and checked it for gaps in the ABC data and found none. Both the script and the IceTV log still show the stop time/duration error on the Kelly Clarkson episode, but not the House Hunters International episode that previously had the bad stop time/duration.

The thing is though, these are not shows on ABC, and the same feed is in use by the IceBoxes, and Humax 2Tune boxes as well, but it's only happening for ABC network channels and for Beyonwiz T/U/V series boxes.

I am not at home to be able to test with a V2 at the moment but can later on tonight.
Title: Re: Missing ABC Content in EPG
Post by: prl on October 26, 2024, 02:21:31 PM
Yes, I've always said that the wildly incorrect stop time errors are unrelated to the missing ABC EPG data.
Title: Re: Missing ABC Content in EPG
Post by: prl on October 26, 2024, 04:12:34 PM
Currently the EPG for ABC TV is empty up to the episode of Rage Guest Programmer (2331-0501 tonight/tomorrow morning), then there are a sequence of missing entries after that early tomorrow morning (Sun 27 Oct), Rage (0501-0600), Rage (0600-0700), Weekend Breakfast (0700-0902). The rest of the day's programming is missing up to Plum (2030-2126), then the EPG is empty from 27/10 2126 - 28/10 0001 when Fires is shown (28/10 0001-0052). From there on, the EPG for ABC TV is OK for the rest of the week.

Looking at the programs I listed that follow Rage Guest Programmer, I can't see anything wrong with the JSON data.

The only IceTV errors in either the onscreen log or the debug log file are for the unrelated stop time problem with the Kelly Carson Show.
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 27, 2024, 04:44:07 PM
I have finally got a fix running now, it is updating all the available data, it will finish in the next 15-20 minutes or so, after that your Beyonwiz should download the updated data automatically.
Title: Re: Missing ABC Content in EPG
Post by: BazzaG on October 27, 2024, 05:34:04 PM
Daniel, thanks for your work, however, looking at the IceTV log:

2024-10-27 17:24:58 - EPG downloaded OK

However, there's no change to the ABC channels (Melbourne).

I can't reboot my U4 at the moment as it's busy recording another channel.

Or should I try something else?
Title: Re: Missing ABC Content in EPG
Post by: IanL-S on October 27, 2024, 06:27:42 PM
Bazza, I assume that you have gone into the IceTV add-on and downloaded the Guide and Timers.
Title: Re: Missing ABC Content in EPG
Post by: IanL-S on October 27, 2024, 08:21:25 PM
I am seeing the same thing in Melbourne - but it appears to be OK on Monday morning. Requesting EPG update does not solve the problem.
Title: Re: Missing ABC Content in EPG
Post by: BazzaG on October 27, 2024, 08:36:58 PM
Quote from: IanL-S on October 27, 2024, 06:27:42 PMBazza, I assume that you have gone into the IceTV add-on and downloaded the Guide and Timers.

Correct. Now 20:36 & still no difference. I haven't double checked but all the ABC channels currently look OK from midnight tonight. My U4 is busy recording various channels until later tonight, so no chance to see if a reboot makes any difference.
Title: Re: Missing ABC Content in EPG
Post by: Daniel Hall at IceTV on October 27, 2024, 09:21:44 PM
It looks like it didn't quite fix it, and have pushed another update now. Please check your Beyonwiz recorders after the next automatic update (there should be no need of manual intervention).
Title: Re: Missing ABC Content in EPG
Post by: BazzaG on October 27, 2024, 09:28:45 PM
EPG data between now & midnight just came through.

Thanks VERY muchly.