IceTV Forum

IceTV Guide for IceTV enabled PVRs => Topfield => Topic started by: Starionx on April 16, 2013, 04:05:26 PM

Title: XML data not updating
Post by: Starionx on April 16, 2013, 04:05:26 PM
I use the Justepg Tap with XMLTV as the source (on a Toppy 2400), and the epg has not updated for 5 days. I don't use Icetv for recordings, just to get the xml data.
In my Icetv account, it shows -

Last EPG fetches:
16 April, 2013 at 03:53pm with Topfield TRF-2400
10 April, 2013 at 05:59pm with XML

There is another 2400 owner who has the exact same problem (no XML update since the 10th).

Anyone else having this problem?
Title: Re: XML data not updating
Post by: ggm@pobox.com on April 16, 2013, 07:29:12 PM
7100hd+ using justepg 17 same. Last XML fetch 11th, ongoing device fetch showing. I have reset justepg to eit data until this resolves.

Is it a coincidence Itopfield web has gone offline?
Title: Re: XML data not updating
Post by: Starionx on April 17, 2013, 03:27:31 AM
In case anyone in Icetv land reads these forums, this is the message that gets returned when the Justepg Tap tries to do an XML fetch -

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>401 Authorization Required</title>
</head><body>
<h1>Authorization Required</h1>
<p>This server could not verify that you
are authorized to access the document
requested.  Either you supplied the wrong
credentials (e.g., bad password), or your
browser doesn't understand how to supply
the credentials required.</p>


<address>Apache/2.2.15 (CentOS) Server at iceguide.icetv.com.au Port 80</address>
</body></html>
Title: Re: XML data not updating
Post by: IanL-S on April 17, 2013, 07:37:56 AM
Quote from: ggm@pobox.com on April 16, 2013, 07:29:12 PM
<<<snip>>>
Is it a coincidence Itopfield web has gone offline?

Yes, just a coincidence. And an annoying one ... well over two weeks now. The site was up for about an hour twice in the intervening period ... usually late in the evening.

Ian
Title: Re: XML data not updating
Post by: Paul55 on April 17, 2013, 07:53:31 AM
I have same problem - no XML on my Toppy 2400 since 10 April. Still getting normal IceTV EPG.
Another user (other than Starionx) has also reported same issue - also Toppy 2400.
Corrupt data?? Bad character in show title??
Doesn't happen often, but damned annoying.
Title: Re: XML data not updating
Post by: Dave at IceTV on April 17, 2013, 12:35:29 PM
Hi guys,

The XML feed is downloading as normal for me in both IE9 and using webget (fetching the Sydney guide data). If anyone is still having a problem please reply with the region that is set in your account, and the ISP and type of Internet connection (ADSL, Cable or 3G/4G Wireless) that you are using.
Title: Re: XML data not updating
Post by: Starionx on April 17, 2013, 01:05:15 PM
Last EPG fetches:

17 April, 2013 at 01:02pm with Topfield TRF-2400
10 April, 2013 at 05:59pm with XML

Region - Sydney
ISP - TPG
Connection - ADSL2+
Title: Re: XML data not updating
Post by: Dave at IceTV on April 17, 2013, 04:37:34 PM
I just validated the current Sydney xml file at www.xmlvalidation.com and it said "No errors were found".

If everyone having an issue is using JustEPG then you may need to talk to the author of JustEPG. It actually seems like a daylight savings issue in JustEPG.
Title: Re: XML data not updating
Post by: Starionx on April 17, 2013, 04:54:10 PM
I think you're right Dave. I've been testing both FTA and ICEtv data and they both come up fine in the original EPG guide. I can sometimes even get Justepg to show the ICEtv data, before it goes through it's data parsing.
The problem I have is that with the Itopfield website in limbo, I don't know how to get in touch with the Justepg author.  :(
Title: Re: XML data not updating
Post by: Starionx on April 17, 2013, 05:35:53 PM
For anyone having this problem, I have a temporary workaround.
Set the IceTV to Enabled in the Toppy settings.
Set the EPG Data Source in JustEpg to EIT+FTAFILE.
You may have to flip the Toppy IceTV setting to disabled/enabled a few times and do the Reset EPG Data (red button) a few times too. It was a little bit flaky for me.

If it works, you will see the program data in JustEpg as normal (almost).
Any repeat programs will actually start with [R] and you will not see any 'repeat colour coding' (if you've set that up). Personally, I think this looks better.
The downside to this fix is that the program description does not have things like Actors, directors, year etc which Justepg would add from the xml data, which we are not getting!
Title: Re: XML data not updating
Post by: markb on April 17, 2013, 06:10:32 PM
Quote from: Starionx on April 17, 2013, 05:35:53 PM
The downside to this fix is that the program description does not have things like Actors, directors, year etc which Justepg would add from the xml data, which we are not getting!

I still don't understand why ICE simply can't append this info to the description text field for Topfield PVRs. I/we've asked plenty of times but never had any clear response. That's an incredibly easy solution which would take a capable developer about 5 mins to add, and does not require any coordination or action by Topfield.
Title: Re: XML data not updating
Post by: Dave at IceTV on April 17, 2013, 06:37:22 PM
Quote from: Starionx on April 17, 2013, 04:54:10 PM
The problem I have is that with the Itopfield website in limbo, I don't know how to get in touch with the Justepg author.  :(
Peter (the JustEPG author) also frequents the DTV forum as pgdownload (http://www.dtvforum.info/index.php?showuser=7970)
Title: Re: XML data not updating
Post by: markb on April 17, 2013, 07:27:31 PM
See what I mean? I'm a ghost it seems :(
Title: Re: XML data not updating
Post by: Starionx on April 17, 2013, 07:33:23 PM
Quote from: Dave at IceTV on April 17, 2013, 06:37:22 PM
Peter (the JustEPG author) also frequents the DTV forum as pgdownload (http://www.dtvforum.info/index.php?showuser=7970)

Actually, Peter is the author of the Toppy 5000 version. He didn't make the changes to the TMS Toppy Justepg version.

Quote from: markb on April 17, 2013, 07:27:31 PM
See what I mean? I'm a ghost it seems :(

LOL.  ;D
Title: Re: XML data not updating
Post by: Starionx on April 17, 2013, 07:56:16 PM
The plot thickens.
There is a post in the whirlpool forums where a reply from Icetv that one of the users got states that they have changed servers.
http://forums.whirlpool.net.au/forum-replies.cfm?t=2086966#r1

The '.INI' file that Justepg users to logon to the Icetv site is as follows

Host=iceguide.icetv.com.au
Path=/cgi-bin/epg/iceguide.cgi?op=xmlguide&desc_length=1500

I take it that this path is now incorrect which is why Justepg is getting an error.

If someone from Icetv could advise what the new path is, we should be able to solve the problem.  :)
Title: Re: XML data not updating
Post by: lukem on April 17, 2013, 08:11:36 PM
If you paste http://iceguide.icetv.com.au/cgi-bin/epg/iceguide.cgi?op=xmlguide&desc_length=1500 into your browser, and enter your username and password when prompted, do you receive the guide?

The above URL works for me.
Title: Re: XML data not updating
Post by: Starionx on April 17, 2013, 08:25:31 PM
CRAP!
Yes, it works. Well I'm running out of ideas.  :(
Title: Re: XML data not updating
Post by: lukem on April 17, 2013, 08:28:30 PM
Is your DNS returning the correct IP address for iceguide.icetv.com.au?

You could also try replace iceguide with www and see if you get the same result.

Are you using a proxy? Does your ISP use a proxy?
Title: Re: XML data not updating
Post by: dfindlay on April 17, 2013, 10:45:01 PM
I would just like to advise that I have the exact same issue.  My region in Melbourne.  ISP is Internode.  There is no proxy either locally or at my ISP.  The XML connection via JustEPG has worked perfectly for years and just stopped working 11 April.  No changes to JuspEPG at my end, so it would seem that something has changed at the IceTV end.

If I manually go to the XML URL in a web browser, it asks for username and password and when I enter them it returns a bunch of data.  But I never tried this prior to 11 April so I am not sure if the behaviour is any different.  Since someone mentioned that the error suggests something about an authorisation issue, my next question to IceTV support guys would be did anything change with your web server authentication protocol??

   Dave
Title: Re: XML data not updating
Post by: Paul55 on April 17, 2013, 10:46:32 PM
Don't know if you still need this;

10 April, 2013 at 10:55pm with XML
17 April, 2013 at 10:26pm with Topfield TRF-2400

Brisbane
bigpond
adsl

I have made no changes to JustEPG for months and my Toppy is accessing the internet normally - including IceTV for 'normal' EPG data.

Daylight saving is not an issue because I live in QLD.
Title: Re: XML data not updating
Post by: Paul55 on April 17, 2013, 10:50:31 PM
Accessed the XML data via the link posted by Luke.
IceTV - My Account, shows it as a fetch.
Title: Re: XML data not updating
Post by: Dave at IceTV on April 18, 2013, 07:55:51 PM
Hi guys,

What's happening is the request for the xml file is arriving from JustEPG without any IceTV login details. Our recent server move seems to have highlighted a bug in JustEPG. We (you) need the current JustEPG author to have a look at how it requests the file download.
Title: Re: XML data not updating
Post by: lukem on April 18, 2013, 08:06:25 PM
I'm thinking out loud here, but I wonder if the bug in JustEPG is related to same bug in the Topfield as to how it handles HTTP headers. HTTP headers can sometimes contain more information when traffic is passed through smart load-balancers. The Topfield does not like this (even though the headers conform to the standard) so we work around the Topfield bug by routing Topfield traffic (which hits remote-topfield.icetv.com.au) through an IP-only load-balancer.

To test this theory, could you please replace iceguide.icetv.com.au in the JustEPG INI file with remote-topfield.icetv.com.au?

Cheers,
Luke
Title: Re: XML data not updating
Post by: Starionx on April 18, 2013, 09:03:13 PM
Quote from: Luke at IceTV on April 18, 2013, 08:06:25 PM
I'm thinking out loud here, but I wonder if the bug in JustEPG is related to same bug in the Topfield as to how it handles HTTP headers. HTTP headers can sometimes contain more information when traffic is passed through smart load-balancers. The Topfield does not like this (even though the headers conform to the standard) so we work around the Topfield bug by routing Topfield traffic (which hits remote-topfield.icetv.com.au) through an IP-only load-balancer.

To test this theory, could you please replace iceguide.icetv.com.au in the JustEPG INI file with remote-topfield.icetv.com.au?

Cheers,
Luke

WooHoo. Works like a charm.
:) :) :) :)
Title: Re: XML data not updating
Post by: Starionx on April 18, 2013, 09:18:37 PM
For those who don't know where to make the change, use the following steps.

You will need to access a file called xmltv.ini. This will be in 'ProgramFiles/Settings/EPG' in the Toppy directory. You will need to access this from an FTP client e.g. Filezilla. The file will have the following data -

[Fetch]
Host=iceguide.icetv.com.au
Path=/cgi-bin/epg/iceguide.cgi?op=xmlguide&desc_length=1500
Username=xxxxxx
Password=xxxxxx

(the username and password will actually have your username and password)


You need to change the 'Host=' line to read -

Host=remote-topfield.icetv.com.au

Save this file. Go into Justepg and change the EPG Data Source back to XMLTV WEB (if you changed this while we had the problem).
If you also disabled the Toppy settings for Icetv, then you will need re-enable it.
Go back to Justepg and reload the EPG.

Sadly, I have to go to work now, so if anyone still has problems, maybe someone else could give them a hand.  :)

Thanks Luke for 'thinking out loud'.  ;D
Title: Re: XML data not updating
Post by: dfindlay on April 18, 2013, 11:18:34 PM
That's fantastic.  Works a charm for me too.   ;D

Thanks a heap to Dave and Luke at IceTV for their attention to this and for everyone working together to find a solution.

Cheers,
   Dave
Title: Re: XML data not updating
Post by: Paul55 on April 19, 2013, 06:24:55 PM
Another confirmed fix here. Took me two goes because I left the .iceguide. in the line. DOH!
Title: Re: XML data not updating
Post by: ggm@pobox.com on April 20, 2013, 12:51:21 PM
instant fix. many thanks.