Error trying to fetch: Python int too large to convert to C long

Started by franklinoffner, October 25, 2020, 04:08:57 PM

Previous topic - Next topic

franklinoffner

Not getting updates and getting this entry in the ice log after attempting a manual fetch and update.

This is on a Beyonwiz U4 which has been rebooted.

Tried enable/disable to no avail.

Any ideas what to try next?

IceTV version 20191013

Alan
Alan
BeyonWiz T4, BeyonWiz U4.

Daniel Hall at IceTV

This is definitely a weird one, and we have had other reports of this as well and are currently investigating.
Regards,

Daniel.
CTO.

franklinoffner

OK, had a look into the Wiz log file and find this

{868}<    39.497> Unhandled Error
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
   
  File "/usr/lib/python2.7/threading.py", line 754, in run
   
  File "/usr/lib/python2.7/site-packages/twisted/_threads/_threadworker.py", line 46, in work
   
  File "/usr/lib/python2.7/site-packages/twisted/_threads/_team.py", line 190, in doWork
   
--- <exception caught here> ---
  File "/usr/lib/python2.7/site-packages/twisted/python/threadpool.py", line 250, in inContext
   
  File "/usr/lib/python2.7/site-packages/twisted/python/threadpool.py", line 266, in <lambda>
   
  File "/usr/lib/python2.7/site-packages/twisted/python/context.py", line 122, in callWithContext
   
  File "/usr/lib/python2.7/site-packages/twisted/python/context.py", line 85, in callWithContext
   
  File "/usr/lib/enigma2/python/Plugins/SystemPlugins/IceTV/plugin.py", line 517, in doWork
   
exceptions.OverflowError: Python int too large to convert to C long

Trust that is might help

Alan
Alan
BeyonWiz T4, BeyonWiz U4.

franklinoffner

Incase that it is relevant the U4 is running current beta

System OE:          OE-Alliance 4.3
Firmware version:   beyonwiz 19.3.20201011 (19.3-346-g6461e3a)
Kernel / Drivers:   4.9.51 / 180411-16.4
Alan
BeyonWiz T4, BeyonWiz U4.

grumpy_geoff

I believe the issue started occurring last evening (AWST).

Did IceTV add a new genre?

{780}< 46871.718> [IceTV] 2020-10-24 20:56:11: EPG download OK
{780}< 46871.718> [IceTV] 2020-10-24 20:56:11: Timers updated OK
{780}< 46871.719> [IceTV] 2020-10-24 20:56:11: End update
...
{780}< 47770.899> [IceTV] 2020-10-24 21:11:11: Start update
{780}< 47771.889> [EPGFetcher] ERROR: lookup of 0x20 "Current Affairs" returned "News"
{780}< 47771.897> [EPGFetcher] ERROR: lookup of 0x10 "Drama" returned "Movie"
{780}< 47771.900> [EPGFetcher] ERROR: lookup of 0x10 "Drama" returned "Movie"
{780}< 47771.901> [EPGFetcher] ERROR: lookup of 0x11 "Mystery" returned "Crime"
{780}< 47771.901> [EPGFetcher] ERROR: lookup of 0x01 "Violence" returned "Cult"
...
{780}< 47773.568> [EPGFetcher] ERROR: lookup of 0x01 "Renovation" returned "Cult"
{780}< 47773.573> [EPGFetcher] ERROR: lookup of 0xa0 "Lifestyle" returned "Infotainment"
{780}< 47773.576> [EPGFetcher] ERROR: lookup of 0xa0 "Lifestyle" returned "Infotainment"
{780}< 47773.578> [EPGFetcher] ERROR: lookup of 0xa0 "Lifestyle" returned "Infotainment"
{780}< 47773.579> [EPGFetcher] ERROR: lookup of 0x01 "Renovation" returned "Cult"
{780}< 47773.629> /usr/lib/enigma2/python/Plugins/SystemPlugins/IceTV/plugin.py:517: RuntimeWarning: tp_compare didn't return -1 or -2 for exception
{780}< 47773.649> Unhandled Error
Traceback (most recent call last):
  File "/usr/lib/python2.7/threading.py", line 801, in __bootstrap_inner
   
  File "/usr/lib/python2.7/threading.py", line 754, in run
   
  File "/usr/lib/python2.7/site-packages/twisted/_threads/_threadworker.py", line 46, in work
   
  File "/usr/lib/python2.7/site-packages/twisted/_threads/_team.py", line 190, in doWork
   
--- <exception caught here> ---
  File "/usr/lib/python2.7/site-packages/twisted/python/threadpool.py", line 250, in inContext
   
  File "/usr/lib/python2.7/site-packages/twisted/python/threadpool.py", line 266, in <lambda>
   
  File "/usr/lib/python2.7/site-packages/twisted/python/context.py", line 122, in callWithContext
   
  File "/usr/lib/python2.7/site-packages/twisted/python/context.py", line 85, in callWithContext
   
  File "/usr/lib/enigma2/python/Plugins/SystemPlugins/IceTV/plugin.py", line 517, in doWork
   
exceptions.OverflowError: Python int too large to convert to C long

Daniel Hall at IceTV

We have not added a new genre, but it is also now fixed, we will keep investigating to try and find the root cause, but it is now working.
Regards,

Daniel.
CTO.

franklinoffner

I can confirm working.  EPG and timers now loaded on our U4.

Many thanks for such quick response.

Alan.
Alan
BeyonWiz T4, BeyonWiz U4.

grampus

+1.   :)
both my devices are now updating ok now.
thanks.
Phew.
BeyonWiz, T3

JPP

I think the issue is back again. First sign was frozen remote, then spinning wheel and then reboot.

The T2 has been running continuously since I re-enabled ICETV around 3pm. If it is an issue to do with memory creep/depletion, this maybe of some help in nailing down the problem.
Phil.
Beyonwiz T2, DVDO Duo Video Processor

Daniel Hall at IceTV

Quote from: JPP on October 25, 2020, 09:10:07 PM
I think the issue is back again. First sign was frozen remote, then spinning wheel and then reboot.

The T2 has been running continuously since I re-enabled ICETV around 3pm. If it is an issue to do with memory creep/depletion, this maybe of some help in nailing down the problem.

I tested late last night and could not replicate it (which I could earlier in the day), is there anything in the debug logs.
Regards,

Daniel.
CTO.

grampus

Both my U4 and T3 were left in standby all night, each with multiple recordings scheduled during the night.
All indications this morning were that there were no disruptions in Ice log, and all recordings competed with no sign of disruption.
BTW, I have my Ice interval set at 15 minutes.   Probably too much information, but just in case someone might have mentally gone down that path

Since around 8AM today I have put them both to normal use.  Just rechecked (at 10 AM) once again with no disruptions
Fingers crossed.
BeyonWiz, T3

prl

IceTV have added quite a few new genres, but currently only one of the new genres is being used in the EPG ("Politics", currently being used on "QLD Votes 2020" and "Biden V Trump: The Choice 2020").

Somehow, the "Motorsport" genre also got added, when there was already a "Motor Sport" genre. The "Motorsport" genre has been removed.

The genre errors that grumpy_geoff reported, though, seem to be due to whatever was happening to the IceTV server yesterday, possibly down to strange things in the EPG, but unfortunately there wasn't enough time to dig into the problem to nail down the exact cause (and I never saw those errors).

The debug log errors that the "Motorsport" and "Politics" genres caused were:
{642}<  7279.226> [EPGFetcher] ERROR: lookup of 0x47 "Motorsport" returned "Motor Sport"
{642}<  7285.871> [EPGFetcher] ERROR: lookup of 0x01 "Politics" returned "Cult"


Now that the "Motorsport" genre has been removed, I'm now only getting the error for the "Politics" genre. The error is handled by ignoring the unrecognised genre and not putting it into the EPG.

I have submitted an update of the IceTV plugin with the updated genre tables to the Beyonwiz code repository.
Peter
Beyonwiz T4 in-use
Beyonwiz T2, T3, T4, U4 & V2 for testing

grumpy_geoff

Quote from: prl on October 26, 2020, 05:11:51 PM
The genre errors that grumpy_geoff reported, though, seem to be due to whatever was happening to the IceTV server yesterday, possibly down to strange things in the EPG, but unfortunately there wasn't enough time to dig into the problem to nail down the exact cause (and I never saw those errors).

I still get them, e.g. just now there were 2,612 "[EPGFetcher]" entries -

{12595}< 16279.068> [IceTV] 2020-10-26 15:41:05: Start update
{12595}< 16282.929> [EPGFetcher] ERROR: lookup of 0x10 "Drama" returned "Movie"
{12595}< 16282.950> [EPGFetcher] ERROR: lookup of 0x10 "Drama" returned "Movie"
{12595}< 16282.954> [EPGFetcher] ERROR: lookup of 0x10 "Drama" returned "Movie"
...
{12595}< 16295.572> [EPGFetcher] ERROR: lookup of 0x01 "Cycling" returned "Cult"
{12595}< 16295.581> [EPGFetcher] ERROR: lookup of 0x20 "Current Affairs" returned "News"
{12595}< 16295.582> [EPGFetcher] ERROR: lookup of 0x01 "Politics" returned "Cult"
{12595}< 16296.289> [IceTV] 2020-10-26 15:41:23: EPG download OK
{12595}< 16296.322> [RecordTimer] ignore double timer
{12595}< 16296.323> [IceTV] 2020-10-26 15:41:23: Timers updated OK
{12595}< 16296.324> [IceTV] 2020-10-26 15:41:23: End update


Here's the unique set:
[EPGFetcher] ERROR: lookup of 0x01 "Cycling" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x01 "Family" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x01 "Horse Racing" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x01 "Politics" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x01 "Renovation" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x01 "Short Film" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x01 "Special" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x01 "Violence" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x01 "Youth" returned "Cult"
[EPGFetcher] ERROR: lookup of 0x10 "Drama" returned "Movie"
[EPGFetcher] ERROR: lookup of 0x11 "Murder" returned "Crime"
[EPGFetcher] ERROR: lookup of 0x11 "Mystery" returned "Crime"
[EPGFetcher] ERROR: lookup of 0x11 "Thriller" returned "Crime"
[EPGFetcher] ERROR: lookup of 0x12 "Action" returned "Adventure"
[EPGFetcher] ERROR: lookup of 0x12 "War" returned "Adventure"
[EPGFetcher] ERROR: lookup of 0x12 "Western" returned "Adventure"
[EPGFetcher] ERROR: lookup of 0x13 "Fantasy" returned "Sci-Fi"
[EPGFetcher] ERROR: lookup of 0x13 "Horror" returned "Sci-Fi"
[EPGFetcher] ERROR: lookup of 0x14 "Sitcom" returned "Comedy"
[EPGFetcher] ERROR: lookup of 0x20 "Current Affairs" returned "News"
[EPGFetcher] ERROR: lookup of 0x45 "AFL" returned "Football"
[EPGFetcher] ERROR: lookup of 0x45 "American Football" returned "Football"
[EPGFetcher] ERROR: lookup of 0x45 "Baseball" returned "Football"
[EPGFetcher] ERROR: lookup of 0x45 "Cricket" returned "Football"
[EPGFetcher] ERROR: lookup of 0x45 "Netball" returned "Football"
[EPGFetcher] ERROR: lookup of 0x45 "Rugby League" returned "Football"
[EPGFetcher] ERROR: lookup of 0x45 "Rugby" returned "Football"
[EPGFetcher] ERROR: lookup of 0x55 "Cartoon" returned "Animation"
[EPGFetcher] ERROR: lookup of 0x60 "Dance" returned "Music"
[EPGFetcher] ERROR: lookup of 0x60 "Musical" returned "Music"
[EPGFetcher] ERROR: lookup of 0x80 "Business & Finance" returned "Society & Culture"
[EPGFetcher] ERROR: lookup of 0x80 "Parliament" returned "Society & Culture"
[EPGFetcher] ERROR: lookup of 0x90 "Science" returned "Education"
[EPGFetcher] ERROR: lookup of 0xa0 "Fishing" returned "Infotainment"
[EPGFetcher] ERROR: lookup of 0xa0 "Lifestyle" returned "Infotainment"
[EPGFetcher] ERROR: lookup of 0xa5 "Food/Wine" returned "Cooking"

prl

Strange. Tonight I'm only seeing the expected errors on "Politics" (ACT guide).

I assume that you've done a GUI restart (at least) since the problems on Sunday?
Peter
Beyonwiz T4 in-use
Beyonwiz T2, T3, T4, U4 & V2 for testing

grumpy_geoff

Quote from: prl on October 26, 2020, 10:18:39 PM
Strange. Tonight I'm only seeing the expected errors on "Politics" (ACT guide).

I assume that you've done a GUI restart (at least) since the problems on Sunday?

Yes, that was from the first fetch after a GUI restart this 'arvo.

Strictly speaking it was the second fetch, as the first failed with the known "lock held" issue -
  File "/usr/lib/enigma2/python/Plugins/SystemPlugins/IceTV/plugin.py", line 514, in doWork
  File "/usr/lib/enigma2/python/Plugins/Extensions/IceTVDesc/hook.py", line 14, in run
  File "/usr/lib/enigma2/python/Plugins/Extensions/IceTVDesc/hook.py", line 31, in makeChanShowMap
exceptions.ImportError: Failed to import _strptime because the import lockis held by another thread.