41 replies to this topic

[ColinB]

Hi Willy,

 

for some reason epg is hasn't dowloaded any epg for UK and Adult. Last good epg is showing programs to Thursday 9th March, so seems like the problem happend over the weekend.

 

I've been using LatinMunic for Spain and it is good, also my filtered Portugal seem normal.

 

cheers Colin

[WanWizard]

I've reported this yesterday. I've got errors in the log saying the downloaded file is not a gzip file, and when I checked the xml for the ones I could unpack, it looked like it was saved with a utf-8 BOM header.

[doglover]

Very curious.

When I run an import from the net i get:

[EPGImport] WakeUpTime now set to 1488874527 (now=1488813300)
[EPGImport] Run check deep standby after import
[EPGImport] nextImport, source= Rytec UK XMLTV
[EPGImport] Downloading: http://www.xxxxxxxxxxxxxxxUK.gz to local path: /tmp/epgimport.gz
[EPGImport] afterDownload /tmp/epgimport.gz
[EPGImport] unlink /tmp/epgimport.gz
[EPGImport] afterChannelDownload None
[EPGImport] Using twisted thread
[XMLTVConverter] Enumerating event information
[EPGImport] ### thread is ready ### Events: 0
[EPGImport] imported 0 events
[EPGImport] Save last import date and count event
[EPGImport] Wait for parse autotimers 30 sec.
[EPGImport] Run start parse autotimers
[EPGImport] #### Finished ####

When I run the import from my local files (which are exactly the same as the ones on the internet) I get a normal import.

Very strange.

 

Tried the upload the local UK file to the different servers.  No result.  (no import)

 

Need to look further.

 

Willy

[doglover]

End of the log file when imported with the local files:

[EPGImport] ### thread is ready ### Events: 100329
[EPGImport] imported 100329 events
[EPGImport] Save last import date and count event
[EPGImport] #### Finished ####

Willy

[doglover]

Try again.  I refreshed the channels file.  And this does seem to do the trick.  (at least on my receiver when I download from the net)

 

Willy

 

PS: The difference is when I import an unzipped channels file is used.  There must have been something wrong when I gzipped the channels file.

[WanWizard]

I know that.

 

I looked inside the gz file that caused 0 events to be imported, and noticed that the XML file starts with three bytes, before the "<xml" opening tag. Which looks to me like a UTF-8 BOM header.

 

This will cause the xml parser to crash, as it is non-valid, hence the 0 events...

[WanWizard]

Our posts crossed.

 

Just started a manual import, and it seems to work fine again.

 

Thanks for fixing it, Willy !!!

[doglover]

The files are already for a long time utf-8 (with a BOM header) this should not be problem.

 

The only thing I have done now, is gzipped the channels file again, and uploaded it.

Nothing has been changed.  It must have been a zip operation which has gone haywire.

 

Willy

[WanWizard]

It is never a good idea to save files with a BOM header, a lot of environments don't know how to handle it.

 

Whether or not that has anything to do with the issue.

[Q-BiC]

I'm having the same issue. But not only for UK. Benelux is also empty. 0 events.

The EPG has been acting up for a few days now (UK sometimes missing, and Benelux showing wrong events), but when I got home this evening, the whole EPG was empty and manually rescanning doesn't help.

[WanWizard]

Can't reproduce that here. So either some of the download mirrors are not in sync, or there is something wrong at your end?

 

Both Benelux and UK import fine here after Willy's fixes yesterday. 

[doglover]

I tried to import here from the websites, and I also got 0 import.

Checked the files with the off-line importer, and nothing wrong can be found.

 

However, the whole problem started after one of the mirrors has gone off-line.

The mirror still answers, but it is not the desired file.  This creates a problem.

 

Access denied

This domain has been blocked. The administrator of this domain is advised to contact TransIP BV.

Note:information about this domain is only provided to the administrator, not to third parties.

 

 

I recommended to edit the rytec.sources.xml file in /etc/epgimport.

Remove the line:

<url>http://www.xmltvepg.nl/rytec.channels.xml.gz</url>

This will take this mirror off-line.

Further remove (delete the lines) which reference to this website:  www.xmltvepg.nl

 

Willy

 

PS: after this edit do not forget to restart enigma2, as the channels has to be reloaded.  By restarting enigma2 a new download of this file is forced.

Edited by doglover, 8 March 2017 - 08:42.

[Q-BiC]

yes, victory. Thanks. Only had to comment out that 1 line. 

 

BBC 1 is still empty after the first couple of events though. Same as before. 

Edited by Q-BiC, 7 March 2017 - 22:24.

[doglover]

Further notice:  It is really needed to comment out (or delele) all references to the .nl mirror

 

From my import log:

[EPGImport] nextImport, source= Rytec France XMLTV
[EPGImport] Downloading: http://www.xmltvepg.nl/xxxxxxxxxxxx.gz to local path: /tmp/epgimport.gz
[EPGImport] afterDownload /tmp/epgimport.gz
[EPGImport] unlink /tmp/epgimport.gz
[EPGImport] afterChannelDownload None
[EPGImport] Using twisted thread

The importer gets an answer, a wrong one, and does not go to another website.

 

 

Willy

[doglover]

BBC 1 is still empty after the first couple of events though. Same as before. 

 

 

I get all BBC 1 filled with EPG.

But to be sure, which service ref for BBC1 does not get EPG?

 

Willy

[WanWizard]

I have to back out of my statement. I don't have BBC1 as well (stops in 2 programmes time), also ITV is empty.

 

I tried all available "feeds", but they all are not ok.

[WanWizard]

Also missing:

 

Discovery Shed +1

Tru TV

Tru TV +1

[doglover]

The problem with the Uk channels (BBC1, Tru TV etc) are not related to the problem with the mirrors.

It looks like the above channels have EPG today.

If problems persist however, pls. report them in a separate thread.

 

 

Willy

[Pr2]

Hi,

 

This shows that EPGimport can be improved.  

 

The error:  

 

Failed to import /tmp/epgimport.gz: Not a gzipped file

 

Should trigger a try to download from another mirror site in EPGimport.

 

I try manually to download the file with wget from the site that is now blocked and indeed it returns a file which is the html page that is displayed when you manually access it (size is 3065 bytes).

 

Pr2

[Pr2]

In the meantime:

 

I think that it would be nice to update this package:

 

enigma2-plugin-extensions-xmltvimport-rytec

 

So people performing an update of there image will get a clean up version of the source file.

 

Pr2