Jump to content


Photo

How to debug EPGImport 0 events issue


  • Please log in to reply
7 replies to this topic

#1 IAmATeaf

  • Senior Member
  • 58 posts

0
Neutral

Posted 31 December 2020 - 19:01

I'm trying to use EPGImport to download and update the EPG data for my IPTV stream.

 

Have it all configured but it always exits with 0 events found.

 

What I've checked so far is that the Source is configured correctly in EPGImport.
 
When I perform a manual import of Sources I can see that the file /tmp/epgimport (around 35Mb) gets downloaded/created. It then processes the file which is when it seems to find no matching events?
 
[XMLTVImport] WakeUpTime now set to 1609482008 (now=1609436954)
[EPGImport] nextImport, source= IPTV
[EPGImport] Downloading: https://IPTV.uk:443/...ord&next_days=2 to local path: /tmp/epgimport
[EPGImport] No IPv6, using IPv4 directly: https://IPTV.uk:443/...ord&next_days=2
[EPGImport] afterDownload /tmp/epgimport
[EPGImport] unlink /tmp/epgimport
[EPGImport] afterChannelDownload None
[EPGImport] Using twisted thread
[XMLTVConverter] Enumerating event information
[EPGImport] ### thread is ready ### Events: 0
[EPGImport] imported 0 events
[XMLTVImport] Save last import date and count event
[XMLTVImport] Run check deep standby after import
[EPGImport] #### Finished ####
[XMLTVImport] WakeUpTime now set to 1609482008 (now=1609436992)
[XMLTVImport] WakeUpTime now set to 1609482008 (now=1609436998)
 

Is there a way to be able to enable further logging or even debugging the problem I'm seeing? Or is there a way I can run the step XMLTVConverter manually to see if it errors? Also why does it, from the logs does it unlink the file straight after downloading it, I've looked at the code for EPGImport and see that it does read the file before the unlink command so I'd assume that the file at that point has been loaded into memory/buffer?

 

The frustrating thing is that it did used to work until last week when my box crashed and since the restart it's just failed and I can't figure out why.

 

Lastly, I know the above is about IPTV so apologies if talk/help isn't allowed or can't be given.

 



Re: How to debug EPGImport 0 events issue #2 doglover

  • Rytec EPG Team
  • 17,393 posts

+658
Excellent

Posted 1 January 2021 - 07:34

Several things can go wrong.  In order to get EPG there are several things have to be correct.

 

1. All the bouquet entries must have an unique service ref assigned.

For IPTV, you or your provider must assign these correctly.

 

2. In the channels file these unique service refs have to be linked with the correct xmltv-id or channel-id from the xmltv file.

This info is in the channels.xml file in the /etc/epgimport/ folder or the channels file which you download.  No information of this has been given in the log above.  (Parsing the channels file)

Can you restart your box (to force a new download of the channels file), and perform a fresh import of the one source, and obtain the new log.

 

3. The XMLTV file could be at fault.

this file is not one of ours, and I cannot check this file. (Password protected)

 

If it worked up to last week before your crash, something you put back is not correct.


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: How to debug EPGImport 0 events issue #3 IAmATeaf

  • Senior Member
  • 58 posts

0
Neutral

Posted 1 January 2021 - 14:57

Thanks for the reply, much appreciated. I seem to have made a boo-boo with pasting snippets of the log. There is a reference to the channels file, see below. I’ll compare the contents of the downloaded EPG file and the channels.xml, any hints/tips on what specifically to look for?

XMLTVImport] autostart (0) occured at 1609498649.37
[XMLTVImport] autostart (0) occured at 1609498649.51
[XMLTVImport] WakeUpTime now set to 1609568408 (now=1609498649)
[XMLTVImport] Selected source: ['']
sourcesDone(): False None
[EPGImport] nextImport, source= IPTV
[EPGImport] Downloading: https://IPTV.uk:443/...ord&next_days=2 to local path: /tmp/epgimport
[EPGImport] No IPv6, using IPv4 directly: https://IPTV.uk:443/...ord&next_days=2
[EPGImport] afterDownload /tmp/epgimport
[EPGImport] unlink /tmp/epgimport
[EPGImport] afterChannelDownload None
[EPGImport] Using twisted thread
[EPGImport] Parsing channels from '/etc/epgimport/xstreamity.IPTV.channels.xml'
[XMLTVConverter] Enumerating event information
[EPGImport] ### thread is ready ### Events: 0
[EPGImport] imported 0 events
[XMLTVImport] Save last import date and count event
[XMLTVImport] Run check deep standby after import
[EPGImport] #### Finished ####

Re: How to debug EPGImport 0 events issue #4 doglover

  • Rytec EPG Team
  • 17,393 posts

+658
Excellent

Posted 1 January 2021 - 15:17

The epgimport log does not give more info at the moment.

There is however more info if other errors are encountered.

 

Firstly compare the info in [EPGImport] '/etc/epgimport/xstreamity.IPTV.channels.xml'

[EPGImport] Parsing channels from '/etc/epgimport/xstreamity.IPTV.channels.xml'

 

Compare the service ref given in this file with the service ref in your Bouquetfile(s).

A few channels is anenough to get the idea if we have to search here for the error.

 

I give you an example:

 

In the channels file I have:

<channel id="LN24.fr">5002:0:1:1:16:1:32:0:0:0:http%3a//live.cdn.ln24.be/out/v1/b191621c8b9a436cad37bb36a82d2e1c/index.m3u8</channel><!-- LN24 -->

 

in the bouquetfile i have:

 

#SERVICE 5002:0:1:1:16:1:32:0:0:0:http%3a//live.cdn.ln24.be/out/v1/b191621c8b9a436cad37bb36a82d2e1c/index.m3u8:LN24 (nieuws, BE, franstalig)

 

The service ref (here:  5002:0:1:1:16:1:32:0:0:0:) have to match.


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: How to debug EPGImport 0 events issue #5 IAmATeaf

  • Senior Member
  • 58 posts

0
Neutral

Posted 1 January 2021 - 17:09

After your explanation above I think I've found what might be the issue but have no idea if it really is the issue or even how to fix/resolve?  By the way I'm using XStreamity so have no real bouquets on the box as such.

 

So the downloaded epgimport file has no references to the service ref. Would the lack of a matching service ref mean that when XMLTVConvertor processes the files it find no matches hence reports 0 events to populate back into the boxes epg.dat file?

 

Snippet from channels.xml

<?xml version="1.0" encoding="utf-8"?>
<channels>
<channel id="skysportsnews.uk">1:0:1:0000:7c99:000003e7:0:0:0:0:http%3a//example.m3u8</channel><!--UK | Sky Sports News FHD-->
<channel id="skysportsnews.uk">1:0:1:0000:0053:000003e7:0:0:0:0:http%3a//example.m3u8</channel><!--UK | Sky Sports News HD-->
<channel id="skysportsnews.uk">1:0:1:0000:0090:000003e7:0:0:0:0:http%3a//example.m3u8</channel><!--UK | Sky Sports News SD-->
 
Snippet from the downloaded epgimport file (There are multiple channel= entries for the epg events)
<?xml version="1.0" encoding="utf-8" ?><!DOCTYPE tv SYSTEM "xmltv.dtd"><tv generator-info-name="IPTV IPTV" generator-info-url="http://IPTV.co.uk:80/">
<channel id="skysportsnews.uk"><display-name>UK | Sky Sports News HD</display-name><icon src="http://epg4you.com/l...ysportsnews.png" /></channel>
<channel id="skysportsnews.uk"><display-name>UK | Sky Sports News SD</display-name><icon src="http://epg4you.com/l...ysportsnews.png" /></channel>
<channel id="skysportsnews.uk"><display-name>UK | Sky Sports News FHD</display-name><icon src="http://epg4you.com/l...ortsnews_uk.png" /></channel>
channel="skysportsnews.uk" ><title>Gillette Soccer Special</title><desc>Follow all the drama from the evening&apos;s matches, with the team on hand to bring you all the latest scores and talking points from around the grounds..</desc></programme><programme start="20201229184500 +0000" stop="20201229220000 +0000"


Re: How to debug EPGImport 0 events issue #6 doglover

  • Rytec EPG Team
  • 17,393 posts

+658
Excellent

Posted 2 January 2021 - 08:25

You lost me there.

I do not know anything about XStreamly....

 

I would advise to present your problem to them....


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: How to debug EPGImport 0 events issue #7 IAmATeaf

  • Senior Member
  • 58 posts

0
Neutral

Posted 2 January 2021 - 12:49

XStreamity just makes use of any epg data on the box. So I’m using EPGIMPORT to pull down the epg from the provider and then process and inject it into the epg cache but it always seems to find 0 events.

Re: How to debug EPGImport 0 events issue #8 IAmATeaf

  • Senior Member
  • 58 posts

0
Neutral

Posted 2 January 2021 - 17:27

Did some more investigation, have downloaded the source file and added some extra print statements (with MK in the text), have to admit I still don't fully understand but it looks like although it downloads the file /tmp/epgimport it then doesn't seem to use it as I've highlighted below. So the None is the name of the file that it's processing?

 

[EPGImport MK] Within try sslverify.
[XMLTVImport] autostart (0) occured at 1609604192.75
[XMLTVImport] autostart (0) occured at 1609604192.88
[XMLTVImport] WakeUpTime now set to 1609654808 (now=1609604192)
[EPGImport] nextImport, source= IPTV
[EPGImport] Downloading: https://IPTV.uk:443/...ord&next_days=2 to local path: /tmp/epgimport
[EPGImport] No IPv6, using IPv4 directly: https://IPTV.uk:443/...ord&next_days=2
[EPGImport] afterDownload /tmp/epgimport
[EPGImport] unlink /tmp/epgimport
[EPGImport MK] self.channelFiles None
[EPGImport MK] not self.channelFiles
[EPGImport] afterChannelDownload None
[EPGImport] Using twisted thread
[EPGImport MK] Using twisted thread None
[EPGImport] Parsing channels from '/etc/epgimport/xstreamity.IPTV.channels.xml'
[XMLTVConverter] Enumerating event information
[XMLTVConverter MK] not self.channels
[EPGImport] ### thread is ready ### Events: 0
[EPGImport] imported 0 events
[XMLTVImport] Save last import date and count event
[XMLTVImport] Run check deep standby after import
[EPGImport] #### Finished ####



1 user(s) are reading this topic

0 members, 1 guests, 0 anonymous users