←  [EN] Rytec XMLTV and EPG support

Forums

»

Just ran update. No events coming in with...

destroyer2usa's Photo destroyer2usa 10 Mar 2011

Just did a online software update and to see if those sky movie/sports channels listing come in again I ran a manual update but no events are coming in.

All servers down or bug in update?
Quote

VU+NL's Photo VU+NL 10 Mar 2011

Triggered by this post I did an update and everything worked just fine.
Quote

destroyer2usa's Photo destroyer2usa 10 Mar 2011

Strange...still no go overhere...enigma has done a restart after software update so should be ok? Have a recording running...will try a full switch on/off later to see if that fixes the no events coming in..
Quote

VU+NL's Photo VU+NL 10 Mar 2011

You are using the latest version of the two XMLTV-plugins?
Quote

destroyer2usa's Photo destroyer2usa 10 Mar 2011

You are using the latest version of the two XMLTV-plugins?



Doing a software update online doesn't automatically update those plugins? I have to manually grab those of the rytec site?

Installed my system 10 days ago.
Quote

rytec's Photo rytec 10 Mar 2011

Strange...still no go overhere...enigma has done a restart after software update so should be ok? Have a recording running...will try a full switch on/off later to see if that fixes the no events coming in..



No problems at the moment with hosting or kind of so I suggest ; restart box and try again.

I hope Mike will soon put the new randomized EPG import plugin online, this one can take from 6 different sites, if one goes down it goes to another, etc
Quote

VU+NL's Photo VU+NL 10 Mar 2011

I hope Mike will soon put the new randomized EPG import plugin online, this one can take from 6 different sites, if one goes down it goes to another, etc

I think Mike did just that a couple of days ago (see here)
Quote

rytec's Photo rytec 10 Mar 2011

There were some issues which he was forgotten while he and I pm'ed to each other about the new plugin, since then I didn't heared anything so I'm not sure if these things are updated.
Quote

destroyer2usa's Photo destroyer2usa 10 Mar 2011

Manually removed the plugins...manually re-installed plugins from rytec site. On/Off...hangs with spinning wheel on epgimportmenu (a new menu for me...in the middle of the screen overlayed with actual picture). I just switched off the ET9000 with the switch when hanging. Restart and now epgimport works again. I'll see if I can dig up the crashlog and list it here.
Quote

MiLo's Photo MiLo 11 Mar 2011

The only issue is that the "channels" file is not being mirrored.

But what's keeping you from using the data mirroring support that's built in already? It's even backwards compatible.
Quote

rytec's Photo rytec 11 Mar 2011

Mike,

As I explained to you in our conversations, if the xmltvepg site is down, the plugin cannot use this channelfile, what will happen?

The data can be pulled from other sites if we add multiple url's to the rytec.sources.xml file but it would be better if you also make it that way the channelfiles can be pulled from multiple sites.

Also another checkpoint was to prevent the plugin downloading files which are not bigger then 0 bytes (corrupted files) when this happened the plugin crashes somehow, therefor the box needed to be rebooted before it could do an import again.

On the multiple downloadsites I have created seperated rytec.sources.xml files with their own links to the data and channelfiles.
Instead of leaving the sources.xml file in /etc/epgimport/ you just should use a file in etc/epgimport where the active download sites are noted and which can be used by the plugin.

regards,
Ryan
Quote

MiLo's Photo MiLo 11 Mar 2011

Putting a sources.xml on each site assumes that if you can download one file from a server, you'll automatically be able to download all other files too. That's a false assumption, so it'd be better not to do that.

Better to list the alternatives in the single sources file, that way, the plugin can cope with any error and not just that one particular case that the whole server is down.
Quote

rytec's Photo rytec 11 Mar 2011

Mike,

if the xmltvepg site is down, the plugin cannot use this channelfile, what will happen?



Can you answer what the plugin will do if it can't download the channelsfile from this site?
Quote

MiLo's Photo MiLo 11 Mar 2011

I don't really know, it could continue with an empty set, or simply abort. Whatever it does, it won't break anything, you'll just get no new events.
Quote

rytec's Photo rytec 11 Mar 2011

Well then, why hesistate and don't you just use the already working way of Andy? He recoded also this randomized function and we have tested it for a few days now and from the logging reports I can confirm you that it works perfectly, even with the randomized channelfiles and filesize checks.
Quote

MiLo's Photo MiLo 11 Mar 2011

Because of what I wrote a few posts up: His method will only work when entire servers are unavailable.

I'm actually waiting for an rytec.sources.xml with the mirrors included, so far i've only tested with my local webserver.
Quote

rytec's Photo rytec 11 Mar 2011

In attachement the new rytec.sources.xml file

Attached Files

Quote

doglover's Photo doglover 11 Mar 2011

Be carefull:

<source type="gen_xmltv" channels="http://www.xmltvepg....annels.xml.gz">

It will try to download the channels file always from www.xmltvepg.be
and when this is not available - the download will fail.

Willy
Quote

doglover's Photo doglover 11 Mar 2011

Just an idea:

Could you work with a variable:

<?xml version="1.0" encoding="latin-1"?>


<site>http://www.world-of-...epg_data</site>
<site>http://www.xmltvepg.be</site>
<site>http://www.xmltvepg.nl</site>
<site>http://www.tm800hd.co.uk</site>
<site>http://rytec.tman.nl</site>
<site>http://xmltvepg.isgr...reat.org</site>

<sources>
<source type="gen_xmltv" channels="$$site$$/rytec.channels.xml.gz">
<description>Rytec Benelux XMLTV</description>
<url>$$site$$/rytecxmltvbenl.gz</url>
</source>

etc...


In the program you randomly pick one of the sites, and substitutes $$site$$ with the site value. Now you check if the channels file can be downloaded and contains data.
download the channels file if everything OK. If not change to another site.

Do the same with the xmltvepg file

One request: It should still be possible to use local or fixed files. Local files which are stored somewhere on our own system. Fixed files: having a fixed url. (No variables)

Willy
Quote

MiLo's Photo MiLo 11 Mar 2011

Placing extra lines like the ones below at the top of the sources file like this will enable the load-balancing for channel files too (starting tomorrow):

<channel name="http://www.xmltvepg.be/rytec.channels.xml.gz">
    <url>http://www.xmltvepg.be/rytec.channels.xml.gz</url>
    <url>http://xmltvepg.isgreat.org/rytec.channels.xml.gz</url>
</channel>

This will work with tomorrow's version, today's version will simply ignore these lines.
Quote