Jump to content


Photo

Rytex XMLTV has only 1 (important) shortcoming !


  • Please log in to reply
104 replies to this topic

Re: Rytex XMLTV has only 1 (important) shortcoming ! #61 Rob van der Does

  • Senior Member
  • 7,766 posts

+184
Excellent

Posted 6 January 2015 - 17:10

Crossepg read the OpenTV data from the provider (sat) and stores it in its own database.
This database is then used to pump the EPG in enigma in the same way as the XMLTVimporter uses.  So the OpenTV EPG becomes actually also an "external source" for EPG.

Yes: all EPG data is handled the same way, regardless of the source.

Re: Rytex XMLTV has only 1 (important) shortcoming ! #62 Robinson

  • Senior Member
  • 2,621 posts

+30
Good

Posted 6 January 2015 - 17:18

I don't really see why someone should have multiple EPG sources active at any time - this is surely asking for problems.

Some channels are not available as XMLTV while others do not have EIT EPG.

 

this will stop enigma2 daily at 7:45 am, delete the EPG file at 7:46 am, and restart enigma2 at 7:47 am

And what if a recording is taking place at the same time?
 


ET9000, OpenPLi 4.0, 13E, 19E

HD51, OpenPLi 6.2, 75E - 30W


Re: Rytex XMLTV has only 1 (important) shortcoming ! #63 pluizebol

  • Senior Member
  • 809 posts

+9
Neutral

Posted 6 January 2015 - 17:23

it is feasable for those of us who download the EPG data "in batch" from time to time

(as long as no better algorithm is available for updating the EPG)

 

Thanks for the dirty solution as you call it yourself ;)

 

I have to admit that I am not very fond of non-standard solutions. I prefer to stick with the standard stuff that comes with OpenPli and/or Enigma2.

I was hoping for a solution that extends the capabilities of the standard System Tool for cleaning the EPG: a possibility to do the clearing at a recurring time.

 

But thanks anyway for your kind help,

I will keep your workaround in mind if it becomes clear that all hope for a standard solution has vanished.

 

Regards


VU+ DUO 4K SE (1xDVB-S2X FBC Twin en 1xDVB-T2) / OpenPLi 8.3 / Logitech Harmony AB

Windows 10 Home Edition 64bits / VU+ Duo 4K SE / OpenPLi 8.3 / Citroën C5 II hydractive III+ BlueHDi / Samsung S21+

La Douce France


Re: Rytex XMLTV has only 1 (important) shortcoming ! #64 jeanclaude

  • Senior Member
  • 866 posts

+28
Good

Posted 6 January 2015 - 17:25

well, as I said : it's a crude & brutal method :)

and if a channel has no EPG attached to it, I just ask Willy to add it to his EPG data ........

so I'm not sure what channels you are talking about, ah, cable perhaps ?


DreamBox 7000S+8000HD (eindelijk), openPLi, CCcam, 85 cm schotel, draaibare opstelling en VEEL te weinig slaap.

Re: Rytex XMLTV has only 1 (important) shortcoming ! #65 pluizebol

  • Senior Member
  • 809 posts

+9
Neutral

Posted 6 January 2015 - 17:33

 

so I'm not sure what channels you are talking about, ah, cable perhaps ?

Right now, I am importing Benelux and France on Astra 19 & 23 with XMLTV only.

And I will also try the new extension EPG-Import-Filter that lets us further narrow down the download to the channels we are really interested in.

(The extension EPG-Import-Filter will most probably/hopefully become available on the feed within a couple of days).


VU+ DUO 4K SE (1xDVB-S2X FBC Twin en 1xDVB-T2) / OpenPLi 8.3 / Logitech Harmony AB

Windows 10 Home Edition 64bits / VU+ Duo 4K SE / OpenPLi 8.3 / Citroën C5 II hydractive III+ BlueHDi / Samsung S21+

La Douce France


Re: Rytex XMLTV has only 1 (important) shortcoming ! #66 doglover

  • Rytec EPG Team
  • 17,407 posts

+658
Excellent

Posted 6 January 2015 - 17:58

I think the EPG cache already tracks multiple sources. It just doesn't appear to handle things correctly. It can also handle multiple languages, I don't know if it stores them all but shows only one, or just drops other languages in favor of the preferred one.

What it needs is a source prioritization, probably the same as in use for languages (you can pick a preferred language in the settings).
When overlap occurs, the cache should make a decision based on priority. It would make sense to give higher prio to the imported data.

 

Prioritising does not solve the problem.  It is the changes in schedules which are the problem. 

 

Say:  today a schedule is published, grabbed and imported in the box.

The schedule now is changed.  The changes are grabbed and imported.  If you do not delete the old EPG you will end up with both the schedules intermixed.

At this point, we have used only one EPG source!!!!  You can prioritize it all you want.  But is the same source with the same priority.

 

Willy


Edited by doglover, 6 January 2015 - 17:58.

~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: Rytex XMLTV has only 1 (important) shortcoming ! #67 doglover

  • Rytec EPG Team
  • 17,407 posts

+658
Excellent

Posted 6 January 2015 - 18:12

In my opnion the XMLTV import routine should be revised with the following:

 

From the XMLTV file you read in:

  <programme start="20150106001000 +0100" stop="20150106003000 +0100" channel="FoxSerie.de">
    <title lang="de">How I Met Your Mother</title>
    <sub-title lang="de">[DRAMA (SERIE)] Klapsgiving (Ep.9) [0+]</sub-title>
    <desc lang="de">Sitcom. Lily will zum ersten Mal für die Clique eine Thanksgivingfeier veranstalten. Doch an Thanksgiving ist die Stimmung auf dem Tiefpunkt angelangt IMDb Rating: 8.9 /10
Josh Radnor, Jason Segel, Cobie Smulders, Neil Patrick Harris, Alyson Hannigan.</desc>
  </programme>

From this you know that the channel is FoxSerie.de

From the channels file you know that this schedule is loaded in the following service references:

 

<channel id="FoxSerie.de">1:0:1:10:1:85:C00000:0:0:0:</channel> <!--  Fox Serie -->

<channel id="FoxSerie.de">1:0:1:10:1:85:FFFF0000:0:0:0:</channel> <!-- Fox Serie ++CABLE++ -->

(or more)

 

Now you kick out all EPG for these service references (IF POSSIBLE AT ALL)

 

Now import all data for this channel to the service references defined in the channels file.

 

Next move on the next channel and repeat.

 

This should only apply to the importer which is used with the Oudeis patch (like OpenPli)

The importer which uses the epg.dat method should not be adapted, since using this method uses a reboot to load the data.  And in the process the old EPG data is erased anyway.

 

Willy


Edited by doglover, 6 January 2015 - 18:12.

~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: Rytex XMLTV has only 1 (important) shortcoming ! #68 Robinson

  • Senior Member
  • 2,621 posts

+30
Good

Posted 6 January 2015 - 19:15

well, as I said : it's a crude & brutal method :)

and if a channel has no EPG attached to it, I just ask Willy to add it to his EPG data ........

so I'm not sure what channels you are talking about, ah, cable perhaps ?

There are quite a few channels that do not have its schedules on the internet or it is impossible to transfer the schedules from their websites, so WIlly can't do anything about that.


Edited by Robinson, 6 January 2015 - 19:16.

ET9000, OpenPLi 4.0, 13E, 19E

HD51, OpenPLi 6.2, 75E - 30W


Re: Rytex XMLTV has only 1 (important) shortcoming ! #69 pluizebol

  • Senior Member
  • 809 posts

+9
Neutral

Posted 12 January 2015 - 13:04

I don't really see why someone should have multiple EPG sources active at any time - this is surely asking for problems.

OK, the "delete & reload" method should not be used when a "live" EPG datastream is used, otherwise the box will be doing nothing else but delete & replace it's EPG contents.

but it is feasable for those of us who download the EPG data "in batch" from time to time

(as long as no better algorithm is available for updating the EPG)

 

pluizebol : the easiest solution (and dirtiest) is to use "cron". I have created a file "/etc/cron/inittab" with the following 3 lines :

45 7 * * * init 4

46 7 * * * rm /tmp/epg.dat

47 7 * * * init 3

 

this will stop enigma2 daily at 7:45 am, delete the EPG file at 7:46 am, and restart enigma2 at 7:47 am. My EPG is then downloaded daily at 8:10 am.

it's crude, but it works. only snag is that if there is no EPG in the download, then all EPG info will be empty on the screen, but this happens very rarely.

Hi JeanClaude

 

I tried that but I am not sure if it worked because the time/date stamp of my EPG.dat file didn't change.

Does your solution work when my box in standby mode ?


VU+ DUO 4K SE (1xDVB-S2X FBC Twin en 1xDVB-T2) / OpenPLi 8.3 / Logitech Harmony AB

Windows 10 Home Edition 64bits / VU+ Duo 4K SE / OpenPLi 8.3 / Citroën C5 II hydractive III+ BlueHDi / Samsung S21+

La Douce France


Re: Rytex XMLTV has only 1 (important) shortcoming ! #70 doglover

  • Rytec EPG Team
  • 17,407 posts

+658
Excellent

Posted 12 January 2015 - 13:56

@pluizebol

 

Jij moet heel wss dit statement aanpassen:

 

46 7 * * * rm /tmp/epg.dat

 

in

 

46 7 * * * rm /hdd/epg.dat

 

Of waar de epg.dat file ook bij U staat.

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: Rytex XMLTV has only 1 (important) shortcoming ! #71 hemertje

  • Forum Moderator
    PLi® Core member
  • 33,503 posts

+118
Excellent

Posted 12 January 2015 - 14:05

Please keep it english

on the Glassfibre 1GB DVB-C...


Re: Rytex XMLTV has only 1 (important) shortcoming ! #72 pluizebol

  • Senior Member
  • 809 posts

+9
Neutral

Posted 12 January 2015 - 14:09

@pluizebol

 

Jij moet heel wss dit statement aanpassen:

 

46 7 * * * rm /tmp/epg.dat

 

in

 

46 7 * * * rm /hdd/epg.dat

 

Of waar de epg.dat file ook bij U staat.

 

Willy

 

Ik had rm /media/hdd/epg.dat staan

Dit heb ik nu gewijzigd naar rm /hdd/epg.dat (alhoewel ik denk dat dit op hetzelfde neerkomt ?)

 

The statement was rm /media/hdd/epg.dat

Although I think that it doesn't matter that much, I changed it into rm /hdd/epg.dat

 

 

 

Hoe moeten de attributes voor mijn cron-file staan ? 744 of 755 ?

Ik heb die op 755 gezet.

 

What attributes should I set the cron-file to ? 744 or 755 ?

I have set mine to 755


Edited by pluizebol, 12 January 2015 - 14:13.

VU+ DUO 4K SE (1xDVB-S2X FBC Twin en 1xDVB-T2) / OpenPLi 8.3 / Logitech Harmony AB

Windows 10 Home Edition 64bits / VU+ Duo 4K SE / OpenPLi 8.3 / Citroën C5 II hydractive III+ BlueHDi / Samsung S21+

La Douce France


Re: Rytex XMLTV has only 1 (important) shortcoming ! #73 hemertje

  • Forum Moderator
    PLi® Core member
  • 33,503 posts

+118
Excellent

Posted 12 January 2015 - 14:11

Please keep it english


on the Glassfibre 1GB DVB-C...


Re: Rytex XMLTV has only 1 (important) shortcoming ! #74 doglover

  • Rytec EPG Team
  • 17,407 posts

+658
Excellent

Posted 12 January 2015 - 14:25

Sorry for the dutch

 

Ik had rm /media/hdd/epg.dat staan

Dit heb ik nu gewijzigd naar rm /hdd/epg.dat (alhoewel ik denk dat dit op hetzelfde neerkomt ?)

 

 

Yes, both are the same in our linux boxes.  I would not state this in general, but here it is the same.

After the cron job has executed the epg.dat file should have disappeared.  So if you still got one (and even with the same time stamp as before) something has not worked as expected.

 

The attribute is set 744 on my box.  And it is working.  The 755 you have set should be OK.  (more permissions)

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: Rytex XMLTV has only 1 (important) shortcoming ! #75 Rob van der Does

  • Senior Member
  • 7,766 posts

+184
Excellent

Posted 12 January 2015 - 15:42

Have a look at

https://github.com/OpenViX/enigma2/commit/3e2db4ea53d477c27c0fafdc29123c51e7ef9f79

This update allows to delete the EPG.dat without stopping E2 (some C++ code change was involved, so the EPG was immediately deleted from RAM as well).
 



Re: Rytex XMLTV has only 1 (important) shortcoming ! #76 doglover

  • Rytec EPG Team
  • 17,407 posts

+658
Excellent

Posted 12 January 2015 - 15:46

Have a look at

https://github.com/OpenViX/enigma2/commit/3e2db4ea53d477c27c0fafdc29123c51e7ef9f79

This update allows to delete the EPG.dat without stopping E2 (some C++ code change was involved, so the EPG was immediately deleted from RAM as well).
 

 

This is for OpenViX is it not?

How does it work?  Could this be implemented in OpenPli or the the XMLTV importer?

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: Rytex XMLTV has only 1 (important) shortcoming ! #77 Rob van der Does

  • Senior Member
  • 7,766 posts

+184
Excellent

Posted 12 January 2015 - 15:47

This could be taken aboard by PLi in their E2 as well.



Re: Rytex XMLTV has only 1 (important) shortcoming ! #78 pluizebol

  • Senior Member
  • 809 posts

+9
Neutral

Posted 12 January 2015 - 16:52

Sorry for the dutch

 

Ik had rm /media/hdd/epg.dat staan

Dit heb ik nu gewijzigd naar rm /hdd/epg.dat (alhoewel ik denk dat dit op hetzelfde neerkomt ?)

 

 

Yes, both are the same in our linux boxes.  I would not state this in general, but here it is the same.

After the cron job has executed the epg.dat file should have disappeared.  So if you still got one (and even with the same time stamp as before) something has not worked as expected.

 

The attribute is set 744 on my box.  And it is working.  The 755 you have set should be OK.  (more permissions)

 

Willy

 

Well Willy, whatever I try, the epg.dat file remains stubbornly in place with the same time-stamp on top of it.

 

Cron really doesn't like my box :(


VU+ DUO 4K SE (1xDVB-S2X FBC Twin en 1xDVB-T2) / OpenPLi 8.3 / Logitech Harmony AB

Windows 10 Home Edition 64bits / VU+ Duo 4K SE / OpenPLi 8.3 / Citroën C5 II hydractive III+ BlueHDi / Samsung S21+

La Douce France


Re: Rytex XMLTV has only 1 (important) shortcoming ! #79 jeanclaude

  • Senior Member
  • 866 posts

+28
Good

Posted 12 January 2015 - 18:17

are the other 2 cron commands working ?

the box should terminate enigma2 at 7:45, and enigma2 is restarted at 7:47

might be that cron isn't running on your system.

what do you get when yoy type in the command "ps | grep cron" in a unix command box ?

You should get something like this :

root@dm8000:~# ps | grep cron                                        
  607 root      3128 S    /usr/sbin/crond -c /etc/cron/crontabs      
 4908 root      2936 S    grep cron                                  
root@dm8000:~#                                                       

DreamBox 7000S+8000HD (eindelijk), openPLi, CCcam, 85 cm schotel, draaibare opstelling en VEEL te weinig slaap.

Re: Rytex XMLTV has only 1 (important) shortcoming ! #80 pluizebol

  • Senior Member
  • 809 posts

+9
Neutral

Posted 12 January 2015 - 18:51

 

are the other 2 cron commands working ?

the box should terminate enigma2 at 7:45, and enigma2 is restarted at 7:47

might be that cron isn't running on your system.

what do you get when yoy type in the command "ps | grep cron" in a unix command box ?

You should get something like this :

root@dm8000:~# ps | grep cron                                        
  607 root      3128 S    /usr/sbin/crond -c /etc/cron/crontabs      
 4908 root      2936 S    grep cron                                  
root@dm8000:~#                                                       

 

 

Hi Jeanclaude

 

I appreciate your help, but these tests go too far for me.

I'm only a simple/dumb user :)

If it doesn't work, so be it, I will uninstall cron - no harm done.


VU+ DUO 4K SE (1xDVB-S2X FBC Twin en 1xDVB-T2) / OpenPLi 8.3 / Logitech Harmony AB

Windows 10 Home Edition 64bits / VU+ Duo 4K SE / OpenPLi 8.3 / Citroën C5 II hydractive III+ BlueHDi / Samsung S21+

La Douce France



2 user(s) are reading this topic

0 members, 2 guests, 0 anonymous users