104 replies to this topic

[Rob van der Does]

Crossepg read the OpenTV data from the provider (sat) and stores it in its own database.
This database is then used to pump the EPG in enigma in the same way as the XMLTVimporter uses.  So the OpenTV EPG becomes actually also an "external source" for EPG.

Yes: all EPG data is handled the same way, regardless of the source.

[Robinson]

I don't really see why someone should have multiple EPG sources active at any time - this is surely asking for problems.

Some channels are not available as XMLTV while others do not have EIT EPG.

 

this will stop enigma2 daily at 7:45 am, delete the EPG file at 7:46 am, and restart enigma2 at 7:47 am

And what if a recording is taking place at the same time?
 

[pluizebol]

it is feasable for those of us who download the EPG data "in batch" from time to time

(as long as no better algorithm is available for updating the EPG)

 

Thanks for the dirty solution as you call it yourself

 

I have to admit that I am not very fond of non-standard solutions. I prefer to stick with the standard stuff that comes with OpenPli and/or Enigma2.

I was hoping for a solution that extends the capabilities of the standard System Tool for cleaning the EPG: a possibility to do the clearing at a recurring time.

 

But thanks anyway for your kind help,

I will keep your workaround in mind if it becomes clear that all hope for a standard solution has vanished.

 

Regards

[jeanclaude]

well, as I said : it's a crude & brutal method

and if a channel has no EPG attached to it, I just ask Willy to add it to his EPG data ........

so I'm not sure what channels you are talking about, ah, cable perhaps ?

[pluizebol]

 

so I'm not sure what channels you are talking about, ah, cable perhaps ?

Right now, I am importing Benelux and France on Astra 19 & 23 with XMLTV only.

And I will also try the new extension EPG-Import-Filter that lets us further narrow down the download to the channels we are really interested in.

(The extension EPG-Import-Filter will most probably/hopefully become available on the feed within a couple of days).

[doglover]

I think the EPG cache already tracks multiple sources. It just doesn't appear to handle things correctly. It can also handle multiple languages, I don't know if it stores them all but shows only one, or just drops other languages in favor of the preferred one.

What it needs is a source prioritization, probably the same as in use for languages (you can pick a preferred language in the settings).
When overlap occurs, the cache should make a decision based on priority. It would make sense to give higher prio to the imported data.

 

Prioritising does not solve the problem.  It is the changes in schedules which are the problem. 

 

Say:  today a schedule is published, grabbed and imported in the box.

The schedule now is changed.  The changes are grabbed and imported.  If you do not delete the old EPG you will end up with both the schedules intermixed.

At this point, we have used only one EPG source!!!!  You can prioritize it all you want.  But is the same source with the same priority.

 

Willy

Edited by doglover, 6 January 2015 - 17:58.

[doglover]

In my opnion the XMLTV import routine should be revised with the following:

 

From the XMLTV file you read in:

  <programme start="20150106001000 +0100" stop="20150106003000 +0100" channel="FoxSerie.de">
    <title lang="de">How I Met Your Mother</title>
    <sub-title lang="de">[DRAMA (SERIE)] Klapsgiving (Ep.9) [0+]</sub-title>
    <desc lang="de">Sitcom. Lily will zum ersten Mal für die Clique eine Thanksgivingfeier veranstalten. Doch an Thanksgiving ist die Stimmung auf dem Tiefpunkt angelangt IMDb Rating: 8.9 /10
Josh Radnor, Jason Segel, Cobie Smulders, Neil Patrick Harris, Alyson Hannigan.</desc>
  </programme>

From this you know that the channel is FoxSerie.de

From the channels file you know that this schedule is loaded in the following service references:

 

<channel id="FoxSerie.de">1:0:1:10:1:85:C00000:0:0:0:</channel> <!--  Fox Serie -->

<channel id="FoxSerie.de">1:0:1:10:1:85:FFFF0000:0:0:0:</channel> <!-- Fox Serie ++CABLE++ -->

(or more)

 

Now you kick out all EPG for these service references (IF POSSIBLE AT ALL)

 

Now import all data for this channel to the service references defined in the channels file.

 

Next move on the next channel and repeat.

 

This should only apply to the importer which is used with the Oudeis patch (like OpenPli)

The importer which uses the epg.dat method should not be adapted, since using this method uses a reboot to load the data.  And in the process the old EPG data is erased anyway.

 

Willy

Edited by doglover, 6 January 2015 - 18:12.

[Robinson]

well, as I said : it's a crude & brutal method

and if a channel has no EPG attached to it, I just ask Willy to add it to his EPG data ........

so I'm not sure what channels you are talking about, ah, cable perhaps ?

There are quite a few channels that do not have its schedules on the internet or it is impossible to transfer the schedules from their websites, so WIlly can't do anything about that.

Edited by Robinson, 6 January 2015 - 19:16.

[pluizebol]

I don't really see why someone should have multiple EPG sources active at any time - this is surely asking for problems.

OK, the "delete & reload" method should not be used when a "live" EPG datastream is used, otherwise the box will be doing nothing else but delete & replace it's EPG contents.

but it is feasable for those of us who download the EPG data "in batch" from time to time

(as long as no better algorithm is available for updating the EPG)

 

pluizebol : the easiest solution (and dirtiest) is to use "cron". I have created a file "/etc/cron/inittab" with the following 3 lines :

45 7 * * * init 4

46 7 * * * rm /tmp/epg.dat

47 7 * * * init 3

 

this will stop enigma2 daily at 7:45 am, delete the EPG file at 7:46 am, and restart enigma2 at 7:47 am. My EPG is then downloaded daily at 8:10 am.

it's crude, but it works. only snag is that if there is no EPG in the download, then all EPG info will be empty on the screen, but this happens very rarely.

Hi JeanClaude

 

I tried that but I am not sure if it worked because the time/date stamp of my EPG.dat file didn't change.

Does your solution work when my box in standby mode ?

[doglover]

@pluizebol

 

Jij moet heel wss dit statement aanpassen:

 

46 7 * * * rm /tmp/epg.dat

 

in

 

46 7 * * * rm /hdd/epg.dat

 

Of waar de epg.dat file ook bij U staat.

 

Willy

[hemertje]

Please keep it english

[pluizebol]

@pluizebol

 

Jij moet heel wss dit statement aanpassen:

 

46 7 * * * rm /tmp/epg.dat

 

in

 

46 7 * * * rm /hdd/epg.dat

 

Of waar de epg.dat file ook bij U staat.

 

Willy

 

Ik had rm /media/hdd/epg.dat staan

Dit heb ik nu gewijzigd naar rm /hdd/epg.dat (alhoewel ik denk dat dit op hetzelfde neerkomt ?)

 

The statement was rm /media/hdd/epg.dat

Although I think that it doesn't matter that much, I changed it into rm /hdd/epg.dat

 

 

 

Hoe moeten de attributes voor mijn cron-file staan ? 744 of 755 ?

Ik heb die op 755 gezet.

 

What attributes should I set the cron-file to ? 744 or 755 ?

I have set mine to 755

Edited by pluizebol, 12 January 2015 - 14:13.

[hemertje]

Please keep it english

[doglover]

Sorry for the dutch

 

Ik had rm /media/hdd/epg.dat staan

Dit heb ik nu gewijzigd naar rm /hdd/epg.dat (alhoewel ik denk dat dit op hetzelfde neerkomt ?)

 

 

Yes, both are the same in our linux boxes.  I would not state this in general, but here it is the same.

After the cron job has executed the epg.dat file should have disappeared.  So if you still got one (and even with the same time stamp as before) something has not worked as expected.

 

The attribute is set 744 on my box.  And it is working.  The 755 you have set should be OK.  (more permissions)

 

Willy

[Rob van der Does]

Have a look at

https://github.com/OpenViX/enigma2/commit/3e2db4ea53d477c27c0fafdc29123c51e7ef9f79

This update allows to delete the EPG.dat without stopping E2 (some C++ code change was involved, so the EPG was immediately deleted from RAM as well).
 

[doglover]

Have a look at

https://github.com/OpenViX/enigma2/commit/3e2db4ea53d477c27c0fafdc29123c51e7ef9f79

This update allows to delete the EPG.dat without stopping E2 (some C++ code change was involved, so the EPG was immediately deleted from RAM as well).
 

 

This is for OpenViX is it not?

How does it work?  Could this be implemented in OpenPli or the the XMLTV importer?

 

Willy

[Rob van der Does]

This could be taken aboard by PLi in their E2 as well.

[pluizebol]

Sorry for the dutch

 

Ik had rm /media/hdd/epg.dat staan

Dit heb ik nu gewijzigd naar rm /hdd/epg.dat (alhoewel ik denk dat dit op hetzelfde neerkomt ?)

 

 

Yes, both are the same in our linux boxes.  I would not state this in general, but here it is the same.

After the cron job has executed the epg.dat file should have disappeared.  So if you still got one (and even with the same time stamp as before) something has not worked as expected.

 

The attribute is set 744 on my box.  And it is working.  The 755 you have set should be OK.  (more permissions)

 

Willy

 

Well Willy, whatever I try, the epg.dat file remains stubbornly in place with the same time-stamp on top of it.

 

Cron really doesn't like my box

[jeanclaude]

are the other 2 cron commands working ?

the box should terminate enigma2 at 7:45, and enigma2 is restarted at 7:47

might be that cron isn't running on your system.

what do you get when yoy type in the command "ps | grep cron" in a unix command box ?

You should get something like this :

root@dm8000:~# ps | grep cron                                        

  607 root      3128 S    /usr/sbin/crond -c /etc/cron/crontabs      

 4908 root      2936 S    grep cron                                  

root@dm8000:~#                                                       

[pluizebol]

 

are the other 2 cron commands working ?

the box should terminate enigma2 at 7:45, and enigma2 is restarted at 7:47

might be that cron isn't running on your system.

what do you get when yoy type in the command "ps | grep cron" in a unix command box ?

You should get something like this :

root@dm8000:~# ps | grep cron                                        

  607 root      3128 S    /usr/sbin/crond -c /etc/cron/crontabs      

 4908 root      2936 S    grep cron                                  

root@dm8000:~#                                                       

 

 

Hi Jeanclaude

 

I appreciate your help, but these tests go too far for me.

I'm only a simple/dumb user

If it doesn't work, so be it, I will uninstall cron - no harm done.