Thanks, Acds. Works nicely now. Now I can again use EPGimport on my old DM8000 with its limited memory.
EPGImport Filter v1.00 by Acds
Started by Acds, 16 Oct 2014 17:49
205 replies to this topic
Re: EPGImport Filter v1.00 by Acds #141
-
- Senior Member
- 25 posts
+7
Neutral
Posted 14 April 2015 - 22:56
Re: EPGImport Filter v1.00 by Acds #142
-
- Senior Member
- 108 posts
+4
Neutral
Posted 15 April 2015 - 09:41
Thanks, Acds. Works nicely now. Now I can again use EPGimport on my old DM8000 with its limited memory.
Nice. 
Re: EPGImport Filter v1.00 by Acds #143
-
- Senior Member
- 1,030 posts
+65
Good
Posted 5 June 2015 - 20:50
Hi!
Nice plugin, but I noticed a problem:
It skips stations with alternatives when scanning for stations to update.
It would be great if you could fix that, because "alternatives" are a great feature ... if only plugin authors wouldn't forget them that often.
One of its benefits is even related to the benefits of your plugin:
You can (optionally) stop parsing the sub-bouquet an alternative actually is after the first hit, as it is enough to update the EPG for one of the stations within (As they are all the same station).
In theory, this can reduce the amount of EPG data to load by two thirds or even more.
If you don't get it:
Imagine a user having more than one way of reception, e.g. DVB-S and DVB-C.
That setup is quite common, common enough for vendors to sell boxes with Dual-DVB-S + Single-DVB-C/T tuners built-in.
People living for rent often aren't allowed for proper mounted dishes, so they use rather small ones on the balcony or behind the window, which gives a very low bad weather reserve.
Thus they use DVB-C as their bad weather reserve and thus we have more dual DVB-S + single-DVB-C boxes on the market than good dual DVB-C boxes ...
Ever wondered what the tuner preference order DVB-S/DVB-C/DVB-T -> DVB-C/DVB-S/DVB-T -> ... is about? About exactly this
One of the greatest features of E2 is that you do NOT need to add the same station to your bouquets multiple times, once for each way of reception, but only ONCE, adding the second way of reception as "alternative".
While an entry for single station looks like that:
Inside this bouquet, you will find the usual service refs:
As alternatives are treated as a single station anywhere (where alternatives are properly supported), it's enough to update the EPG for one of them.
Taken the case that there are three reception ways (e.g. DVB-S + DVB-C + DVB-T or DVB-S + DVB-C + IPTV/Stream) configured for one station, that makes two thirds less EPG to update.
Nice plugin, but I noticed a problem:
It skips stations with alternatives when scanning for stations to update.
It would be great if you could fix that, because "alternatives" are a great feature ... if only plugin authors wouldn't forget them that often.
One of its benefits is even related to the benefits of your plugin:
You can (optionally) stop parsing the sub-bouquet an alternative actually is after the first hit, as it is enough to update the EPG for one of the stations within (As they are all the same station).
In theory, this can reduce the amount of EPG data to load by two thirds or even more.
If you don't get it:
Imagine a user having more than one way of reception, e.g. DVB-S and DVB-C.
That setup is quite common, common enough for vendors to sell boxes with Dual-DVB-S + Single-DVB-C/T tuners built-in.
People living for rent often aren't allowed for proper mounted dishes, so they use rather small ones on the balcony or behind the window, which gives a very low bad weather reserve.
Thus they use DVB-C as their bad weather reserve and thus we have more dual DVB-S + single-DVB-C boxes on the market than good dual DVB-C boxes ...
Ever wondered what the tuner preference order DVB-S/DVB-C/DVB-T -> DVB-C/DVB-S/DVB-T -> ... is about? About exactly this
One of the greatest features of E2 is that you do NOT need to add the same station to your bouquets multiple times, once for each way of reception, but only ONCE, adding the second way of reception as "alternative".
While an entry for single station looks like that:
#SERVICE 1:0:19:283D:3FB:1:C00000:0:0:0one for a station with alternatives looks like this:
#SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.DasErsteHD.tv" ORDER BY bouquetSo technically it's a bouquet but it never gets shown as one.
Inside this bouquet, you will find the usual service refs:
#SERVICE 1:0:19:283D:3FB:1:C00000:0:0:0 #SERVICE 1:0:19:2B5C:41B:A401:FFFF0000:0:0:0In this case, its the service refs for "Das Erste HD" via Astra 1 and Unitymedia Cable.
As alternatives are treated as a single station anywhere (where alternatives are properly supported), it's enough to update the EPG for one of them.
Taken the case that there are three reception ways (e.g. DVB-S + DVB-C + DVB-T or DVB-S + DVB-C + IPTV/Stream) configured for one station, that makes two thirds less EPG to update.
1st box: Vu+ Ultimo 4k 4xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
2nd box: Gigablue Quad 4k 2xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
testing boxes: Vu+ Duo² + AX Quadbox HD2400 + 2x Vu+ Solo² + Octagon SF4008
Sats & Pay-TV: Astra 19.2°E + Hotbird 13°E with Redlight / SCT HD / SES Astra HD- / Sky V14 / 4th empire propaganda TV
Card-Server: Raspberry Pi + IPv6-capable oscam
Router: Linksys WRT1900ACS w/ LEDE + Fritz!Box 7390
2nd box: Gigablue Quad 4k 2xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
testing boxes: Vu+ Duo² + AX Quadbox HD2400 + 2x Vu+ Solo² + Octagon SF4008
Sats & Pay-TV: Astra 19.2°E + Hotbird 13°E with Redlight / SCT HD / SES Astra HD- / Sky V14 / 4th empire propaganda TV
Card-Server: Raspberry Pi + IPv6-capable oscam
Router: Linksys WRT1900ACS w/ LEDE + Fritz!Box 7390
Re: EPGImport Filter v1.00 by Acds #144
-
- Senior Member
- 108 posts
+4
Neutral
Posted 10 June 2015 - 22:28
Hi!
Nice plugin, but I noticed a problem:
It skips stations with alternatives when scanning for stations to update.
It would be great if you could fix that, because "alternatives" are a great feature ... if only plugin authors wouldn't forget them that often.
One of its benefits is even related to the benefits of your plugin:
You can (optionally) stop parsing the sub-bouquet an alternative actually is after the first hit, as it is enough to update the EPG for one of the stations within (As they are all the same station).
In theory, this can reduce the amount of EPG data to load by two thirds or even more.
If you don't get it:
Imagine a user having more than one way of reception, e.g. DVB-S and DVB-C.
That setup is quite common, common enough for vendors to sell boxes with Dual-DVB-S + Single-DVB-C/T tuners built-in.
People living for rent often aren't allowed for proper mounted dishes, so they use rather small ones on the balcony or behind the window, which gives a very low bad weather reserve.
Thus they use DVB-C as their bad weather reserve and thus we have more dual DVB-S + single-DVB-C boxes on the market than good dual DVB-C boxes ...
Ever wondered what the tuner preference order DVB-S/DVB-C/DVB-T -> DVB-C/DVB-S/DVB-T -> ... is about? About exactly this
One of the greatest features of E2 is that you do NOT need to add the same station to your bouquets multiple times, once for each way of reception, but only ONCE, adding the second way of reception as "alternative".
While an entry for single station looks like that:#SERVICE 1:0:19:283D:3FB:1:C00000:0:0:0one for a station with alternatives looks like this:#SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.DasErsteHD.tv" ORDER BY bouquetSo technically it's a bouquet but it never gets shown as one.
Inside this bouquet, you will find the usual service refs:#SERVICE 1:0:19:283D:3FB:1:C00000:0:0:0 #SERVICE 1:0:19:2B5C:41B:A401:FFFF0000:0:0:0In this case, its the service refs for "Das Erste HD" via Astra 1 and Unitymedia Cable.
As alternatives are treated as a single station anywhere (where alternatives are properly supported), it's enough to update the EPG for one of them.
Taken the case that there are three reception ways (e.g. DVB-S + DVB-C + DVB-T or DVB-S + DVB-C + IPTV/Stream) configured for one station, that makes two thirds less EPG to update.
I am not sure I understand the problem. This plugin will not load the EPG data itself it will only make a filter file for EPGImport plugin that will load the actual data.
Can you explain where the actual problem happens in the plugin itself, the "alternative" channels are not visible in the channel list?
Re: EPGImport Filter v1.00 by Acds #145
-
- Senior Member
- 1,030 posts
+65
Good
Posted 11 June 2015 - 05:36
Well, it's simple:
BOUQUET 1 ->> nn channels
BOUQUET 2 ->> nn channels
BOUQUET 3 ->> nn channels
BOUQUET . ->> nn channels
BOUQUET n ->> nn channels
This is how you handle building the filter list of channels for which EPGImport shall update with rytec data.
But it's not that one-dimensional:
Bouquets can exist inside Bouquets too!
I'll show you more detailled:
My "root" bouquet (/etc/enigma2/bouquets.tv) looks like this:
Your EPGImportFilter allows me to chose one or more out of the real bouquets listed above ... fine.
But obviously your filter only accepts entries like these:
But bouquets might look like this as well:
You might notice the srefs of the alternatives do not start with 1:7:1: like real bouquets but with 1:134:1 which marks them as being one station with alternatives.
These "sub-bouquets" are meant to be entirely transparent to the user, as seen here in the channel list:
or on OWif:
If you look at those chans, you will without doubt agree that Rytec has EPG for at least some of them, but the filteres result is comparibly short:
So this is what do do:
When you encounter an entry starting with 1:134:1 inside a bouquet do not skip it (I guess you do not even intentionally do that but instead look up its sref again and again without success).
Instead,
1. descend into it (that means: Read the srefs listed inside))
2. Search for a Rytec source one after the other for each entry until you have found a hit, then stop processing that alternative definition (It's enough if one of the stations has an EPG)
3. Go on with the next station/alternative
BOUQUET 1 ->> nn channels
BOUQUET 2 ->> nn channels
BOUQUET 3 ->> nn channels
BOUQUET . ->> nn channels
BOUQUET n ->> nn channels
This is how you handle building the filter list of channels for which EPGImport shall update with rytec data.
But it's not that one-dimensional:
Bouquets can exist inside Bouquets too!
I'll show you more detailled:
My "root" bouquet (/etc/enigma2/bouquets.tv) looks like this:
#NAME User - bouquets (TV) #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.favourites.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.bef001.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.iptv_XXX.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.sd.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.kinder.tv" ORDER BY bouquetNothing spectacular, it will look this or any similar way for everybody.
Your EPGImportFilter allows me to chose one or more out of the real bouquets listed above ... fine.
But obviously your filter only accepts entries like these:
#NAME SD-Alternativen (TV) #SERVICE 1:0:1:2EE3:441:1:C00000:0:0:0: #SERVICE 1:0:1:2EF4:441:1:C00000:0:0:0: ... #SERVICE 1:0:1:6E2E:431:1:C00000:0:0:0: #SERVICE 1:0:1:6DCE:44D:1:C00000:0:0:0:inside the bouquets.
But bouquets might look like this as well:
#NAME Favoriten (TV) #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.RTLHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.RTL2HD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SUPERRTLHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.RTLNITROHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.RTLCrimeHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.ProSiebenHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.ProSiebenMAXXHD.tv" ORDER BY bouquet #SERVICE 1:0:19:6A:E:85:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SAT.1HD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SAT.1GoldHD.tv" ORDER BY bouquet #SERVICE 1:0:1:125D:3F7:1:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.kabeleinsHD.tv" ORDER BY bouquet #SERVICE 1:0:1:4462:453:1:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.VOXHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SIXXHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.Tele5HD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.AXNHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.FoxHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.TNTSerieHD.tv" ORDER BY bouquet #SERVICE 1:0:1:23:F:85:C00000:0:0:0: #SERVICE 1:0:19:88:8:85:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.13thStreetHD.tv" ORDER BY bouquet #SERVICE 1:0:19:65:E:85:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SyfyHD.tv" ORDER BY bouquet #SERVICE 1:0:1:17:1:85:C00000:0:0:0: #SERVICE 1:0:1:21:F:85:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SkyCinemaHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SkyActionHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SkyAtlanticHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SkyHitsHD.tv" ORDER BY bouquetAs you can see, there are very few single channels inside the bouquets but mainly "services with alternatives" (The ones which look almost like bouquets themselves).
You might notice the srefs of the alternatives do not start with 1:7:1: like real bouquets but with 1:134:1 which marks them as being one station with alternatives.
These "sub-bouquets" are meant to be entirely transparent to the user, as seen here in the channel list:
or on OWif:
If you look at those chans, you will without doubt agree that Rytec has EPG for at least some of them, but the filteres result is comparibly short:
<?xml version="1.0" encoding="latin-1"?> <!-- service references can be found in /etc/enigma2/lamedb --> <channels> <channel id="ProSiebenFun.de">1:0:19:6a:e:85:c00000:0:0:0:</channel> <!-- --> <channel id="Sat1Comedy.de">1:0:1:125d:3f7:1:c00000:0:0:0:</channel> <!-- --> <channel id="KabelEinsClassic.de">1:0:1:4462:453:1:c00000:0:0:0:</channel> <!-- --> <channel id="TNTFilm.de">1:0:1:23:f:85:c00000:0:0:0:</channel> <!-- --> <channel id="TNTGlitz.de">1:0:19:88:8:85:c00000:0:0:0:</channel> <!-- --> <channel id="Universal.de">1:0:19:65:e:85:c00000:0:0:0:</channel> <!-- --> <channel id="SkyKrimi.de">1:0:1:17:1:85:c00000:0:0:0:</channel> <!-- --> <channel id="Kinowelt.de">1:0:1:21:f:85:c00000:0:0:0:</channel> <!-- --> <channel id="SkyComedy.de">1:0:1:8:2:85:c00000:0:0:0:</channel> <!-- --> <channel id="SkyEmotion.de">1:0:1:14:2:85:c00000:0:0:0:</channel> <!-- --> <channel id="SkyNostalgie.de">1:0:1:204:3:85:c00000:0:0:0:</channel> <!-- --> <channel id="ATV2.at">1:0:1:33a7:3eb:1:c00000:0:0:0:</channel> <!-- --> <channel id="Puls4.at">1:0:1:4e27:43a:1:c00000:0:0:0:</channel> <!-- --> <channel id="3plus.ch">1:0:1:1260:3f7:1:c00000:0:0:0:</channel> <!-- --> <channel id="Brazzers.ero">1:0:1:1d25:2fa8:13e:820000:0:0:0:</channel> <!-- --> <channel id="RedlightHD.ero">1:0:1:4224:3db8:13e:820000:0:0:0:</channel> <!-- --> <channel id="HustlerHD.ero">1:0:1:4225:3db8:13e:820000:0:0:0:</channel> <!-- --> <channel id="HustlerTV.ero">1:0:16:3253:45f:35:c00000:0:0:0:</channel> <!-- --> <channel id="DaringTV.ero">1:0:1:1360:33f4:13e:820000:0:0:0:</channel> <!-- --> <channel id="FrenchLover.ero">1:0:1:34c8:3c28:13e:820000:0:0:0:</channel> <!-- --> <channel id="Dorcel.ero">1:0:1:364c:1fa4:13e:820000:0:0:0:</channel> <!-- --> <channel id="Brazzers.ero">1:0:16:3252:45f:35:c00000:0:0:0:</channel> <!-- --> <channel id="DorcelNight.ero">1:0:1:4285:446:1:c00000:0:0:0:</channel> <!-- --> <channel id="PINK'oTV.ero">1:0:1:35d8:1388:13e:820000:0:0:0:</channel> <!-- --> <channel id="beateUhseTV.de">1:0:1:15:11:85:c00000:0:0:0:</channel> <!-- --> <channel id="PlayboyTV.ero">1:0:1:778b:424:1:c00000:0:0:0:</channel> <!-- --> <channel id="VividTV.ero">1:0:1:fe0:451:35:c00000:0:0:0:</channel> <!-- --> <channel id="ComedyCentral/VIVA.de">1:0:1:7004:436:1:c00000:0:0:0:</channel> <!-- --> <channel id="MTVMusic24.fr">1:0:1:6fff:436:1:c00000:0:0:0:</channel> <!-- --> <channel id="MTVHits.fr">1:0:1:6fee:42a:1:c00000:0:0:0:</channel> <!-- --> <channel id="MTVDance.uk">1:0:1:6fef:42a:1:c00000:0:0:0:</channel> <!-- --> <channel id="MTVRocks.fr">1:0:1:6ff3:42a:1:c00000:0:0:0:</channel> <!-- --> <channel id="VH1UK.uk">1:0:1:6ff0:42a:1:c00000:0:0:0:</channel> <!-- --> <channel id="go.tv">1:0:1:32dd:45d:1:c00000:0:0:0:</channel> <!-- --> <channel id="HistoryHD.de">1:0:19:71:b:85:c00000:0:0:0:</channel> <!-- --> <channel id="AandE.de">1:0:1:39:f:85:c00000:0:0:0:</channel> <!-- --> <channel id="MotorVision.de">1:0:1:a8:1:85:c00000:0:0:0:</channel> <!-- --> <channel id="ARD-alpha.de">1:0:1:6f47:445:1:c00000:0:0:0:</channel> <!-- --> <channel id="RTLLiving.de">1:0:1:2efe:441:1:c00000:0:0:0:</channel> <!-- --> <channel id="rheinmaintv.de">1:0:1:3146:459:1:c00000:0:0:0:</channel> <!-- --> <channel id="Romance.de">1:0:1:26:f:85:c00000:0:0:0:</channel> <!-- --> <channel id="RTLPassion.de">1:0:1:1d:1:85:c00000:0:0:0:</channel> <!-- --> <channel id="Heimatkanal.de">1:0:1:16:11:85:c00000:0:0:0:</channel> <!-- --> <channel id="9Live.de">1:0:1:206:11:85:c00000:0:0:0:</channel> <!-- --> <channel id="Classica.de">1:0:1:18:11:85:c00000:0:0:0:</channel> <!-- --> <channel id="EEntertainment.de">1:0:19:80:e:85:c00000:0:0:0:</channel> <!-- --> </channels>This list is identical the list of channels that are not defined with alternatives (and have a Rytec EPG), so the reason for the list being that short has to be that EPGImportFilter forgot to parse the alternatives.
So this is what do do:
When you encounter an entry starting with 1:134:1 inside a bouquet do not skip it (I guess you do not even intentionally do that but instead look up its sref again and again without success).
Instead,
1. descend into it (that means: Read the srefs listed inside))
2. Search for a Rytec source one after the other for each entry until you have found a hit, then stop processing that alternative definition (It's enough if one of the stations has an EPG)
3. Go on with the next station/alternative
1st box: Vu+ Ultimo 4k 4xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
2nd box: Gigablue Quad 4k 2xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
testing boxes: Vu+ Duo² + AX Quadbox HD2400 + 2x Vu+ Solo² + Octagon SF4008
Sats & Pay-TV: Astra 19.2°E + Hotbird 13°E with Redlight / SCT HD / SES Astra HD- / Sky V14 / 4th empire propaganda TV
Card-Server: Raspberry Pi + IPv6-capable oscam
Router: Linksys WRT1900ACS w/ LEDE + Fritz!Box 7390
2nd box: Gigablue Quad 4k 2xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
testing boxes: Vu+ Duo² + AX Quadbox HD2400 + 2x Vu+ Solo² + Octagon SF4008
Sats & Pay-TV: Astra 19.2°E + Hotbird 13°E with Redlight / SCT HD / SES Astra HD- / Sky V14 / 4th empire propaganda TV
Card-Server: Raspberry Pi + IPv6-capable oscam
Router: Linksys WRT1900ACS w/ LEDE + Fritz!Box 7390
Re: EPGImport Filter v1.00 by Acds #146
-
- Senior Member
- 108 posts
+4
Neutral
Posted 11 June 2015 - 10:22
Well, it's simple:
BOUQUET 1 ->> nn channels
BOUQUET 2 ->> nn channels
BOUQUET 3 ->> nn channels
BOUQUET . ->> nn channels
BOUQUET n ->> nn channels
This is how you handle building the filter list of channels for which EPGImport shall update with rytec data.
But it's not that one-dimensional:
Bouquets can exist inside Bouquets too!
I'll show you more detailled:
My "root" bouquet (/etc/enigma2/bouquets.tv) looks like this:#NAME User - bouquets (TV) #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.favourites.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.bef001.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.iptv_XXX.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.sd.tv" ORDER BY bouquet #SERVICE 1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "userbouquet.kinder.tv" ORDER BY bouquetNothing spectacular, it will look this or any similar way for everybody.
Your EPGImportFilter allows me to chose one or more out of the real bouquets listed above ... fine.
But obviously your filter only accepts entries like these:#NAME SD-Alternativen (TV) #SERVICE 1:0:1:2EE3:441:1:C00000:0:0:0: #SERVICE 1:0:1:2EF4:441:1:C00000:0:0:0: ... #SERVICE 1:0:1:6E2E:431:1:C00000:0:0:0: #SERVICE 1:0:1:6DCE:44D:1:C00000:0:0:0:inside the bouquets.
But bouquets might look like this as well:#NAME Favoriten (TV) #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.RTLHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.RTL2HD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SUPERRTLHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.RTLNITROHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.RTLCrimeHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.ProSiebenHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.ProSiebenMAXXHD.tv" ORDER BY bouquet #SERVICE 1:0:19:6A:E:85:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SAT.1HD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SAT.1GoldHD.tv" ORDER BY bouquet #SERVICE 1:0:1:125D:3F7:1:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.kabeleinsHD.tv" ORDER BY bouquet #SERVICE 1:0:1:4462:453:1:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.VOXHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SIXXHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.Tele5HD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.AXNHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.FoxHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.TNTSerieHD.tv" ORDER BY bouquet #SERVICE 1:0:1:23:F:85:C00000:0:0:0: #SERVICE 1:0:19:88:8:85:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.13thStreetHD.tv" ORDER BY bouquet #SERVICE 1:0:19:65:E:85:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SyfyHD.tv" ORDER BY bouquet #SERVICE 1:0:1:17:1:85:C00000:0:0:0: #SERVICE 1:0:1:21:F:85:C00000:0:0:0: #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SkyCinemaHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SkyActionHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SkyAtlanticHD.tv" ORDER BY bouquet #SERVICE 1:134:1:0:0:0:0:0:0:0:FROM BOUQUET "alternatives.SkyHitsHD.tv" ORDER BY bouquetAs you can see, there are very few single channels inside the bouquets but mainly "services with alternatives" (The ones which look almost like bouquets themselves).
You might notice the srefs of the alternatives do not start with 1:7:1: like real bouquets but with 1:134:1 which marks them as being one station with alternatives.
These "sub-bouquets" are meant to be entirely transparent to the user, as seen here in the channel list:
or on OWif:
If you look at those chans, you will without doubt agree that Rytec has EPG for at least some of them, but the filteres result is comparibly short:<?xml version="1.0" encoding="latin-1"?> <!-- service references can be found in /etc/enigma2/lamedb --> <channels> <channel id="ProSiebenFun.de">1:0:19:6a:e:85:c00000:0:0:0:</channel> <!-- --> <channel id="Sat1Comedy.de">1:0:1:125d:3f7:1:c00000:0:0:0:</channel> <!-- --> <channel id="KabelEinsClassic.de">1:0:1:4462:453:1:c00000:0:0:0:</channel> <!-- --> <channel id="TNTFilm.de">1:0:1:23:f:85:c00000:0:0:0:</channel> <!-- --> <channel id="TNTGlitz.de">1:0:19:88:8:85:c00000:0:0:0:</channel> <!-- --> <channel id="Universal.de">1:0:19:65:e:85:c00000:0:0:0:</channel> <!-- --> <channel id="SkyKrimi.de">1:0:1:17:1:85:c00000:0:0:0:</channel> <!-- --> <channel id="Kinowelt.de">1:0:1:21:f:85:c00000:0:0:0:</channel> <!-- --> <channel id="SkyComedy.de">1:0:1:8:2:85:c00000:0:0:0:</channel> <!-- --> <channel id="SkyEmotion.de">1:0:1:14:2:85:c00000:0:0:0:</channel> <!-- --> <channel id="SkyNostalgie.de">1:0:1:204:3:85:c00000:0:0:0:</channel> <!-- --> <channel id="ATV2.at">1:0:1:33a7:3eb:1:c00000:0:0:0:</channel> <!-- --> <channel id="Puls4.at">1:0:1:4e27:43a:1:c00000:0:0:0:</channel> <!-- --> <channel id="3plus.ch">1:0:1:1260:3f7:1:c00000:0:0:0:</channel> <!-- --> <channel id="Brazzers.ero">1:0:1:1d25:2fa8:13e:820000:0:0:0:</channel> <!-- --> <channel id="RedlightHD.ero">1:0:1:4224:3db8:13e:820000:0:0:0:</channel> <!-- --> <channel id="HustlerHD.ero">1:0:1:4225:3db8:13e:820000:0:0:0:</channel> <!-- --> <channel id="HustlerTV.ero">1:0:16:3253:45f:35:c00000:0:0:0:</channel> <!-- --> <channel id="DaringTV.ero">1:0:1:1360:33f4:13e:820000:0:0:0:</channel> <!-- --> <channel id="FrenchLover.ero">1:0:1:34c8:3c28:13e:820000:0:0:0:</channel> <!-- --> <channel id="Dorcel.ero">1:0:1:364c:1fa4:13e:820000:0:0:0:</channel> <!-- --> <channel id="Brazzers.ero">1:0:16:3252:45f:35:c00000:0:0:0:</channel> <!-- --> <channel id="DorcelNight.ero">1:0:1:4285:446:1:c00000:0:0:0:</channel> <!-- --> <channel id="PINK'oTV.ero">1:0:1:35d8:1388:13e:820000:0:0:0:</channel> <!-- --> <channel id="beateUhseTV.de">1:0:1:15:11:85:c00000:0:0:0:</channel> <!-- --> <channel id="PlayboyTV.ero">1:0:1:778b:424:1:c00000:0:0:0:</channel> <!-- --> <channel id="VividTV.ero">1:0:1:fe0:451:35:c00000:0:0:0:</channel> <!-- --> <channel id="ComedyCentral/VIVA.de">1:0:1:7004:436:1:c00000:0:0:0:</channel> <!-- --> <channel id="MTVMusic24.fr">1:0:1:6fff:436:1:c00000:0:0:0:</channel> <!-- --> <channel id="MTVHits.fr">1:0:1:6fee:42a:1:c00000:0:0:0:</channel> <!-- --> <channel id="MTVDance.uk">1:0:1:6fef:42a:1:c00000:0:0:0:</channel> <!-- --> <channel id="MTVRocks.fr">1:0:1:6ff3:42a:1:c00000:0:0:0:</channel> <!-- --> <channel id="VH1UK.uk">1:0:1:6ff0:42a:1:c00000:0:0:0:</channel> <!-- --> <channel id="go.tv">1:0:1:32dd:45d:1:c00000:0:0:0:</channel> <!-- --> <channel id="HistoryHD.de">1:0:19:71:b:85:c00000:0:0:0:</channel> <!-- --> <channel id="AandE.de">1:0:1:39:f:85:c00000:0:0:0:</channel> <!-- --> <channel id="MotorVision.de">1:0:1:a8:1:85:c00000:0:0:0:</channel> <!-- --> <channel id="ARD-alpha.de">1:0:1:6f47:445:1:c00000:0:0:0:</channel> <!-- --> <channel id="RTLLiving.de">1:0:1:2efe:441:1:c00000:0:0:0:</channel> <!-- --> <channel id="rheinmaintv.de">1:0:1:3146:459:1:c00000:0:0:0:</channel> <!-- --> <channel id="Romance.de">1:0:1:26:f:85:c00000:0:0:0:</channel> <!-- --> <channel id="RTLPassion.de">1:0:1:1d:1:85:c00000:0:0:0:</channel> <!-- --> <channel id="Heimatkanal.de">1:0:1:16:11:85:c00000:0:0:0:</channel> <!-- --> <channel id="9Live.de">1:0:1:206:11:85:c00000:0:0:0:</channel> <!-- --> <channel id="Classica.de">1:0:1:18:11:85:c00000:0:0:0:</channel> <!-- --> <channel id="EEntertainment.de">1:0:19:80:e:85:c00000:0:0:0:</channel> <!-- --> </channels>This list is identical the list of channels that are not defined with alternatives (and have a Rytec EPG), so the reason for the list being that short has to be that EPGImportFilter forgot to parse the alternatives.
So this is what do do:
When you encounter an entry starting with 1:134:1 inside a bouquet do not skip it (I guess you do not even intentionally do that but instead look up its sref again and again without success).
Instead,
1. descend into it (that means: Read the srefs listed inside))
2. Search for a Rytec source one after the other for each entry until you have found a hit, then stop processing that alternative definition (It's enough if one of the stations has an EPG)
3. Go on with the next station/alternative
I just checked the code. It selects all bouquets / channels with:
def getChannelList(self, bouquetNames = None):
channels = [ ]
serviceHandler = eServiceCenter.getInstance()
bouquet_rootstr = '1:7:1:0:0:0:0:0:0:0:FROM BOUQUET "bouquets.tv" ORDER BY bouquet'
bouquet_root = eServiceReference(bouquet_rootstr)
idx = 0
list = serviceHandler.list(bouquet_root)
if list:
while True:
s = list.getNext()
if not s.valid():
break
if s.flags & eServiceReference.isDirectory:
info = serviceHandler.info(s)
if info:
if bouquetNames is None or info.getName(s) in bouquetNames:
clist = serviceHandler.list(s)
if clist:
while True:
a = clist.getNext()
if not a.valid(): break
if not (a.flags & eServiceReference.isMarker):
i = serviceHandler.info(a)
name = self.getCompareName(i.getName(a))
# Ref, full name, compare name, indicator of mapping, #matches
channels.append([a.toCompareString().lower(), i.getName(a), name, -1, idx])
idx += 1
Do you see where the problem is maybe? If not I will have to create alternatives and debug it and I am so lazzy when the weather is this hot.
Re: EPGImport Filter v1.00 by Acds #147
-
- Senior Member
- 96 posts
0
Neutral
Posted 27 August 2015 - 12:58
This plugin just saves RAM usage, not downloaded data, right?? I ask this because I don't care about RAM usage (Duo2) but I have a very slow internet connection... less downloaded data would mean less time.
DVBS Tuner (satfinder only) || GI Avatar 2 2xDVBS2 (spark162_SH4) ||Vu+ Zero || Vu+ Duo2 4xDVBS2 1TB HD || OpenATV 6.0
0,6m+(0.8m)+0,9m+1,2m Multi feed @13ºE, 19.2ºE, 28.3ºE, 30W
Samsung 32" HDTV || 2.1 Trust Tytan
Win 10 x64 || FX8350 || 8GB RAM || MSI Gaming GTX970 || ASUS VP278H 27" || Trust Tytan 2.1 || Logitech G29
Raspberry PI 3 Model B || Samsung S22c300 21.5"
TPLINK WR1043NDv2 running LEDE || OpenVPN >=< LAN|| Lt26i Custom Android
Re: EPGImport Filter v1.00 by Acds #148
-
- Senior Member
- 108 posts
+4
Neutral
Posted 27 August 2015 - 17:04
This plugin just saves RAM usage, not downloaded data, right?? I ask this because I don't care about RAM usage (Duo2) but I have a very slow internet connection... less downloaded data would mean less time.
It downloads same EPG packages but it will take significantly less time when processing because it will process / update only EPG channels of your choice.
So in general, it won't save you much bandwith but loading time will be significantly lower.
Re: EPGImport Filter v1.00 by Acds #149
-
- Senior Member
- 96 posts
0
Neutral
Posted 27 August 2015 - 18:35
Thanks
BTW the Advanced Matching window appears like this (see attachment) on my system, window seems cut off at the top. This is a openwebif screenshot, also looks the same on tv.
Maybe a skin problem or not? I have a FullHD skin.
Attached Files
-
1.jpg 62.89KB
6 downloads
DVBS Tuner (satfinder only) || GI Avatar 2 2xDVBS2 (spark162_SH4) ||Vu+ Zero || Vu+ Duo2 4xDVBS2 1TB HD || OpenATV 6.0
0,6m+(0.8m)+0,9m+1,2m Multi feed @13ºE, 19.2ºE, 28.3ºE, 30W
Samsung 32" HDTV || 2.1 Trust Tytan
Win 10 x64 || FX8350 || 8GB RAM || MSI Gaming GTX970 || ASUS VP278H 27" || Trust Tytan 2.1 || Logitech G29
Raspberry PI 3 Model B || Samsung S22c300 21.5"
TPLINK WR1043NDv2 running LEDE || OpenVPN >=< LAN|| Lt26i Custom Android
Re: EPGImport Filter v1.00 by Acds #150
-
- Senior Member
- 108 posts
+4
Neutral
Posted 27 August 2015 - 22:07
Thanks
BTW the Advanced Matching window appears like this (see attachment) on my system, window seems cut off at the top. This is a openwebif screenshot, also looks the same on tv.
Maybe a skin problem or not? I have a FullHD skin.
Seems as skin issue, yeah.
Re: EPGImport Filter v1.00 by Acds #151
-
- Member
- 2 posts
0
Neutral
Posted 1 September 2015 - 16:12
Hello i have problem with plugin on et5000 - i can select bouquet but i when i press blue button nothing happen?
what can i do...Other buttons work.
Re: EPGImport Filter v1.00 by Acds #152
-
- Member
- 2 posts
0
Neutral
Posted 1 September 2015 - 16:31
Sorry wasnt using latest version
Re: EPGImport Filter v1.00 by Acds #153
-
- Member
- 6 posts
0
Neutral
Posted 1 December 2015 - 22:08
Hello in the Group, I am trying to get EPG Import Filter working on an OPENATV image 5.1 on a DM8000. I got the lastest version from Github. 1.12, installed it and got the plugin running.
I can select my Bouquet which I which to find EPG data for. I have added a file to /etc/epgimport called rytec.sources.xml
Here is an example of the file (I have XXX the link, but the gz file is active and working..)
<?xml version="1.0" encoding="latin-1"?>
<sources>
<source type="gen_xmltv" channels="http://www.vuplus-co...annels.xml.gz">
<description>Rytec Benelux XMLTV</description>
</source>
</sources>
When i push the Blue button i get the message "No channel download links found in /etc/epgimport/rytec.sources.xml ..
Can anybody give me a tip ? Thanks Lawman
Re: EPGImport Filter v1.00 by Acds #154
-
- Member
- 6 posts
0
Neutral
Posted 4 December 2015 - 09:58
So after i entered some channel link info into the rytec.sourece.xml file. I was able to see my channels from the bouguet i selected. I selected then the Rytec Source that i needed (in this case uk) i see that it downloaded it (the gz file is in the tmp folder), then it begins Parsing...but it never stops and doesnt find epg info.
In the /etc/epgimport folder i do see two new files: filteredchannels.xml and filteredrytec.sources.xml
Is there a way to see a log file so that i can determine what the plugin is doing ?
thanks law
Edited by Lawman, 4 December 2015 - 10:00.
Re: EPGImport Filter v1.00 by Acds #155
-
- Senior Member
- 1,030 posts
+65
Good
Posted 12 December 2015 - 19:59
The oe-a plugin EPGImport is heavily modified, compared to the PLi variant of it.
For that reason, the EPGImport filter does not work at all in conjunction with XMLTVImport (oe-a's EPGImport).
I once started an attempt to merge the later PLi changes and the oe-a changes into a new fork of EPGImport, but haven't found the time to finish it yet:
https://github.com/o...gin-xmltvimport
In fact, EPGImportFilter would actually work together with that re-fork (Based on OpenPLi's version and re-introducing oe-a changes, but not breaking file paths and names like it was done the previous time), but I didn't dare to replace the outdated "XMTVImporter" with my remake yet, as it doesn't contain all previous mods made by Andy Black yet and there are oe-a teams that react pretty harsh to that ...
1st box: Vu+ Ultimo 4k 4xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
2nd box: Gigablue Quad 4k 2xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
testing boxes: Vu+ Duo² + AX Quadbox HD2400 + 2x Vu+ Solo² + Octagon SF4008
Sats & Pay-TV: Astra 19.2°E + Hotbird 13°E with Redlight / SCT HD / SES Astra HD- / Sky V14 / 4th empire propaganda TV
Card-Server: Raspberry Pi + IPv6-capable oscam
Router: Linksys WRT1900ACS w/ LEDE + Fritz!Box 7390
2nd box: Gigablue Quad 4k 2xDVB-S2 FBC / 2xDVB-C / 1.8 TB HDD / OpenATV 6.2
testing boxes: Vu+ Duo² + AX Quadbox HD2400 + 2x Vu+ Solo² + Octagon SF4008
Sats & Pay-TV: Astra 19.2°E + Hotbird 13°E with Redlight / SCT HD / SES Astra HD- / Sky V14 / 4th empire propaganda TV
Card-Server: Raspberry Pi + IPv6-capable oscam
Router: Linksys WRT1900ACS w/ LEDE + Fritz!Box 7390
Re: EPGImport Filter v1.00 by Acds #156
-
- Senior Member
- 743 posts
+28
Good
Posted 4 April 2016 - 17:00
@Acds
with the new default skin there is a problem using your plugin
Cheers Colin
PLi Full-Night.jpg 50.45KB
42 downloads
Xtrend et8000 7.1-Release
2 x 8/1 DiSEqC 30w 13e 19e 23e 28e
Astrometa USB Tuner Working DVB-T2 now on Kernel 4.10+
WD10EARX 1TB
Sandisk 32GB USB for AFB, EPG, Picons & Timeshift
ZGemma Star S 7.0-Release
4/1 DiSEqC 30w 13e 19e 28e
Sandisk 8GB USB for AFB, EPG, Picons & Timeshift
LG 49UH610V UHD-HDR
UHF/Cable/Sat
E-Channelizer
Re: EPGImport Filter v1.00 by Acds #157
-
- Senior Member
- 108 posts
+4
Neutral
Posted 17 June 2016 - 21:15
@Acds
with the new default skin there is a problem using your plugin
Cheers Colin
I will fix that when I install newest build. I kinda tend to stick to the build thats stable for a while..
Re: EPGImport Filter v1.00 by Acds #158
-
- Senior Member
- 321 posts
+4
Neutral
Posted 9 July 2016 - 16:04
since any days i cant get no epg data more in Turkish language. have selected turkey but it adds nothing. the sender remain without epg.
relates mainly Turksat
Re: EPGImport Filter v1.00 by Acds #159
-
- Member
- 18 posts
0
Neutral
Posted 19 October 2016 - 14:49
Hi Acds,
Thanks for this plugin.
A few issues I've noted :
TVP Info is auto matched to a wrong channel
La Une Belgium extracted EPG contains TVN Poland EPG and its own EPG
Then I'm not certain if these issues are due to Rytec XML files or your plugin
Can't find channels to match ATV Austria, AMC Poland (previously MGM) & Eleven Sports Extra
Al Jazeera English EPG has a 30 min difference with EIT EPG
Re: EPGImport Filter v1.00 by Acds #160
-
- Member
- 18 posts
0
Neutral
Posted 21 October 2016 - 12:37
Sorted all except :
TVP Info is auto matched to a wrong channel
La Une Belgium extracted EPG contains TVN Poland EPG and its own EPG
Then I'm not certain if these issues are due to Rytec XML files or your plugin
Can't find channels to match ATV Austria, AMC Poland (previously MGM) & Eleven Sports Extra
Al Jazeera English EPG has a 30 min difference with EIT EPG
2 user(s) are reading this topic
0 members, 2 guests, 0 anonymous users
