16 replies to this topic

[FlyGuy94]

Hi 

 

I'm using my own webgrab++ xmltv file. It grabs data from yelo.be (telenet).

I tried to use your plugin. but I see no diffence with the included epg on the dvb-c. I would like to get the season and eps numbers for the shows. They are present in my xmltv from webgrab++.

 

So Is it possible to use that file and import it into my enigma2 box?

[doglover]

Enigma2 has only 5 fields for EPG.

Start time, duration, title, short description and long description.

 

The XMLTV files has much more tags.  Now the epgimporter imports only the directly corresponding tags.  Itr ignores alle the rest, like episode and Cast.

But nothing is lost, you can convert the tags  from webgrab++ to include this info into the corresponding tags.

 

To the siteini of yelo add at the end (completely at the bottom) the following statements .

*For classical credits - remove the next lines
category.modify {cleanup(removeduplicates)}
category.modify {cleanup}
actor.modify {cleanup}
director.modify {cleanup}
actor.modify {replace|\|\||\|}
description.modify {addend('director' not "" separator=", ")|\n'director'}
description.modify {addend('actor' not "" separator="\n")|\n'actor'}
actor.modify {clear}
director.modify {clear}
subtitle.modify {addstart ('titleoriginal' not "") | ('titleoriginal')}
subtitle.modify {addend ('episode' not "") | ('episode')}
subtitle.modify {addend ('productiondate' not "") | ('productiondate')}
subtitle.modify {addstart ('category' not "") |['category'] }
subtitle.modify {addend ('rating' not "") | ['rating'] }
subtitle.modify {cleanup}
rating.modify {clear}
episode.modify {clear}
category.modify {clear}
productiondate.modify {clear}
titleoriginal.modify {clear}
writer.modify {clear}
producer.modify {clear}
composer.modify {clear}
starrating.modify {clear}
rating.modify {clear}
presenter.modify {clear}
starrating.modify {clear}
videoquality.modify {clear}
videoaspect.modify {clear}
index_category.modify {cleanup(removeduplicates)}
index_category.modify {cleanup}
index_description.modify {addend ('index_director' not "" separator=", " )|\n'index_director'}
index_description.modify {addend ('index_actor' not "" separator="\n" )|\n'index_actor'}
index_description.modify {addend ('index_presenter' not "" separator=", " )|\n'index_presenter'}
index_subtitle.modify {addstart ('index_titleoriginal' not "") | ('index_titleoriginal')}
index_subtitle.modify {addend ('index_episode' not "") | ('index_episode')}
index_subtitle.modify {addend ('index_productiondate' not "") | ('index_productiondate')}
index_subtitle.modify {addstart ('index_category' not "") |['index_category'] }
index_subtitle.modify {addend ('index_rating' not "") | ['index_rating'] }
index_writer.modify  {clear}
index_rating.modify {clear}
index_productiondate.modify {clear}
index_titleoriginal.modify {clear}
index_actor.modify {clear}
index_director.modify {clear}
index_presenter.modify {clear}
index_episode.modify {clear}
index_category.modify {clear}
index_videoquality.modify {clear}
description.modify {substring(type=char)|'description' 0 2300}
title.modify {substring(type=char)|'title' 0 80}
subtitle.modify {substring(type=char)|'subtitle' 0 160}
index_description.modify {substring(type=char)|'index_description' 0 2300}
index_title.modify {substring(type=char)|'index_title' 0 80}
index_subtitle.modify {substring(type=char)|'index_subtitle' 0 160}

Now do a full regrab, import the result and you will see the season/episode in the subtitle tag (or short description)

 

Willy

Edited by doglover, 5 February 2018 - 17:15.

[FlyGuy94]

Ok webgrab is running now and it seems to be working.

Just how do I import the file into my box I couldn't find an option to import it in the plugin?

[FlyGuy94]

Enigma2 has only 5 fields for EPG.

Start time, duration, title, short description and long description.

 

The XMLTV files has much more tags.  Now the epgimporter imports only the directly corresponding tags.  Itr ignores alle the rest, like episode and Cast.

But nothing is lost, you can convert the tags  from webgrab++ to include this info into the corresponding tags.

 

To the siteini of yelo add at the end (completely at the bottom) the following statements .

*For classical credits - remove the next lines
category.modify {cleanup(removeduplicates)}
category.modify {cleanup}
actor.modify {cleanup}
director.modify {cleanup}
actor.modify {replace|\|\||\|}
description.modify {addend('director' not "" separator=", ")|\n'director'}
description.modify {addend('actor' not "" separator="\n")|\n'actor'}
actor.modify {clear}
director.modify {clear}
subtitle.modify {addstart ('titleoriginal' not "") | ('titleoriginal')}
subtitle.modify {addend ('episode' not "") | ('episode')}
subtitle.modify {addend ('productiondate' not "") | ('productiondate')}
subtitle.modify {addstart ('category' not "") |['category'] }
subtitle.modify {addend ('rating' not "") | ['rating'] }
subtitle.modify {cleanup}
rating.modify {clear}
episode.modify {clear}
category.modify {clear}
productiondate.modify {clear}
titleoriginal.modify {clear}
writer.modify {clear}
producer.modify {clear}
composer.modify {clear}
starrating.modify {clear}
rating.modify {clear}
presenter.modify {clear}
starrating.modify {clear}
videoquality.modify {clear}
videoaspect.modify {clear}
index_category.modify {cleanup(removeduplicates)}
index_category.modify {cleanup}
index_description.modify {addend ('index_director' not "" separator=", " )|\n'index_director'}
index_description.modify {addend ('index_actor' not "" separator="\n" )|\n'index_actor'}
index_description.modify {addend ('index_presenter' not "" separator=", " )|\n'index_presenter'}
index_subtitle.modify {addstart ('index_titleoriginal' not "") | ('index_titleoriginal')}
index_subtitle.modify {addend ('index_episode' not "") | ('index_episode')}
index_subtitle.modify {addend ('index_productiondate' not "") | ('index_productiondate')}
index_subtitle.modify {addstart ('index_category' not "") |['index_category'] }
index_subtitle.modify {addend ('index_rating' not "") | ['index_rating'] }
index_writer.modify  {clear}
index_rating.modify {clear}
index_productiondate.modify {clear}
index_titleoriginal.modify {clear}
index_actor.modify {clear}
index_director.modify {clear}
index_presenter.modify {clear}
index_episode.modify {clear}
index_category.modify {clear}
index_videoquality.modify {clear}
description.modify {substring(type=char)|'description' 0 2300}
title.modify {substring(type=char)|'title' 0 80}
subtitle.modify {substring(type=char)|'subtitle' 0 160}
index_description.modify {substring(type=char)|'index_description' 0 2300}
index_title.modify {substring(type=char)|'index_title' 0 80}
index_subtitle.modify {substring(type=char)|'index_subtitle' 0 160}

Now do a full regrab, import the result and you will see the season/episode in the subtitle tag (or short description)

 

Willy

I looked again at the plugins options this morning. Still can't find a way to import it. Am I supposed to ftp the file to a folder in my box or something?

I quickly tried googling the issue but came up empty for now.

[doglover]

You have to build a custom.sources.xml file and a customs.channels.xml file.

 

The sources file can be this:

<?xml version="1.0" encoding="UTF-8"?>
<sources>
<sourcecat sourcecatname="Telenet XMLTV">
<source type="gen_xmltv" channels="custom.channels.xml">
  <description>Vlaanderen - Telenet (Custom)</description>
<url>/home/Fritz/epg/guide.xml</url>
</source>
</sourcecat>
</sources>

Place this file in /etc/epgimport/ under the name custom.sources.xml

 

You have to make a custom.channels.xml file and place these also in /etc/epgimport/

This file should contain the channel service refs and the link with the <channel id="   " tag of your guide.xml

(yes, this is a time consuming job)

 

Or, you can try to import simply the Rytec Belgie/Belgique/Nederland/France XMLTV category:

 

Nederland - Basis (xz)

Vlaanderen - Basis (xz)

Vlaanderen/Nederland - Gemeenschappelijk (xz)

Nederland - Sport/Movies (xz)

Wallonie - Telesat Base (xz)

 

These also contain links for telenet.  Although I have not received any corrections lately, so some links may not be correct anymore.

 

Willy

[FlyGuy94]

Ok thanks I will try manually. Your links from telenet are indeed mostly dead. 

I will have my work cut out for me tonight.

[doglover]

Ok thanks I will try manually. Your links from telenet are indeed mostly dead. 

I will have my work cut out for me tonight.

 

Maybe you can help me with updating these.  See here:

 

https://forums.openp...g-for-channels/

 

Willy

[FlyGuy94]

Sure if I figure it out I will let you know.

[FlyGuy94]

I'm getting closer. Still not quite there yet when I try to import on a fresh boot i get this log

0_0_0_0
Invalid serviceref string: 1_0_1_38C_9_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_259_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_907_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_207_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_900_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_131_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_2C0_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_3EB_A_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_25E_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_25D_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_906_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_3EF_A_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_25A_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_8FD_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_3F3_A_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_455_B_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_454_B_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_903_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_CE_2_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_456_B_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_CA_2_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_4B9_C_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_4B3_C_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_2BD_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_2BE_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_2BF_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_389_9_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_38A_9_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_713_12_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_714_12_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_715_12_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_716_12_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_269_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_267_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_64C_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_709_12_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_4B6_C_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_909_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_90A_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_587_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_588_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_2C4_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_1F6_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_203_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_589_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_580_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_901_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_388_9_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_CD_2_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_656_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_57D_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_90B_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_2C5_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_D0_2_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_2CB_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_1F7_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_4B5_C_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_641_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_90D_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_718_12_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_717_12_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_197_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_198_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_58C_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_57F_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_582_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_64B_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_579_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_3F4_A_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_CC_2_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_CB_2_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_328_8_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_201_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_193_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_195_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_191_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_19A_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_194_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_192_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_2EF_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_934_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_57E_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_20F_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_34D_8_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_34C_8_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_67A_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_4DA_C_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_925_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_289_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_66F_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_34E_8_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_66A_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_66E_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_F4_2_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_22C_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_294_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_669_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_5A2_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_5A3_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_287_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_66B_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_2C3_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_2C2_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_2C6_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_645_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_644_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_200_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_902_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_8FE_17_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_58A_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_260_6_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_322_8_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_321_8_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_658_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_202_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_210_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_205_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_1F9_5_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_2C1_7_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_12D_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_12F_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_130_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_138_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_132_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_134_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_136_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_137_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_133_3_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_32A_8_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_57A_E_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_642_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_1_196_4_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_643_10_1_FFFF0000_0_0_0
Invalid serviceref string: 1_0_19_64F_10_1_FFFF0000_0_0_0
[XMLTVConverter] Enumerating event information
[EPGImport] imported 0 events
[EPGImport] Save last import date and count event
[EPGImport] Wait for parse autotimers 30 sec.
[EPGImport] Run start parse autotimers
[EPGImport] #### Finished ####
[EPGImport] connectionLost [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionFdescWentAway'>: Uh: Filedescriptor went away.
]

If I try again without rebooting I get this

[EPGImport] nextImport, source= Vlaanderen - Telenet (Custom)
[EPGImport] afterDownload /media/net/NAS/guide.xml
[EPGImport] afterChannelDownload None
[XMLTVConverter] Enumerating event information
[EPGImport] imported 0 events
[EPGImport] Save last import date and count event
[EPGImport] Wait for parse autotimers 30 sec.
[EPGImport] Run start parse autotimers
[EPGImport] #### Finished ####
[EPGImport] connectionLost [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionFdescWentAway'>: Uh: Filedescriptor went away.
]
[EPGImport] Run check deep standby after import

Then I copied the guide to the box itself and imported it just to rule out a network issue. The result was still unchanged.

Attached Files

•  epgimport.log   7.83KB   6 downloads
•  epgimport.log   614bytes   2 downloads
•  custom.channels.xml   9.76KB   33 downloads
•  custom.sources.xml   276bytes   46 downloads

[FlyGuy94]

Don't mind me I'm just a massive idiot somehow after copying so many lines I failed to notice when copying the serviceref it always changed from ":" to "_"

Then after some more fiddling I managed to erase the epg and fill in my own. There are still some channels that have no epg for some reason so yeah still have to fix that. 

[doglover]

The service refs have the wrong format:

 

<channel id="VTM HD">1_0_19_3ED_A_1_FFFF0000_0_0_0</channel>

 

should be:

 

<channel id="VTM HD">1:0:19:3ED:A:1:FFFF0000:0:0:0:</channel>

 

This can be corrected with 2 search and replaces.  Replace _ with : and </channel> with :</channel>

 

Willy

[FlyGuy94]

It seems some channels don't want to play ball. I can't get epg for "één HD" and "The Israëli Network" and some others with special characters for some reason. 

 

I triple checked the name and service id they are correct but they still don't show epg. Log says unknown channel.

 

[doglover]

"één HD" and "The Israëli Network"

 

 

These special chars should work (enigma2 is utf-8 compatible) , however I experienced also problems with those.

I avoid them altogether.

 

Willy

[FlyGuy94]

Thanks my channels file wasn't set for  UTF-8 encoding. problem solved.

[FlyGuy94]

 

Ok thanks I will try manually. Your links from telenet are indeed mostly dead. 

I will have my work cut out for me tonight.

 

Maybe you can help me with updating these.  See here:

 

https://forums.openp...g-for-channels/

 

Willy

 

 

Do you still need this? 

The channels xml file I uploaded before should be enough right?

Still here is the latest one without the mistakes. I have also added the picons incase you have a use for them.

Attached Files

•  picon.zip   2.14MB   17 downloads
•  custom.channels.xml   9.81KB   41 downloads

[doglover]

Thanks.

I will correct the Telenet channels in rytec channels file.

 

Willy

[FlyGuy94]

Thanks.

I will correct the Telenet channels in rytec channels file.

 

Willy

 

Ok just note Not all channels are in there There are some regonal channels that I can't watch where I live. My regonal channel is called "focus" but there are some others. 

Incase someone needs them I can look if I can scan for them manually and give you the service refs.

 

Trying to do all of this manually made me realise how much work you put into this each and every day. I thought my arm was going to fall off after copying all those channels one by one just for one country.

But you do like so many more I don't think all people realise just how much work goes into this.

 

Respect mate.