22 replies to this topic

[sonic-x]

Hi, I have been exporting my epg from one enigma 2 receiver using Web grab plus and open webif, I then created the corresponding channel.xml and the epg xml file created by webgrab+, I then created the rytec file and placed it into the crossepg providers folder with the correct links to the files and mapped the channels in the channel xml but for some reason the import hangs on loading, I have test on 2 recivers and hangs on both, I want to export the epg from one to the other because one receiver downloads my operators epg in he preferred language properly but the other doesnt and shows it in a different language(default), I want to import the epg from one receiver onto the other as both receivers have cross epg. I would appreciate some help on the correct web grabber xml settings for the rytec import to work or any other setting that could be wrong.

[doglover]

Crossepg cannot import local files.

It imports only files downloaded from the internet.

 

If you want to do this you have to use XMLTVimport on the importing machine.  XMLTVimport can import local files.

And files procuced by Webgrab++ are compatible with the EPG structure used by both Crossepg and XMLTVimport.

However only 4 tags are imported.

 

1. Schedule settings (time)

2. Title

3. Subtitle

4. Description

 

All other tags are disgarded.

 

If you post the SiteIni you use, I can take a look if something can be improved on.

 

Willy

Edited by doglover, 10 August 2015 - 07:51.

[sonic-x]

Hi,  yes I uploaded the files to a web server and included the links in the cross epg rytec files, the files on the web server are a channel.xml with mapped channels and the webgrap output xml with the epg and correct channel names matching the channel xml, Cross Epg starts the download process, then initializes but then hangs on loading data. it happens on both receivers so Im doing something wrong.

 

I could upload the files if it would help. I have uploaded the ini file you requested, its actually based on a file you uploaded in the past and it works great at grabbing the data.

 

The idea is that once I get it working I would automate the xml update etc so it would work on the normal crossepg, the second receiver is quiet limited with epg imports it will only work with cross epg that has been ported to it by the manufacturer so I need to get this to work with cross epg.

 

 

Thank you

 

 

 

Attached Files

•  openwebif.rar   752bytes   67 downloads

[sonic-x]

Ok, I figured at which stage the problem is happening, when reading the web grab output xml after deflating it the cross epg hangs at loading and the logs say this every time 

 

10/08/2015 20:36:14 Deflating epgdata.gz

10/08/2015 20:36:14 File deflated

10/08/2015 20:36:14 Parsing /media/hdd//crossepg/crossepg.tmp.d3nye1

10/08/2015 20:36:14 Read 0 events

10/08/2015 20:36:14 Failed to parse /media/hdd//crossepg/crossepg.tmp.d3nye1 (on line 1: SYSTEM or PUBLIC, the URI is missing

)

[sonic-x]

After bit of tweaking I shrunk the list down and I managed to get it to read the events for 2 channels but I still cannot get cross epg to parse the events heres the latest log, I would appreciate some help with what could be causing the parsing error with the web grab generated xml

 

10/08/2015 21:34:36 File deflated

10/08/2015 21:34:36 Parsing /media/hdd//crossepg/crossepg.tmp.7OWo7Y

10/08/2015 21:34:36 Read 97 events

10/08/2015 21:34:36 Failed to parse /media/hdd//crossepg/crossepg.tmp.7OWo7Y for new events

 

10/08/2015 21:34:36 No more url available

10/08/2015 21:34:36 Error downloading/parsing channels file

10/08/2015 21:34:36 Interactive: SAVE cmd received

10/08/2015 21:34:37 Interactive: CLOSE cmd received

10/08/2015 21:34:37 EPGDB closed

10/08/2015 21:34:37 Interactive: OK action sent

10/08/2015 21:34:37 Interactive: QUIT cmd received

[doglover]

I will try tomorrow to duplicate something.

 

(I installed last week WIN10 - a disaster)  so today I spent the whole trying to get WIN8.1 back.

 

Willy

[sonic-x]

Hey, ok thanks but I got it to work so I think its ok, it seems the problem was with the cross epg cache on the receivers keeping the original epg data so even though it wasnt parsing it was still being inserted, however the receiver I was importing the files to still overwrites them with the new epg once i zap to a channel :/ so Im trying to find out how to stop that i dunno by corrupting the EIT process no success yet, why was win 10 a disaster? I was hoping it was better than win 8, I havent installed it yet.

[doglover]

I tried to import on XMLTVimport with 3 channels a grabbed with your definition.

No problem.

[EPGImport] WakeUpTime now set to 1439277327 (now=1439276089)
[EPGImport] nextImport, source= Test XMLTV
[EPGImport] afterDownload /etc/epgimport/testwebgrab.xml
[EPGImport] afterChannelDownload None
[EPGImport] Using twisted thread
[EPGImport] Parsing channels from '/etc/epgimport/test.channels.xml'
[XMLTVConverter] Enumerating event information
[EPGImport] ### thread is ready ### Events: 438
[EPGImport] imported 438 events
[EPGImport] #### Finished ####

Your grabber definition contains something strange:

 

end_scope

 

This statement needs another one, which is missing in your SiteINI

Something like this:

scope.range {(channellist)|end}

 

So you simply delete it.

 

 

And these statements:

title.scrub {single|<div class="titlename"|">|</div>}
title.modify {cleanup}
description.scrub {multi (exclude="text-indent")|<div class="synopsis-content-th"|">|</p>|</div>}
description.modify {cleanup(tags="<"">")}
temp_1.scrub {multi (exclude="text-indent")|<div class="synopsis-content-eng"|">|</p>|</div>}
description.modify {cleanup(tags="<"">")}
description.modify {addend ('temp_1' not = "")|\n'temp_1'}

Do not do anything.  They are used on detail pages (which there are not any)

In order to load detail pages you need a statement beginning with:  index_urlshow {url

 

Which is not present, so no detail pages are loaded.  (There aren't any on enigma2)

You can simply delete these statements.

 

If have come accross in the past on one thing which could be problematic in the import.

Can you check if in the XMLTV file no line is ending on: " />"

Omit the quotes.  The space is important.

Open the XMLTV file in an editor and Search for this string.

If this happens:  trouble.

I know what to do, but I cannot prevent it.  It should not happen however with this SiteINI, but you never know.

 

For Win10 see: http://forums.openpl...ws-10-disaster/

 

Willy

[gogglebox]

Hi, I have been exporting my epg from one enigma 2 receiver using Web grab plus and open webif, I then created the corresponding channel.xml and the epg xml file created by webgrab+, I then created the rytec file and placed it into the crossepg providers folder with the correct links to the files and mapped the channels in the channel xml but for some reason the import hangs on loading, I have test on 2 recivers and hangs on both, I want to export the epg from one to the other because one receiver downloads my operators epg in he preferred language properly but the other doesnt and shows it in a different language(default), I want to import the epg from one receiver onto the other as both receivers have cross epg. I would appreciate some help on the correct web grabber xml settings for the rytec import to work or any other setting that could be wrong.

 

Hi, I'm trying to do the same thing and I have the file from webgrab++ and the channels mapped in channels.xml but it's refusing to load. I have tried hosting the file on a website and locally on the networkbut neither of them work with CrossEPG. It seems to skip the downloading (at least pass very quickly) and does all the other steps but I get the flashing blue circle in the top left on loading the data. Any advice onto how to get this working?

 

I'm using CrossEPG because it works for me.

 

Thanks

[doglover]

Crossepg clearly does not work.

 

If you read my contributions, I have had it with Crossepg.  I am not going to find th errors anymore.

If anybody else can help, be my guest.

 

Willy

[gogglebox]

Turns out it's the file webgrab++ is producing. It's very bizarre the output I'm getting.

 

I only seem to have part of a day (in the past it turns out). When I try adding more days, I seem to get more programmes but with the wrong date stamp...

 

Sorry about posting in two places, I assumed I was getting the same problem as the original poster here.

[gogglebox]

Having done some more testing, I have narrowed it down to two problems:

 

1) The grabber isn't grabbing the data correctly. I have edited manually the file to have the correct dates and times for today on one channel. I am trying to solve this on the grabber's forum.

2) Crossepg isn't downloading the files so nothing is getting loaded, I know doglover hates crossepg so if anybody else has any suggestions they would be welcome? I'm using SMB in order to get the files off my PC. 

[doglover]

I do not know how good your grabber definition is for grabbing the EPG from an enigma receiver.

A long time ago, I wrote one myself.  I have attached it here.

 

In the config.xml file you request a channel like this:

 

<channel update="i" site="openwebif" site_id="1:0:1:51AE:C96:3:EB0000:0:0:0:" xmltv_id="Film1Action">Film 1 Action</channel>

 

The SiteIni is attached - is for grabbing EPG from OpenWebIf:

 

Willy

Attached Files

•  openwebif.zip   774bytes   80 downloads

[gogglebox]

Thanks WIlly!

 

Instead of using TVGuide, is it ready to download from another source?

[gogglebox]

I'm using a different site to the site mentioned in the .ini you posted, is this a problem?

 

I have tried grabbing from the openwebif but I don't get ny data. I'm trying to populate the radio channels with an peg.

 

Thanks

[gogglebox]

The grabber works now. It just needed to be rewritten.

 

Thanks

[marcel19850]

HI i have problem, writes no shows in indexpage!

[doglover]

Is this with the Openwebif SiteIni?

 

Probably something changed then in OpenWebif.

 

Willy

[marcel19850]

I have image OpenATV

[doglover]

Yep.  OpenWebif has been given a new look.  And has been changed.

Attached the new grabber for the EPG from OpenWebif.

As before you have to adapt
 

site {url=openwebif|timezone=Europe/Brussels|maxdays=8.1|cultureinfo=en-GB|charset=UTF-8|titlematchfactor=90|retry=<retry time-out="10">2</retry>}
url_index{url|http://192.168.178.15/ajax/epgpop?sref=|channel|}

To your situation.:

 

Timezone and cultureinfo

and

of course the IP-adres of you local box.

 

Willy

 

 

 

 

 

 

Attached Files

•  openwebif-org.v2.zip   712bytes   61 downloads