45 replies to this topic

[shax]

Thanks for the info.
I suppose i'll check for Python version installed.

Do you maybe know how to load epg.dat on Ozoon?
They don't seem to have .load() method?

[shax]

Ok, i've uploaded new version to the same link

- gemini.epg.dat is no longer 0 bytes
- fixed problems with wrong packet detection, instead of kernel it detects python version as Milo sugested, should work now on PLi and others

[Zupy]

Great work my friend /images/smiley/smile.gif

[muelleimer321]

Thx shax, the merge works now, but i´ve a next problem.

At the first download i downloaded the EPG Data for Sky Italia.
The Merge works.
After at the second run i downloaded EPG Data for Sky Italia und Poland and enigma2 crash like already rytecs plugin.

[EPGC] start cleanloop
[EPGC] stop cleanloop
[EPGC] 923958 bytes for cache used
action -> OkCancelActions ok
okbuttonClick
reused converter!
reused converter!
action -> WizardActions ok
Looking for embedded skin
reused converter!
action -> ColorActions blue
Looking for embedded skin
reused converter!
action -> SetupActions cancel
sourcesDone(): False None
action -> ColorActions yellow
action -> MsgBoxActions ok
[EPGImport] oudeis patch not detected, using epg.dat instead.
[EPGImport] using C module, yay
[EPGImport] nextImport, source= OWN SKY IT epg.dat
[EPGImport] Downloading: http://www.xmltvepg....taly/epg.dat.gz to local path: /media/hdd/epgimport
.gz
[EPGImport] afterDownload /media/hdd/epgimport.gz
[EPGImport] Uncompressing /media/hdd/epgimport.gz
[EPGImport] Importing /hdd/epg.dat
main thread is non-idle! display spinner!
no spinner DC!
[EPGC] 48300 events read from /media/hdd/gemini.epg.dat
[EPGImport] epg.dat type provider imported, loading next
[EPGImport] imported 0 events
[EPGImport] #### Finished ####
nr_read 29336 nr_write 9981
sum 39317 prev_sum 39299
hdd was accessed since previous check!
[IDLE] 0 600 False
ERROR reading PES (fd=53) - Value too large for defined data type
poll: unhandled POLLERR/HUP/NVAL for fd 53(8)
It's now Sun Sep 12 16:27:27 2010
next real activation is Sun Sep 12 17:39:40 2010
[timer.py] next activation: 1284301747 (in 99994 ms)
It's now Sun Sep 12 16:27:28 2010
[timer.py] next activation: 1284301748 (in 99997 ms)
It's now Sun Sep 12 16:27:28 2010
next real activation is Mon Sep 13 05:00:01 2010
[timer.py] next activation: 1284301748 (in 99591 ms)
[EPGC] start cleanloop
FATAL: LINE 171 descriptor not found in descriptor cache fffdb737!!!!!!
PC: 2aafa040
00000000 00000001 2ac2bd88 040e55eb
016a9468 01a7cdd0 00000000 2ac3ff80
00000000 00000001 2ac56530 20000000
68736172 61676f6c 736f7475 005e0000
01a7cdd0 2ab11e54 016a9468 01a7cdd0
00570000 2cdf9df0 2cdf9970 00570000
005df800 2aafa000 00000000 00000000
2ac58200 2cdf98c0 00570000 2ab9f6b0
As a final action, i will try to dump a bit of code.
I just hope that this won't crash.
2aafa040: 0c 00 09 8d 01 00 24 25 0c 00 04 ad 00 00 e3 8c 2a 10 64 00 0c 00 40 10 21 c8 20 02 30 80
8b 8f (end)
-------
Segmentation fault
root@dm8000:~#

[shax]

Ahhh.. wonders of Gemini

I can confirm that, just watching debug output...
Solution is simple

You have to configure Gemini 5.0 so it is able to read the EPG files (use the remote control):
Press Blue button, then settings, epg
off
off
off

15 min (does not really matters)
off

on
epg.dat
/media/hdd
off

Seems like gemini uses not only different name but also different epg.format, if you set it to gemini.epg.dat it expects its format, epg.dat is standard. This is just my guess.
Anyway, i tested this and works, just change gemini.epg.dat to epg.dat

[shax]

I disabled generation of gemini.epg.dat in new version for now, to stop boxes from crashing.
So if you're using gemini you'll have to change your epg file name to epg.dat before using plugin.

[muelleimer321]

My Blue Panel was set with these settings and the epg.dat has this name, but the plugin crash also
[highlight=#ffffff]when the epg.dat file is not empty.

[EPGImport] Selected sources: ['OWN SKY IT epg.dat', 'OWN Sky Germany XMLTV']
sourcesDone(): True ['OWN SKY IT epg.dat', 'OWN Sky Germany XMLTV']
action -> ColorActions yellow
action -> MsgBoxActions ok
[EPGImport] oudeis patch not detected, using epg.dat instead.
[EPGImport] nextImport, source= OWN SKY IT epg.dat
[EPGImport] Downloading: http://www.xmltvepg....taly/epg.dat.gz to local path: /media/hdd/epgimport
.gz
[EPGImport] afterDownload /media/hdd/epgimport.gz
[EPGImport] Uncompressing /media/hdd/epgimport.gz
main thread is non-idle! display spinner!
no spinner DC!
[EPGImport] Importing /hdd/epg.dat
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
[EPGC] 48300 events read from /media/hdd/epg.dat
[EPGImport] epg.dat type provider imported, loading next
[EPGImport] nextImport, source= OWN Sky Germany XMLTV
[EPGImport] Downloading: http://www.xmltvepg....many/epg.dat.gz to local path: /media/hdd/epgimpo
rt.gz
main thread is non-idle! display spinner!
no spinner DC!
It's now Sun Sep 12 18:55:51 2010
next real activation is Mon Sep 13 05:00:01 2010
[timer.py] next activation: 1284310651 (in 99909 ms)
It's now Sun Sep 12 18:55:51 2010
next real activation is Sun Sep 12 19:39:40 2010
[timer.py] next activation: 1284310651 (in 99482 ms)
It's now Sun Sep 12 18:55:51 2010
[timer.py] next activation: 1284310651 (in 99479 ms)
ERROR reading PES (fd=47) - Value too large for defined data type
poll: unhandled POLLERR/HUP/NVAL for fd 47(8)
[EPGImport] afterDownload /media/hdd/epgimport.gz
[EPGImport] Uncompressing /media/hdd/epgimport.gz
[EPGImport] Importing /hdd/epg.dat
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
main thread is non-idle! display spinner!
no spinner DC!
[EPGC] 56406 events read from /media/hdd/epg.dat
[EPGImport] epg.dat type provider imported, loading next
[EPGImport] imported 0 events
[EPGImport] #### Finished ####
nr_read 2077 nr_write 10329
sum 12406 prev_sum 12360
hdd was accessed since previous check!
[IDLE] 0 600 False
main thread is non-idle! display spinner!
no spinner DC!
[EPGC] start cleanloop
FATAL: LINE 171 descriptor not found in descriptor cache 19037b04!!!!!!
getResolvedKey PC: 2ab41c04
00000000 00000001 20000000Fatal Python error: GC object already tracked
20000000
00000000 2ac38494 2ac34880 2ac38d00
2aba2d0c fff4ab0c 2ac38494 2ac38d00
2ce596f8 00000002 2bae9ec0 2bae9ec0
00000003 00345678 000f4243 01a34d60
ffffffff 00014258 00842488 00000000
2cdf906c 2ab41be4 00000001 00000000
2ac58200 2cdf8c10 00000008 2ab58e00
Segmentation fault
root@dm8000:~#

[/highlight]

[shax]

It's clear that plugin did what it was supposed to do, downloaded epg.dat and initialized enigma to read it.
Content was read, crash happens after events have been filled in. I know that is not helpfull to you but i can only conclude plugin does what it should.
Maybe problem is size, i really don't know. Try loading Krkadoni Ex-Yu for few times, it's small just to see if it will also crash.
Many people reported this working just fine with Gemini so it's getting stranger and stranger...

My apologies to PLi team for using their board to basically support other images, it's just this is extremely useful and well programed plugin, and it's a shame not to exploit all it's possibilities. Hope you understand.

[muelleimer321]

I´ve tested many options. With Cam, without cam, on FTA Channel, on Channel with Transponder EPG.
Everything led to the same problem.
When i download only 1 Source (Sky IT or SkyDE) it works an i can download everytime. When i download 2 Sources (Sky IT, Sky DE) the gemini crashes on the merge with epg.dat.

Has the Parameter channels a relevance in the rytec.source.xml File?
The Plugin load alle channels and not the channels who i defined that

<source type="epg.dat" channels="http://www.xmltvepg....annels.xml.gz">
<description>OWN SKY IT epg.dat</description>
<url>http://www.xmltvepg....pg.dat.gz</url>
</source>
<source type="epg.dat" channels="own.channels.xml">
<description>OWN Sky Germany XMLTV</description>
<url>http://www.xmltvepg....pg.dat.gz</url>
</source>

<!-- Sky Germany -->
<channel id="artefrance.be">1:0:1:233b:400:1:c00000:0:0:0:</channel> <!-- Arte France-->
<channel id="CNBC.uk">1:0:1:272e:402:1:c00000:0:0:0:</channel> <!--  CNBC Europe -->
<channel id="CNN.de">1:0:1:6f6a:42c:1:c00000:0:0:0:</channel> <!--  CNN International -->
<channel id="DeLuxeMusic.de">1:0:1:2774:444:1:C00000:0:0:0:</channel> <!-- Deluxe Music -->
<channel id="Eurosport.de">1:0:1:79e0:443:1:c00000:0:0:0:</channel> <!--  EuroSport -->
<channel id="go.tv">1:0:1:332e:45b:1:c00000:0:0:0:</channel> <!--  Go TV -->
<channel id="imusic.tv">1:0:1:304:5:85:c00000:0:0:0:</channel> <!-- iMusic TV -->
<channel id="MTVBase.de">1:0:1:1b5f:07da:0002:011a0000:0:0:0:</channel> <!--  MTV BASE -->
<channel id="MTVMusic.de">1:0:1:6fff:0436:0001:00c00000:0:0:0:</channel> <!--  MTV Music -->
<channel id="RTL.de">1:0:1:1f43:319c:13e:820000:0:0:0:</channel> <!-- RTL CH -->
<channel id="RTL.de">1:0:1:2f09:441:1:c00000:0:0:0:</channel> <!-- RTL CH -->
<channel id="HH1.de">1:0:1:0050:3ab3:0001:00eb2cfb:0:0:0:</channel> <!-- SAT1 HH/SH -->
<channel id="SAT1.de">1:0:1:0032:3ab3:0001:00eb2cfb:0:0:0:</channel> <!-- SAT1 National -->
<channel id="SunshineLive.de">1:0:2:a9:7:85:c00000:0:0:0:</channel> <!--  Sunshine Live -->
<channel id="Vox.de">1:0:1:2f1d:441:1:c00000:0:0:0:</channel> <!-- VOX CH -->

[shax]

No, channel references are obsolete for epg.dat provider types, it doesn't matter what's in, epg has all references already generated inside the file.
I'll install gemini and see what's going on, in the meantime i tested plugin with latest Ozoon and works like a charm. Someone reported here that it's not loading epg?

[MiLo]

...When i download 2 Sources (Sky IT, Sky DE) the gemini crashes on the merge with epg.dat.

I've had the same experience. It probably is related to the two parts "sharing" the same data somewhere, which causes the refcounting mechanism in the EPG cache to fail because the reference count has been reset in the second .dat file.

The .dat files were never meant to be exchanged between boxes.

[MiLo]

Has the Parameter channels a relevance in the rytec.source.xml File?

Not with the epg.dat loader, it cannot filter at all and will waste a considerable amount of RAM because it will also store EPG for channels that aren't in your list.

The XML loader will -in addition to what's in the channels file- also filter out channels that cannot be received in the current configuration.

[muelleimer321]

ok thanks, then I cannot use your version of the plugin, because I would like only special channels who hasn´t a transponder epg.to have imported only special transmitters of plugin
The Problem of alle EPG from download is 60% of the EPGs for the channels are wrong, old or from a other channel e.g. nat Geo Wild has the EPG from Sky Sport 1 or discovery channel the epg from a other channel and many more.

I use rytecs Plugin every week (Saturday) and load the EPGs for 7 days. The Download works better and more stably as your download files. Sorry, thanks nevertheless for the attempt of the plugin for gemini.
Would be beautifully been if it would have folded!

[shax]

@ MiLo

Yes, this absolutely true. Users will receive EPG data even for the channels that do not have references for. But isn't this the way transponder data work?
Also, enigma2 at first was not supposed to load user epg at all, xml or .dat but this changed. It's all about making end user choose what they find more suitable.

@ muelleimer321
You should definitely use xmltv providers for your needs, epg.dat in your case is a big overhead.

[rtzhjgg0]

...in the meantime i tested plugin with latest Ozoon and works like a charm. Someone reported here that it's not loading epg?

Yes, I reported about the problem on last OoZooN:

[EPGImport] Downloading: http://www.xmltvepg.be/csat/epg.dat.gz to local path: /media/hdd/epgimport.gz
[EPGImport] afterDownload /media/hdd/epgimport.gz
[EPGImport] Cannot load EPG.DAT files on unpatched enigma. Need CrossEPG patch.

The normal XMLTV-import works perfectlly on this image but yours not...

[shax]

I'm missing someting, i tryed Ozoon from multiboot, maybe that's the problem, but still in Ozoon's enigma.py i have

eEPGCache.load = new_instancemethod(_enigma.eEPGCache_load,None,eEPGCache)

Need to flash it obviously

[shax]

@rtzhjgg0
I've downloaded latest OoZooN for DM800
Installed in flash
Installed my plugin

Everything works!

Only problems was OoZoon refused to install local ipkg if it has that plugin in repository list, but that is fixed in the latest version, preinst script makes shure local plugin is installed instead repository version.
If user makes update repository version will be installed but that's expected.

Only image i've found reporting that enigma is not patched is PLi, maybe you mistaken this with PLi?
Speaking of PLi - i cannot flash my box with PLi (check support) to test, so it would be greatly appreciated if someone could point me in the right direction.. MiLo?

[rtzhjgg0]

@rtzhjgg0
I've downloaded latest OoZooN for DM800
Installed in flash
Installed my plugin

Everything works!...

Strange...
Box: 8000, Flash, OoZooN 07.09.2010
Installing without problems. But executing a import brings this:

[EPGImport] WakeUpTime now set to 1284349500 (now=1284329820)
[EPGImport] nextImport, source= Rytec CSAT epg.dat
[EPGImport] Downloading: http://www.xmltvepg.be/csat/epg.dat.gz to local path: /media/hdd/epgimport.gz
[EPGImport] afterDownload /media/hdd/epgimport.gz
[EPGImport] Cannot load EPG.DAT files on unpatched enigma. Need CrossEPG patch.
[EPGImport] epg.dat type provider imported, loading next
[EPGImport] nextImport, source= Rytec POLAND epg.dat
[EPGImport] Downloading: http://www.xmltvepg....land/epg.dat.gz to local path: /media/hdd/epgimport.gz
[EPGImport] afterDownload /media/hdd/epgimport.gz
[EPGImport] Cannot load EPG.DAT files on unpatched enigma. Need CrossEPG patch.
[EPGImport] epg.dat type provider imported, loading next
[EPGImport] imported 0 events
[EPGImport] #### Finished ####

[shax]

Hmm, i'm getting too tired, i've seem to installed
OoZooN-Image-dm800-20100703.nfi
and by further checking i see now that the latest is
OoZooN-Image-dm800-20100805.nfi

Meaning i'll have to do it all over again

I have found problem and workaround for Gemini crashes, but it's very poor.
Seems that problem occurs if 2 dat files are loaded between two EPGC start cleanloop events.
If i wait 60 sec after each download cleanlopp is fired after each download automatically and no problems occur.
Strange :/

[rtzhjgg0]

@shax

The idea of a universal pack that installs on all images and imports XMLTV + epg.dat sources is a great one... but it seems that for now, the only image your ipk runs is DreamElite.

You have to consider that the PLi team had perhaps some reason to deactivate the epg.dat import feature. 9 months ago there was a XMLTV-import version with a feature for importing of epg.dat sources. But this caused instability and was deactivated. HERE

But I still hope you will succeed in your attempt/images/smiley/wink.gif