Jump to content


Photo

xmltv grabber for digiturk (Turkish platform)

xmltv digiturk

  • Please log in to reply
45 replies to this topic

#1 diglam

  • Member
  • 23 posts

0
Neutral

Posted 15 February 2014 - 19:23

Hi everyone.

 

I coded a grabber for digiturk a Turkish SAT TV Platform (http://www.digiturk.com.tr/yayinakisi/).

 

grabber :

https://dl.dropboxus...rab_tr_digiturk

 

 

a generated output:

https://dl.dropboxus.../digiturk.xmltv

 

 

maybe it can be added to Rytec XMLTV



Re: xmltv grabber for digiturk (Turkish platform) #2 doglover

  • Rytec EPG Team
  • 17,371 posts

+657
Excellent

Posted 16 February 2014 - 09:27

Some questions:

 

1. Are prepared to run this on a regurlar base (daily?)

2. Will the output file always on the above mentioned website?

3. Is there a channels file which links the XMLTV content to the actual channels (service references)?

 

We are certainly interested on including it, however I do not have the time anymore for maintaining a new source and set of service references.

I could however pick up ready made XMLTV and  channels files and copy it to our downloadsites.  Maintaining them would completely fall under your responsability.

 

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: xmltv grabber for digiturk (Turkish platform) #3 diglam

  • Member
  • 23 posts

0
Neutral

Posted 16 February 2014 - 10:23

This grabber is fully compatible XMLTV grabber written in perl.

 

We can run it how we want. e.g:

 

tv_grab_tr_digiturk --configure

will fetch the channel list and user may chose which channel programmes shall be fetched, configuration will be written to file. So this step is necessary only once.

 

tv_grab_tr_digiturk --days 2 --output digiturk.xml

will fetch all programmes of 2 days period for the channels chosen before and write them to a xmltv compatible digiturk.xml file.

 

I need a server/service to be able to run grabber on it periodically (maybe daily) so we can get output from that server.

I'm looking for such a server.


Edited by diglam, 16 February 2014 - 10:24.


Re: xmltv grabber for digiturk (Turkish platform) #4 diglam

  • Member
  • 23 posts

0
Neutral

Posted 16 February 2014 - 10:32

As you can see below example, channel and programme linking is in the same file like an normal xmltv file.

channel="136" is channel "KANALTURK" and  all programmes which has channel_id as channel="136" will be link to channel "KANALTURK"

 

 

<tv source-info-url="http://www.digiturk.com.tr/" source-info-name="Digiturk" generator-info-name="tv_grab_tr_digiturk" generator-info-url="http://wiki.xmltv.or...hp/XMLTVProject">


  <channel id="136">
    <display-name lang="tr">KANALTURK</display-name>
  </channel>

 

<programme start="20140215070000 +0200" stop="20140215083000 +0200" channel="136">
    <title lang="tr">GAG GUK</title>
    <desc lang="tr">BİRBİRİNDEN KOMİK VİDEOLAR,KAHKAHA KRİZİ YARATAN ŞAKALAR, GAG GUK İLE EKRANA GELİYOR.</desc>
    <category lang="tr">Eğlence</category>
  </programme>


  <programme start="20140215083000 +0200" stop="20140215093000 +0200" channel="136">
    <title lang="tr">BURADA NE YENİR</title>
    <desc lang="tr">DİLARA GÜDER, HER HAFTA TÜRKİYE’NİN BİRBİRİNDEN GÜZEL ŞEHİRLERİNİ DOLAŞACAK VE “BURADA NE YENİR?” SORUSUNA CEVAP ARAYACAK</desc>
    <category lang="tr">Life Style</category>
  </programme>

</tv>



Re: xmltv grabber for digiturk (Turkish platform) #5 diglam

  • Member
  • 23 posts

0
Neutral

Posted 18 February 2014 - 20:35

Hi,

 

xmltv file that includes 2 day epg data will be on :

 

-- cut --

 

Everday at 03:30 GMT+2 that file will be updated.


Edited by WanWizard, 17 March 2015 - 13:15.
link removed due to abuse


Re: xmltv grabber for digiturk (Turkish platform) #6 needz

  • Senior Member
  • 214 posts

0
Neutral

Posted 19 February 2014 - 07:34

Webgrabber++ works pretty well for digiturk.. 6 days can be grabbed as far as I know..



Re: xmltv grabber for digiturk (Turkish platform) #7 diglam

  • Member
  • 23 posts

0
Neutral

Posted 19 February 2014 - 08:17

Some questions:

 

1. Are prepared to run this on a regurlar base (daily?)

- 2 days epg data will be generated daily

2. Will the output file always on the above mentioned website?

- Output file will be on the server

3. Is there a channels file which links the XMLTV content to the actual channels (service references)?

- There is no such a file at the moment. I've searched dorum for a tutorial or howto that explains file structures, but couldn't find any detailed information yet.

Could you explain a bit, please?

 

We are certainly interested on including it, however I do not have the time anymore for maintaining a new source and set of service references.

I could however pick up ready made XMLTV and  channels files and copy it to our downloadsites.  Maintaining them would completely fall under your responsability.

 

 

Willy


Edited by WanWizard, 17 March 2015 - 14:41.
removed links due to abuse


Re: xmltv grabber for digiturk (Turkish platform) #8 diglam

  • Member
  • 23 posts

0
Neutral

Posted 19 February 2014 - 09:46

If files genereated like below, does them work ?

 

digiturk_rytec.xml:

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE tv SYSTEM "xmltv.dtd">

<tv source-info-url="http://www.digiturk.com.tr/" source-info-name="Digiturk" generator-info-name="tv_grab_tr_digiturk_rytec" generator-info-url="http://wiki.xmltv.org/index.php/XMLTVProject">
  <channel id="KANALTURK.digiturk.com.tr">
    <display-name lang="tr">KANALTURK.digiturk.com.tr</display-name>
  </channel>
  <programme start="20140219070000 +0200" stop="20140219084500 +0200" channel="KANALTURK.digiturk.com.tr">
    <title lang="tr">HER SABAH</title>
    <desc lang="tr">GECENİN SICAK GELİŞMELERİ VE TÜM HABERLERİ HAFTA İÇİ HER GÜN 06.30 – 08.45 SAATLERİ ARASINDA KANALTÜRK EKRANINDA İZLEYECEKSİNİZ.</desc>
    <category lang="tr">Haberler</category>
  </programme>
</tv>

digiturk_rytec_channels.xml:

<?xml version="1.0" encoding="latin-1"?>
<!-- service references can be found in /etc/enigma2/lamedb -->
<channels>
<channel id="KANALTURK.digiturk.com.tr">1:0:1:xxxx:xxx:xx:xxxxxx:x:x:x:</channel> <!-- KANALTURK-->
</channels>


Re: xmltv grabber for digiturk (Turkish platform) #9 doglover

  • Rytec EPG Team
  • 17,371 posts

+657
Excellent

Posted 19 February 2014 - 10:05

This is a correct structure.

The category tag will not be imported.  (I included this in the subtitle tag)  It is however no problem if you leave it in there.

 

The channels file has to be created before we can include it. 

This is however a tedious job.

 

If you send me the Dreambox edit  (or dreamset) files, with only the digiturk channels in it (all the rest you delete), I will return you a file with the correct structure in which you only have to fill in the channel id's.

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: xmltv grabber for digiturk (Turkish platform) #10 diglam

  • Member
  • 23 posts

0
Neutral

Posted 19 February 2014 - 11:01

This is a correct structure.

The category tag will not be imported.  (I included this in the subtitle tag)  It is however no problem if you leave it in there.

 

The channels file has to be created before we can include it. 

This is however a tedious job.

 

If you send me the Dreambox edit  (or dreamset) files, with only the digiturk channels in it (all the rest you delete), I will return you a file with the correct structure in which you only have to fill in the channel id's.

 

Willy

 

settings file:

https://dl.dropboxus...igiturk 42E.zip



Re: xmltv grabber for digiturk (Turkish platform) #11 doglover

  • Rytec EPG Team
  • 17,371 posts

+657
Excellent

Posted 19 February 2014 - 12:27

Channels file (to be filled in)

 

Willy

Attached Files


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: xmltv grabber for digiturk (Turkish platform) #12 diglam

  • Member
  • 23 posts

0
Neutral

Posted 19 February 2014 - 13:37

filled channels file:

Attached Files



Re: xmltv grabber for digiturk (Turkish platform) #13 doglover

  • Rytec EPG Team
  • 17,371 posts

+657
Excellent

Posted 19 February 2014 - 14:35

Can you put the channels file also on the website pls.

 

I can pick it up automatically from there.  (you have to maintain it.)

 

Secondly: when will the updated file be available each morning?  We update our files starting from 5h15 in the morning (UTC+1)

So if yours would be ready by then, I could intergrate it in the normal update.  However if it is later it would not be problem.  It will have to be a separate update then.

 

The rytec.sources.xml file attached.

 

Willy


Edited by WanWizard, 17 March 2015 - 13:18.
links removed due to abuse

~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: xmltv grabber for digiturk (Turkish platform) #14 diglam

  • Member
  • 23 posts

0
Neutral

Posted 19 February 2014 - 18:54

Can you put the channels file also on the website pls.

 

I can pick it up automatically from there.  (you have to maintain it.)

 

Secondly: when will the updated file be available each morning?  We update our files starting from 5h15 in the morning (UTC+1)

So if yours would be ready by then, I could intergrate it in the normal update.  However if it is later it would not be problem.  It will have to be a separate update then.

 

The rytec.sources.xml file attached.

 

Willy

 

I've put channels file on the website

I'll maintain it :)

 

New epg-data/xmltv file will be available aound 3:30 UTC+2 on site.

 

If you have a script or program to generate channels file, could you share it? It may help me.

 

Thank you


Edited by WanWizard, 17 March 2015 - 13:19.
links removed due to abuse


Re: xmltv grabber for digiturk (Turkish platform) #15 doglover

  • Rytec EPG Team
  • 17,371 posts

+657
Excellent

Posted 20 February 2014 - 07:58

The files will be put on the downloadsites this morning.  And will updated everyday fro now on.

 

I have a spreadsheet to convert a complete list of service references to the list I have send you.

The spreadsheet is made in LibreOffice (or OpenOffice).  With extension ods

If converted it to Excel 2010.  However I do not know if it works in Excel.

 

You have to paste in the dreamboxEDIT Export Bouquets.txt file on the first page of the sheet starting in cell A1.

The dreamboxEDIT Export Bouquets.txt file you make from exporting your bouquet in DreamboxEdit.

Import Options: Separated by tabs and all Fields as Text.

 

The result you can find on Page2 of the spreadsheet in Kolom G.

 

Willy

 

It is good for creating a complete set of service references.  For one or two I just edit them by hand. Be carefull for typo's

Attached Files


Edited by doglover, 20 February 2014 - 08:01.

~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: xmltv grabber for digiturk (Turkish platform) #16 needz

  • Senior Member
  • 214 posts

0
Neutral

Posted 20 February 2014 - 08:44

doglover, if you need ideas for Channel EPG codes for Digiturk, maybe you could use some of these http://siptv.eu/temp/digiturk.html



Re: xmltv grabber for digiturk (Turkish platform) #17 assa51

  • Member
  • 5 posts

0
Neutral

Posted 23 February 2014 - 11:57

Hi all,
 
I am a new user of OpenPli and i use PKT Hyperion v3 image which is based on opnepli for octagon sf1008SE+
 
I have a problem with turkey epgs as well. can you help me and where is the my mistake?
 
http://i.imgur.com/Qgb6hug.jpg
 
http://i.imgur.com/HdFsXQW.jpg
("evet" means in Turkis "yes")
 
http://i.imgur.com/57tPdMx.jpg
 
http://i.imgur.com/YJtJqJy.jpg
 
http://i.imgur.com/xkMcjLL.jpg
 
when download completed there was no update or data write on hdd (flashable image for reciever via usb)
 
http://i.imgur.com/LYxjQBz.jpg
 
how i can get epg info from your plugins? (base on diglam support, digiturk tv guide for 42E satellite)
 
thanks alot

Re: xmltv grabber for digiturk (Turkish platform) #18 doglover

  • Rytec EPG Team
  • 17,371 posts

+657
Excellent

Posted 23 February 2014 - 13:42

You are using crossepg.

I think it is not included (yet)

 

In \usr\crossepg\providers\ you will find a file:

 

rytec_turkey_xmltv.conf

 

Open this with an editor and edit file with these values:

 

description=Turkey XMLTV
protocol=xmltv
channels_url_0=http://rytec.sifteam.eu/digiturk.channels.xml.gz
channels_url_1=http://enigma2.world-of-satellite.com/epg_data/digiturk.channels.xml.gz
channels_url_2=http://xmltvepg.wanwizard.eu/digiturk.channels.xml.gz
channels_url_3=http://www.ebook-directory.net/rytecxmlepg/digiturk.channels.xml.gz
channels_url_4=http://www.vuplus-community.net/rytec/digiturk.channels.xml.gz
epg_url_0=http://rytec.sifteam.eu/digiturk.xmltv.gz
epg_url_1=http://enigma2.world-of-satellite.com/epg_data/digiturk.xmltv.gz
epg_url_2=http://xmltvepg.wanwizard.eu/digiturk.xmltv.gz
epg_url_3=http://www.ebook-directory.net/rytecxmlepg/rytec/digiturk.xmltv.gz
epg_url_4=http://www.vuplus-community.net/rytec/digiturk.xmltv.gz
preferred_language=eng
 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: xmltv grabber for digiturk (Turkish platform) #19 assa51

  • Member
  • 5 posts

0
Neutral

Posted 23 February 2014 - 14:01

You are using crossepg.
I think it is not included (yet)
 
In \usr\crossepg\providers\ you will find a file:
 
rytec_turkey_xmltv.conf
 
Open this with an editor and edit file with these values:
 

description=Turkey XMLTV
protocol=xmltv
channels_url_0=http://rytec.sifteam.eu/digiturk.channels.xml.gz
channels_url_1=http://enigma2.world-of-satellite.com/epg_data/digiturk.channels.xml.gz
channels_url_2=http://xmltvepg.wanwizard.eu/digiturk.channels.xml.gz
channels_url_3=http://www.ebook-directory.net/rytecxmlepg/digiturk.channels.xml.gz
channels_url_4=http://www.vuplus-community.net/rytec/digiturk.channels.xml.gz
epg_url_0=http://rytec.sifteam.eu/digiturk.xmltv.gz
epg_url_1=http://enigma2.world-of-satellite.com/epg_data/digiturk.xmltv.gz
epg_url_2=http://xmltvepg.wanwizard.eu/digiturk.xmltv.gz
epg_url_3=http://www.ebook-directory.net/rytecxmlepg/rytec/digiturk.xmltv.gz
epg_url_4=http://www.vuplus-community.net/rytec/digiturk.xmltv.gz
preferred_language=eng
 
Willy

I followed your instructions

I found providers file in /var/crossepg/providers and changed with your codes

 

now it works perfectly. thank you very much, both of you

 

you can find the results

 

 

gWkpUmM.jpg

 

 

before

LYxjQBz.jpg

 

after

w9n9V0N.jpg

 

 

But I have one issue now.

 

In channel list it shows OK. and when i zap the channel it shows OK but after 1 or 2 seconds later on Current, Next, No information such kind of text terminate info and replace theirselves

 

how i  can fix it? Do I need de-activate epg in settings for sattelite's push?

 

regards


Edited by assa51, 23 February 2014 - 14:02.


Re: xmltv grabber for digiturk (Turkish platform) #20 doglover

  • Rytec EPG Team
  • 17,371 posts

+657
Excellent

Posted 24 February 2014 - 08:17

You have to switch off the EIT - EPG both for download and in the information bar.

 

The switches should reside somewhere in Menu - Settings - System

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*



16 user(s) are reading this topic

0 members, 16 guests, 0 anonymous users