38 replies to this topic

[Rob van der Does]

OpenTV will not cover all the satellite channels, so this can be helpful for a bunch of channels but not all.

I think it covers all 28.2E services (maybe also FreeSat is required, but that reader is available).

[doglover]

Can somebody with knowledge of PHP make a PHP script which reads the following pages from

https://www.a1.hr/raspored

https://www.a1.hr/bnetepg/call/method::get_init2
GET /bnetepg/call/method::get_init2 HTTP/1.1
Host: www.a1.hr
User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:66.0) Gecko/20100101 Firefox/66.0
Accept: */*
Accept-Language: nl,en-US;q=0.7,en;q=0.3
Accept-Encoding: gzip, deflate, br
Referer: https://www.a1.hr/raspored
X-Requested-With: XMLHttpRequest
Connection: keep-alive
Cookie: GDPR_consent=false; COOKIE_SUPPORT=true; GUEST_LANGUAGE_ID=hr_HR; ANONYMOUS_USER_ID=603235998; ajs_user_id=null; ajs_group_id=null; _ga=GA1.2.703060790.1552813224; _gcl_au=1.1.1973057734.1552813225; _gid=GA1.2.663676338.1555068929; TS0100abbe=01bfb3d758431cb359df57fe8d4b5f40c59333070c9bfcea9dd32c2b41e1c2a751a4bb02bc7737d3f06fd780128b1ff2fbb659c22dc13a4baa0dc3f0cc3da66542f3a14f4e; TS0100abbe_28=019b2e131147292ace1b35a044bf87ff4b6d7947f03c37060506d5bb6deb51316a0f57a28bde15cb8194a1089c14dce047f90e07c8; aaaStaticCookie=lvpaaa1; TS01bf97ba=0142c2695f806686a383861640fdc90eaf11595161d8c577f543728f3d85375b29ecc278cf5706259fad8a2fc908789947b18a95d6b7dc6d57e6cb8021a7cd5021d4c59024e7a3f28e379bca566cd6fa659d60e0cd6c6474332dae719bcb175be9acb997eb; TS0193b03d=0142c2695f2eeaa9182230efdf9fd4ff0b99102e03d8c577f543728f3d85375b29ecc278cf078ca94ed28c7eb59476dcfdc298da97e16d1f680413e3e4d8e6b5291803d7b6; BS=apps1; JSESSIONID=B19D7E626F8A86654DDCD3F53AE5678B; lbsrv=lvplr04; BIGipServer~Corp-L1P~Cms_vipnet_80=rd1o00000000000000000000ffff0af39a9ao80; asmpCookieMaster=a/6834911461555082187449; webappsStaticCookie=lvpbbgw3; AAAproxySession=lvpaaa1.vipnet.hr/54436046692779483291555082
Cache-Control: max-age=0


https://www.a1.hr/bnetepg/call/method::get_entries::channels::957,958,959,960,953,3673,956,955,7402,173,962,963,965,937,987::date::2019-04-12
GET /bnetepg/call/method::get_entries::channels::957,958,959,960,953,3673,956,955,7402,173,962,963,965,937,987::date::2019-04-12 HTTP/1.1
Host: www.a1.hr
User-Agent: Mozilla/5.0 (Windows NT 6.3; Win64; x64; rv:66.0) Gecko/20100101 Firefox/66.0
Accept: */*
Accept-Language: nl,en-US;q=0.7,en;q=0.3
Accept-Encoding: gzip, deflate, br
Referer: https://www.a1.hr/raspored
X-Requested-With: XMLHttpRequest
Connection: keep-alive
Cookie: GDPR_consent=false; COOKIE_SUPPORT=true; GUEST_LANGUAGE_ID=hr_HR; ANONYMOUS_USER_ID=603235998; ajs_user_id=null; ajs_group_id=null; _ga=GA1.2.703060790.1552813224; _gcl_au=1.1.1973057734.1552813225; _gid=GA1.2.663676338.1555068929; TS0100abbe=01bfb3d758431cb359df57fe8d4b5f40c59333070c9bfcea9dd32c2b41e1c2a751a4bb02bc7737d3f06fd780128b1ff2fbb659c22dc13a4baa0dc3f0cc3da66542f3a14f4e; TS0100abbe_28=019b2e131147292ace1b35a044bf87ff4b6d7947f03c37060506d5bb6deb51316a0f57a28bde15cb8194a1089c14dce047f90e07c8; aaaStaticCookie=lvpaaa1; TS01bf97ba=0142c2695f806686a383861640fdc90eaf11595161d8c577f543728f3d85375b29ecc278cf5706259fad8a2fc908789947b18a95d6b7dc6d57e6cb8021a7cd5021d4c59024e7a3f28e379bca566cd6fa659d60e0cd6c6474332dae719bcb175be9acb997eb; TS0193b03d=0142c2695f2eeaa9182230efdf9fd4ff0b99102e03d8c577f543728f3d85375b29ecc278cf078ca94ed28c7eb59476dcfdc298da97e16d1f680413e3e4d8e6b5291803d7b6; BS=apps1; JSESSIONID=B19D7E626F8A86654DDCD3F53AE5678B; lbsrv=lvplr04; BIGipServer~Corp-L1P~Cms_vipnet_80=rd1o00000000000000000000ffff0af39a9ao80; asmpCookieMaster=a/6834911461555082187449; webappsStaticCookie=lvpbbgw3; AAAproxySession=lvpaaa1.vipnet.hr/54436046692779483291555082
If-Modified-Since: Fri, 12 Apr 2019 15:17:41 GMT

These are variables:

channels::957,958,959,960,953,3673,956,955,7402,173,962,963,965,937,987::date::2019-04-12

 

I know what todo with it.  No problem here.

 

I suppose the problem is in this

Cookie: GDPR_consent=false; COOKIE_SUPPORT=true; GUEST_LANGUAGE_ID=hr_HR; ANONYMOUS_USER_ID=603235998; ajs_user_id=null; ajs_group_id=null; _ga=GA1.2.703060790.1552813224; _gcl_au=1.1.1973057734.1552813225; _gid=GA1.2.663676338.1555068929; TS0100abbe=01bfb3d758431cb359df57fe8d4b5f40c59333070c9bfcea9dd32c2b41e1c2a751a4bb02bc7737d3f06fd780128b1ff2fbb659c22dc13a4baa0dc3f0cc3da66542f3a14f4e; TS0100abbe_28=019b2e131147292ace1b35a044bf87ff4b6d7947f03c37060506d5bb6deb51316a0f57a28bde15cb8194a1089c14dce047f90e07c8; aaaStaticCookie=lvpaaa1; TS01bf97ba=0142c2695f806686a383861640fdc90eaf11595161d8c577f543728f3d85375b29ecc278cf5706259fad8a2fc908789947b18a95d6b7dc6d57e6cb8021a7cd5021d4c59024e7a3f28e379bca566cd6fa659d60e0cd6c6474332dae719bcb175be9acb997eb; TS0193b03d=0142c2695f2eeaa9182230efdf9fd4ff0b99102e03d8c577f543728f3d85375b29ecc278cf078ca94ed28c7eb59476dcfdc298da97e16d1f680413e3e4d8e6b5291803d7b6; BS=apps1; JSESSIONID=B19D7E626F8A86654DDCD3F53AE5678B; lbsrv=lvplr04; BIGipServer~Corp-L1P~Cms_vipnet_80=rd1o00000000000000000000ffff0af39a9ao80; asmpCookieMaster=a/6834911461555082187449; webappsStaticCookie=lvpbbgw3; AAAproxySession=lvpaaa1.vipnet.hr/54436046692779483291555082

I have no clue how to pass this on in PHP script.  Also it might be variable, and this has to be got from another page in the download stream.

 

Thanks in advance.

 

Willy

[WanWizard]

Very simplistic example:

<?php
$url = "https://www.a1.hr/bnetepg/call/method::get_init";
$cookie = "GDPR_consent=false; COOKIE_SUPPORT=true; GUEST_LANGUAGE_ID=hr_HR; ANONYMOUS_USER_ID=603235998; ajs_user_id=null; ajs_group_id=null; _ga=GA1.2.703060790.1552813224; _gcl_au=1.1.1973057734.1552813225; _gid=GA1.2.663676338.1555068929; TS0100abbe=01bfb3d758431cb359df57fe8d4b5f40c59333070c9bfcea9dd32c2b41e1c2a751a4bb02bc7737d3f06fd780128b1ff2fbb659c22dc13a4baa0dc3f0cc3da66542f3a14f4e; TS0100abbe_28=019b2e131147292ace1b35a044bf87ff4b6d7947f03c37060506d5bb6deb51316a0f57a28bde15cb8194a1089c14dce047f90e07c8; aaaStaticCookie=lvpaaa1; TS01bf97ba=0142c2695f806686a383861640fdc90eaf11595161d8c577f543728f3d85375b29ecc278cf5706259fad8a2fc908789947b18a95d6b7dc6d57e6cb8021a7cd5021d4c59024e7a3f28e379bca566cd6fa659d60e0cd6c6474332dae719bcb175be9acb997eb; TS0193b03d=0142c2695f2eeaa9182230efdf9fd4ff0b99102e03d8c577f543728f3d85375b29ecc278cf078ca94ed28c7eb59476dcfdc298da97e16d1f680413e3e4d8e6b5291803d7b6; BS=apps1; JSESSIONID=B19D7E626F8A86654DDCD3F53AE5678B; lbsrv=lvplr04; BIGipServer~Corp-L1P~Cms_vipnet_80=rd1o00000000000000000000ffff0af39a9ao80; asmpCookieMaster=a/6834911461555082187449; webappsStaticCookie=lvpbbgw3; AAAproxySession=lvpaaa1.vipnet.hr/54436046692779483291555082";

$ch = curl_init($url);
$fp = fopen("output.json", "w");

curl_setopt($ch, CURLOPT_FILE, $fp);
curl_setopt($ch, CURLOPT_HEADER, 0);
curl_setopt($ch, CURLOPT_COOKIE, $cookie);

curl_exec($ch);
curl_close($ch);
fclose($fp);

[doglover]

Thanks.

This helps.  I can take it from here.

It is indeed very simple, but not knowing anything from PHP makes it difficult.

Learned a lot with this simple example.

 

Willy

 

PS:  It looks like I found all the relevant info needed.

[WanWizard]

Give a shout if you need more help in the future, PHP has been my thing since the late 90's.

[doglover]

To integrate it with WG++, this is what I made from it.

<?php
        $ch = curl_init();
        $reqtype = $_GET['reqtype'];
        if($reqtype == '1') {
                $channel = $_GET['channel'];
                $date = $_GET['date'];
                $url = "https://www.a1.hr/bnetepg/call/method::get_entries::channels::" . $channel . "::date::" . $date;
        } elseif($reqtype == '2') {
             $url = "https://www.a1.hr/bnetepg/call/method::get_init";
        }
        $cookie = "GDPR_consent=false; COOKIE_SUPPORT=true; GUEST_LANGUAGE_ID=hr_HR; ANONYMOUS_USER_ID=603235998; ajs_user_id=null; ajs_group_id=null; _ga=GA1.2.703060790.1552813224; _gcl_au=1.1.1973057734.1552813225; _gid=GA1.2.663676338.1555068929; TS0100abbe=01bfb3d758431cb359df57fe8d4b5f40c59333070c9bfcea9dd32c2b41e1c2a751a4bb02bc7737d3f06fd780128b1ff2fbb659c22dc13a4baa0dc3f0cc3da66542f3a14f4e; TS0100abbe_28=019b2e131147292ace1b35a044bf87ff4b6d7947f03c37060506d5bb6deb51316a0f57a28bde15cb8194a1089c14dce047f90e07c8; aaaStaticCookie=lvpaaa1; TS01bf97ba=0142c2695f806686a383861640fdc90eaf11595161d8c577f543728f3d85375b29ecc278cf5706259fad8a2fc908789947b18a95d6b7dc6d57e6cb8021a7cd5021d4c59024e7a3f28e379bca566cd6fa659d60e0cd6c6474332dae719bcb175be9acb997eb; TS0193b03d=0142c2695f2eeaa9182230efdf9fd4ff0b99102e03d8c577f543728f3d85375b29ecc278cf078ca94ed28c7eb59476dcfdc298da97e16d1f680413e3e4d8e6b5291803d7b6; BS=apps1; JSESSIONID=B19D7E626F8A86654DDCD3F53AE5678B; lbsrv=lvplr04; BIGipServer~Corp-L1P~Cms_vipnet_80=rd1o00000000000000000000ffff0af39a9ao80; asmpCookieMaster=a/6834911461555082187449; webappsStaticCookie=lvpbbgw3; AAAproxySession=lvpaaa1.vipnet.hr/54436046692779483291555082";
        $ch = curl_init($url);
        curl_setopt($ch, CURLOPT_HEADER, 0);
        curl_setopt($ch, CURLOPT_COOKIE, $cookie);
       
        $output = curl_exec($ch);
        curl_close($ch);
        echo $output;
?>

Working.

Willy

[WanWizard]

Remove the last "?>". It isn't needed, and it may create all sorts of misery if you happen to type anything after it.

[Lost in Space]

Partly inspired by the motivating discussion here in this thread I've taken the freedom to create an EPGExport Plugin, which allows you to export the EPG that your box has received in standard XMLTV Format.

 

It also allows to use the Webinterface on your box as a (local) XMLTV server, which means one box could download from normal XMLTV Servers and then act as a local XMLTV server for other boxes in your household to reduce the load on the standard XMLTV Servers

 

This means also that people which are able to receive exotic positions could share such received EPG in XMLTV Format  ... which should reduce the need to grab websites for everything ...

 

EPGExport Plugin is still under development, but testkits are available in his kit and support thread in  OoZooN's board

 

Ciao

gutemine

Edited by gutemine, 13 April 2019 - 22:03.

[WanWizard]

Nice for those not using OpenPLi. OpenPLi already has the option to sync EPG between boxes.

[littlesat]

Wanwizard, Gutemine means something different... not synchronize epg, but export to xml format instead...but Gutemine where are the sources so we can help with your nice idea... a kind of epg.dat in xml format...?

Edited by littlesat, 13 April 2019 - 22:44.

[jenseneverest]

yes, very interested but i can even register on the other site, my email addy for the last 20 years is not valid lol

[WanWizard]

Wanwizard, Gutemine means something different... not synchronize epg, 

 

I was referring to

 

It also allows to use the Webinterface on your box as a (local) XMLTV server, which means one box could download from normal XMLTV Servers and then act as a local XMLTV server for other boxes in your household to reduce the load on the standard XMLTV Servers

 

which is exactly that.

 

Only we sync the epg.dat in native format, instead of exporting to XML, and then importing XML again on the other box.

[Lost in Space]

My EPGdbBackup Plugin does nicely copying of epg files between local boxes on all DreamOS Images, thank you

 

But you really didn't get the point of the advantage of instead of copying around epg.dat Files (which need to be reloaded) EPGExport creates native XMLTV format for transfering and whatever else you want to do with it.

 

The EPGExport kit includes all the sources and I'm pretty sure that it would work on OpenPLi also, as I tested the ipk on an OpenATV,

 

BUT as it is still under development there is NO license included which means it still holds my full copyright and you would need to ask for permission for distributing or changing.

 

And before you start throwing fruits and vegetables ... it  will end up with GPL as soon as there is a released Version 1.0 - but this will take a few days until which I need to control what is happening with it.

 

gutemine

Edited by gutemine, 13 April 2019 - 23:26.

[WanWizard]

I am just saying that for sharing EPG between boxes, OpenPLi works just fine, without the intermediate step of exporting and importing XML (which takes ages).

 

I am very aware that XMLTV format files may have other uses, but I wasn't talking about that.

[Lost in Space]

OK, but your 'solution' will not work for your local Kodi Clients or Plex Servers.

 

If you want to feed them with EPG you are normally dependant on loading it from the standard XMLTV Servers (which already caused performance problems some times ago, if i remember correctly), unless you want to transfer manually xml files that you downloaded by hand which is not very user friendly.

 

With EPGExport Plugin these devices can load their EPG from a lokal enigma2 box.

 

Finally I only posted this here because of the original posting:

 

When people are able to create XMLTV Files directly with their boxes, then the need for grabbing everything from sometimes strange, or continuously  changing websites, or webistes where you don't even understand the language, etc. would dramatically decrease - which brings us back to doglover's orginal problem of doing all this with limited help and support.

Edited by gutemine, 14 April 2019 - 11:33.

[doglover]

As an example of how I am treated at WG++ pls read this:

http://www.webgrabpl...s#comment-17310

 

I posted a SiteIni in trying to solve a problem.

Pls read the comments I got.

 

thief, hero and other nice things.  That is the help they give over there!!!

 

Willy

[WanWizard]

OK, but your 'solution' will not work for your local Kodi Clients or Plex Servers.

 

Very true, hence the fact that my remark was limited to OpenPLi only.

[Lost in Space]

I'm knowing how it feels when people do "nice" comments pretty well

 

This is why it is sometimes better to follow Sinatra 'I did it my way ...' 

[Lost in Space]

PS: EPGExport Plugin release candidate 1.0 is now under GPL v3, but this is now my last OT here on this subject.