Jump to content


Photo

FTP Client (not as a plugin)

ET6000

  • Please log in to reply
128 replies to this topic

Re: FTP Client (not as a plugin) #41 greatred

  • Senior Member
  • 268 posts

+2
Neutral

Posted 18 April 2015 - 09:17

yes <password> | sftp -b /hdd/epg/king.txt user@IP


Re: FTP Client (not as a plugin) #42 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 18 April 2015 - 09:38

Still asks me for the password.

                                              
root@et9x00:~# yes password|sftp -b /hdd/epg/king.txt user@IP
WARNING: Ignoring unknown argument '-oForwardX11 no'                           
WARNING: Ignoring unknown argument '-oForwardAgent no'                         
WARNING: Ignoring unknown argument '-oPermitLocalCommand no'                   
WARNING: Ignoring unknown argument '-oClearAllForwardings yes'                 
WARNING: Ignoring unknown argument '-obatchmode yes'                           
WARNING: Ignoring unknown argument '-oProtocol 2'                              
WARNING: Ignoring unknown argument '--'                                        
user@IP.76's password:                                               
user@IP.76's password:                                               
sftp> cd /epg_data/                                                            
sftp> put /hdd/epg/rytecxmltvxxxx.gz                                         
root@et9x00:~#                                                                 
                           

After typing it in.  The file is uploaded.

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: FTP Client (not as a plugin) #43 athoik

  • PLi® Core member
  • 8,458 posts

+327
Excellent

Posted 18 April 2015 - 10:05

@Willy

I can confirm that guide I send you works! (https://www.linux-ti...rsa-key-problem)

Using above guide I can connect from "OpenPLi" box to "Debian" box without password.
 
root@formuler1:~# cd /home/root/
root@formuler1:~# dropbearkey -t rsa -f id_rsa
Generating key, this may take a while...
Public key portion is:
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCcLtECXigmbq2p3dA+qkexHTLVbwwW6jLNo8m6gV+zv8Q38/bsV8Eu7Lah9IcLeHJs1paG5ImqZ7ZoCc5djnoB7pi+PMgHM+kDMQ+l8U30sy3BG2tTEeOBc7W48QuZJnXjAnJgauJarMX39ZXfG68n816g6LfQEj+8urVzEOqiGs/J12dV8YLmmPA3LFhr3vcLqk0VkPUYXvMRY1PrIdeLecILGrBSwLagJOW4bcpKQDxrTFHOJOkINXqeLA+RMTFyoDIDy2qJrftRHySIgZUM+S/E82pbBsG0KfSoa8yjejglIzxzcYGi3ndaLVlZlgOYbAj+GsV66ugfy+CwtYp9 root@formuler1
Fingerprint: md5 68:de:97:66:c0:02:fa:2c:cf:2d:a8:65:d1:0f:3a:a8

Then on "Debian" box I entered the following into .ssh/authorized_keys

ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCcLtECXigmbq2p3dA+qkexHTLVbwwW6jLNo8m6gV+zv8Q38/bsV8Eu7Lah9IcLeHJs1paG5ImqZ7ZoCc5djnoB7pi+PMgHM+kDMQ+l8U30sy3BG2tTEeOBc7W48QuZJnXjAnJgauJarMX39ZXfG68n816g6LfQEj+8urVzEOqiGs/J12dV8YLmmPA3LFhr3vcLqk0VkPUYXvMRY1PrIdeLecILGrBSwLagJOW4bcpKQDxrTFHOJOkINXqeLA+RMTFyoDIDy2qJrftRHySIgZUM+S/E82pbBsG0KfSoa8yjejglIzxzcYGi3ndaLVlZlgOYbAj+GsV66ugfy+CwtYp9 root@formuler1

Please note that .ssh (folder) must have access rights rwx (700) and authorized_keys (file) rw (700).


root@formuler1:~# dbclient -y -i id_rsa XXX_USER@YYY_IP
Linux images 3.2.0-4-amd64 #1 SMP Debian 3.2.63-2+deb7u2 x86_64

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
You have new mail.
Last login: Sat Apr 18 11:43:32 2015 from XXX@YYYY

root@formuler1:~# scp -S dbclient -i /home/root/id_rsa /tmp/ecm.info XXX_USER@YYY_IP:/tmp/
ecm.info         
Please keep your keys PRIVATE!

Also consider using stronger key size (eg 2048 or 4096 ...)
 
root@formuler1:~# dropbearkey
Must specify a key filename
Usage: dropbearkey -t <type> -f <filename> [-s bits]
-t type Type of key to generate. One of:
                rsa
                dss
                ecdsa
-f filename     Use filename for the secret key
-s bits Key size in bits, should be a multiple of 8 (optional)
           DSS has a fixed size of 1024 bits
           ECDSA has sizes 256 384 521
-y              Just print the publickey and fingerprint for the
                private key in <filename>.
root@formuler1:~# dropbearkey -t rsa -f id_rsa4096 -s 4096

Edited by athoik, 18 April 2015 - 10:06.

Wavefield T90: 0.8W - 1.9E - 4.8E - 13E - 16E - 19.2E - 23.5E - 26E - 33E - 39E - 42E - 45E on EMP Centauri DiseqC 16/1
Unamed: 13E Quattro - 9E Quattro on IKUSI MS-0916

Re: FTP Client (not as a plugin) #44 theparasol

  • Senior Member
  • 4,157 posts

+198
Excellent

Posted 18 April 2015 - 10:06

Problem is (if I read this topic replies correctly!) doglover isnt able to generate/use RSA on the host he has to connect so this solution isnt an option for him....


@Camping: ZGemma H.2S, Technisat Multytenne 4-in-1 @Home: Edision Mini 4K, Wave Frontier T55, EMP Centauri EMP DiSEqC 8/1 switch, 4x Inverto Ultra Black single LNB


Re: FTP Client (not as a plugin) #45 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 18 April 2015 - 10:15

Problem is (if I read this topic replies correctly!) doglover isnt able to generate/use RSA on the host he has to connect so this solution isnt an option for him....

 

Exactly.....

 

People seem not to understand this.  They keep coming up with all this key storing on the remote server.which i cannot do, and the owner does not want to do or does not even know how to do.

 

In can log on to the server with user and password without any problem.  I only want to automate this.

On WinSCP this is no problem:

open sftp://user:password@example.com/ -hostkey="ssh-rsa 2048 xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx"

But this is Windows.  I want to do it with a linux program.

sftp and scp do not let me pass a password in automated mode!!!!!!!  (Or I cannot find the correct syntax)

 

Willy


Edited by doglover, 18 April 2015 - 10:18.

~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: FTP Client (not as a plugin) #46 catastrofus

  • Senior Member
  • 3,440 posts

+43
Good

Posted 18 April 2015 - 10:37

Another option is using something like sshpass, but that is not available on a stb.

Then you could say: SSHPASS=<your-password-here>; sshpass -e sftp <options> - sftp-user@remote-host


2 x ultimo4k (dvb-c fbc + 1 dvb-s2, 8.3r/nb) + een et10k/osmini (geen tuners en dus fallbackclient, nb) met een Synology ds214+ (2 x 6 TB) op DSM 7.1.1 in ziggo oost (voormalig @Home) + A1/A2/A3/HB (TechniSat)
 


Re: FTP Client (not as a plugin) #47 athoik

  • PLi® Core member
  • 8,458 posts

+327
Excellent

Posted 18 April 2015 - 10:43

Problem is (if I read this topic replies correctly!) doglover isnt able to generate/use RSA on the host he has to connect so this solution isnt an option for him....

 
Exactly.....
 
People seem not to understand this.  They keep coming up with all this key storing on the remote server.which i cannot do, and the owner does not want to do or does not even know how to do.


Clear.. (scp is from dropbear not openssh)
 
DROPBEAR_PASSWORD="Password_Escape_Special_Chars_eg_\!" scp /tmp/ecm.info someuser@somehost:/tmp/

Edited by athoik, 18 April 2015 - 10:43.

Wavefield T90: 0.8W - 1.9E - 4.8E - 13E - 16E - 19.2E - 23.5E - 26E - 33E - 39E - 42E - 45E on EMP Centauri DiseqC 16/1
Unamed: 13E Quattro - 9E Quattro on IKUSI MS-0916

Re: FTP Client (not as a plugin) #48 theparasol

  • Senior Member
  • 4,157 posts

+198
Excellent

Posted 18 April 2015 - 10:53

Athoik, since you are far more experienced than me hope you are willing/can assist:

 

If we can change the way Curl is compiled into the feeds Doglover is able to use SFTP too.

Right now the compiled Curl sitting in the feeds is missing SFTP support due to fact of very small compile parameter issue:

 

in rules file replace "--without-libssh2" with "--with-libssh2"

 

I dont have a clue where to find this curl in the build environment and how to add some kind of patch to make this change but I think someone who knows what to do and

where to look can do this in a heartbeat ;)

 

I think if we can change that Doglover can use sftp the way he wants and can focus again on epg data optimalisation.


@Camping: ZGemma H.2S, Technisat Multytenne 4-in-1 @Home: Edision Mini 4K, Wave Frontier T55, EMP Centauri EMP DiSEqC 8/1 switch, 4x Inverto Ultra Black single LNB


Re: FTP Client (not as a plugin) #49 blzr

  • PLi® Core member
  • 2,269 posts

+118
Excellent

Posted 18 April 2015 - 11:01

Another option is using something like sshpass, but that is not available on a stb.

Then you could say: SSHPASS=<your-password-here>; sshpass -e sftp <options> - sftp-user@remote-host

 

you can try attached...

Attached Files


True sarcasm doesn't need green font...

Re: FTP Client (not as a plugin) #50 athoik

  • PLi® Core member
  • 8,458 posts

+327
Excellent

Posted 18 April 2015 - 12:08

I dont have a clue where to find this curl in the build environment and how to add some kind of patch to make this change but I think someone who knows what to do and
where to look can do this in a heartbeat ;)


You can find curl in openembedded-core/meta/recipes-support/curl/curl_7.40.0.bb.

If you take a look at .bb file you will notice that package config for libssl2 is not enabled.

...
PACKAGECONFIG ??= "${@bb.utils.contains("DISTRO_FEATURES", "ipv6", "ipv6", "", d)} gnutls zlib"
...
PACKAGECONFIG[libssh2] = "--with-libssh2,--without-libssh2,libssh2"
...
You can simply fix this on your local enviroment by adding a .bbappend in meta-local folder.

meta-local/recipes-local/ovverides/curl_7.%.bbappend (% is wildcard)
meta-local/recipes-local/ovverides/curl_7.40.0.bbappend

PACKAGECONFIG = "${@bb.utils.contains("DISTRO_FEATURES", "ipv6", "ipv6", "", d)} gnutls zlib libssh2"

Wavefield T90: 0.8W - 1.9E - 4.8E - 13E - 16E - 19.2E - 23.5E - 26E - 33E - 39E - 42E - 45E on EMP Centauri DiseqC 16/1
Unamed: 13E Quattro - 9E Quattro on IKUSI MS-0916

Re: FTP Client (not as a plugin) #51 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 18 April 2015 - 12:11

Another option is using something like sshpass, but that is not available on a stb.

Then you could say: SSHPASS=<your-password-here>; sshpass -e sftp <options> - sftp-user@remote-host

 

Success.  Found a mipsel version of sshpass (not the same as above - I saw that after i found my version)

And this works.!!!

 

 

Problem solved.  (I think)

 

I am still interested to have curl fixed.

 

Willy


Edited by doglover, 18 April 2015 - 12:12.

~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: FTP Client (not as a plugin) #52 athoik

  • PLi® Core member
  • 8,458 posts

+327
Excellent

Posted 18 April 2015 - 12:16

DROPBEAR_PASSWORD doesn't work or you didn't try?
Wavefield T90: 0.8W - 1.9E - 4.8E - 13E - 16E - 19.2E - 23.5E - 26E - 33E - 39E - 42E - 45E on EMP Centauri DiseqC 16/1
Unamed: 13E Quattro - 9E Quattro on IKUSI MS-0916

Re: FTP Client (not as a plugin) #53 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 18 April 2015 - 12:29

DROPBEAR_PASSWORD doesn't work or you didn't try?

 

No did not try this.  (As I found a solution with sshpass)

And I am working on this thing already 4 days.  It is enough for now.

 

Willy


Edited by doglover, 18 April 2015 - 12:30.

~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: FTP Client (not as a plugin) #54 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 18 April 2015 - 19:19

DROPBEAR_PASSWORD doesn't work or you didn't try?

 

Worked and not.

 

I got this message back:

This service allows sftp connections only.

So yes the dropbear method worked.  But SCP is not allowed.

 

Willy

 


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: FTP Client (not as a plugin) #55 Lost in Space

  • Senior Member
  • 876 posts

+69
Good

Posted 18 April 2015 - 20:04

I borrowed it from Debian and posted it long ago ....

 

PS: I also have compiled curlftps for mipsel, then it is even easier, but you need matching fuse modules and utils for your box and as Dreamboxe ar not on your Radar Screen anymore help yourself.

Attached Files


Edited by gutemine, 18 April 2015 - 20:09.


Re: FTP Client (not as a plugin) #56 Erik Slagter

  • PLi® Core member
  • 46,951 posts

+541
Excellent

Posted 19 April 2015 - 09:16

This service allows sftp connections only.
So yes the dropbear method worked.  But SCP is not allowed.

As mentioned before, dropbear, ssh, sftp and scp all use the same protocol. There is a possibility that the host doesn't allow one of them explicitly, which I think is silly though.


* Wavefrontier T90 with 28E/23E/19E/13E via SCR switches 2 x 2 x 6 user bands
I don't read PM -> if you have something to ask or to report, do it in the forum so others can benefit. I don't take freelance jobs.
Ik lees geen PM -> als je iets te vragen of te melden hebt, doe het op het forum, zodat anderen er ook wat aan hebben.


Re: FTP Client (not as a plugin) #57 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 19 April 2015 - 10:27

I have completed now the batch file.  Just ran a complete update (not the grabbing part) of the XMLTV files via my ET-9500.

Collecting the files from the different grabbing PC's, an uploading them to the different mirrors took just 25 minutes.

Which is considerable less than the 2h30 it takes on the PC with the crappy line I was using before.

 

Willy

 

 

As mentioned before, dropbear, ssh, sftp and scp all use the same protocol. There is a possibility that the host doesn't allow one of them explicitly, which I think is silly though.

 

 

It gets even more silly.  I figured out how to set up the log-in method with public and private keys.

This does not work on this particular server.

Reason:  for this to work I need to able to store the public key in the authorized_keys file in folder .ssh on the home dir of the site.

Now I cannot store anything in this home dir.  In the home folder there is another folder where i can store things in (like the epg data).  I took the chance and sored the authorized_keys in this folder and in a .ssh folder which I created in the folder I can store things in.  As expected this does not work.

I do not understand this webmaster.  He forces me to use sftp, but prevents me from using the safest method of logging in.


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*


Re: FTP Client (not as a plugin) #58 Erik Slagter

  • PLi® Core member
  • 46,951 posts

+541
Excellent

Posted 19 April 2015 - 12:01

Exactly.

 

But WanWizard already warned for this.


* Wavefrontier T90 with 28E/23E/19E/13E via SCR switches 2 x 2 x 6 user bands
I don't read PM -> if you have something to ask or to report, do it in the forum so others can benefit. I don't take freelance jobs.
Ik lees geen PM -> als je iets te vragen of te melden hebt, doe het op het forum, zodat anderen er ook wat aan hebben.


Re: FTP Client (not as a plugin) #59 athoik

  • PLi® Core member
  • 8,458 posts

+327
Excellent

Posted 19 April 2015 - 16:16

Hi,

Here is the yafc bitbake. (I test it and it works)
 
SUMMARY = "Yafc is yet another ftp client (with some handy features)"
DESCRIPTION = "Yafc is a command-line Linux FTP client, with a bunch of useful \
        features which make it easier to use than ftp or sftp"

HOMEPAGE = "http://www.yafc-ftp.com"
BUGTRACKER = "https://github.com/sebastinas/yafc/issues/"
MAINTAINER = "Sebastian Ramacher"
LICENSE = "GPLv2"
LIC_FILES_CHKSUM = "file://COPYING;md5=74f65085a4958dced34e7b33cdf95eaf"

DEPENDS = "libbsd readline openssl libssh"

SRCREV = "a096028738c00859a76c191afaeea531909b5513"
SRC_URI = "git://github.com/sebastinas/yafc.git"

inherit gettext pkgconfig autotools

S = "${WORKDIR}/git"

do_configure_prepend() {
        sed -i 's/AC_CONFIG_AUX_DIR/#AC_CONFIG_AUX_DIR/' ${S}/configure.ac
}

Attached Files


Wavefield T90: 0.8W - 1.9E - 4.8E - 13E - 16E - 19.2E - 23.5E - 26E - 33E - 39E - 42E - 45E on EMP Centauri DiseqC 16/1
Unamed: 13E Quattro - 9E Quattro on IKUSI MS-0916

Re: FTP Client (not as a plugin) #60 doglover

  • Rytec EPG Team
  • 16,974 posts

+635
Excellent

Posted 20 April 2015 - 07:53

Nice this bitbake recipe.

If now somebody would build this for me, It would be great.

 

Willy


~~Rytec Team~~
Maxytec Multibox SE OpenPli (used as mediaplayer)
Mutant HD2400 OpenPli
Vu+ Duo OpenPli (backup)

Synology NAS

Sat: 13E, 19.2E, 23.5E and 28.2E
*Pli/Rytec EPG POWERED*




Also tagged with one or more of these keywords: ET6000

0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users