128 replies to this topic

[greatred]

yes <password> | sftp -b /hdd/epg/king.txt user@IP

[doglover]

Still asks me for the password.

                                              
root@et9x00:~# yes password|sftp -b /hdd/epg/king.txt user@IP
WARNING: Ignoring unknown argument '-oForwardX11 no'                           
WARNING: Ignoring unknown argument '-oForwardAgent no'                         
WARNING: Ignoring unknown argument '-oPermitLocalCommand no'                   
WARNING: Ignoring unknown argument '-oClearAllForwardings yes'                 
WARNING: Ignoring unknown argument '-obatchmode yes'                           
WARNING: Ignoring unknown argument '-oProtocol 2'                              
WARNING: Ignoring unknown argument '--'                                        
user@IP.76's password:                                               
user@IP.76's password:                                               
sftp> cd /epg_data/                                                            
sftp> put /hdd/epg/rytecxmltvxxxx.gz                                         
root@et9x00:~#                                                                 
                           

After typing it in.  The file is uploaded.

 

Willy

[athoik]

@Willy

I can confirm that guide I send you works! (https://www.linux-ti...rsa-key-problem)

Using above guide I can connect from "OpenPLi" box to "Debian" box without password.
 

root@formuler1:~# cd /home/root/
root@formuler1:~# dropbearkey -t rsa -f id_rsa
Generating key, this may take a while...
Public key portion is:
ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCcLtECXigmbq2p3dA+qkexHTLVbwwW6jLNo8m6gV+zv8Q38/bsV8Eu7Lah9IcLeHJs1paG5ImqZ7ZoCc5djnoB7pi+PMgHM+kDMQ+l8U30sy3BG2tTEeOBc7W48QuZJnXjAnJgauJarMX39ZXfG68n816g6LfQEj+8urVzEOqiGs/J12dV8YLmmPA3LFhr3vcLqk0VkPUYXvMRY1PrIdeLecILGrBSwLagJOW4bcpKQDxrTFHOJOkINXqeLA+RMTFyoDIDy2qJrftRHySIgZUM+S/E82pbBsG0KfSoa8yjejglIzxzcYGi3ndaLVlZlgOYbAj+GsV66ugfy+CwtYp9 root@formuler1
Fingerprint: md5 68:de:97:66:c0:02:fa:2c:cf:2d:a8:65:d1:0f:3a:a8

Then on "Debian" box I entered the following into .ssh/authorized_keys

ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCcLtECXigmbq2p3dA+qkexHTLVbwwW6jLNo8m6gV+zv8Q38/bsV8Eu7Lah9IcLeHJs1paG5ImqZ7ZoCc5djnoB7pi+PMgHM+kDMQ+l8U30sy3BG2tTEeOBc7W48QuZJnXjAnJgauJarMX39ZXfG68n816g6LfQEj+8urVzEOqiGs/J12dV8YLmmPA3LFhr3vcLqk0VkPUYXvMRY1PrIdeLecILGrBSwLagJOW4bcpKQDxrTFHOJOkINXqeLA+RMTFyoDIDy2qJrftRHySIgZUM+S/E82pbBsG0KfSoa8yjejglIzxzcYGi3ndaLVlZlgOYbAj+GsV66ugfy+CwtYp9 root@formuler1

Please note that .ssh (folder) must have access rights rwx (700) and authorized_keys (file) rw (700).


root@formuler1:~# dbclient -y -i id_rsa XXX_USER@YYY_IP
Linux images 3.2.0-4-amd64 #1 SMP Debian 3.2.63-2+deb7u2 x86_64

The programs included with the Debian GNU/Linux system are free software;
the exact distribution terms for each program are described in the
individual files in /usr/share/doc/*/copyright.

Debian GNU/Linux comes with ABSOLUTELY NO WARRANTY, to the extent
permitted by applicable law.
You have new mail.
Last login: Sat Apr 18 11:43:32 2015 from XXX@YYYY

root@formuler1:~# scp -S dbclient -i /home/root/id_rsa /tmp/ecm.info XXX_USER@YYY_IP:/tmp/
ecm.info         

Please keep your keys PRIVATE!

Also consider using stronger key size (eg 2048 or 4096 ...)
 

root@formuler1:~# dropbearkey
Must specify a key filename
Usage: dropbearkey -t <type> -f <filename> [-s bits]
-t type Type of key to generate. One of:
                rsa
                dss
                ecdsa
-f filename     Use filename for the secret key
-s bits Key size in bits, should be a multiple of 8 (optional)
           DSS has a fixed size of 1024 bits
           ECDSA has sizes 256 384 521
-y              Just print the publickey and fingerprint for the
                private key in <filename>.
root@formuler1:~# dropbearkey -t rsa -f id_rsa4096 -s 4096

Edited by athoik, 18 April 2015 - 10:06.

[theparasol]

Problem is (if I read this topic replies correctly!) doglover isnt able to generate/use RSA on the host he has to connect so this solution isnt an option for him....

[doglover]

Problem is (if I read this topic replies correctly!) doglover isnt able to generate/use RSA on the host he has to connect so this solution isnt an option for him....

 

Exactly.....

 

People seem not to understand this.  They keep coming up with all this key storing on the remote server.which i cannot do, and the owner does not want to do or does not even know how to do.

 

In can log on to the server with user and password without any problem.  I only want to automate this.

On WinSCP this is no problem:

open sftp://user:password@example.com/ -hostkey="ssh-rsa 2048 xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx:xx"

But this is Windows.  I want to do it with a linux program.

sftp and scp do not let me pass a password in automated mode!!!!!!!  (Or I cannot find the correct syntax)

 

Willy

Edited by doglover, 18 April 2015 - 10:18.

[catastrofus]

Another option is using something like sshpass, but that is not available on a stb.

Then you could say: SSHPASS=<your-password-here>; sshpass -e sftp <options> - sftp-user@remote-host

[athoik]

Problem is (if I read this topic replies correctly!) doglover isnt able to generate/use RSA on the host he has to connect so this solution isnt an option for him....

 
Exactly.....
 
People seem not to understand this.  They keep coming up with all this key storing on the remote server.which i cannot do, and the owner does not want to do or does not even know how to do.

Clear.. (scp is from dropbear not openssh)
 

DROPBEAR_PASSWORD="Password_Escape_Special_Chars_eg_\!" scp /tmp/ecm.info someuser@somehost:/tmp/

Edited by athoik, 18 April 2015 - 10:43.

[theparasol]

Athoik, since you are far more experienced than me hope you are willing/can assist:

 

If we can change the way Curl is compiled into the feeds Doglover is able to use SFTP too.

Right now the compiled Curl sitting in the feeds is missing SFTP support due to fact of very small compile parameter issue:

 

in rules file replace "--without-libssh2" with "--with-libssh2"

 

I dont have a clue where to find this curl in the build environment and how to add some kind of patch to make this change but I think someone who knows what to do and

where to look can do this in a heartbeat

 

I think if we can change that Doglover can use sftp the way he wants and can focus again on epg data optimalisation.

[blzr]

Another option is using something like sshpass, but that is not available on a stb.

Then you could say: SSHPASS=<your-password-here>; sshpass -e sftp <options> - sftp-user@remote-host

 

you can try attached...

Attached Files

•  sshpass_1.05-r0_mips32el.ipk   5.46KB   2 downloads

[athoik]

I dont have a clue where to find this curl in the build environment and how to add some kind of patch to make this change but I think someone who knows what to do and
where to look can do this in a heartbeat

You can find curl in openembedded-core/meta/recipes-support/curl/curl_7.40.0.bb.

If you take a look at .bb file you will notice that package config for libssl2 is not enabled.

...
PACKAGECONFIG ??= "${@bb.utils.contains("DISTRO_FEATURES", "ipv6", "ipv6", "", d)} gnutls zlib"
...
PACKAGECONFIG[libssh2] = "--with-libssh2,--without-libssh2,libssh2"
...

You can simply fix this on your local enviroment by adding a .bbappend in meta-local folder.

meta-local/recipes-local/ovverides/curl_7.%.bbappend (% is wildcard)
meta-local/recipes-local/ovverides/curl_7.40.0.bbappend

PACKAGECONFIG = "${@bb.utils.contains("DISTRO_FEATURES", "ipv6", "ipv6", "", d)} gnutls zlib libssh2"

[doglover]

Another option is using something like sshpass, but that is not available on a stb.

Then you could say: SSHPASS=<your-password-here>; sshpass -e sftp <options> - sftp-user@remote-host

 

Success.  Found a mipsel version of sshpass (not the same as above - I saw that after i found my version)

And this works.!!!

 

 

Problem solved.  (I think)

 

I am still interested to have curl fixed.

 

Willy

Edited by doglover, 18 April 2015 - 12:12.

[athoik]

DROPBEAR_PASSWORD doesn't work or you didn't try?

[doglover]

DROPBEAR_PASSWORD doesn't work or you didn't try?

 

No did not try this.  (As I found a solution with sshpass)

And I am working on this thing already 4 days.  It is enough for now.

 

Willy

Edited by doglover, 18 April 2015 - 12:30.

[doglover]

DROPBEAR_PASSWORD doesn't work or you didn't try?

 

Worked and not.

 

I got this message back:

This service allows sftp connections only.

So yes the dropbear method worked.  But SCP is not allowed.

 

Willy

 

[Lost in Space]

I borrowed it from Debian and posted it long ago ....

 

PS: I also have compiled curlftps for mipsel, then it is even easier, but you need matching fuse modules and utils for your box and as Dreamboxe ar not on your Radar Screen anymore help yourself.

Attached Files

•  ftp_0.17-18_mipsel.ipk   39.78KB   12 downloads

Edited by gutemine, 18 April 2015 - 20:09.

[Erik Slagter]

This service allows sftp connections only.

So yes the dropbear method worked.  But SCP is not allowed.

As mentioned before, dropbear, ssh, sftp and scp all use the same protocol. There is a possibility that the host doesn't allow one of them explicitly, which I think is silly though.

[doglover]

I have completed now the batch file.  Just ran a complete update (not the grabbing part) of the XMLTV files via my ET-9500.

Collecting the files from the different grabbing PC's, an uploading them to the different mirrors took just 25 minutes.

Which is considerable less than the 2h30 it takes on the PC with the crappy line I was using before.

 

Willy

 

 

As mentioned before, dropbear, ssh, sftp and scp all use the same protocol. There is a possibility that the host doesn't allow one of them explicitly, which I think is silly though.

 

 

It gets even more silly.  I figured out how to set up the log-in method with public and private keys.

This does not work on this particular server.

Reason:  for this to work I need to able to store the public key in the authorized_keys file in folder .ssh on the home dir of the site.

Now I cannot store anything in this home dir.  In the home folder there is another folder where i can store things in (like the epg data).  I took the chance and sored the authorized_keys in this folder and in a .ssh folder which I created in the folder I can store things in.  As expected this does not work.

I do not understand this webmaster.  He forces me to use sftp, but prevents me from using the safest method of logging in.

[Erik Slagter]

Exactly.

 

But WanWizard already warned for this.

[athoik]

Hi,

Here is the yafc bitbake. (I test it and it works)
 

SUMMARY = "Yafc is yet another ftp client (with some handy features)"
DESCRIPTION = "Yafc is a command-line Linux FTP client, with a bunch of useful \
        features which make it easier to use than ftp or sftp"

HOMEPAGE = "http://www.yafc-ftp.com"
BUGTRACKER = "https://github.com/sebastinas/yafc/issues/"
MAINTAINER = "Sebastian Ramacher"
LICENSE = "GPLv2"
LIC_FILES_CHKSUM = "file://COPYING;md5=74f65085a4958dced34e7b33cdf95eaf"

DEPENDS = "libbsd readline openssl libssh"

SRCREV = "a096028738c00859a76c191afaeea531909b5513"
SRC_URI = "git://github.com/sebastinas/yafc.git"

inherit gettext pkgconfig autotools

S = "${WORKDIR}/git"

do_configure_prepend() {
        sed -i 's/AC_CONFIG_AUX_DIR/#AC_CONFIG_AUX_DIR/' ${S}/configure.ac
}

Attached Files

•  yafc_1.3.5.bb.txt   730bytes   9 downloads

[doglover]

Nice this bitbake recipe.

If now somebody would build this for me, It would be great.

 

Willy