Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/YuriyNasretdinov/GoSSHa

Go SSH agent: can execute commands at thousands of servers and upload files to them
https://github.com/YuriyNasretdinov/GoSSHa

Last synced: 3 months ago
JSON representation

Go SSH agent: can execute commands at thousands of servers and upload files to them

Awesome Lists containing this project

README 

        
GoSSHa: Go SSH agent

====================



Ssh client that supports command execution and file upload on multiple servers (designed to handle thousands of parallel SSH connections). GoSSHa supports SSH authentication using private keys (encrypted keys are supported using external call to *ssh-keygen*) and ssh-agent, implemented using go.crypto/ssh.



Installation

============



1. Install go (programming language) at http://golang.org/

2. Install GoSSHa: `$ go get github.com/YuriyNasretdinov/GoSSHa`



Usage

=====



GoSSHa is not designed to be used directly by end users, but rather serve as a lightweight proxy between your application (GUI or CLI) and thousands of SSH connections to remote servers.



## Basic protocol



You send commands and receive response by writing and reading JSON lines, for example:



```

$ GoSSHa

{"Type":"InitializeComplete","InitializeComplete":true}

{"Action":"ssh","Cmd":"uptime","Hosts":["localhost"]}   # your input

{"Type":"ConnectionProgress","ConnectedHost":"localhost"}

{"Type":"Reply","Hostname":"localhost","Stdout":" 1:07  up 1 day,  1:32, 2 users, load averages: 0.90 0.99 1.08\n","Stderr":"","Success":true,"ErrMsg":""}

{"Type":"FinalReply","TotalTime":0.082024023,"TimedOutHosts":{}}

```



GoSSHa continiously reads stdin and writes response to stdout. The protocol can be split into 2 major phases: initialization and execute loop.



**Note:** When stdin is closed (EOF), then the program exits even if pending operations are not completed.



## Initialization



To be able to run commands GoSSHa examines `~/.ssh/id_rsa`, `~/.ssh/id_dsa` and `~/.ssh/id_ecdsa` if present and asks for their passwords if they are encrypted. If ssh-agent auth socket is present (identified by presence of `SSH_AUTH_SOCK` environment variable) then it is used as a primary authentication method with fallback to private keys. Password or keyboard-interactive authentication methods are not currently supported, but there are no technical difficulties for adding them.



During initialization, GoSSHa will ask for password for all encrypted private keys it finds, printing message in the following format:



```

{"Type":"PasswordRequest","PasswordFor":""}

```



You can respond with empty object (`{}`) or provide the passphrase:



```

{"Password":""}

```



In case of any non-critical errors (e.g. you did not provide a passphrase or the passphase is invalid) you will receive message in the following format:



```

{"Type":"UserError","IsCritical":false,"ErrorMsg":""}

```



If critical error occurs then all pending operations will be aborted and you will be presented with the same response but "IsCritical":true, for example:



```

{"Type":"UserError","IsCritical":true,"ErrorMsg":"Cannot parse JSON: unexpected end of JSON input"}

```



When GoSSHa finishes initialization and is ready to accept commands, the following line will be printed:



```

{"Type":"InitializeComplete","InitializeComplete":true}

```



## Commands execution



In order to execute a certain `` on remote servers (e.g. `` and `:`):



```

{"Action":"ssh","Cmd":"","Hosts":["",":"]}

```



You can also set `"Timeout": ` in milliseconds (default is 30000 ms)



While connections to hosts are estabilished and command results are ready you will receive one of the following messages:



1. Error messages: `{"Type":"UserError","IsCritical":false,"ErrorMsg":""}`

2. Connection progress: `{"Type":"ConnectionProgress","ConnectedHost":""}`

3. Command result:



```

{"Type":"Reply","Hostname":"","Stdout":"","Stderr":"","Success":true|false,"ErrMsg":""}

```



After all commands have done executing or when timeout comes you will receive the following response:



```

{"Type":"FinalReply","TotalTime":,"TimedOutHosts":{"":true,...,"":true}}

```



For your convenience all hosts that timed out are listed in "TimedOutHosts" property, although you could deduce these hosts by subtracting the sets of hostnames that were present in request and the ones present in response.



**Note:** If you send requests to hosts that previously timed out then GoSSHa may not send `{"ConnectedHost":""}` for it and only send the command result.



## File upload



You can also upload file using the following command:



```

{"Action":"scp","Source":"","Target":"","Hosts":[...]}

```



You can also set `"Timeout": ` in milliseconds (default is 30000 ms) and `"MaxThroughput": ` in bytes per second to limit maximum bandwidth usage. In default implementation MaxThroughput cannot be less than about 50 Mbit/sec (6553600 bytes per second). If you want to be able to use less bandwidth, try increasing THROUGHPUT_SLEEP_INTERVAL or decreasing MIN_CHUNKS and CHUNK_SIZE constant values in source code.



You will receive progress and results in exactly the same format as for command execution.



**Note:** Source file contents are fully read in memory, so you should not upload very large files using this command. If you really need to upload huge file to a lot of hosts, try using bittorrent or UFTP, as they provide much higher network effeciency than SSH.



Source code modification

========================



GoSSHa is pretty simple (all it's code is contained in a single file with 500 SLOC) and it should be pretty easy to add new functionality or alter some of it's behaviour. We are always open for pull requests and feature requests as well.