Elastic Transfer, Innovating Data Management

Elastic Transfer (eT) is a framework that permit us to form scalable storage platforms and enable us to create adhoc nearby storage formations and use a huge number of I/O nodes in order to increase the available bandwidth. eT is a open source limited version of IKAROS, focusing on outreach and training activities.

By using eT we are able to address the limitations that traditional globally shared file systems facing when used with large-scale systems, because:

1. Bandwidth does not scale economically to large-scale system.

2.I/O traffic on the high speed network can impact on and be influenced by other unrelated jobs.

3.I/O traffic on the storage server can impact on and be influenced by other unrelated jobs.

Install node.js

At the following link you can find details on how to install Node.js via package manager Wiki by joyent

Install "elastic-transfer" Node.js module

At a node.js command promt, just execute :

npm install elastic-transfer

At a node.js command promt, execute the following :

cd node_modules

cd elastic-transfer

node eT.js

(depending on your system you may need to run this as a Superuser)

After running: node eT.js, the eT module will automatically open a browser window, pointing at the eT GUI (http://localhost:61949/gui). You may go to the last box (Action box) and fill it with the following:

A: 'Source Host' or 'elf', elf stands for "elastic file". We are calling "elfs" the files that have been transfered between hosts by using the eT platform. eT is keeping the file metadata, such as file size and distribution schema, in this way it is easier for us to rebuild the file, search it and transfer it again and again based to our needs (e.g: http://192.168.2.2:61949, http://ikaros-virdomain.3x.et-js.org:443 or elf).

B: 'Destination Host' or 'comma separated Hosts', we must choose at which host we want to send our file. If we want to split and distribute the file between our PCs then we can use a comma separated destination hosts (e.g: http://192.168.2.2:61949, http://ikaros-virdomain.3x.et-js.org:443, http://192.168.2.5:61949).

C: 'Source File' or 'elf', we must choose which file we want to transfer (e.g: root/et_128_v3.png) we are transfering files locating in the "eTshare" folder. If the file is an "elf" you do not need to give the full path (e.g A: elf, C:et_128_v3.png).

D: 'Output File'. The file will be transfered to the destination host with this name, just choose one, if not it will be the same with the 'Source File' (e.g: et_128_v3.png).

eT is using port: 61949

You must ensure connectivity with your IMAP and SMTP server.

After running the eT module, your host will serving content, at least, through two identifiers: one public (e.g:http://ikaros-virdomain.3x.et-js.org:443 ) and one private (e.g: http://localhost:61949 ). Do not use the public identifier for inter-cluster or LAN communications.