BIG DATA TRANSFER FOR TABLET-CLASS MACHINES

Authors

  • Tevaganthan Veluppillai
  • Brandon Ortiz
  • Robert E. Hiromoto

DOI:

https://doi.org/10.47839/ijc.12.4.611

Keywords:

Blocked file transport, stream-based, block-oriented, tablet machines, client/server configuration.

Abstract

Several well-known data transfer protocols are presented in a comparative study to address the issue of big data transfer for tablet-class machines. The data transfer protocols include standard Java and C++, and block-data transfers protocols that use both the Java New IO (NIO) and the Zerocopy libraries, and a block-data C++ transfer protocol. Several experiments are described and results compared against the standard Java IO and C++ (stream-based file transport protocols). The motivation for this study is the development of a client/server big data file transport protocol for tablet-class client machines that rely on the Java Remote Method Invocation (RMI) package for distributed computing.

References

C. Wang, D. Zhang. A novel compression tool for efficient storage of genome resequencing data, Nucleic Acids Research, Vol. 39, Issue 7, April 2011, e45.

Lynda Chin, William C. Hahn, Gad Getz, et al. Making sense of cancer genomic data, Genes & Development, Vol. 25, Issue 6, 2011, pp. 534-555.

http://supercomputing.caltech.edu (last accessed 15, Feb., 2013.)

M. J. de Smith, M. F. Goodchild, P. A. Longley. Geospatial Analysis: A Comprehensive Guide to Principles, Techniques and Software Tools, 2nd edition, Troubador, UK, 2007.

W. Allcock, J. Bresnahan, R. Kettimuthu, M. Link, C. Dumitrescu, I. Raicu, I. Foster, The globus striped GridFTP framework and server, Proceedings of the ACM/IEEE conference on Supercomputing SC'05, ACM Press, November 2005, pp. 54.

http://doc.in2p3.fr/bbftp/

http://www.slac.stanford.edu/~abh/bbcp/

R. S. Prasad, M. Jain and C. Dovrolis, Socket Buffer Auto-Sizing for High-Performance Data Transfers, Journal of Grid Computing, Vol. 1, Issue 1, 2003, pp. 361-376.

Getting started with NIO, https://www.ibm.com/developerworks/java/tutorials/j-nio/j-nio-pdf.pdf.

V. Tevaganthan, B. Ortiz, R. E. Hiromoto, A big data file transfer tool for tablet-class machines, Proceedings of the IEEE 7th International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS'2013), Berlin, Germany, September 12-14, 2013, pp. 676-680.

S. K. Palaniappan and P. B. Nagaraja, Efficient data transfer through zero copy: Zero copy, zero overhead, 2 Sep 2008, http://www.ibm.com/developerworks/library/j-zerocopy/

M. Jain, R. S. Prasad and C. Dovrolis, The TCP bandwidth-delay product revisited: network buffering, cross traffic, and socket buffer auto-sizing, http://hdl.handle.net/1853/5920.

Greg Travis, Getting started with new I/O (NIO) skill level: introductory, http://www.ibm.com/developerworks/java/tutorials/j-nio/j-nio-pdf.pdf.

C. Jin et al., FAST TCP: from theory to experiments, IEEE Network, Vol. 19, Issue 1, 2005, pp. 4-11.

http://datatransfer.codeplex.com

S. Thulasidasan, W. Feng, M. K. Gardner. Optimizing GridFTP through dynamic right-sizing, Proceedings of IEEE International Symposium on High Performance Distributed Computing, 2003, pp. 14-23.

J. Semke, J. Mahdavi, M. Mathis, Automatic TCP buffer tuning, Computer Communication Review, Vol. 28, 1998, pp. 315-322.

R. S. Prasad, M. Jain, C. Dovrolis, Socket buffer auto-sizing for high-performance data transfers, Journal of Grid Computing, Vol. 1, Issue 4, 2003, pp. 361-376.

Beej's Guide to Network Programming, Jorgensen Publishing, October 20, 2011.

http://www.linuxhowtos.org/C_C++/socket.htm (last accessed 16 Dec., 2013).

https://developer.apple.com/technologies/tools/ (last accessed 31 Dec., 2013).

Downloads

Published

2014-08-01

How to Cite

Veluppillai, T., Ortiz, B., & Hiromoto, R. E. (2014). BIG DATA TRANSFER FOR TABLET-CLASS MACHINES. International Journal of Computing, 12(4), 316-323. https://doi.org/10.47839/ijc.12.4.611

Issue

2013, Volume 12, Issue 4

Section

Articles

License

International Journal of Computing is an open access journal. Authors who publish with this journal agree to the following terms:
•    Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
•    Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
•    Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work.