{"id":18622538,"url":"https://github.com/mindreframer/file-transfer-accelerators","last_synced_at":"2026-01-24T14:41:22.074Z","repository":{"id":10489573,"uuid":"12670190","full_name":"mindreframer/file-transfer-accelerators","owner":"mindreframer","description":null,"archived":false,"fork":false,"pushed_at":"2013-09-07T20:23:16.000Z","size":736,"stargazers_count":39,"open_issues_count":0,"forks_count":7,"subscribers_count":6,"default_branch":"master","last_synced_at":"2024-12-27T05:07:43.000Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":"arunisrael/angularjs-geolocation","license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mindreframer.png","metadata":{"files":{"readme":"Readme.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2013-09-07T19:20:37.000Z","updated_at":"2023-02-18T20:15:06.000Z","dependencies_parsed_at":"2022-07-30T18:48:06.218Z","dependency_job_id":null,"html_url":"https://github.com/mindreframer/file-transfer-accelerators","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mindreframer%2Ffile-transfer-accelerators","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mindreframer%2Ffile-transfer-accelerators/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mindreframer%2Ffile-transfer-accelerators/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mindreframer%2Ffile-transfer-accelerators/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mindreframer","download_url":"https://codeload.github.com/mindreframer/file-transfer-accelerators/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":239418544,"owners_count":19635203,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-07T04:17:32.346Z","updated_at":"2025-11-03T16:30:18.000Z","avatar_url":"https://github.com/mindreframer.png","language":null,"readme":"## Discussions\n  - http://www.quora.com/What-kind-of-technology-does-Filecatalyst-and-Aspera-uses-to-fast-file-transfers\n  - http://serverfault.com/questions/300086/file-transfer-alternatives\n  - http://serverfault.com/questions/111813/what-is-the-best-way-to-transfer-a-single-large-file-over-a-high-speed-high-lat\n  - http://forums.smallnetbuilder.com/showthread.php?t=10950\n  - http://www.networkworld.com/news/2012/111312-file-transfer-tools-264194.html\n  - http://www.quora.com/James-Lewis-10/answers\n  - http://www.linkedin.com/groupItem?view=\u0026gid=4341810\u0026type=member\u0026item=99631847\u0026commentID=76026411\u0026qid=51d0f011-7deb-4b74-b7c9-a8e5abdae9b7\u0026trk=groups_most_popular-0-b-cmn\u0026goback=%2Egmp_4341810#commentID_76026411\n\n\n## File Catalyst:\n  - http://www.filecatalyst.com/what-problems-are-we-solving\n  - http://www.filecatalyst.com/collateral/Accelerating_File_Transfers.pdf\n  - Customers:\n    - http://www.filecatalyst.com/quicklink-and-filecatalyst-together-on-ios-and-iphone\n    - http://www.filecatalyst.com/sending-large-media-files-how-free-services-stack-up (February 14, 2013)\n    - http://svgeurope.org/blog/headlines/shapeshifter-taps-filecatalyst-for-large-media-file-transfer/\n  - Critic:\n    - http://etherealmind.com/file-catalyst-unlimitech-software-dishonest-comments/\n  - Pricing:\n    - http://www.filecatalyst.com/products/filecatalyst-workflow/workflow-pricing\n  - [Videos](http://www.youtube.com/watch?v=yvjnWjUwOdo)\n\n## JScape\n  - http://www.jscape.com/Portals/26878/whitepapers/how_to_boost_file_transfer_speeds_with_aftp.pdf\n  - http://www.jscape.com/blog/bid/76604/Accelerated-File-Transfer-In-Action\n  - http://www.jscape.com/products/accelerated-file-transfer/\n  - http://www.jscape.com/blog/bid/99124/4-Popular-Large-File-Transfer-Methods-With-Big-Deficiencies\n  - http://www.jscape.com/blog/bid/94894/Solving-the-Problem-of-Big-Data-Transfers-in-the-Film-Industry\n  - http://www.jscape.com/products/file-transfer-servers/jscape-mft-server/\n  - http://www.jscape.com/download-jscape-mft-server/\n  - http://www.jscape.com/blog/?Tag=Case+Studies\n  - [Version History](http://files.jscape.com/secureftpserver/docs/index.html)\n  - [Managed File Transfer and Network Solutions](http://www.jscape.com/blog/bid/73903/Load-Testing-Managed-File-Transfer-Applications)\n  - Download:\n    - http://www.jscape.com/downloads/anyclient\n    - http://www.jscape.com/downloads/jscape-mft-server/\n    - http://www.jscape.com/downloads/file-transfer-command-line\n\n  - Docs: http://www.jscape.com/support/documentation/\n    - http://files.jscape.com/ftcl/docs/html/\n    - http://files.jscape.com/secureftpserver/docs/index.html\n\n  - Pricing:\n    - http://store.jscape.com/index.php?main_page=index\u0026cPath=1_2\n\n## DataExp:\n  - http://www.dataexpedition.com/expedat/?gclid=CLqAnZKatbkCFYKS3godiEkAXw\n\n## Aspera + Amazon\n  - http://readwrite.com/2011/09/27/aspera-sends-your-data-directl\n\n## Comparison:\n  - http://www.thinkmind.org/index.php?view=article\u0026articleid=icns_2013_2_40_10167\n  - http://www.thinkmind.org/download.php?articleid=icns_2013_2_40_10167\n  - http://www.filecatalyst.com/pride-in-our-work\n    - TIXStream\n    - FC Direct\n    - ExpeDat\n\n## Companies:\n  - http://www.tixeltec.com/index_en.html\n  - http://www.tixeltec.com/ps_tixway_en.html\n  - http://agilesys.com/bridgeworks/\n\n## S3 Fuse\n  - https://code.google.com/p/s3fs/wiki/FuseOverAmazon\n  - https://code.google.com/p/s3fs/issues/detail?id=24\n  - http://www.idevelopment.info/data/AWS/AWS_Tips/AWS_Management/AWS_20.shtml#s3fs Limitations\n  - http://juliensimon.blogspot.de/2013/08/howto-aws-mount-s3-buckets-from-linux.html\n\n## s3ql\n  - https://code.google.com/p/s3ql/\n\n## Problems/Solutions with AWS + S3\n  - http://www.jscape.com/blog/bid/94768/A-Faster-Way-to-Send-Big-Data-to-the-Cloud\n  - http://aws.typepad.com/aws/2010/12/amazon-s3-object-size-limit.html\n  - http://www.filecatalyst.com/what-to-know-before-moving-your-data-to-the-cloud\n  - http://www.turnkeylinux.org/blog/exploring-s3-based-filesystems-s3fs-and-s3backer\n  - http://www.rightscale.com/blog/cloud-industry-insights/network-performance-within-amazon-ec2-and-amazon-s3\n\n## Airship:\n  - http://help.useairship.com/wiki/Home\n  - http://help.useairship.com/wiki/Installation\n  - http://help.useairship.com/wiki/License\n  - http://help.useairship.com/wiki/FAQ\n  - http://www.useairware.com/#!about/c1nmv\n  - http://www.useairware.com/#!client-stories/cmv5\n  - http://www.useairware.com/#!clients/c1szy\n  - http://help.useairship.com/images/4/44/AIRShip_technical_guide_v_1_2_2-2.pdf\n  - http://forums.smallnetbuilder.com/showpost.php?s=a429954b3fac433340e1f57b6ef3c8d2\u0026p=74111\u0026postcount=4\n\n## Open Source:\n  - [How to transfer large amounts of data via network.](http://moo.nac.uci.edu/~hjm/HOWTO_move_data.html)\n  - http://www.filecatalyst.com/open-source-fast-file-transfers\n  - http://coolpandaca.wordpress.com/2012/10/30/hscp-udt-udp-a-better-way-of-scp-and-file-transfer-over-the-network/\n\n## mrsync (multicast remote sync)\n  - http://mrsync.sourceforge.net/\n  - http://sourceforge.net/projects/mrsync/files/mrsync/\n\n## RBUDP\n  - http://www.evl.uic.edu/cavern/RBUDP/Reliable%20Blast%20UDP.html\n\n## GridFTP\n  - http://en.wikipedia.org/wiki/GridFTP\n  - http://www.globus.org/toolkit/docs/latest-stable/gridftp/\n  - http://www.globus.org/toolkit/docs/latest-stable/gridftp/gridftp.pdf\n\n## bbcp\n  - http://moo.nac.uci.edu/~hjm/HOWTO_move_data.html#bbcp\n\n## UDT: Breaking the Data Transfer Bottleneck\n  - http://udt.sourceforge.net/\n  - http://udt.sourceforge.net/doc.html\n  - http://sourceforge.net/p/udt/git/ci/master/tree/\n  - http://blog.verycloud.com/blog/\n  - http://www.hpcwire.com/hpcwire/2009-12-08/open_cloud_testbed_wins_bandwidth_challenge_at_sc09.html\n\n## Sector/Sphere\n  - http://sector.sourceforge.net/\n  - http://sector.sourceforge.net/pub/Sector-cloudcom-tutorial.pdf\n\n## Tsunami-UDP\n  - https://github.com/rriley/tsunami-udp\n  - [Using Tsunami UDP in AWS- How it helps, Configuration and Comparison](http://harish11g.blogspot.de/2013/05/How-to-transfer-huge-data-to-Amazon-Web-Services-AWS-using-Tsunami-UDP-Configuration-Comparison.html)\n  - http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.113.4551\u0026rep=rep1\u0026type=pdf\n  - http://www.csm.ornl.gov/~dunigan/netperf/udp/\n\n\n\n### FTP Streaming To S3\n  - https://github.com/felixge/node-formidable/issues/227\n  Is it possible to stream directly to S3 without uploading to `uploadDir` first?\n    - No. The S3 API requires you to provide the size of new files when creating them. This information is not available for multipart/form-data files until they have been fully received. This means streaming is impossible.\n\n    - No. The S3 API requires you to provide the size of new files when creating them. This information is not available for multipart/form-data files until they have been fully received. This means streaming is impossible.\n  - https://github.com/felixge/node-formidable\n\n\n\n## Programming with S3\n  - http://stackoverflow.com/questions/6774201/how-to-upload-a-file-from-the-browser-to-amazon-s3-with-node-js-express-and-kn\n  - https://github.com/LearnBoost/knox\n  - https://github.com/nathanoehlman/knox-mpu\n  - https://github.com/goodeggs/knox-copy\n  - https://github.com/segmentio/s3-lister\n  - https://github.com/nathanpeck/s3-upload-stream\n\n\n\n## Aspera on Amazon S3\n  - http://cloud.asperasoft.com/aspera-on-demand/aspera-on-demand-for-amazon-web-services/\n\n\n###### GOLANG\n## Stream directly to S3\n- http://godoc.org/github.com/kr/s3/s3util\n- http://godoc.org/github.com/kr/s3/s3cp\n\n- https://github.com/brettweavnet/gosync\n\n\nGoAMZ\n  - http://bazaar.launchpad.net/~goamz/goamz/trunk/files/head:/s3/","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmindreframer%2Ffile-transfer-accelerators","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmindreframer%2Ffile-transfer-accelerators","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmindreframer%2Ffile-transfer-accelerators/lists"}