Support

Akeeba Backup for Joomla!

#8825 Amazon S3 Upload Fails - Broken Pipe

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
n/a
PHP version
n/a
Akeeba Backup version
n/a

Latest post by nicholas on Sunday, 20 March 2011 11:09 CDT

user9936
I was excited to see in the documentation that large (up to 2GB) part sizes can be used with Amazon S3. I tried with 2GB part size and the post-processing upload failed after 129.7MB (same, both tries) in my bucket. The error was "AEUtilAmazons3::uploadMultipart(): [55] Send failure: Broken pipe."

I then tried a smaller part size of 100MB. About 15 of my 20 parts uploaded to S3 but then failed with the same message.

Am I doing something wrong? I hope to use the large part sizes as the files are easier on the eyes and it is easier to see what is what.

THANKS!

Akeeba 3.2.4
Joomla 1.5.22
PHP 5.2.15
MySQL 5.1.52 ?
Host: HostGator

nicholas
Akeeba Staff
Manager
The support of large files actually depends on the host. Akeeba Backup chops each file to upload in 5Mb parts and starts pushing them to Amazon, one at a time. At the end of the process it asks Amazon to glue them together into a single file. If the parts can't be transferred fast enough, the connection used to upload them times out and you get the error you mentioned.

Unfortunately, there's no workaround to that issue other than using a host with more outbound bandwidth available, or at least trying to backup your site in off-peak hours. A good way to determine off-peak hours is using the pageviews view of Google Analytics and clicking the clock icon. You'll notice which time of the day (expressed in the California time zone) is the least busy of the day for your site and -most likely- a good candidate for running a backup on.

Nicholas K. Dionysopoulos

Lead Developer and Director

πŸ‡¬πŸ‡·Greek: native πŸ‡¬πŸ‡§English: excellent πŸ‡«πŸ‡·French: basic β€’ πŸ• My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user33622
Thanks for the info, this was my issue also. How can I find out which hosts have more outbound bandwidth?

nicholas
Akeeba Staff
Manager
Unfortunately, you can't know that beforehand. I know that my preferred hosts (Rochen, CloudAccess.net and iRedHost.com) do have adequate bandwidth. There are more hosts very fit for this task, but I only know about those three I mentioned. After a few years of building sites, I tend to gravitate towards high-quality hosts that I know I can trust my sites with :)

Nicholas K. Dionysopoulos

Lead Developer and Director

πŸ‡¬πŸ‡·Greek: native πŸ‡¬πŸ‡§English: excellent πŸ‡«πŸ‡·French: basic β€’ πŸ• My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!