Support

Akeeba Backup for Joomla!

#37621 Post-processing and storage quota

Posted in ‘Akeeba Backup for Joomla! 4 & 5’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

Joomla! version
3.10.11
PHP version
7.4
Akeeba Backup version
8.1.10

Latest post by nicholas on Tuesday, 30 August 2022 08:46 CDT

thefbi

Hello,

I have a lot of problems with my automatic backups, sending via ftp in post-processing and quotas.

I use post-processing on my sites to send via ftp to a remote server.

1. My first concern and the reason for this post is that on some sites, post-processing does not work. I mean that the ftp connection works, but Akeeba can not send the file on the server. In this case, a file of 1.4GB. Yet this same file has already been sent successfully. How and where to see what does not work ? I tested in backend and SSH command line. The only error message I get is that the post-processing has failed...

2. Another point, I see that the quota management via ftp does not work. Well, it's not a big problem, because my goal is to leave as few files as possible on the hosting, to limit the space occupation by backups. So what I would like to do is to have maybe 2-3 backups maximum on my site, but keep the ones I want on my server (ftp) which is a storage server, with much larger capacities at lower cost. So I have to be able to manage it manually.

However, if I have the same problem with post-processing, how can I be notified by email that the ftp upload did not work?

Regards,

Frédéric

nicholas
Akeeba Staff
Manager

Right now the quota settings are shared between both the local and the remote storage. We do not have separate quota settings. I understand the use cases where this is a problem and will address it in a future version. It's already on my to-do list, it's just that Joomla 4 coming out last year necessitated a lot of rewriting which made me push the less pressing features behind (rewriting, bug fixes and high priority features which cannot be worked around any other way had to take priority given that it's only two of us doing development and support).

Regarding being notified about upload failures, these are logged as Warnings. How do you run your backups? Back-end (manual), legacy front-end, JSON API or CLI? The answer to how you can be notified about warnings is different depending on the answer to this question.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

thefbi

Hello,

Thank you.

I run my backup from CLI.

And for my problem of ftp post-processing, how can i find the problem ?

nicholas
Akeeba Staff
Manager

The CLI backup prints out the warnings. If you remove the "> /dev/null 2>1" suffix from the CRON command line the output of the script will be sent to you by email. You can create email filters to look for these emails which mention warnings and deliver them with a priority flag to your inbox.

Regarding finding the problem, I would need to look at the log file of a backup where the upload failed. Most likely it's a random network issue but I will know for sure looking at the log file.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

thefbi

OK, is it possible to make this topic private for the sending of my log file ?

For the command line, i dont understand. Here is the coomand i use : 25 23 * * * /path/to/php /my_site_path/web_lelapinbo/cli/akeeba-backup.php

I dont have "> /dev/null 2>1"

thefbi

OK, i got it. If i put in my SSH command line MAILTO=my@email it work. So i have to filter now depending of text.

nicholas
Akeeba Staff
Manager

All attachments are private — even on public tickets. You can ZIP and attach your log file, only you and us can see it.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

thefbi

Ho, ok. There it is.

Sorry, but have error : file type is not supported...

thefbi

I try on txt file

nicholas
Akeeba Staff
Manager

Akeeba Backup connects to the remote FTP server and starts sending the file. After 48 seconds the remote server closes the connection on us.

This is most likely something you have to configure on the remote FTP server. Off the top of my head, in vsftpd this is the idle_session_timeout option (time between commands in the command channel to trigger a disconnection). Since we're uploading a file and I presume you're using passive mode, we issue one command on the command channel to initiate the upload, then the file transfer takes place through the data channel (a different TCP/IP port). If the remote server has a very short idle session timeout it would close the connection altogether which makes PHP to fail the transfer. 

Best ask your FTP server's manager to look at the transfer logs to determine why the connection is being closed and adjust the configuration accordingly.

If possible, best use SFTP. It's faster, more secure and does not suffer these problems.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

thefbi

OK, thank you for all.

I try to upload with SFTP (SSH), if it that you talk about.

I can connect when test the connection, but unable to upload the files. The error i have is : Could not open remote SFTP file /backup_sites/site-lelapinbo.ch-20220830-132954-BjQvx3AS99Uuk7jj.jpa for writing

In the initial directory, i only put the /backup_sites/ folder. I dont have any other path, even if i connect direct with Filezilla for example.

So i dont know why it dos not work... I put my log here. Have i to ask my host for another path info ?

thefbi

Now i try to do the same test with another site in Joomla 4.

When try to connect to the sftp (Test in the Akeeba config) i have an error message : Akeeba Backup was able to connect to your server, but it could not upload a test file. Backup upload could fail.

This is the same credentials... I don't understand it anymore

thefbi

EDIT : With my last test, Joomla 4 => SFTP cURL, it work. I will continue testing now... (sorry for all this messages)

thefbi

OK, it work now with SFTP cURL, even with my first site with upload problem. 

I just have now to find the right split archieve parameter. This site is 1.4 GB.

nicholas
Akeeba Staff
Manager

Start with 100MiB. If that doesn't work, start halving the part size, retry uploading, rinse and repeat until you find something which works for you (on most server combinations it's something between 5MiB and 200MiB).

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!