Support

Site Restoration

#25017 Kickstart Dropbox—How to IMPORT FROM URL

Posted in ‘Site restoration’
This is a public ticket

Everybody will be able to see its contents. Do not include usernames, passwords or any other sensitive information.

Environment Information

PHP version
n/a
CMS Type
Other
CMS Version
n/a
Backup Tool Version
n/a
Kickstart version
n/a

Latest post by on Thursday, 26 May 2016 17:20 CDT

user89837
 
Last year, I successfully restored a site to a different server using Kickstart.

This week we attempted a Kickstart restore of a different site. Our archive had been successfully backed up to Dropbox (v2). We experienced problems with Kickstart using the IMPORT FROM URL option in Step 1. The first URL entered was obtained for the .jpa file using the "Share this link" function inside Dropbox web interface.

Once the link was entered, Kickstart advanced to "Step 2. Importing" with a message that said "Please do not close this window while your backup archives are being imported." The data counter showing numerals for the number of bytes began advancing, however there was never any blue showing in the progress bar, neither did the percentage complete change from 0%.

Our Dropbox backup was in eight (8) 20 MB parts totaling 155,000 KB

We waited until the data counter reached 257,449,673 bytes before we ended the session. There were never any errors returned.

This is to request support for IMPORTING THE ARCHIVE from a Dropbox url.

nicholas
Akeeba Staff
Manager
There are three fine points.

When you ask Dropbox to share a file it creates a URL that ends in ?dl=0 This means that a page will be displayed where a browser can download that file. Using that URL with Kickstart will not work. You need to replace ?dl=0 with ?dl=1. Due to the way Dropbox works, if you use the dl=0 URL it tells us that the download was successful and that there's more data to follow. This is what is causing the infinite loop you experienced. We can't work around that as the "fix" would actually break HTTP downloads from well behaving servers (the majority of server) :/

The file sharing URLs do not have a 1:1 mapping with filenames. That is, we can't just replace .jpa with .j01 in the URL you provided and try to import that part file automatically. You will need to manually import each and every part of your backup archive.

Kickstart uses the base name of the URL to download the file when using Import from URL. As a result your imported files will be in the form of actual_file_name.jpa?dl=1 which makes them unusable for archive extraction. Therefore, before extraction, you need to go through FTP or the file manager in your hosting control panel and rename these files so that the all have the same name and the correct extension (.jpa, .j01, ...).

I'd like to note that I explored the possibility of adding Dropbox support to Kickstart itself. Unfortunately, this required us hosting a special server to act as the authentication gateway, just like we do with Akeeba Backup. The difference is that Akeeba Backup saves the token so it really needs to access our server very infrequently. Since Kickstart does not have any storage (obviously) it would have to make several requests to our server during import. That would disrupt the service for Akeeba Backup. Therefore we decided to not add direct integration with Dropbox or any other service using OAuth2-based authentication such as Google Drive and OneDrive. We recommend that you download the files locally and upload them to your server or, if your Internet connection is really slow, that you use the import from URL feature taking into account the three fine points above.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

user89837

Ok. This is interesting.

It would be important to know if the other cloud services present the same scenario of having to rename files.

We are using Joomla as a framework within a Jelastic server environment. SFTPing files has a tendency to break the scalability provided by Jelastic. I want to be able to move (import) files to the destination server without SFTP. This also means I'm looking for a processing engine on your list that will allow me to restore a backup or transfer archives independent of having to manage the files via SFTP after the import.

Would the Rackspace option require one to change filenames after an import?
In the least desirable scenario, would the remote SFTP server option require one to change filenames after an import?

nicholas
Akeeba Staff
Manager
It would be important to know if the other cloud services present the same scenario of having to rename files.


This depends entirely on the share URL they create. Since the share URLs always have a query parameter suffix it's generally true that share URLs require renaming.

This also means I'm looking for a processing engine on your list that will allow me to restore a backup or transfer archives independent of having to manage the files via SFTP after the import.


Store the on Amazon S3 and use Akeeba Kickstart Professional. Kickstart Pro has an Amazon S3 integration. You just select the backup archive from your Amazon bucket and it imports all parts automatically. S3 has all the right API tools to make that possible. I love S3. It's the best thing since sliced bread!

Would the Rackspace option require one to change filenames after an import?


Yes. RackSpace CloudFiles' signed URLs fall in the same category I described above.

In the least desirable scenario, would the remote SFTP server option require one to change filenames after an import?


No. The uploaded files already have the correct file names and extensions.

Nicholas K. Dionysopoulos

Lead Developer and Director

🇬🇷Greek: native 🇬🇧English: excellent 🇫🇷French: basic • 🕐 My time zone is Europe / Athens
Please keep in mind my timezone and cultural differences when reading my replies. Thank you!

System Task
system
This ticket has been automatically closed. All tickets which have been inactive for a long time are automatically closed. If you believe that this ticket was closed in error, please contact us.

Support Information

Working hours: We are open Monday to Friday, 9am to 7pm Cyprus timezone (EET / EEST). Support is provided by the same developers writing the software, all of which live in Europe. You can still file tickets outside of our working hours, but we cannot respond to them until we're back at the office.

Support policy: We would like to kindly inform you that when using our support you have already agreed to the Support Policy which is part of our Terms of Service. Thank you for your understanding and for helping us help you!