Using Amazon S3 external storage does not work with large files on servers with smal disks

Server
, ,
1

Steps to reproduce
1. Set up owncloud on a small server, like a DigitalOcean droplet with only 20GB disk space.
2. Enable the external storage app.
3. Add an Amazon S3 bucket to an account
4. Attempt to sync several very large (10GB+) files to your S3 bucket.

Expected behaviour
The files should upload to the Amazon S3 bucket.

Actual behaviour
Some small files upload successfully, but when the large files are synced, the server runs out of disk space, and everything on it stops working.

Server configuration
Operating system: Ubuntu 14.04
Web server: Apache 2.4
Database: MySQL
PHP version: 5.5.9
ownCloud version (see ownCloud admin page): 9.1.1
Updated from an older ownCloud or fresh install: Fresh install.
Special configuration (external storage, external authentication, reverse proxy, server-side-encryption): IMAP auth.

ownCloud log (data/owncloud.log)

I had to delete the log to help free up disk space.

Integrity status for oC9+

No errors have been found.

Any ideas on how to work around this issue? I assume that you have to upload the entire file to the OwnCloud server itself before you can send the file to S3. Which means that if you are uploading files that are larger than the server's disk space, there's no way for it to work.

I would assume the same would be true for most external storage backends.

Is there a way to make OwnCloud act as a direct connection to S3?

2

The only "workaround is to use S3 as a primary storage like explained here:

https://doc.owncloud.org/server/latest/admin_manual/enterprise_external_storage/s3_swift_as_primary_object_store_configuration.html

3

That won't work in the Community Edition, right?

4

Yes, thats available in the Enterprise Edition only according to the documentation.