Can't upload files over ~200MB using Web


#1

Steps to reproduce

  1. Mount owncloud webdev volume to Windows or Mac OSx
  2. Try to copy file from computer to Owncloud webdav volume > 200MB

Expected behaviour

Tell us what should happen

Actual behaviour

Tell us what happens instead

Server configuration

Operating system: Fedora 29

Web server: Apache 2.4

Database: MySQL

PHP version: 7.2

ownCloud version: 10.0.10.4

I can not upload files greater than about 200mb with WebDAV. I mount the WebDAV volume on Windows and MacOS X and I’m getting the same problem.

I can upload the files just fine from the web interface.

This is the error in the owncloud.log file:
{“reqId”:“XK@NAZAvnr5LaoycCyBK8QAAAEM”,“level”:4,“time”:“2019-04-11T18:53:09+00:00”,“remoteAddr”:“172.16.2.88”,“user”:“Bob”,“app”:“webdav”,“method”:“PUT”,“url”:"/oc/remote.php/webdav/2014-02-02%2017.09.11.mp4",“message”:“Exception: HTTP/1.1 400 expected filesize 472688419 got 237666304: {“Exception”:“Sabre\\DAV\\Exception\\BadRequest”,“Message”:“expected filesize 472688419 got 237666304”,“Code”:0,“Trace”:”#0 \/var\/www\/html\/owncloud\/lib\/composer\/sabre\/dav\/lib\/DAV\/Server.php(1129): OCA\\DAV\\Connector\\Sabre\\File->put(Resource id #63)\n#1 \/var\/www\/html\/owncloud\/lib\/composer\/sabre\/dav\/lib\/DAV\/CorePlugin.php(513): Sabre\\DAV\\Server->updateFile(‘2014-02-02 17.0…’, Resource id #63, NULL)\n#2 [internal function]: Sabre\\DAV\\CorePlugin->httpPut(Object(Sabre\\HTTP\\Request), Object(Sabre\\HTTP\\Response))\n#3 \/var\/www\/html\/owncloud\/lib\/composer\/sabre\/event\/lib\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\n#4 \/var\/www\/html\/owncloud\/lib\/composer\/sabre\/dav\/lib\/DAV\/Server.php(479): Sabre\\Event\\EventEmitter->emit(‘method:PUT’, Array)\n#5 \/var\/www\/html\/owncloud\/lib\/composer\/sabre\/dav\/lib\/DAV\/Server.php(254): Sabre\\DAV\\Server->invokeMethod(Object(Sabre\\HTTP\\Request), Object(Sabre\\HTTP\\Response))\n#6 \/var\/www\/html\/owncloud\/apps\/dav\/appinfo\/v1\/webdav.php(64): Sabre\\DAV\\Server->exec()\n#7 \/var\/www\/html\/owncloud\/remote.php(165): require_once(’\/var\/www\/html\/o…’)\n#8 {main}",“File”:"\/var\/www\/html\/owncloud\/apps\/dav\/lib\/Connector\/Sabre\/File.php",“Line”:227}"}

~


#2

Have you looked at this page of the docs?

https://doc.owncloud.com/server/10.0/admin_manual/configuration/files/big_file_upload_configuration.html


#3

Dmitry,

Yes I have. This is my .user.ini:
upload_max_filesize=16G
post_max_size=16G
memory_limit=512M
mbstring.func_overload=0
always_populate_raw_post_data=-1
default_charset=‘UTF-8’
output_buffering=0
max_input_time 3600
max_execution_time 3600

I don’t see any issues with the Apache configuration…There aren’t any errors in the Apache log files.

Most of the configuration issues discussed in that link relate to files over 2GB, I can’t even get to 200MB.


#4

Hey,

i did the following search https://central.owncloud.org/search?q="expected%20filesize"%20"got" and found the following FAQ about this message:


#5

Tom42,

Yes, I’ve tried those. PRoblem is, most of those solutions suggested are 4-5 years old and for many versions ago.

Seems file size upload issues are an ongoing issue with Owncloud. according to searches. Wonder why they can’t put a nail in this issue once and for all.


#6

Hey,

if i’m understanding the items listed in the FAQ as well as in the big upload documentation linked by @dmitry most upload problems concerning a specific file size are configuration problems or bugs in either Apache (or any other web server in use) or PHP. And i think such kind of items are also still valid even if 4-5 years old.

Not sure how they can do any fixes from ownCloud for such configuration issues or bugs the server admin needs to fix / reconfigure. :frowning_face:


#7

I’ve just started experiencing this after upgrading from 10.1.0.4 to 10.1.1.1 on my Fedora 29 box. I upload gigabyte files at least twice a week without a hitch now my Windows client is struggling with a 400Mb file and nothing else has changed. The log repeatedly shows:

{"reqId":"d0e222ba-9bfa-4658-a440-c3e940cd15bc","level":4,"time":"2019-04-15T06:41:19+00:00","remoteAddr":"192.168.1.1","user":"ferd","app":"webdav","method":"PUT","url":"\/remote.php\/dav\/uploads\/ferd\/3285899628\/00000013","message":"Exception: HTTP\/1.1 400 expected filesize 42471896 got 25722880: {\"Exception\":\"Sabre\\\\DAV\\\\Exception\\\\BadRequest\",\"Message\":\"expected filesize 42471896 got 25722880\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/html\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1130): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #536)\\n#1 \\\/var\\\/www\\\/html\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(513): Sabre\\\\DAV\\\\Server->updateFile('uploads\\\/ferd\\\/32...', Resource id #536, NULL)\\n#2 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#3 \\\/var\\\/www\\\/html\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#4 \\\/var\\\/www\\\/html\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#5 \\\/var\\\/www\\\/html\\\/owncloud\\\/lib\\\/composer\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#6 \\\/var\\\/www\\\/html\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Server.php(288): Sabre\\\\DAV\\\\Server->exec()\\n#7 \\\/var\\\/www\\\/html\\\/owncloud\\\/apps\\\/dav\\\/appinfo\\\/v2\\\/remote.php(31): OCA\\\\DAV\\\\Server->exec()\\n#8 \\\/var\\\/www\\\/html\\\/owncloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/html\\\/o...')\\n#9 {main}\",\"File\":\"\\\/var\\\/www\\\/html\\\/owncloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/File.php\",\"Line\":228}"}

I followed the same procedure for years to upgrade making sure OC was in maintenance, stopping Apache, applying the update then running the upgrade before restarting Apache and disabling maintenance mode.


#8

Hey,

i’m not sure if this update is related. I have checked the changes between 10.1.0 and 10.1.1 (found on https://owncloud.org/changelog/server/) and it doesn’t look to me that any code related to uploading files where touched.

Could it be possible that some new configuration or PHP modules got updated / active during the update (e.g. due to a server restart where the changes/updates took place some days/weeks/months ago) which is now causing this issue?


#9

It’s always possible and I normally check and apply updates each Monday and this has never happened before even when it’s needed to update ownCloud in the past - I always check what DNF wants to do before I let it go ahead, and as I saw that ownCloud came up I made sure to close it down as I mention before.

Smaller files are just fine, and when it hits a larger one I can keep forcing a sync and the client eventually uploads the entire thing. Downloads are fine.


#10

This must be a Fedora 29 issue then, as I’m on Fedora 29 as well.

I also tried installing NextCloud 15 to see if that had the same issue, and it does. Exact same behavior.

So our commonality is Fedora 29 then at this time.


#11

Oh joy, so I wonder what’s been broken in F29 then?

On my system looks like PHP was upgraded to 7.2.17-1 amongst other things:

Install  kernel-5.0.7-200.fc29.x86_64                                    @updates
Install  kernel-core-5.0.7-200.fc29.x86_64                               @updates
Install  kernel-modules-5.0.7-200.fc29.x86_64                            @updates
Upgrade  owncloud-files-10.1.1-1.1.noarch                                @ce_10.1
Upgraded owncloud-files-10.1.0-1.1.noarch                                @@System
Upgrade  containers-common-1:0.1.35-2.git404c5bd.fc29.x86_64             @updates
Upgraded containers-common-1:0.1.35-1.git404c5bd.fc29.x86_64             @@System
Upgrade  fuse-2.9.9-2.fc29.x86_64                                        @updates
Upgraded fuse-2.9.9-1.fc29.x86_64                                        @@System
Upgrade  fuse-common-3.4.2-2.fc29.x86_64                                 @updates
Upgraded fuse-common-3.4.2-1.fc29.x86_64                                 @@System
Upgrade  fuse-libs-2.9.9-2.fc29.x86_64                                   @updates
Upgraded fuse-libs-2.9.9-1.fc29.x86_64                                   @@System
Upgrade  iwl100-firmware-39.31.5.1-94.fc29.noarch                        @updates
Upgraded iwl100-firmware-39.31.5.1-93.fc29.noarch                        @@System
Upgrade  iwl1000-firmware-1:39.31.5.1-94.fc29.noarch                     @updates
Upgraded iwl1000-firmware-1:39.31.5.1-93.fc29.noarch                     @@System
Upgrade  iwl105-firmware-18.168.6.1-94.fc29.noarch                       @updates
Upgraded iwl105-firmware-18.168.6.1-93.fc29.noarch                       @@System
Upgrade  iwl135-firmware-18.168.6.1-94.fc29.noarch                       @updates
Upgraded iwl135-firmware-18.168.6.1-93.fc29.noarch                       @@System
Upgrade  iwl2000-firmware-18.168.6.1-94.fc29.noarch                      @updates
Upgraded iwl2000-firmware-18.168.6.1-93.fc29.noarch                      @@System
Upgrade  iwl2030-firmware-18.168.6.1-94.fc29.noarch                      @updates
Upgraded iwl2030-firmware-18.168.6.1-93.fc29.noarch                      @@System
Upgrade  iwl3160-firmware-1:25.30.13.0-94.fc29.noarch                    @updates
Upgraded iwl3160-firmware-1:25.30.13.0-93.fc29.noarch                    @@System
Upgrade  iwl3945-firmware-15.32.2.9-94.fc29.noarch                       @updates
Upgraded iwl3945-firmware-15.32.2.9-93.fc29.noarch                       @@System
Upgrade  iwl4965-firmware-228.61.2.24-94.fc29.noarch                     @updates
Upgraded iwl4965-firmware-228.61.2.24-93.fc29.noarch                     @@System
Upgrade  iwl5000-firmware-8.83.5.1_1-94.fc29.noarch                      @updates
Upgrade  iwl5150-firmware-8.24.2.2-94.fc29.noarch                        @updates
Upgraded iwl5150-firmware-8.24.2.2-93.fc29.noarch                        @@System
Upgrade  iwl6000-firmware-9.221.4.1-94.fc29.noarch                       @updates
Upgraded iwl6000-firmware-9.221.4.1-93.fc29.noarch                       @@System
Upgrade  iwl6000g2a-firmware-18.168.6.1-94.fc29.noarch                   @updates
Upgraded iwl6000g2a-firmware-18.168.6.1-93.fc29.noarch                   @@System
Upgrade  iwl6000g2b-firmware-18.168.6.1-94.fc29.noarch                   @updates
Upgraded iwl6000g2b-firmware-18.168.6.1-93.fc29.noarch                   @@System
Upgrade  iwl6050-firmware-41.28.5.1-94.fc29.noarch                       @updates
Upgraded iwl6050-firmware-41.28.5.1-93.fc29.noarch                       @@System
Upgrade  iwl7260-firmware-1:25.30.13.0-94.fc29.noarch                    @updates
Upgraded iwl7260-firmware-1:25.30.13.0-93.fc29.noarch                    @@System
Upgrade  kernel-headers-5.0.7-200.fc29.x86_64                            @updates
Upgraded kernel-headers-5.0.6-200.fc29.x86_64                            @@System
Upgrade  kernel-tools-5.0.7-200.fc29.x86_64                              @updates
Upgraded kernel-tools-5.0.6-200.fc29.x86_64                              @@System
Upgrade  kernel-tools-libs-5.0.7-200.fc29.x86_64                         @updates
Upgraded kernel-tools-libs-5.0.6-200.fc29.x86_64                         @@System
Upgrade  libertas-usb8388-firmware-2:20190312-94.fc29.noarch             @updates
Upgraded libertas-usb8388-firmware-2:20190213-93.git710963fe.fc29.noarch @@System
Upgrade  linux-firmware-20190312-94.fc29.noarch                          @updates
Upgraded linux-firmware-20190213-93.git710963fe.fc29.noarch              @@System
Upgrade  linux-firmware-whence-20190312-94.fc29.noarch                   @updates
Upgraded linux-firmware-whence-20190213-93.git710963fe.fc29.noarch       @@System
Upgrade  pcre2-10.32-9.fc29.x86_64                                       @updates
Upgraded pcre2-10.32-8.fc29.x86_64                                       @@System
Upgrade  perl-Data-Dumper-2.173-2.fc29.x86_64                            @updates
Upgraded perl-Data-Dumper-2.173-1.fc29.x86_64                            @@System
Upgrade  php-7.2.17-1.fc29.x86_64                                        @updates
Upgraded php-7.2.16-1.fc29.x86_64                                        @@System
Upgrade  php-cli-7.2.17-1.fc29.x86_64                                    @updates
Upgraded php-cli-7.2.16-1.fc29.x86_64                                    @@System
Upgrade  php-common-7.2.17-1.fc29.x86_64                                 @updates
Upgraded php-common-7.2.16-1.fc29.x86_64                                 @@System
Upgrade  php-devel-7.2.17-1.fc29.x86_64                                  @updates
Upgraded php-devel-7.2.16-1.fc29.x86_64                                  @@System
Upgrade  php-fpm-7.2.17-1.fc29.x86_64                                    @updates
Upgraded php-fpm-7.2.16-1.fc29.x86_64                                    @@System
Upgrade  php-gd-7.2.17-1.fc29.x86_64                                     @updates
Upgraded php-gd-7.2.16-1.fc29.x86_64                                     @@System
Upgrade  php-intl-7.2.17-1.fc29.x86_64                                   @updates
Upgraded php-intl-7.2.16-1.fc29.x86_64                                   @@System
Upgrade  php-json-7.2.17-1.fc29.x86_64                                   @updates
Upgraded php-json-7.2.16-1.fc29.x86_64                                   @@System
Upgrade  php-ldap-7.2.17-1.fc29.x86_64                                   @updates
Upgraded php-ldap-7.2.16-1.fc29.x86_64                                   @@System
Upgrade  php-mbstring-7.2.17-1.fc29.x86_64                               @updates
Upgraded php-mbstring-7.2.16-1.fc29.x86_64                               @@System
Upgrade  php-mysqlnd-7.2.17-1.fc29.x86_64                                @updates
Upgraded php-mysqlnd-7.2.16-1.fc29.x86_64                                @@System
Upgrade  php-pdo-7.2.17-1.fc29.x86_64                                    @updates
Upgraded php-pdo-7.2.16-1.fc29.x86_64                                    @@System
Upgrade  php-process-7.2.17-1.fc29.x86_64                                @updates
Upgraded php-process-7.2.16-1.fc29.x86_64                                @@System
Upgrade  php-xml-7.2.17-1.fc29.x86_64                                    @updates
Upgraded php-xml-7.2.16-1.fc29.x86_64                                    @@System
Upgrade  python3-3.7.3-1.fc29.x86_64                                     @updates
Upgraded python3-3.7.2-5.fc29.x86_64                                     @@System
Upgrade  python3-libs-3.7.3-1.fc29.x86_64                                @updates
Upgraded python3-libs-3.7.2-5.fc29.x86_64                                @@System
Upgrade  python3-perf-5.0.7-200.fc29.x86_64                              @updates
Upgraded python3-perf-5.0.6-200.fc29.x86_64                              @@System
Upgrade  skopeo-1:0.1.35-2.git404c5bd.fc29.x86_64                        @updates
Upgraded skopeo-1:0.1.35-1.git404c5bd.fc29.x86_64                        @@System
Upgrade  vim-minimal-2:8.1.1137-1.fc29.x86_64                            @updates
Upgraded vim-minimal-2:8.1.1099-1.fc29.x86_64                            @@System
Removed  kernel-5.0.4-200.fc29.x86_64                                    @@System
Removed  kernel-core-5.0.4-200.fc29.x86_64                               @@System
Removed  kernel-modules-5.0.4-200.fc29.x86_64                            @@System