Owncloud linux client vs windows client

Jack1976 · September 7, 2019, 10:40am

Hi there,

My problem is that the windows client is uploading files larger than 2GB. And the linux client stops between the 2.0 and 2.1 GB. Is there a way to resolve this issue?

Thank you in advance.
Jack

michaelstingl · September 8, 2019, 10:25am

@Jack1976 Logs should reveal what’s going on:
https://doc.owncloud.org/desktop/2.6/troubleshooting.html

Jack1976 · September 12, 2019, 4:55pm

Ok I have captured the error this was in the client log

9-12 18:48:58:654 [ debug sync.database ] [ OCC::SyncJournalDb::commitInternal ]: Transaction commit “Upload info” and starting new transaction
09-12 18:48:58:654 [ warning sync.propagator.upload ]: Could not prepare upload device: “Unknown error”
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 1 QVariant(QString, “Pi-Hole.img”)
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “SELECT lastTryEtag, lastTryModtime, retrycount, errorstring, lastTryTime, ignoreDuration, renameTarget, errorCategory, requestId FROM blacklist WHERE path=?1”
09-12 18:48:58:654 [ info sync.database ]: Setting blacklist entry for “Pi-Hole.img” 1 “Unknown error” 1568306938 0 1565331943 “” “” 0
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 1 QVariant(QString, “Pi-Hole.img”)
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 2 QVariant(QByteArray, “”)
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 3 QVariant(qlonglong, 1565331943)
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 4 QVariant(int, 1)
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 5 QVariant(QString, “Unknown error”)
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 6 QVariant(qlonglong, 1568306938)
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 7 QVariant(qlonglong, 0)
09-12 18:48:58:654 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 8 QVariant(QString, “”)
09-12 18:48:58:655 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 9 QVariant(int, 0)
09-12 18:48:58:655 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 10 QVariant(QByteArray, “”)
09-12 18:48:58:655 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “INSERT OR REPLACE INTO blacklist (path, lastTryEtag, lastTryModtime, retrycount, errorstring, lastTryTime, ignoreDuration, renameTarget, errorCategory, requestId) VALUES ( ?1, ?2, ?3, ?4, ?5, ?6, ?7, ?8, ?9, ?10)”
09-12 18:48:58:655 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: Last exec affected 1 rows.
09-12 18:48:58:655 [ warning sync.propagator ]: Could not complete propagation of “Pi-Hole.img” by OCC::PropagateUploadFileNG(0x55936a3c9fd0) with status OCC::SyncFileItem::SoftError and error: “Unknown error”
09-12 18:48:58:851 [ debug sync.statustracker ] [ OCC::SyncFileStatusTracker::slotItemCompleted ]: Item completed “Pi-Hole.img” OCC::SyncFileItem::SoftError 8
09-12 18:48:58:870 [ debug sync.localdiscoverytracker ] [ OCC::LocalDiscoveryTracker::slotItemCompleted ]: inserted error item “Pi-Hole.img”
09-12 18:48:58:870 [ debug sync.networkjob ] [ OCC::AbstractNetworkJob::slotFinished ]: Network job OCC::PUTFileJob finished for “”
09-12 18:48:58:870 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “SELECT path FROM conflicts”
09-12 18:48:58:870 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “DELETE FROM flags WHERE path != ‘’ AND path NOT IN (SELECT path from metadata);”
09-12 18:48:58:870 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: Last exec affected 0 rows.
09-12 18:48:58:870 [ debug sync.database ] [ OCC::SyncJournalDb::commitInternal ]: Transaction commit “All Finished.”
09-12 18:48:58:871 [ info sync.engine ]: Sync run took 257704 ms
09-12 18:48:58:871 [ debug sync.localdiscoverytracker ] [ OCC::LocalDiscoveryTracker::slotSyncFinished ]: sync failed, keeping last sync’s local discovery path list

I cant make head or tails from this error.
I hope that you can help me with this error.

jnweiger · September 12, 2019, 6:48pm

Can you confirm that the file on the server is an exact copy of the file you uploaded from windows?
Do you have another windows machine, where it downloads fine, or can you log in to the server and make a checksum of the file in the data folder, or can you download via web GUI?

Which server version is this? Can you see if the php config of the server has size or time limits, that we hit?

guruz · September 13, 2019, 8:52am

What are the lines before that?

Sounds to me like a problem with the local file?

@Jack1976 which version are you using?

Jack1976 · September 13, 2019, 4:38pm

Hello,

I did try to generate a MD5 of the server but the file is not uploaded to the server.
I have altered the PHP7 ini file with the following settings
php_value upload_max_filesize = 16G
php_value post_max_size = 16G

and in the phpinfo page the settings have applied successful.
But not in the “master” value settings they remain 2GB.
And I think that the “master” value settings are causing this problem.
Is it wise to change this settings? And if so where do I need to change this settings?

Best regards, Jack

Jack1976 · September 13, 2019, 4:36pm

Hello,

  I did try to generate a MD5 of the server but the file is not

uploaded to the server.

I have altered the PHP7 ini file with the following settings


php_value upload_max_filesize = 16G
php_value post_max_size = 16G
and in the phpinfo page the settings have applied successful.
But not in the "master" value settings they remain 2GB.
And I think that the "master" value settings are causing this problem.
Is it wise to change this settings? And if so where do I need to change this settings?
Best regards, Jack

Jack1976 · September 13, 2019, 4:42pm

I am using 2.6.0rc1 build 1432 for the linux client my server is currently on 10.2.1.4
Best regards, Jack

Jack1976 · September 13, 2019, 4:47pm

09-13 18:21:57:827 [ info sync.networkjob.put ]: PUT of “https://XXXX.XXXX.XXX/remote.php/dav/uploads/Jack/1805878927/0000002110000000” FINISHED WITH STATUS “OK” QVariant(int, 201) QVariant(QString, “Created”)
09-13 18:21:57:827 [ info sync.propagator.upload ]: Chunked upload of 100000000 bytes took 10455 ms, desired is 60000 ms, expected good chunk size is 573888091 bytes and nudged next chunk size to 100000000 bytes
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 1 QVariant(QString, “test/Pi-Hole.img”)
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “SELECT chunk, transferid, errorcount, size, modtime, contentChecksum FROM uploadinfo WHERE path=?1”
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 1 QVariant(QString, “test/Pi-Hole.img”)
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 2 QVariant(int, 0)
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 3 QVariant(uint, 1805878927)
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 4 QVariant(int, 0)
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 5 QVariant(qlonglong, 3965190144)
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 6 QVariant(qlonglong, 1565331943)
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 7 QVariant(QByteArray, “SHA1:7b385186932cedecfbffb233bae7205e6806259c”)
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “INSERT OR REPLACE INTO uploadinfo (path, chunk, transferid, errorcount, size, modtime, contentChecksum) VALUES ( ?1 , ?2, ?3 , ?4 , ?5, ?6 , ?7 )”
09-13 18:21:57:827 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: Last exec affected 1 rows.
09-13 18:21:57:827 [ debug sync.database ] [ OCC::SyncJournalDb::commitInternal ]: Transaction commit “Upload info” and starting new transaction
09-13 18:21:57:828 [ warning sync.propagator.upload ]: Could not prepare upload device: “Unknown error”
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 1 QVariant(QString, “test/Pi-Hole.img”)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “SELECT lastTryEtag, lastTryModtime, retrycount, errorstring, lastTryTime, ignoreDuration, renameTarget, errorCategory, requestId FROM blacklist WHERE path=?1”
09-13 18:21:57:828 [ info sync.database ]: Setting blacklist entry for “test/Pi-Hole.img” 1 “Unknown error” 1568391717 0 1565331943 “” “” 0
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 1 QVariant(QString, “test/Pi-Hole.img”)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 2 QVariant(QByteArray, “”)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 3 QVariant(qlonglong, 1565331943)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 4 QVariant(int, 1)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 5 QVariant(QString, “Unknown error”)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 6 QVariant(qlonglong, 1568391717)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 7 QVariant(qlonglong, 0)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 8 QVariant(QString, “”)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 9 QVariant(int, 0)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 10 QVariant(QByteArray, “”)
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “INSERT OR REPLACE INTO blacklist (path, lastTryEtag, lastTryModtime, retrycount, errorstring, lastTryTime, ignoreDuration, renameTarget, errorCategory, requestId) VALUES ( ?1, ?2, ?3, ?4, ?5, ?6, ?7, ?8, ?9, ?10)”
09-13 18:21:57:828 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: Last exec affected 1 rows.
09-13 18:21:57:828 [ warning sync.propagator ]: Could not complete propagation of “test/Pi-Hole.img” by OCC::PropagateUploadFileNG(0x5602efd83a70) with status OCC::SyncFileItem::SoftError and error: “Unknown error”
09-13 18:21:57:830 [ debug sync.statustracker ] [ OCC::SyncFileStatusTracker::slotItemCompleted ]: Item completed “test/Pi-Hole.img” OCC::SyncFileItem::SoftError 8
09-13 18:21:57:830 [ debug sync.database.sql ] [ OCC::SqlQuery::bindValue ]: SQL bind 1 QVariant(qlonglong, -3755529217315663867)
09-13 18:21:57:830 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “SELECT path, inode, modtime, type, md5, fileid, remotePerm, filesize, ignoredChildrenRemote, contentchecksumtype.name || ‘:’ || contentChecksum FROM metadata LEFT JOIN checksumtype as contentchecksumtype ON metadata.contentChecksumTypeId == contentchecksumtype.id WHERE phash=?1”
09-13 18:21:57:831 [ debug sync.localdiscoverytracker ] [ OCC::LocalDiscoveryTracker::slotItemCompleted ]: inserted error item “test/Pi-Hole.img”
09-13 18:21:57:831 [ debug sync.networkjob ] [ OCC::AbstractNetworkJob::slotFinished ]: Network job OCC::PUTFileJob finished for “”
09-13 18:21:57:831 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “SELECT path FROM conflicts”
09-13 18:21:57:831 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: SQL exec “DELETE FROM flags WHERE path != ‘’ AND path NOT IN (SELECT path from metadata);”
09-13 18:21:57:831 [ debug sync.database.sql ] [ OCC::SqlQuery::exec ]: Last exec affected 0 rows.
09-13 18:21:57:831 [ debug sync.database ] [ OCC::SyncJournalDb::commitInternal ]: Transaction commit “All Finished.”
09-13 18:21:57:832 [ info sync.engine ]: Sync run took 242508 ms
09-13 18:21:57:832 [ debug sync.localdiscoverytracker ] [ OCC::LocalDiscoveryTracker::slotSyncFinished ]: sync failed, keeping last sync’s local discovery path list
09-13 18:21:57:834 [ info gui.folder ]: Client version 2.6.0rc1 (build 1432) Qt 5.12.4 SSL OpenSSL 1.1.1b 26 Feb 2019
09-13 18:21:57:834 [ info gui.folder ]: SyncEngine finished without problem.
09-13 18:21:57:834 [ info gui.folder ]: Folder sync result: 3
09-13 18:21:57:835 [ info gui.application ]: Sync state changed for folder “https://xxxx.xxxxx.xxx/remote.php/dav/files/Jack/” : “Success, some files were ignored.”

jnweiger · October 8, 2019, 1:27pm

I have an issue with a 2.5 GB file, being uploaded from a windows 2.6daily client to a 10.3 server:

That could be the same thing that spoiled your upload?

Jack1976 · October 10, 2019, 3:01am

It looks like it. I will try to build the version in your proposed tread, some where this week. And I will report back. Thank you

Jack1976 · October 17, 2019, 6:00am

Yes it works now.

Thank you all.