files locked on server, syncing changed files causes conflicts

[Florz]

Steps to reproduce

1. locally edit a previously synced file (first upload seems to work)
2. wait for sync client do upload changes
3. conflict happens

Expected behaviour

changed file should be uploaded, no additional files should be generated locally

Actual behaviour

locally: the new version gets renamed to ..._conflict... and the original version of the file gets restored
server: nothing changes, error about file being locked

Server configuration

Operating system:
debian testing
Web server:
apache 2.4.23-4
Database:
mysql Ver 14.14 Distrib 5.6.30, for debian-linux-gnu (x86_64) using EditLine wrapper
PHP version:
PHP 7.0.10-1 (cli) ( NTS )
Nextcloud version: (see Nextcloud admin page)
Nextcloud 11.0.0 (stable)
Updated from an older Nextcloud/ownCloud or fresh install:
updated from RC1 (problems since RC1)
Where did you install Nextcloud from:
from tar then updated via updater
Signing status:

Signing status

No errors have been found.

List of activated apps:

App list

Enabled: - activity: 2.4.1 - admin_audit: 1.1.0 - audioplayer: 1.4.0 - calendar: 1.4.1 - comments: 1.1.0 - contacts: 1.5.2 - dav: 1.1.1 - federatedfilesharing: 1.1.1 - federation: 1.1.1 - files: 1.6.1 - files_accesscontrol: 1.1.2 - files_external: 1.1.2 - files_pdfviewer: 1.0.1 - files_sharing: 1.1.1 - files_texteditor: 2.2 - files_trashbin: 1.1.0 - files_versions: 1.4.0 - files_videoplayer: 1.0.0 - firstrunwizard: 2.0 - gallery: 16.0.0 - logreader: 2.0.0 - lookup_server_connector: 1.0.0 - mail: 0.6.2 - news: 10.1.0 - nextant: 1.0.1 - nextcloud_announcements: 1.0 - notes: 2.1.0 - notifications: 1.0.1 - password_policy: 1.1.0 - previewgenerator: 1.0.1 - provisioning_api: 1.1.0 - serverinfo: 1.1.1 - sharebymail: 1.0.1 - survey_client: 0.1.5 - systemtags: 1.1.3 - tasks: 0.9.4 - templateeditor: 0.2 - theming: 1.1.1 - twofactor_backupcodes: 1.0.0 - twofactor_totp: 0.5.0 - updatenotification: 1.1.1 - user_external: 0.4 - workflowengine: 1.1.1 Disabled: - encryption - external - files_automatedtagging - files_retention - user_ldap - user_saml

The content of config/config.php:

Config report

{ "system": { "instanceid": "oc563d2ba690", "passwordsalt": "***REMOVED SENSITIVE VALUE***", "trusted_domains": [ "domain.tld", "server.domain.tld", "1.2.3.4", "5.6.7.8" ], "datadirectory": "\/var\/www\/owncloud_data", "overwritewebroot": "\/owncloud", "overwrite.cli.url": "\/owncloud", "dbtype": "mysql", "dbname": "owncloud", "dbuser": "***REMOVED SENSITIVE VALUE***", "dbpassword": "***REMOVED SENSITIVE VALUE***", "dbhost": "localhost", "dbtableprefix": "oc_", "version": "11.0.0.10", "installed": true, "theme": "", "forcessl": true, "mail_from_address": "root", "mail_smtpmode": "smtp", "mail_domain": "domain.tld", "loglevel": 2, "mail_smtphost": "127.0.0.1", "mail_smtpname": "***REMOVED SENSITIVE VALUE***", "mail_smtppassword": "***REMOVED SENSITIVE VALUE***", "mail_smtpport": "25", "log_rotate_size": "100 MiB", "maintenance": false, "secret": "***REMOVED SENSITIVE VALUE***", "preview_libreoffice_path": "\/usr\/bin\/libreoffice", "memcache.local": "\\OC\\Memcache\\APCu", "trashbin_retention_obligation": "auto", "updatechecker": false, "htaccess.RewriteBase": "\/owncloud", "updater.release.channel": "stable" } }

Are you using external storage, if yes which one: local/smb/sftp/...
3 local folders
Are you using encryption: yes/no
no
Are you using an external user-backend, if yes which one: LDAP/ActiveDirectory/Webdav/...
no

Client configuration

Browser:
Firefox
Operating system:
devuan testing

Logs

Nextcloud log (data/nextcloud.log)

Nextcloud log

``` {"reqId":"0OC6eWHD0eY6TVAAxdv0","remoteAddr":"","app":"PHP","message":"file_exists(): connect() failed: No route to host at \/var\/www\/nextcloud\/apps\/files_external\/lib\ /Lib\/Storage\/StreamWrapper.php#74","level":3,"time":"2016-12-23T00:16:22+00:00","method":"--","url":"\/owncloud\/cron.php","user":"--","version":"11.0.0.6"} {"reqId":"RQhT\/YpPg0oD0mVRTts8","remoteAddr":"::1","app":"webdav","message":"Exception: {\"Message\":\"HTTP\\\/1.1 423 \\\"foldername\\\/subfolder\\\/filename.ods\\\" is locked\",\"Exception\":\"OCA\\\\DAV\\\\Connector\\\\Sabre\\\\Exception\\\\FileLocked\",\"Code\":0,\"Trace\":\"#0 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(1106): OCA\\\\DAV\\\\Connector\\\\Sabre\\\\File->put(Resource id #31)\\n#1 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/CorePlugin.php(513): Sabre\\\\DAV\\\\Server->updateFile('foldername\\\/subfolder\\\/G...', Resource id #31, NULL)\\n#2 [internal function]: Sabre\\\\DAV\\\\CorePlugin->httpPut(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#3 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/event\\\/lib\\\/EventEmitterTrait.php(105): call_user_func_array(Array, Array)\\n#4 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(479): Sabre\\\\Event\\\\EventEmitter->emit('method:PUT', Array)\\n#5 \\\/var\\\/www\\\/nextcloud\\\/3rdparty\\\/sabre\\\/dav\\\/lib\\\/DAV\\\/Server.php(254): Sabre\\\\DAV\\\\Server->invokeMethod(Object(Sabre\\\\HTTP\\\\Request), Object(Sabre\\\\HTTP\\\\Response))\\n#6 \\\/var\\\/www\\\/nextcloud\\\/apps\\\/dav\\\/appinfo\\\/v1\\\/webdav.php(60): Sabre\\\\DAV\\\\Server->exec()\\n#7 \\\/var\\\/www\\\/nextcloud\\\/remote.php(165): require_once('\\\/var\\\/www\\\/nextcl...')\\n#8 {main}\",\"File\":\"\\\/var\\\/www\\\/nextcloud\\\/apps\\\/dav\\\/lib\\\/Connector\\\/Sabre\\\/File.php\",\"Line\":175,\"User\":\"florz\"}","level":4,"time":"2016-12-23T00:16:24+00:00","method":"PUT","url":"\/owncloud\/remote.php\/webdav\/foldername\/subfolder\/filename.ods","user":"florz","version":"11.0.0.10"} {"reqId":"0OC6eWHD0eY6TVAAxdv0","remoteAddr":"","app":"PHP","message":"file_exists(): connect() failed: No route to host at \/var\/www\/nextcloud\/apps\/files_external\/lib\/Lib\/Storage\/StreamWrapper.php#74","level":3,"time":"2016-12-23T00:16:25+00:00","method":"--","url":"\/owncloud\/cron.php","user":"--","version":"11.0.0.6"} {"reqId":"0OC6eWHD0eY6TVAAxdv0","remoteAddr":"","app":"PHP","message":"file_exists(): connect() failed: No route to host at \/var\/www\/nextcloud\/apps\/files_external\/lib\/Lib\/Storage\/StreamWrapper.php#74","level":3,"time":"2016-12-23T00:16:28+00:00","method":"--","url":"\/owncloud\/cron.php","user":"--","version":"11.0.0.6"} {"reqId":"0OC6eWHD0eY6TVAAxdv0","remoteAddr":"","app":"OC\\Files\\Cache\\Scanner","message":"!!! Path '' is not accessible or present !!!","level":0,"time":"2016-12-23T00:16:28+00:00","method":"--","url":"\/owncloud\/cron.php","user":"--","version":"11.0.0.6"} ```

[Florz]

@MorrisJobke: as talked about in IRC

[Florz]

I may have fixed the problem by rebooting my server. I will test it again tomorrow.

[MorrisJobke]

I may have fixed the problem by rebooting my server. I will test it again tomorrow.

Interesting. So this seems to be a caching issue. @rullzer @LukasReschke Have you ever seen something like this?

[nickvergessen]

Reading the log it seems like your cron-job run at the same time and might have had a lock on the file. But I guess this should not cause a conflict file, but just delay the syncing?

[nickvergessen]

file_exists(): connect() failed: No route to host at /var/www/nextcloud/apps/files_external/lib/Lib/Storage/StreamWrapper.php

Not sure, but this might be the real issue here.

[ryannix123]

@icewind1991 I believe this is related to another issue and the fix will make its way into Nextcloud 11.0.2

[Florz]

Yupp, seems rebooting didn't fix it. I saw the (same?) problem again yesterday on my notebook. I used a program that writes a database file I want to sync. After I finished my work the database ended as a conflict file and an old version was restored from my cloud. Moving the conflict file over the restored version fixed it and the file was uploaded without further conflicts. (There were several other files that had conflicts. [mostly logging -> simply deleted those])

[nazar-pc]

I have the same issue with 11.0.2 and similar setup (PHP 7, no encryption, no external storage).
My file is pretty big, 4.1GiB.

[nazar-pc]

I can trigger this in 100% of cases when syncing backups. While backups are created (7z archives) Nextcloud client tries to upload file immediately while archive is still being created and updated on disk. After some time client fails to upload and each time it tries to resume uploading it fails to do so.

The only workaround I found in this situation is to move files somewhere and then move them back. In this case Nextcloud uploads them from start and everything works fine. Another workaround is to pause synchronization while creating archives and resume afterwards to avoid this issue altogether.