Upgrade from 9.x to 10.0.3 fails

jensDoe · October 5, 2017, 11:21am

Steps to reproduce

Update OC from 9.x to 10.0.3 with package maintainers version: apt-get dist-upgrade
sudo -u www-data php occ upgrade

Expected behaviour

No error

Actual behaviour

2017-10-05T11:23:29+00:00 Set log level to debug
2017-10-05T11:23:29+00:00 Repair step: Repair MySQL database engine
2017-10-05T11:23:29+00:00 Repair step: Repair MySQL collation
2017-10-05T11:23:29+00:00 Repair info: All tables already have the correct collation -> nothing to do
2017-10-05T11:23:29+00:00 Repair step: Repair SQLite autoincrement
2017-10-05T11:23:29+00:00 Repair step: Repair duplicate entries in oc_lucene_status
2017-10-05T11:23:29+00:00 Repair info: lucene_status table does not exist -> nothing to do
2017-10-05T11:23:29+00:00 Repair step: Upgrade app code from the marketplace
2017-10-05T11:23:29+00:00 Repair info: Enabling market app to assist with update
2017-10-05T11:23:29+00:00 Repair info: Using market to update existing apps
2017-10-05T11:23:29+00:00 Repair info: Attempting to update the following existing compatible apps from market:
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: activity
2017-10-05T11:23:29+00:00 Repair info:
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: comments
2017-10-05T11:23:29+00:00 Repair info: App (comments) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: configreport
2017-10-05T11:23:29+00:00 Repair info: App (configreport) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: dav
2017-10-05T11:23:29+00:00 Repair info: App (dav) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: federatedfilesharing
2017-10-05T11:23:29+00:00 Repair info: App (federatedfilesharing) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: federation
2017-10-05T11:23:29+00:00 Repair info: App (federation) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: files
2017-10-05T11:23:29+00:00 Repair info: App (files) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: files_external
2017-10-05T11:23:29+00:00 Repair info: App (files_external) is not installed
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: files_pdfviewer
2017-10-05T11:23:29+00:00 Repair info:
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: files_sharing
2017-10-05T11:23:29+00:00 Repair info: App (files_sharing) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: files_texteditor
2017-10-05T11:23:29+00:00 Repair info:
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: files_trashbin
2017-10-05T11:23:29+00:00 Repair info: App (files_trashbin) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: files_versions
2017-10-05T11:23:29+00:00 Repair info: App (files_versions) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: files_videoplayer
2017-10-05T11:23:29+00:00 Repair info: App (files_videoplayer) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: firstrunwizard
2017-10-05T11:23:29+00:00 Repair info: App (firstrunwizard) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: market
2017-10-05T11:23:29+00:00 Repair info:
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: notifications
2017-10-05T11:23:29+00:00 Repair info: App (notifications) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: provisioning_api
2017-10-05T11:23:29+00:00 Repair info: App (provisioning_api) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: systemtags
2017-10-05T11:23:29+00:00 Repair info: App (systemtags) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: templateeditor
2017-10-05T11:23:29+00:00 Repair info: App (templateeditor) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: updatenotification
2017-10-05T11:23:29+00:00 Repair info: App (updatenotification) is not known at the marketplace.
2017-10-05T11:23:29+00:00 Repair info: Fetching app from market: user_ldap
2017-10-05T11:23:29+00:00 Repair info:
2017-10-05T11:23:29+00:00 Repair info: App was not updated: activity
2017-10-05T11:23:29+00:00 Repair info: App was not updated: comments
2017-10-05T11:23:29+00:00 Repair info: App was not updated: configreport
2017-10-05T11:23:29+00:00 Repair info: App was not updated: dav
2017-10-05T11:23:29+00:00 Repair info: App was not updated: federatedfilesharing
2017-10-05T11:23:29+00:00 Repair info: App was not updated: federation
2017-10-05T11:23:29+00:00 Repair info: App was not updated: files
2017-10-05T11:23:29+00:00 Repair info: App was not updated: files_external
2017-10-05T11:23:29+00:00 Repair info: App was not updated: files_pdfviewer
2017-10-05T11:23:29+00:00 Repair info: App was not updated: files_sharing
2017-10-05T11:23:29+00:00 Repair info: App was not updated: files_texteditor
2017-10-05T11:23:29+00:00 Repair info: App was not updated: files_trashbin
2017-10-05T11:23:29+00:00 Repair info: App was not updated: files_versions
2017-10-05T11:23:29+00:00 Repair info: App was not updated: files_videoplayer
2017-10-05T11:23:29+00:00 Repair info: App was not updated: firstrunwizard
2017-10-05T11:23:29+00:00 Repair info: App was not updated: market
2017-10-05T11:23:29+00:00 Repair info: App was not updated: notifications
2017-10-05T11:23:29+00:00 Repair info: App was not updated: provisioning_api
2017-10-05T11:23:29+00:00 Repair info: App was not updated: systemtags
2017-10-05T11:23:29+00:00 Repair info: App was not updated: templateeditor
2017-10-05T11:23:29+00:00 Repair info: App was not updated: updatenotification
2017-10-05T11:23:29+00:00 Repair info: App was not updated: user_ldap
2017-10-05T11:23:29+00:00 Updating database schema
2017-10-05T11:23:29+00:00 Updated database
2017-10-05T11:23:29+00:00 Updating ...
2017-10-05T11:23:29+00:00 Doctrine\DBAL\Schema\SchemaException: There is no column with name 'fileid' on table 'oc_properties'.
2017-10-05T11:23:29+00:00 Update failed
2017-10-05T11:23:29+00:00 Maintenance mode is kept active
2017-10-05T11:23:29+00:00 Reset log level

Server configuration

Operating system: Debian 8.9

Web server: Apache/2.4.10 (Debian)

Database: mysqld (mysqld 5.6.37)

PHP version: PHP 5.6.30-0+deb8u1

ownCloud version: 10.0.3.3

Updated from an older ownCloud or fresh install: update from 9.1.6.2 [9.1.5-1.1]

Where did you install ownCloud from: debian repository

Signing status (ownCloud 9.0 and above):

ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
{
"system": {
"updatechecker": false,
"instanceid": "ocp8doibdel2",
"passwordsalt": "REMOVED SENSITIVE VALUE",
"secret": "REMOVED SENSITIVE VALUE",
"trusted_domains": [
"mydomain"
],
"datadirectory": "\/srv\/oc-data",
"overwrite.cli.url": "https:\/\/mydomain",
"dbtype": "mysql",
"version": "9.1.6.2",
"dbname": "owncloud",
"dbhost": "localhost",
"dbtableprefix": "oc_",
"dbuser": "REMOVED SENSITIVE VALUE",
"dbpassword": "REMOVED SENSITIVE VALUE",
"logtimezone": "UTC",
"installed": true,
"maintenance": true,
"loglevel": 2,
"htaccess.RewriteBase": "\/owncloud",
"appcodechecker": true,
"check_for_working_htaccess": true,
"check_for_working_webdav": true,
"memcache.local": "\OC\Memcache\APCu"
}
}

List of activated apps:
Enabled:
- activity: 2.3.6
- comments: 0.3.0
- configreport: 0.1.1
- dav: 0.2.7
- federatedfilesharing: 0.3.1
- federation: 0.1.0
- files: 1.5.1
- files_external: true
- files_pdfviewer: 0.8.2
- files_sharing: 0.10.0
- files_texteditor: 2.2.1
- files_trashbin: 0.9.0
- files_versions: 1.3.0
- files_videoplayer: 0.9.8
- firstrunwizard: 1.1
- market: true
- notifications: 0.3.0
- provisioning_api: 0.5.0
- systemtags: 0.3.0
- templateeditor: 0.1
- updatenotification: 0.2.1
- user_ldap: 0.9.1
Disabled:
- encryption
- external
- files_antivirus
- theme-example
- user_external

Are you using encryption: no

Are you using an external user-backend, if yes which one: LDAP

LDAP configuration (delete this part if not used)

ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade

[Symfony\Component\Console\Exception\CommandNotFoundException]
There are no commands defined in the "ldap" namespace.

ownCloud log (data/owncloud.log)

{"reqId":"agwuFRAVYS7zKFRPJhid","level":0,"time":"2017-10-05T11:40:05+00:00","remoteAddr":"","user":"--","app":"core","method":"--","url":"--","message":"starting upgrade from 9.1.6.2 to 10.0.3.3"}
{"reqId":"agwuFRAVYS7zKFRPJhid","level":3,"time":"2017-10-05T11:40:06+00:00","remoteAddr":"","user":"--","app":"core","method":"--","url":"--","message":"Exception: {\"Exception\":\"Doctrine\\DBAL\\Schema\\SchemaException\",\"Message\":\"There is no column with name 'fileid' on table 'oc_properties'.\",\"Code\":30,\"Trace\":\"#0 \\/var\\/www\\/owncloud\\/lib\\/composer\\/doctrine\\/dbal\\/lib\\/Doctrine\\/DBAL\\/Schema\\/Table.php(671): Doctrine\\DBAL\\Schema\\SchemaException::columnDoesNotExist('fileid', 'oc_properties')\n#1 \\/var\\/www\\/owncloud\\/apps\\/dav\\/appinfo\\/Migrations\\/Version20170711193427.php(25): Doctrine\\DBAL\\Schema\\Table->getColumn('fileid')\n#2 \\/var\\/www\\/owncloud\\/lib\\/private\\/DB\\/MigrationService.php(401): OCA\\DAV\\Migrations\\Version20170711193427->changeSchema(Object(Doctrine\\DBAL\\Schema\\Schema), Array)\n#3 \\/var\\/www\\/owncloud\\/lib\\/private\\/DB\\/MigrationService.php(358): OC\\DB\\MigrationService->executeStep(20170711193427)\n#4 \\/var\\/www\\/owncloud\\/lib\\/private\\/legacy\\/app.php(1064): OC\\DB\\MigrationService->migrate()\n#5 \\/var\\/www\\/owncloud\\/lib\\/private\\/Updater.php(311): OC_App::updateApp('dav')\n#6 \\/var\\/www\\/owncloud\\/lib\\/private\\/Updater.php(234): OC\\Updater->doAppUpgrade()\n#7 \\/var\\/www\\/owncloud\\/lib\\/private\\/Updater.php(108): OC\\Updater->doUpgrade('10.0.3.3', '9.1.6.2')\n#8 \\/var\\/www\\/owncloud\\/core\\/Command\\/Upgrade.php(254): OC\\Updater->upgrade()\n#9 \\/var\\/www\\/owncloud\\/lib\\/composer\\/symfony\\/console\\/Command\\/Command.php(262): OC\\Core\\Command\\Upgrade->execute(Object(Symfony\\Component\\Console\\Input\\ArgvInput), Object(Symfony\\Component\\Console\\Output\\ConsoleOutput))\n#10 \\/var\\/www\\/owncloud\\/lib\\/composer\\/symfony\\/console\\/Application.php(826): Symfony\\Component\\Console\\Command\\Command->run(Object(Symfony\\Component\\Console\\Input\\ArgvInput), Object(Symfony\\Component\\Console\\Output\\ConsoleOutput))\n#11 \\/var\\/www\\/owncloud\\/lib\\/composer\\/symfony\\/console\\/Application.php(189): Symfony\\Component\\Console\\Application->doRunCommand(Object(OC\\Core\\Command\\Upgrade), Object(Symfony\\Component\\Console\\Input\\ArgvInput), Object(Symfony\\Component\\Console\\Output\\ConsoleOutput))\n#12 \\/var\\/www\\/owncloud\\/lib\\/composer\\/symfony\\/console\\/Application.php(120): Symfony\\Component\\Console\\Application->doRun(Object(Symfony\\Component\\Console\\Input\\ArgvInput), Object(Symfony\\Component\\Console\\Output\\ConsoleOutput))\n#13 \\/var\\/www\\/owncloud\\/lib\\/private\\/Console\\/Application.php(160): Symfony\\Component\\Console\\Application->run(NULL, NULL)\n#14 \\/var\\/www\\/owncloud\\/console.php(106): OC\\Console\\Application->run()\n#15 \\/var\\/www\\/owncloud\\/occ(11): require_once('\\/var\\/www\\/ownclo...')\n#16 {main}\",\"File\":\"\\/var\\/www\\/owncloud\\/lib\\/composer\\/doctrine\\/dbal\\/lib\\/Doctrine\\/DBAL\\/Schema\\/SchemaException.php\",\"Line\":86}"}

dmitry · October 5, 2017, 11:40am

Hi,

can you try this command?

occ migrations:migrate core

jensDoe · October 5, 2017, 11:43am

Thanks for helping me. Here is what I get:

# sudo -u www-data php occ migrations:migrate core

ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade

dmitry · October 5, 2017, 11:45am

Your owncloud in still in maintenance mode, you need to turn it off and run the command again:

sudo -u www-data php occ maintenance:mode --off

jensDoe · October 5, 2017, 11:52am

I can't change maintenance mode:
# sudo -u www-data php occ maintenance:mode --off

ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade

dmitry · October 5, 2017, 11:54am

can you run an upgrade again?

jensDoe · October 5, 2017, 11:56am

Like: "# sudo -u www-data php occ upgrade"?

Yes. Still the same error.

dmitry · October 5, 2017, 12:24pm

try: occ migrations:execute core 20170320173955

jensDoe · October 5, 2017, 12:28pm

I wonder, where you get those commands from. migrations seems to be one of those limited commands.

ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade

dmitry · October 5, 2017, 12:47pm

do you have access to your database? if yes, can you delete the oc_migration table in the owncloud database and try the update?

jensDoe · October 5, 2017, 12:55pm

Yes and done. Still the same error. Before I had 16 rows, now I have 4 rows. All 'core'. The old table had also some 'activity', 'dav' and 'federatedfilesharing' entries.

Thanks for your continuous support!

dmitry · October 5, 2017, 1:12pm

can you try this again?

jensDoe · October 5, 2017, 1:14pm

# sudo -u www-data php occ migrations:migrate core
ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade


  [Doctrine\DBAL\Schema\SchemaException]
  The table with name 'owncloud.oc_accounts' already exists.


migrations:migrate <app> [<version>]

The error has changed. Or at least the message changed slightly:

2017-10-05T13:17:13+00:00 Repair info: App was not updated: user_ldap
2017-10-05T13:17:13+00:00 Updating database schema
2017-10-05T13:17:14+00:00 Doctrine\DBAL\Schema\SchemaException: The table with name 'owncloud.oc_accounts' already exists.
2017-10-05T13:17:14+00:00 Update failed
2017-10-05T13:17:14+00:00 Maintenance mode is kept active
2017-10-05T13:17:14+00:00 Reset log level

Since I have a full backup, I started to delete all those tables/rows noted above. I'll report back...

dmitry · October 5, 2017, 1:25pm

After deep consultation we decided that you should try to delete the mentioned table

We hope that you have a back up or no sensitive data

jensDoe · October 5, 2017, 1:32pm

Ok, here is, what I've done:
- removed owncloud.oc_accounts
- deleted column 'share_name' on table 'oc_share'

And it works.
Only thing not as expected: my LDAP-users are missing from display. I guess I have to wait, until they log in for the first time. Or see if I can init a manual sync...

Update on syncing LDAP-users:
# sudo -u www-data php occ user:sync "OCA\User_LDAP\User_Proxy"

dmitry · October 5, 2017, 1:38pm

Yep. I am glad that it worked out for you in the end