Upgrade 10.2.1 to 10.3.0 fails - "apps not found at Marketplace"

hasc · October 21, 2019, 5:48pm

Hello! I’m trying to upgrade from 10.2.1 to 10.3.0, on my little ARM SBC running Armbian Buster

Steps to reproduce

apt update ; apt upgrade
./occ upgrade

Actual behaviour

Output of ./occ upgrade

ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
2019-10-21T17:27:32+00:00 Set log level to debug
2019-10-21T17:27:32+00:00 Repair step: Upgrade app code from the marketplace
2019-10-21T17:27:32+00:00 Repair info: Using market to update existing apps
2019-10-21T17:27:32+00:00 Repair info: Attempting to update the following missing apps from market: files_videoplayer
2019-10-21T17:27:32+00:00 Repair info: Fetching app from market: files_videoplayer
2019-10-21T17:27:38+00:00 Repair info: Unknown app (files_videoplayer)
2019-10-21T17:27:38+00:00 Repair info: Attempting to update the following existing compatible apps from market: comments, configreport, dav, federatedfilesharing, federation, files, files_external, files_sharing, files_trashbin, files_versions, market, notifications, provisioning_api, systemtags, updatenotification
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: comments
2019-10-21T17:27:38+00:00 Repair info: App (comments) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: configreport
2019-10-21T17:27:38+00:00 Repair info: App (configreport) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: dav
2019-10-21T17:27:38+00:00 Repair info: App (dav) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: federatedfilesharing
2019-10-21T17:27:38+00:00 Repair info: App (federatedfilesharing) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: federation
2019-10-21T17:27:38+00:00 Repair info: App (federation) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: files
2019-10-21T17:27:38+00:00 Repair info: App (files) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: files_external
2019-10-21T17:27:38+00:00 Repair info: App (files_external) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: files_sharing
2019-10-21T17:27:38+00:00 Repair info: App (files_sharing) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: files_trashbin
2019-10-21T17:27:38+00:00 Repair info: App (files_trashbin) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: files_versions
2019-10-21T17:27:38+00:00 Repair info: App (files_versions) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: market
2019-10-21T17:27:38+00:00 Repair info:
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: notifications
2019-10-21T17:27:38+00:00 Repair info: App (notifications) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: provisioning_api
2019-10-21T17:27:38+00:00 Repair info: App (provisioning_api) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: systemtags
2019-10-21T17:27:38+00:00 Repair info: App (systemtags) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair info: Fetching app from market: updatenotification
2019-10-21T17:27:38+00:00 Repair info: App (updatenotification) is not known at the marketplace.
2019-10-21T17:27:38+00:00 Repair warning: You have incompatible or missing apps enabled that could not be found or updated via the marketplace.
2019-10-21T17:27:38+00:00 Repair warning: Please install or update the following apps manually or disable them with:
occ app:disable files_videoplayer
2019-10-21T17:27:38+00:00 Repair warning: For manually updating, see https://doc.owncloud.org/server/10.3/go.php?to=admin-marketplace-apps
2019-10-21T17:27:38+00:00 OC\RepairException: Upgrade is not possible
2019-10-21T17:27:38+00:00 Update failed
2019-10-21T17:27:38+00:00 Maintenance mode is kept active
2019-10-21T17:27:38+00:00 Reset log level

Server configuration

Armbian Buster

Apache 2 from Debian Buster

PostgreSQL 10 from Debian Buster

PHP 7.3 from Debian Buster

10.3.0.4

Upgrade from 10.2.1

The content of config/config.php:

<?php $CONFIG = array ( 'updatechecker' => false, 'instanceid' => 'REDACTED', 'passwordsalt' => 'REDACTED', 'secret' => 'REDACTED', 'trusted_domains' => array ( 0 => 'localhost', ), 'datadirectory' => '/var/www/owncloud/data', 'overwrite.cli.url' => 'http://localhost/owncloud', 'dbtype' => 'pgsql', 'version' => '10.2.1.4', 'dbname' => 'REDACTED', 'dbhost' => 'localhost:5432', 'dbtableprefix' => 'oc_', 'dbuser' => 'REDACTED', 'dbpassword' => 'REDACTED', 'logtimezone' => 'UTC', 'installed' => true, 'theme' => '', 'loglevel' => 2, 'maintenance' => true, ); **List of activated apps:** Enabled: - comments: 0.3.0 - configreport: 0.2.0 - dav: 0.4.0 - federatedfilesharing: 0.4.0 - federation: 0.1.0 - files: 1.5.2 - files_external: 0.7.1 - files_sharing: 0.11.0 - files_trashbin: 0.9.1 - files_versions: 1.3.0 - market: 0.5.0 - notifications: 0.5.0 - provisioning_api: 0.5.0 - systemtags: 0.3.0 - updatenotification: 0.2.1 Disabled: - encryption - external - files_mediaviewer - firstrunwizard - user_external

tom42 · October 21, 2019, 5:52pm

Hey,

it looks to me that the output is already explaining / showing what to do now.

The files_videoplayer seems to match what’s called a “Third-Party App” in the upgrading guide:

https://doc.owncloud.org/server/10.3/admin_manual/maintenance/manual_upgrade.html#review-third-party-apps

and it seems to me that you have missed to disabled it before starting the upgrade.

In addition it seems the following part might have been missed as well:

https://doc.owncloud.org/server/10.3/admin_manual/release_notes.html#media-viewer-replaces-gallery-and-video-player

hasc · October 22, 2019, 2:40pm

user$ ./occ app:disable files_videoplayer
ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
No such app enabled: files_videoplayer

user$ ./occ upgrade
ownCloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
2019-10-22T14:30:42+00:00 Set log level to debug
2019-10-22T14:30:42+00:00 Repair step: Upgrade app code from the marketplace
2019-10-22T14:30:42+00:00 Repair info: Using market to update existing apps
2019-10-22T14:30:42+00:00 Repair info: Attempting to update the following existing compatible apps from market: comments, configreport, dav, federatedfilesharing, federation, files, files_external, files_sharing, files_trashbin, files_versions, market, notifications, provisioning_api, systemtags, updatenotification
2019-10-22T14:30:42+00:00 Repair info: Fetching app from market: comments
2019-10-22T14:30:44+00:00 Repair info: App (comments) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: configreport
2019-10-22T14:30:44+00:00 Repair info: App (configreport) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: dav
2019-10-22T14:30:44+00:00 Repair info: App (dav) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: federatedfilesharing
2019-10-22T14:30:44+00:00 Repair info: App (federatedfilesharing) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: federation
2019-10-22T14:30:44+00:00 Repair info: App (federation) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: files
2019-10-22T14:30:44+00:00 Repair info: App (files) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: files_external
2019-10-22T14:30:44+00:00 Repair info: App (files_external) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: files_sharing
2019-10-22T14:30:44+00:00 Repair info: App (files_sharing) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: files_trashbin
2019-10-22T14:30:44+00:00 Repair info: App (files_trashbin) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: files_versions
2019-10-22T14:30:44+00:00 Repair info: App (files_versions) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: market
2019-10-22T14:30:44+00:00 Repair info:
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: notifications
2019-10-22T14:30:44+00:00 Repair info: App (notifications) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: provisioning_api
2019-10-22T14:30:44+00:00 Repair info: App (provisioning_api) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: systemtags
2019-10-22T14:30:44+00:00 Repair info: App (systemtags) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: Fetching app from market: updatenotification
2019-10-22T14:30:44+00:00 Repair info: App (updatenotification) is not known at the marketplace.
2019-10-22T14:30:44+00:00 Repair info: App was not updated: comments
2019-10-22T14:30:44+00:00 Repair info: App was not updated: configreport
2019-10-22T14:30:44+00:00 Repair info: App was not updated: dav
2019-10-22T14:30:44+00:00 Repair info: App was not updated: federatedfilesharing
2019-10-22T14:30:44+00:00 Repair info: App was not updated: federation
2019-10-22T14:30:44+00:00 Repair info: App was not updated: files
2019-10-22T14:30:44+00:00 Repair info: App was not updated: files_external
2019-10-22T14:30:44+00:00 Repair info: App was not updated: files_sharing
2019-10-22T14:30:44+00:00 Repair info: App was not updated: files_trashbin
2019-10-22T14:30:44+00:00 Repair info: App was not updated: files_versions
2019-10-22T14:30:44+00:00 Repair info: App was not updated: market
2019-10-22T14:30:44+00:00 Repair info: App was not updated: notifications
2019-10-22T14:30:44+00:00 Repair info: App was not updated: provisioning_api
2019-10-22T14:30:44+00:00 Repair info: App was not updated: systemtags
2019-10-22T14:30:44+00:00 Repair info: App was not updated: updatenotification
2019-10-22T14:30:44+00:00 Repair step: Repair MySQL database engine
2019-10-22T14:30:44+00:00 Repair info: Not a mysql database -> nothing to do
2019-10-22T14:30:44+00:00 Repair step: Repair MySQL collation
2019-10-22T14:30:44+00:00 Repair info: Not a mysql database -> nothing to do
2019-10-22T14:30:44+00:00 Repair step: Repair SQLite autoincrement
2019-10-22T14:30:44+00:00 Repair step: Repair orphaned reshare
2019-10-22T14:30:44+00:00 Repair step: Repair duplicate entries in oc_lucene_status
2019-10-22T14:30:44+00:00 Repair info: lucene_status table does not exist -> nothing to do
2019-10-22T14:30:44+00:00 Updating database schema
2019-10-22T14:30:44+00:00 Updated database
2019-10-22T14:30:44+00:00 Updating …
2019-10-22T14:30:44+00:00 Doctrine\DBAL\Exception\InvalidFieldNameException: An exception occurred while executing ‘SELECT min_value, increment_by FROM “oc_account_terms_id_seq”’:

SQLSTATE[42703]: Undefined column: 7 ERROR: column “min_value” does not exist
LINE 1: SELECT min_value, increment_by FROM "oc_account_terms_id_seq…
^
2019-10-22T14:30:44+00:00 Update failed
2019-10-22T14:30:44+00:00 Maintenance mode is kept active
2019-10-22T14:30:44+00:00 Reset log level

=======================================================

It seems it still cannot find the marketplace, but at least it goes a little far this time. Now it seems my PostgreSQL database is outdated:

psql --dbname= --username= --host=localhost
Password for user :
psql (11.5 (Debian 11.5-1+deb10u1))
SSL connection (protocol: TLSv1.3, cipher: TLS_AES_256_GCM_SHA384, bits: 256, compression: off)
Type “help” for help.

=> select * from oc_account_terms_id_seq;
last_value | log_cnt | is_called
------------±--------±----------
1 | 0 | f
(1 row)

No “min_value” nor “increment” fields on that table

tom42 · October 22, 2019, 4:56pm

Hey,

if i’m understanding the following text at https://doc.owncloud.org/server/10.3/admin_manual/installation/system_requirements.html#server correctly your database is not outdated but too new for ownCloud

PostgreSQL 9 (versions 10 and above are not yet supported)

funny0frank · November 27, 2019, 8:22pm

I disabled files_videoplayer by logging in as admin/root in the web interface and going into settings -> Apps and disabling the video/media player. Then the upgrade went fine. (I’m running owncloud in a docker container so switching back to the previous version and disabling this was easy)