[Bug]: [user_ldap] Migration from 1.13.0 to 1.13.1 broken

[bjo81]

⚠️ This issue respects the following points: ⚠️

• This is a bug, not a question or a configuration/webserver/proxy issue.
• This issue is not already reported on Github (I've searched it).
• Nextcloud Server is up to date. See Maintenance and Release Schedule for supported versions.
• I agree to follow Nextcloud's Code of Conduct.

Bug description

Migration of user_ldap app fails:
Database error when running migration latest for app user_ldap

Steps to reproduce

1. Upgrade NC 23.0.0.10 to 23.0.1.0
2. Upgrade LDAP App from 1.13.0 to 1.13.1

Expected behavior

No issues while upgrading the app.

Installation method

Other

Operating system

Other

PHP engine version

PHP 7.4

Web server

Nginx

Database engine version

MariaDB

Is this bug present after an update or on a fresh install?

Updated from a minor version (ex. 22.2.3 to 22.2.4)

Are you using the Nextcloud Server Encryption module?

Encryption is Disabled

What user-backends are you using?

• Default user-backend (database)
• LDAP/ Active Directory
• SSO - SAML
• Other

Configuration report

Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
{
    "system": {
        "instanceid": "***REMOVED SENSITIVE VALUE***",
        "passwordsalt": "***REMOVED SENSITIVE VALUE***",
        "secret": "***REMOVED SENSITIVE VALUE***",
        "trusted_proxies": "***REMOVED SENSITIVE VALUE***",
        "overwritehost": "nextcloud.domain.net",
        "overwriteprotocol": "https",
        "trusted_domains": [
            "nextcloud.domain.net"
        ],
        "datadirectory": "***REMOVED SENSITIVE VALUE***",
        "overwrite.cli.url": "https:\/\/nextcloud.domain.net",
        "default_language": "de",
        "dbtype": "mysql",
        "version": "23.0.0.10",
        "dbname": "***REMOVED SENSITIVE VALUE***",
        "dbhost": "***REMOVED SENSITIVE VALUE***",
        "dbport": "",
        "dbtableprefix": "oc_",
        "dbuser": "***REMOVED SENSITIVE VALUE***",
        "dbpassword": "***REMOVED SENSITIVE VALUE***",
        "logtimezone": "UTC",
        "loglevel": "2",
        "installed": true,
        "memcache.local": "\\OC\\Memcache\\APCu",
        "memcache.locking": "\\OC\\Memcache\\Redis",
        "redis": {
            "host": "***REMOVED SENSITIVE VALUE***",
            "port": 6379
        },
        "ldapIgnoreNamingRules": false,
        "ldapProviderFactory": "\\OCA\\User_LDAP\\LDAPProviderFactory",
        "maintenance": false,
        "theme": "",
        "mail_from_address": "***REMOVED SENSITIVE VALUE***",
        "mail_smtpmode": "smtp",
        "mail_domain": "***REMOVED SENSITIVE VALUE***",
        "updater.release.channel": "stable",
        "mail_smtphost": "***REMOVED SENSITIVE VALUE***",
        "default_phone_region": "DE",
        "app_install_overwrite": [
            "quota_warning"
        ],
        "mysql.utf8mb4": true
    }
}

List of activated Apps

Nextcloud or one of the apps require upgrade - only a limited number of commands are available
You may use your browser or the occ upgrade command to do the upgrade
Enabled:
  - accessibility: 1.9.0
  - activity: 2.15.0
  - cloud_federation_api: 1.6.0
  - comments: 1.13.0
  - contactsinteraction: 1.4.0
  - dashboard: 7.3.0
  - dav: 1.21.0
  - federatedfilesharing: 1.13.0
  - federation: 1.13.0
  - files: 1.18.0
  - files_pdfviewer: 2.4.0
  - files_rightclick: 1.2.0
  - files_sharing: 1.15.0
  - files_trashbin: 1.13.0
  - files_versions: 1.16.0
  - files_videoplayer: 1.12.0
  - firstrunwizard: 2.12.0
  - logreader: 2.8.0
  - lookup_server_connector: 1.11.0
  - nextcloud_announcements: 1.12.0
  - notifications: 2.11.1
  - oauth2: 1.11.0
  - password_policy: 1.13.0
  - photos: 1.5.0
  - privacy: 1.7.0
  - provisioning_api: 1.13.0
  - recommendations: 1.2.0
  - serverinfo: 1.13.0
  - settings: 1.5.0
  - sharebymail: 1.13.0
  - support: 1.6.0
  - survey_client: 1.11.0
  - systemtags: 1.13.0
  - text: 3.4.0
  - theming: 1.14.0
  - twofactor_backupcodes: 1.12.0
  - updatenotification: 1.13.0
  - user_ldap: 1.13.0
  - user_status: 1.3.1
  - viewer: 1.7.0
  - weather_status: 1.3.0
  - workflowengine: 2.5.0
Disabled:
  - admin_audit
  - circles: 0.19.5
  - encryption
  - files_external

Nextcloud Signing status

No errors have been found.

Nextcloud Logs

{"reqId":"b2XaK6tsG7sBep1nKa2E","level":3,"time":"2022-01-31T09:47:54+00:00","remoteAddr":"","user":"--","app":"no app in context","method":"","url":"--","message":"Database error when running migration latest for app user_ldap","userAgent":"--","version":"23.0.0.10","exception":{"Exception":"Exception","Message":"Database error when running migration latest for app user_ldap","Code":0,"Trace":[{"file":"/var/www/html/lib/private/legacy/OC_App.php","line":1011,"function":"migrate","class":"OC\\DB\\MigrationService","type":"->","args":[]},{"file":"/var/www/html/lib/private/Updater.php","line":353,"function":"updateApp","class":"OC_App","type":"::","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/lib/private/Updater.php","line":265,"function":"doAppUpgrade","class":"OC\\Updater","type":"->","args":[]},{"file":"/var/www/html/lib/private/Updater.php","line":133,"function":"doUpgrade","class":"OC\\Updater","type":"->","args":["23.0.1.2","23.0.0.10"]},{"file":"/var/www/html/core/Command/Upgrade.php","line":235,"function":"upgrade","class":"OC\\Updater","type":"->","args":[]},{"file":"/var/www/html/3rdparty/symfony/console/Command/Command.php","line":255,"function":"execute","class":"OC\\Core\\Command\\Upgrade","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":1009,"function":"run","class":"Symfony\\Component\\Console\\Command\\Command","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":273,"function":"doRunCommand","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"OC\\Core\\Command\\Upgrade"},{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":149,"function":"doRun","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/lib/private/Console/Application.php","line":211,"function":"run","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/console.php","line":99,"function":"run","class":"OC\\Console\\Application","type":"->","args":[]},{"file":"/var/www/html/occ","line":11,"args":["/var/www/html/console.php"],"function":"require_once"}],"File":"/var/www/html/lib/private/DB/MigrationService.php","Line":429,"Previous":{"Exception":"Doctrine\\DBAL\\Exception\\UniqueConstraintViolationException","Message":"An exception occurred while executing a query: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '300' for key 'ldap_user_directory_uuid'","Code":1062,"Trace":[{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Connection.php","line":1780,"function":"convert","class":"Doctrine\\DBAL\\Driver\\API\\MySQL\\ExceptionConverter","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Driver\\PDO\\Exception"},{"__class__":"Doctrine\\DBAL\\Query"}]},{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Connection.php","line":1719,"function":"handleDriverException","class":"Doctrine\\DBAL\\Connection","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Driver\\PDO\\Exception"},{"__class__":"Doctrine\\DBAL\\Query"}]},{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Connection.php","line":1067,"function":"convertExceptionDuringQuery","class":"Doctrine\\DBAL\\Connection","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Driver\\PDO\\Exception"},"CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)",[],[]]},{"file":"/var/www/html/lib/private/DB/Connection.php","line":237,"function":"executeQuery","class":"Doctrine\\DBAL\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)",[],[],null]},{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Connection.php","line":1809,"function":"executeQuery","class":"OC\\DB\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/lib/private/DB/Migrator.php","line":175,"function":"query","class":"Doctrine\\DBAL\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/lib/private/DB/Migrator.php","line":76,"function":"applySchema","class":"OC\\DB\\Migrator","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/Connection.php","line":546,"function":"migrate","class":"OC\\DB\\Migrator","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/MigrationService.php","line":540,"function":"migrateToSchema","class":"OC\\DB\\Connection","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/MigrationService.php","line":425,"function":"executeStep","class":"OC\\DB\\MigrationService","type":"->","args":["1130Date20211102154716",false]},{"file":"/var/www/html/lib/private/legacy/OC_App.php","line":1011,"function":"migrate","class":"OC\\DB\\MigrationService","type":"->","args":[]},{"file":"/var/www/html/lib/private/Updater.php","line":353,"function":"updateApp","class":"OC_App","type":"::","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/lib/private/Updater.php","line":265,"function":"doAppUpgrade","class":"OC\\Updater","type":"->","args":[]},{"file":"/var/www/html/lib/private/Updater.php","line":133,"function":"doUpgrade","class":"OC\\Updater","type":"->","args":["23.0.1.2","23.0.0.10"]},{"file":"/var/www/html/core/Command/Upgrade.php","line":235,"function":"upgrade","class":"OC\\Updater","type":"->","args":[]},{"file":"/var/www/html/3rdparty/symfony/console/Command/Command.php","line":255,"function":"execute","class":"OC\\Core\\Command\\Upgrade","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":1009,"function":"run","class":"Symfony\\Component\\Console\\Command\\Command","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":273,"function":"doRunCommand","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"OC\\Core\\Command\\Upgrade"},{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":149,"function":"doRun","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/lib/private/Console/Application.php","line":211,"function":"run","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/console.php","line":99,"function":"run","class":"OC\\Console\\Application","type":"->","args":[]},{"file":"/var/www/html/occ","line":11,"args":["/var/www/html/console.php"],"function":"require_once"}],"File":"/var/www/html/3rdparty/doctrine/dbal/src/Driver/API/MySQL/ExceptionConverter.php","Line":60,"Previous":{"Exception":"Doctrine\\DBAL\\Driver\\PDO\\Exception","Message":"SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '300' for key 'ldap_user_directory_uuid'","Code":1062,"Trace":[{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Driver/PDO/Connection.php","line":87,"function":"new","class":"Doctrine\\DBAL\\Driver\\PDO\\Exception","type":"::","args":[{"__class__":"PDOException","errorInfo":["23000",1062,"Duplicate entry '300' for key 'ldap_user_directory_uuid'"]}]},{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Connection.php","line":1062,"function":"query","class":"Doctrine\\DBAL\\Driver\\PDO\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/lib/private/DB/Connection.php","line":237,"function":"executeQuery","class":"Doctrine\\DBAL\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)",[],[],null]},{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Connection.php","line":1809,"function":"executeQuery","class":"OC\\DB\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/lib/private/DB/Migrator.php","line":175,"function":"query","class":"Doctrine\\DBAL\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/lib/private/DB/Migrator.php","line":76,"function":"applySchema","class":"OC\\DB\\Migrator","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/Connection.php","line":546,"function":"migrate","class":"OC\\DB\\Migrator","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/MigrationService.php","line":540,"function":"migrateToSchema","class":"OC\\DB\\Connection","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/MigrationService.php","line":425,"function":"executeStep","class":"OC\\DB\\MigrationService","type":"->","args":["1130Date20211102154716",false]},{"file":"/var/www/html/lib/private/legacy/OC_App.php","line":1011,"function":"migrate","class":"OC\\DB\\MigrationService","type":"->","args":[]},{"file":"/var/www/html/lib/private/Updater.php","line":353,"function":"updateApp","class":"OC_App","type":"::","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/lib/private/Updater.php","line":265,"function":"doAppUpgrade","class":"OC\\Updater","type":"->","args":[]},{"file":"/var/www/html/lib/private/Updater.php","line":133,"function":"doUpgrade","class":"OC\\Updater","type":"->","args":["23.0.1.2","23.0.0.10"]},{"file":"/var/www/html/core/Command/Upgrade.php","line":235,"function":"upgrade","class":"OC\\Updater","type":"->","args":[]},{"file":"/var/www/html/3rdparty/symfony/console/Command/Command.php","line":255,"function":"execute","class":"OC\\Core\\Command\\Upgrade","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":1009,"function":"run","class":"Symfony\\Component\\Console\\Command\\Command","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":273,"function":"doRunCommand","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"OC\\Core\\Command\\Upgrade"},{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":149,"function":"doRun","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/lib/private/Console/Application.php","line":211,"function":"run","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/console.php","line":99,"function":"run","class":"OC\\Console\\Application","type":"->","args":[]},{"file":"/var/www/html/occ","line":11,"args":["/var/www/html/console.php"],"function":"require_once"}],"File":"/var/www/html/3rdparty/doctrine/dbal/src/Driver/PDO/Exception.php","Line":26,"Previous":{"Exception":"PDOException","Message":"SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '300' for key 'ldap_user_directory_uuid'","Code":"23000","Trace":[{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Driver/PDO/Connection.php","line":82,"function":"query","class":"PDO","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Connection.php","line":1062,"function":"query","class":"Doctrine\\DBAL\\Driver\\PDO\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/lib/private/DB/Connection.php","line":237,"function":"executeQuery","class":"Doctrine\\DBAL\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)",[],[],null]},{"file":"/var/www/html/3rdparty/doctrine/dbal/src/Connection.php","line":1809,"function":"executeQuery","class":"OC\\DB\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/lib/private/DB/Migrator.php","line":175,"function":"query","class":"Doctrine\\DBAL\\Connection","type":"->","args":["CREATE UNIQUE INDEX ldap_user_directory_uuid ON oc_ldap_user_mapping (directory_uuid)"]},{"file":"/var/www/html/lib/private/DB/Migrator.php","line":76,"function":"applySchema","class":"OC\\DB\\Migrator","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/Connection.php","line":546,"function":"migrate","class":"OC\\DB\\Migrator","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/MigrationService.php","line":540,"function":"migrateToSchema","class":"OC\\DB\\Connection","type":"->","args":[{"__class__":"Doctrine\\DBAL\\Schema\\Schema"}]},{"file":"/var/www/html/lib/private/DB/MigrationService.php","line":425,"function":"executeStep","class":"OC\\DB\\MigrationService","type":"->","args":["1130Date20211102154716",false]},{"file":"/var/www/html/lib/private/legacy/OC_App.php","line":1011,"function":"migrate","class":"OC\\DB\\MigrationService","type":"->","args":[]},{"file":"/var/www/html/lib/private/Updater.php","line":353,"function":"updateApp","class":"OC_App","type":"::","args":["*** sensitive parameters replaced ***"]},{"file":"/var/www/html/lib/private/Updater.php","line":265,"function":"doAppUpgrade","class":"OC\\Updater","type":"->","args":[]},{"file":"/var/www/html/lib/private/Updater.php","line":133,"function":"doUpgrade","class":"OC\\Updater","type":"->","args":["23.0.1.2","23.0.0.10"]},{"file":"/var/www/html/core/Command/Upgrade.php","line":235,"function":"upgrade","class":"OC\\Updater","type":"->","args":[]},{"file":"/var/www/html/3rdparty/symfony/console/Command/Command.php","line":255,"function":"execute","class":"OC\\Core\\Command\\Upgrade","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":1009,"function":"run","class":"Symfony\\Component\\Console\\Command\\Command","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":273,"function":"doRunCommand","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"OC\\Core\\Command\\Upgrade"},{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/3rdparty/symfony/console/Application.php","line":149,"function":"doRun","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/lib/private/Console/Application.php","line":211,"function":"run","class":"Symfony\\Component\\Console\\Application","type":"->","args":[{"__class__":"Symfony\\Component\\Console\\Input\\ArgvInput"},{"__class__":"Symfony\\Component\\Console\\Output\\ConsoleOutput"}]},{"file":"/var/www/html/console.php","line":99,"function":"run","class":"OC\\Console\\Application","type":"->","args":[]},{"file":"/var/www/html/occ","line":11,"args":["/var/www/html/console.php"],"function":"require_once"}],"File":"/var/www/html/3rdparty/doctrine/dbal/src/Driver/PDO/Connection.php","Line":82}}},"CustomMessage":"Database error when running migration latest for app user_ldap"}}

Additional info

Retrying the upgrade leads to The table with name 'nextcloud.oc_ldap_group_mapping_backup' already exists

[szaimen]

cc @come-nc @nickvergessen

[come-nc]

The source of the error is:
"Message": "An exception occurred while executing a query: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry '300' for key 'ldap_user_directory_uuid'",

@bjo81 Can you share a few lines from your ldap_user_mapping table? Can you share your ldap configuration (occ ldap:show-config)?

[bjo81]

Ok, the UUIDs don't seem to be UUIDs:

| uid=bjo,cn=users,ou=domain.net,dc=domain,dc=net                 | Bjoern_Franke                | 300                          | NULL                                                             |
| uid=bjo,cn=users,ou=domain.net,dc=domain,dc=net                 | Bjoern_Franke_6762           | Bjoern Franke                | abd45f81c6ada83997f60b80f30e4318ac475924c08dfc36648ab225
| uid=meeting-y,cn=users,ou=domain.net,dc=domain,dc=net          | meeting.xy.domain.net      | 300                          | NULL                                                             |
| uid=no-reply,cn=users,ou=domain.net,dc=domain,dc=net            | no_reply                     | no reply                     | NULL                                                             |
| uid=oauthtest,cn=users,ou=domain.net,dc=domain,dc=net           | oauth_test                   | oauth test                   | NULL                                                             |
| uid=foo-bar-reports,cn=users,ou=domain.net,dc=domain,dc=net | foo_baar_reports          | foo baar reporst          | NULL                                                             |
| uid=redmine,cn=users,ou=domain.net,dc=domain,dc=net             | redmine             | 300                          | NULL  

LDAP-Config:

+-------------------------------+--------------------------------------------------------------------+
| Configuration                 |                                                                    |
+-------------------------------+--------------------------------------------------------------------+
| hasMemberOfFilterSupport      |                                                                    |
| homeFolderNamingRule          | attr:cn                                                            |
| lastJpegPhotoLookup           | 0                                                                  |
| ldapAgentName                 |                                                                    |
| ldapAgentPassword             | ***                                                                |
| ldapAttributesForGroupSearch  | ou                                                                 |
| ldapAttributesForUserSearch   | cn;uid                                                             |
| ldapBackupHost                |                                                                    |
| ldapBackupPort                |                                                                    |
| ldapBase                      | dc=domain,dc=net                                                 |
| ldapBaseGroups                | ou=domain.net,dc=domain,dc=net                                 |
| ldapBaseUsers                 | ou=domain.net,dc=domain,dc=net                                 |
| ldapCacheTTL                  | 600                                                                |
| ldapConfigurationActive       | 1                                                                  |
| ldapDefaultPPolicyDN          |                                                                    |
| ldapDynamicGroupMemberURL     |                                                                    |
| ldapEmailAttribute            | mail                                                               |
| ldapExperiencedAdmin          | 0                                                                  |
| ldapExpertUUIDGroupAttr       | gidNumber                                                          |
| ldapExpertUUIDUserAttr        | cn                                                                 |
| ldapExpertUsernameAttr        |                                                                    |
| ldapExtStorageHomeAttribute   |                                                                    |
| ldapGidNumber                 | gidNumber                                                          |
| ldapGroupDisplayName          | cn                                                                 |
| ldapGroupFilter               | (&(|(objectclass=posixGroup)))                                     |
| ldapGroupFilterGroups         |                                                                    |
| ldapGroupFilterMode           | 0                                                                  |
| ldapGroupFilterObjectclass    | posixGroup                                                         |
| ldapGroupMemberAssocAttr      | memberUid                                                          |
| ldapHost                      | ldaps://ldap.domain.net                                          |
| ldapIgnoreNamingRules         |                                                                    |
| ldapLoginFilter               | (&(|(objectclass=posixAccount))(|(mail=%uid)(zarafaAliases=%uid))) |
| ldapLoginFilterAttributes     | mail;zarafaAliases                                                 |
| ldapLoginFilterEmail          | 0                                                                  |
| ldapLoginFilterMode           | 0                                                                  |
| ldapLoginFilterUsername       | 0                                                                  |
| ldapMatchingRuleInChainState  | unknown                                                            |
| ldapNestedGroups              | 0                                                                  |
| ldapOverrideMainServer        |                                                                    |
| ldapPagingSize                | 0                                                                  |
| ldapPort                      | 636                                                                |
| ldapQuotaAttribute            |                                                                    |
| ldapQuotaDefault              |                                                                    |
| ldapTLS                       | 0                                                                  |
| ldapUserAvatarRule            | default                                                            |
| ldapUserDisplayName           | cn                                                                 |
| ldapUserDisplayName2          |                                                                    |
| ldapUserFilter                | (|(objectclass=posixAccount))                                      |
| ldapUserFilterGroups          |                                                                    |
| ldapUserFilterMode            | 0                                                                  |
| ldapUserFilterObjectclass     | posixAccount                                                       |
| ldapUuidGroupAttribute        | auto                                                               |
| ldapUuidUserAttribute         | auto                                                               |
| turnOffCertCheck              | 0                                                                  |
| turnOnPasswordChange          | 0                                                                  |
| useMemberOfToDetectMembership | 1                                                                  |
+-------------------------------+--------------------------------------------------------------------+

[blizzz]

The attributes for UUID were overridden to use cn for users and gidNumber for groups. With the groups you might be lucky, but otherwise this does not satisfy the criteria for UUIDs. This generally complicates matters as I am afraid it is not the only setup configured like that.

[bjo81]

@blizzz yes, but this does not explain why there are many "300" entries as UUID.

[blizzz]

@blizzz yes, but this does not explain why there are many "300" entries as UUID.

At the time of mapping the cn of the record was 300. Or, at the time of mapping the setting was a different one.

[bjo81]

gidNumber and ldapExpertUUIDGroupAttr are 300, but we haven't changed the mapping since months and until the upgrade to 1.13.1 everything was fine. Is it possible that ldapExpertUUIDGroupAttr was accidently used for directory UUID generation?

[blizzz]

So we can consider to change the index to be not a unique index, but allow multiple values. This would keep the state as it is currently. The already existing problem: the business logic was already build with the premise that the UUID is indeed unique.

Background: the UUID is being used to rediscover and LDAP record that was moved and therefore got new DN. The DN is what LDAP operations are being run with.

When we find two or more same UUIDs we can already state that the configuration is borked.

So instead of making the UUID not-unique, which would solve the symptoms maybe, but let's the monster sleep under the bed, I would propose:

• In a new migration step, detect first all duplicated UUIDs
• invalidate each duplicated them by replacing it with a short text and random string, e.g. 'invalidated_1234567890ab'
• inform the admin of the replacement. Certainly in the log file (warning level)
• offer an occ command to update the UUID of all or specified user id, group ids or DNs
  • this could be done also automatically on the duplicated ones, instead of invalidating them. It still may fail for the configuration.

I think a better reporting or information (setup warning) could be done to highlight it and make fixes easy.

Maybe we should also take out the UUID overrides from the settings ui totally and only allow it on CLI. It is necessary for exotic LDAP servers. Or make it harder to change it.

[PVince81]

@blizzz thanks, sounds like a good plan.
My only worry would be how expensive the duplicate detection would be in bigger databases, considering that we don't want the upgrade time to take too long

@come-nc @CarlSchwan any further thoughts on the above approach ?

[blizzz]

@blizzz thanks, sounds like a good plan. My only worry would be how expensive the duplicate detection would be in bigger databases, considering that we don't want the upgrade time to take too long

With the current migration context in mind (copying and restoring the table) it shoud not be significant