Corrupt DB. What should we do?

Hi!
I had some issues on the server and now the DB is corrupt.
Below is the mariadb log.
What would you suggest to do in this case?

Thanks!!
Michael

Feb 15 12:59:27 vm007-matomo systemd[1]: Starting MariaDB 10.6.9 database server...
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] /usr/sbin/mariadbd (server 10.6.9-MariaDB-1:10.6.9+maria~deb10) starting as process 1017 ...
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Using transactional memory
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Number of pools: 1
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Using crc32 + pclmulqdq instructions
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Using Linux native AIO
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Initializing buffer pool, total size = 134217728, chunk size = 134217728
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Completed initialization of buffer pool
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Starting crash recovery from checkpoint LSN=8250829449,8250829449
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Starting final batch to recover 983 pages from redo log.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Set innodb_force_recovery=1 to ignore corrupted pages.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Failed to read page 5 from file './matomo/matomo_archive_numeric_2023_02.ibd': Page read from tablespace is corrupted.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Failed to read page 69 from file './matomo/matomo_archive_numeric_2023_02.ibd': Page read from tablespace is corrupted.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Failed to read page 80 from file './matomo/matomo_archive_numeric_2023_02.ibd': Page read from tablespace is corrupted.
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Plugin initialization aborted with error Data structure corruption
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [Note] InnoDB: Starting shutdown...
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set   innodb_force_recovery=1 to ignore corruption.
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Not applying INSERT_HEAP_DYNAMIC due to corruption on [page id: space=429, page number=450]
  Feb 15 12:59:28 vm007-matomo mariadbd[1017]: 2023-02-15 12:59:28 0 [ERROR] InnoDB: Set innodb_force_recovery=1 to ignore corruption.
....
....

Looks like running with innodb_force_recovery=1 and then restarting without this option fixed the issue for us.

1 Like