REST - [SQLITE_ERROR] SQL error or missing database (no such table: metadata)

[maron546]

Hi.

We're trying to activate the rest frontend, but the service doesn't start due to the following error:

2025-03-05 09:35:44.700 ERROR main org.apache.kyuubi.server.KyuubiServer: Error starting service KyuubiRestFrontendService
org.apache.kyuubi.KyuubiException: Cannot start KyuubiRestFrontendService
 at org.apache.kyuubi.server.KyuubiRestFrontendService.start(KyuubiRestFrontendService.scala:210)
 at org.apache.kyuubi.service.CompositeService.$anonfun$start$1(CompositeService.scala:47)
 at org.apache.kyuubi.service.CompositeService.$anonfun$start$1$adapted(CompositeService.scala:45)
 at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62)
 at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55)
 at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49)
 at org.apache.kyuubi.service.CompositeService.start(CompositeService.scala:45)
 at org.apache.kyuubi.service.Serverable.start(Serverable.scala:53)
 at org.apache.kyuubi.server.KyuubiServer.start(KyuubiServer.scala:220)
 at org.apache.kyuubi.server.KyuubiServer$.startServer(KyuubiServer.scala:68)
 at org.apache.kyuubi.server.KyuubiServer$.main(KyuubiServer.scala:100)
 at org.apache.kyuubi.server.KyuubiServer.main(KyuubiServer.scala)
Caused by: org.apache.kyuubi.KyuubiException: Error executing sql: SELECT identifier,session_type,real_user,user_name,ip_address,kyuubi_instance,state,resource,class_name,request_name,request_conf,request_args,create_time,engine_type,cluster_manager,engine_id,engine_name,engine_url,engine_state,engine_error,end_time,peer_instance_closed FROM metadata WHERE 1 = 1 AND session_type = ? AND state = ? AND kyuubi_instance = ? ORDER BY key_id LIMIT 2147483647 OFFSET 0, with params: BATCH, PENDING, xxx:10099. [SQLITE_ERROR] SQL error or missing database (no such table: metadata)
 at org.apache.kyuubi.server.metadata.jdbc.JDBCMetadataStore.withResultSet(JDBCMetadataStore.scala:509)
 at org.apache.kyuubi.server.metadata.jdbc.JDBCMetadataStore.$anonfun$getMetadataList$1(JDBCMetadataStore.scala:266)
 at org.apache.kyuubi.util.JdbcUtils$.withCloseable(JdbcUtils.scala:43)
 at org.apache.kyuubi.util.JdbcUtils$.withConnection(JdbcUtils.scala:50)
 at org.apache.kyuubi.server.metadata.jdbc.JDBCMetadataStore.getMetadataList(JDBCMetadataStore.scala:265)
 at org.apache.kyuubi.server.metadata.MetadataManager.$anonfun$getBatchesRecoveryMetadata$1(MetadataManager.scala:172)
 at org.apache.kyuubi.server.metadata.MetadataManager.withMetadataRequestMetrics(MetadataManager.scala:99)
 at org.apache.kyuubi.server.metadata.MetadataManager.getBatchesRecoveryMetadata(MetadataManager.scala:172)
 at org.apache.kyuubi.session.KyuubiSessionManager.$anonfun$getBatchSessionsToRecover$2(KyuubiSessionManager.scala:305)
 at scala.Option.map(Option.scala:230)
 at org.apache.kyuubi.session.KyuubiSessionManager.$anonfun$getBatchSessionsToRecover$1(KyuubiSessionManager.scala:305)
 at scala.collection.immutable.List.flatMap(List.scala:366)
 at org.apache.kyuubi.session.KyuubiSessionManager.getBatchSessionsToRecover(KyuubiSessionManager.scala:300)
 at org.apache.kyuubi.server.KyuubiRestFrontendService.recoverBatchSessions(KyuubiRestFrontendService.scala:162)
 at org.apache.kyuubi.server.KyuubiRestFrontendService.start(KyuubiRestFrontendService.scala:208)
 ... 11 more
Caused by: org.sqlite.SQLiteException: [SQLITE_ERROR] SQL error or missing database (no such table: metadata)
 at org.sqlite.core.DB.newSQLException(DB.java:1179)
 at org.sqlite.core.DB.newSQLException(DB.java:1190)
 at org.sqlite.core.DB.throwex(DB.java:1150)
 at org.sqlite.core.NativeDB.prepare_utf8(Native Method)
 at org.sqlite.core.NativeDB.prepare(NativeDB.java:126)
 at org.sqlite.core.DB.prepare(DB.java:264)
 at org.sqlite.core.CorePreparedStatement.<init>(CorePreparedStatement.java:46)
 at org.sqlite.jdbc3.JDBC3PreparedStatement.<init>(JDBC3PreparedStatement.java:32)
 at org.sqlite.jdbc4.JDBC4PreparedStatement.<init>(JDBC4PreparedStatement.java:25)
 at org.sqlite.jdbc4.JDBC4Connection.prepareStatement(JDBC4Connection.java:34)
 at org.sqlite.jdbc3.JDBC3Connection.prepareStatement(JDBC3Connection.java:226)
 at org.sqlite.jdbc3.JDBC3Connection.prepareStatement(JDBC3Connection.java:206)
 at com.zaxxer.hikari.pool.ProxyConnection.prepareStatement(ProxyConnection.java:337)
 at com.zaxxer.hikari.pool.HikariProxyConnection.prepareStatement(HikariProxyConnection.java)
 at org.apache.kyuubi.server.metadata.jdbc.JDBCMetadataStore.withResultSet(JDBCMetadataStore.scala:501)
 ... 25 more

Kyuubi (version 1.9.1) is installed inside Kubernetes.
No particular configuration has been applied, just:

kyuubi.frontend.protocols=THRIFT_BINARY,REST
kyuubi.authentication=KERBEROS

and obviously the 'kyuubi.kinit' properties.
Are we missing something?

Thanks in advance.

[pan3793]

I don't think the the confs you provided are related, please paste the whole kyuubi-defaults.conf

[maron546]

Sorry, it was my fault, I disabled the initialization with the following property:
kyuubi.metadata.store.jdbc.database.schema.init=false