Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

mkdir: `/user/hive/tmp': Input/output error #1

Open
MammadTavakoli opened this issue Apr 1, 2023 · 12 comments
Open

mkdir: `/user/hive/tmp': Input/output error #1

MammadTavakoli opened this issue Apr 1, 2023 · 12 comments

Comments

@MammadTavakoli
Copy link

Hi
I run this docker compose in Debian.
but some error accrued in hive:

mkdir: `/user/hive/tmp': Input/output error
experiment-with-trino-minio-hive-hive-metastore-1  | mkdir: `/user/hive/warehouse': Input/output error
experiment-with-trino-minio-hive-hive-metastore-1  | chmod: `/user/hive/tmp': No such file or directory
experiment-with-trino-minio-hive-hive-metastore-1  | chmod: `/user/hive/warehouse': No such file or directory
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: Class path contains multiple SLF4J bindings.
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: Found binding in [jar:file:/opt/apache-hive-metastore-3.1.3-bin/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: Found binding in [jar:file:/opt/hadoop-3.3.4/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:47,128 main ERROR Cannot access RandomAccessFile java.io.IOException: Could not create directory /user/hive/tmp/hive java.io.IOException: Could not create directory /user/hive/tmp/hive
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.util.FileUtils.mkdir(FileUtils.java:120)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.util.FileUtils.makeParentDirs(FileUtils.java:137)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$RollingRandomAccessFileManagerFactory.createManager(RollingRandomAccessFileManager.java:231)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$RollingRandomAccessFileManagerFactory.createManager(RollingRandomAccessFileManager.java:204)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.AbstractManager.getManager(AbstractManager.java:114)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.OutputStreamManager.getManager(OutputStreamManager.java:100)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager.getRollingRandomAccessFileManager(RollingRandomAccessFileManager.java:107)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender$Builder.build(RollingRandomAccessFileAppender.java:132)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender$Builder.build(RollingRandomAccessFileAppender.java:53)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:122)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:1120)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1045)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1037)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:651)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:247)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:293)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:626)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:699)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:716)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:270)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:155)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.LogManager.getContext(LogManager.java:196)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:137)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:33)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:388)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.<clinit>(RunJar.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:47,158 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender for element RollingRandomAccessFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$RollingRandomAccessFileManagerFactory@7ccfdaef] unable to create manager for [/user/hive/tmp/hive/metastore.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$FactoryData@a6e4897] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$RollingRandomAccessFileManagerFactory@7ccfdaef] unable to create manager for [/user/hive/tmp/hive/metastore.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$FactoryData@a6e4897]
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.AbstractManager.getManager(AbstractManager.java:116)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.OutputStreamManager.getManager(OutputStreamManager.java:100)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager.getRollingRandomAccessFileManager(RollingRandomAccessFileManager.java:107)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender$Builder.build(RollingRandomAccessFileAppender.java:132)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender$Builder.build(RollingRandomAccessFileAppender.java:53)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:122)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:1120)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1045)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1037)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:651)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:247)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:293)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:626)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:699)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:716)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:270)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:155)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.LogManager.getContext(LogManager.java:196)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:137)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:33)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:388)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.<clinit>(RunJar.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:47,159 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender for element RollingRandomAccessFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.findFactoryMethod(PluginBuilder.java:236)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:134)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:1120)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1045)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1037)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:651)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:247)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:293)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:626)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:699)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:716)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:270)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:155)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.LogManager.getContext(LogManager.java:196)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:137)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:33)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:388)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.<clinit>(RunJar.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:47,161 main ERROR Null object returned for RollingRandomAccessFile in Appenders.
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:47,162 main ERROR Unable to locate appender "DRFA" for logger config "root"
experiment-with-trino-minio-hive-hive-metastore-1  | Exception in thread "main" java.io.IOException: Mkdirs failed to create /user/hive/tmp
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.ensureDirectory(RunJar.java:229)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.run(RunJar.java:281)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:47: Starting Metastore Server
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: Class path contains multiple SLF4J bindings.
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: Found binding in [jar:file:/opt/apache-hive-metastore-3.1.3-bin/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: Found binding in [jar:file:/opt/hadoop-3.3.4/share/hadoop/common/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
experiment-with-trino-minio-hive-hive-metastore-1  | SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:51,763 main ERROR Cannot access RandomAccessFile java.io.IOException: Could not create directory /user/hive/tmp/hive java.io.IOException: Could not create directory /user/hive/tmp/hive
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.util.FileUtils.mkdir(FileUtils.java:120)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.util.FileUtils.makeParentDirs(FileUtils.java:137)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$RollingRandomAccessFileManagerFactory.createManager(RollingRandomAccessFileManager.java:231)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$RollingRandomAccessFileManagerFactory.createManager(RollingRandomAccessFileManager.java:204)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.AbstractManager.getManager(AbstractManager.java:114)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.OutputStreamManager.getManager(OutputStreamManager.java:100)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager.getRollingRandomAccessFileManager(RollingRandomAccessFileManager.java:107)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender$Builder.build(RollingRandomAccessFileAppender.java:132)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender$Builder.build(RollingRandomAccessFileAppender.java:53)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:122)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:1120)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1045)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1037)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:651)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:247)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:293)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:626)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:699)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:716)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:270)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:155)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.LogManager.getContext(LogManager.java:196)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:137)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:33)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:388)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.<clinit>(RunJar.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:51,775 main ERROR Could not create plugin of type class org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender for element RollingRandomAccessFile: java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$RollingRandomAccessFileManagerFactory@7ccfdaef] unable to create manager for [/user/hive/tmp/hive/metastore.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$FactoryData@a6e4897] java.lang.IllegalStateException: ManagerFactory [org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$RollingRandomAccessFileManagerFactory@7ccfdaef] unable to create manager for [/user/hive/tmp/hive/metastore.log] with data [org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager$FactoryData@a6e4897]
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.AbstractManager.getManager(AbstractManager.java:116)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.OutputStreamManager.getManager(OutputStreamManager.java:100)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.rolling.RollingRandomAccessFileManager.getRollingRandomAccessFileManager(RollingRandomAccessFileManager.java:107)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender$Builder.build(RollingRandomAccessFileAppender.java:132)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender$Builder.build(RollingRandomAccessFileAppender.java:53)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:122)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:1120)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1045)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1037)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:651)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:247)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:293)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:626)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:699)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:716)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:270)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:155)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.LogManager.getContext(LogManager.java:196)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:137)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:33)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:388)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.<clinit>(RunJar.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:51,776 main ERROR Unable to invoke factory method in class org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender for element RollingRandomAccessFile: java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender java.lang.IllegalStateException: No factory method found for class org.apache.logging.log4j.core.appender.RollingRandomAccessFileAppender
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.findFactoryMethod(PluginBuilder.java:236)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.plugins.util.PluginBuilder.build(PluginBuilder.java:134)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createPluginObject(AbstractConfiguration.java:1120)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1045)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.createConfiguration(AbstractConfiguration.java:1037)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.doConfigure(AbstractConfiguration.java:651)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.initialize(AbstractConfiguration.java:247)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.config.AbstractConfiguration.start(AbstractConfiguration.java:293)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.setConfiguration(LoggerContext.java:626)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:699)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.reconfigure(LoggerContext.java:716)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.LoggerContext.start(LoggerContext.java:270)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:155)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.core.impl.Log4jContextFactory.getContext(Log4jContextFactory.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.LogManager.getContext(LogManager.java:196)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getContext(AbstractLoggerAdapter.java:137)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getContext(Log4jLoggerFactory.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.log4j.spi.AbstractLoggerAdapter.getLogger(AbstractLoggerAdapter.java:47)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.logging.slf4j.Log4jLoggerFactory.getLogger(Log4jLoggerFactory.java:33)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:363)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:388)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.<clinit>(RunJar.java:55)
experiment-with-trino-minio-hive-hive-metastore-1  |
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:51,778 main ERROR Null object returned for RollingRandomAccessFile in Appenders.
experiment-with-trino-minio-hive-hive-metastore-1  | 2023-04-01 13:40:51,778 main ERROR Unable to locate appender "DRFA" for logger config "root"
experiment-with-trino-minio-hive-hive-metastore-1  | Exception in thread "main" java.io.IOException: Mkdirs failed to create /user/hive/tmp
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.ensureDirectory(RunJar.java:229)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.run(RunJar.java:281)
experiment-with-trino-minio-hive-hive-metastore-1  |    at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
experiment-with-trino-minio-hive-hive-metastore-1 exited with code 1

how can solve this problem?
@fithisux
Copy link
Owner

fithisux commented Apr 3, 2023

Hi @MammadTavakoli , which OS are you using? I tested on Intel Mac.

@MammadTavakoli
Copy link
Author

MammadTavakoli commented Apr 3, 2023 •
edited
Loading

Hi @fithisux . Thanks for replying.
I use debian.

@fithisux
Copy link
Owner

fithisux commented Apr 3, 2023

OK here with Docker Desktop it seems to work fine. But .... I suspect collima + docker should not work.

So I think the issue is about permission issues.

How do you run docker?

@fithisux
Copy link
Owner

fithisux commented Apr 3, 2023

I think your issue is here
https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html#setting-the-right-airflow-user

@fithisux
Copy link
Owner

fithisux commented Apr 3, 2023

Here you can find more : https://mydeveloperplanet.com/2022/10/19/docker-files-and-volumes-permission-denied/

@fithisux
Copy link
Owner

fithisux commented Apr 3, 2023

I need to try to find a way to run it with collima. If I succeed I will post here.

@MammadTavakoli
Copy link
Author

OK here with Docker Desktop it seems to work fine. But .... I suspect collima + docker should not work.

So I think the issue is about permission issues.

How do you run docker?

I use sudo docker compose up for running.

@Antony-Jia
Copy link

I met the same question.
I found in the new docker /user/hive/tmp is /usr/hive/tmp
You need replace all.

@fithisux
Copy link
Owner

fithisux commented Oct 4, 2023 via email

@fithisux
Copy link
Owner

fithisux commented Oct 4, 2023 •
edited
Loading

@MammadTavakoli @Antony-Jia

Is my latest commit solving your issues? Use README to start/stop.

@Antony-Jia
Copy link

@MammadTavakoli @Antony-Jia

Is my latest commit solving your issues? Use README to start/stop.

Thank you for this repo and I had ran it right before you commit.

@fithisux
Copy link
Owner

fithisux commented Oct 8, 2023

@Antony-Jia ,

so do you verify the issue is fixed?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@fithisux @MammadTavakoli @Antony-Jia