Skip to content

Master failed to start with hadoop dependency changes #13490

@LuQQiu

Description

Alluxio Version:
Master with commit from #12783

Describe the bug
In a sanity check cluster with Alluxio cluster + HDFS as root UFS,
when starting the Alluxio master, error

Caused by: java.lang.IllegalArgumentException: Unable to create an UnderFileSystem instance for path: hdfs://SanityMicrobench-masters-1:9000/alluxio_storage
        at alluxio.underfs.UnderFileSystem$Factory.create(UnderFileSystem.java:122)
        at alluxio.underfs.AbstractUfsManager.getOrAdd(AbstractUfsManager.java:132)
        at alluxio.underfs.AbstractUfsManager.lambda$addMount$0(AbstractUfsManager.java:171)
        at alluxio.underfs.UfsManager$UfsClient.acquireUfsResource(UfsManager.java:61)
        at alluxio.master.file.DefaultFileSystemMaster.getRootMountInfo(DefaultFileSystemMaster.java:502)
        at alluxio.master.file.DefaultFileSystemMaster.<init>(DefaultFileSystemMaster.java:444)
        at alluxio.master.file.DefaultFileSystemMaster.<init>(DefaultFileSystemMaster.java:425)
        at alluxio.master.file.FileSystemMasterFactory.create(FileSystemMasterFactory.java:51)
        at alluxio.master.file.FileSystemMasterFactory.create(FileSystemMasterFactory.java:28)
        at alluxio.master.MasterUtils.lambda$createMasters$0(MasterUtils.java:49)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
        Suppressed: java.lang.NoClassDefFoundError: org/apache/commons/configuration/Configuration
                at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<init>(DefaultMetricsSystem.java:38)
                at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.<clinit>(DefaultMetricsSystem.java:36)
                at org.apache.hadoop.security.UserGroupInformation$UgiMetrics.create(UserGroupInformation.java:121)
                at org.apache.hadoop.security.UserGroupInformation.<clinit>(UserGroupInformation.java:237)
                at alluxio.underfs.hdfs.HdfsUnderFileSystem.<init>(HdfsUnderFileSystem.java:150)
                at alluxio.underfs.hdfs.HdfsUnderFileSystem.createInstance(HdfsUnderFileSystem.java:108)
                at alluxio.underfs.hdfs.HdfsUnderFileSystemFactory.create(HdfsUnderFileSystemFactory.java:43)
                at alluxio.underfs.UnderFileSystem$Factory.create(UnderFileSystem.java:107)
                ... 13 more
        Caused by: java.lang.ClassNotFoundException: org.apache.commons.configuration.Configuration
                at java.lang.ClassLoader.findClass(ClassLoader.java:523)
                at alluxio.extensions.ExtensionsClassLoader$DefaultClassLoader.findClass(ExtensionsClassLoader.java:43)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:418)
                at alluxio.extensions.ExtensionsClassLoader$DefaultClassLoader.loadClass(ExtensionsClassLoader.java:53)
                at alluxio.extensions.ExtensionsClassLoader.loadClass(ExtensionsClassLoader.java:84)
                at java.lang.ClassLoader.loadClass(ClassLoader.java:351)

shown and master failed to come up, will create an issue for that
To Reproduce
Steps to reproduce the behavior (as minimally and precisely as possible)

Expected behavior
A clear and concise description of what you expected to happen.

Urgency
Describe the impact and urgency of the bug.

Additional context
Add any other context about the problem here.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

    Labels

    priority-mediumstaleThe PR/Issue does not have recent activities and will be closed automaticallytype-bugThis issue is about a bug

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions