Skip to content

Hadoop build with native snappy support for MacOS with M1 chip for hadoop version >= 3.x and <= 3.3 #8

@nikhil-ddu

Description

@nikhil-ddu

Thanks for creating ARM folder for builds for M1/M2 chip. Can you add support for any hadoop version between 3.0 to 3.3?
For example, I'm using 3.1.1 version and my code fails at

https://github.com/apache/hadoop/blob/branch-3.1.1/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/NativeCodeLoader.java#L80

with following error
org.apache.hadoop.hbase.DoNotRetryIOException: java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support. Set hbase.table.sanity.checks to false at conf or table descriptor if you want to bypass sanity checks

I tried to build hadoop locally with require.snappy flag but it fails because of different issues.
It would be much helpful and appreciated if you can add native snappy support.

Thank you

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions