Spark Unable to load native-hadoop library for your platform

Spark Unable to load native-hadoop library for your platform

Asked on January 12, 2019 in Apache-spark.
Add Comment


  • 2 Answer(s)

    The following steps will be useful solve the issue:

    • At first Hadoop binaries need to be downloaded
    • With the user,  the directory is unpacked.
    • For pointing that directory set HADOOP_HOME.
    • And $HADOOP_HOME/lib/native is added to LD_LIBRARY_PATH.
    Answered on January 12, 2019.
    Add Comment

    Alternatively the problem can be fixed by:

    • At first hadoop binary (link) is downloaded and place in home directory. When the different hadoop version is choosen and the next steps is changed accordingly.
    • Here the folder is unzipped in the home directory by using the following command. tar -zxvf hadoop_file_name
    • And export HADOOP_HOME=~/hadoop-2.8.0 is added to the .bashrc file. After try by opening a new terminal.
    Answered on January 12, 2019.
    Add Comment


  • Your Answer

    By posting your answer, you agree to the privacy policy and terms of service.