Hadoop start-all.cmd command : datanode shutting down

I am trying to install hadoop in my windows 10

Reference : https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10

Hadoop start-all.cmd command start namenode , resourceManager and nodeManager successfully but datanode not started

Error ::

checker.StorageLocationChecker: Exception checking StorageLocation [DISK]file:/C:/hadoop-3.1.1/data/datanode

java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;

        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)

        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:455)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:796)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:710)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:678)

        at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:233)

        at org.apache.hadoop.util.DiskChecker.checkDirInternal(DiskChecker.java:141)

        at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:116)

        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:239)

        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:52)

        at org.apache.hadoop.hdfs.server.datanode.checker.ThrottledAsyncChecker$1.call(ThrottledAsyncChecker.java:142)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

2018-12-28 11:19:03,023 ERROR datanode.DataNode: Exception in secureMain

org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

        at org.apache.hadoop.hdfs.server.datanode.checker.StorageLocationChecker.check(StorageLocationChecker.java:220)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2762)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)

2018-12-28 11:19:03,031 INFO util.ExitUtil: Exiting with status 1: org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

2018-12-28 11:19:03,079 INFO datanode.DataNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down DataNode at BHARTI/192.168.2.161

************************************************************/

edited Dec 28 '18 at 18:13

cricket_007

79.6k1142110

asked Dec 28 '18 at 6:02

Bharti Ladumor

353211

This question has an open bounty worth +50
reputation from Bharti Ladumor ending in 6 days.

Looking for an answer drawing from credible and/or official sources.

i want to install hadoop in my windows machine, please provide solution if anyone knows

Note: The blog you are reading uses Hadoop 2.8, and you are using Hadoop 3.1.1, which has differernces in how services are configured and ran
– cricket_007
Dec 28 '18 at 18:12

@cricket_007 i changed by hadoop version than also i got same error
– Bharti Ladumor
21 hours ago

add a comment |

I am trying to install hadoop in my windows 10

Reference : https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10

Hadoop start-all.cmd command start namenode , resourceManager and nodeManager successfully but datanode not started

Error ::

checker.StorageLocationChecker: Exception checking StorageLocation [DISK]file:/C:/hadoop-3.1.1/data/datanode

java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;

        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)

        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:455)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:796)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:710)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:678)

        at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:233)

        at org.apache.hadoop.util.DiskChecker.checkDirInternal(DiskChecker.java:141)

        at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:116)

        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:239)

        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:52)

        at org.apache.hadoop.hdfs.server.datanode.checker.ThrottledAsyncChecker$1.call(ThrottledAsyncChecker.java:142)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

2018-12-28 11:19:03,023 ERROR datanode.DataNode: Exception in secureMain

org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

        at org.apache.hadoop.hdfs.server.datanode.checker.StorageLocationChecker.check(StorageLocationChecker.java:220)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2762)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)

2018-12-28 11:19:03,031 INFO util.ExitUtil: Exiting with status 1: org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

2018-12-28 11:19:03,079 INFO datanode.DataNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down DataNode at BHARTI/192.168.2.161

************************************************************/

edited Dec 28 '18 at 18:13

cricket_007

79.6k1142110

asked Dec 28 '18 at 6:02

Bharti Ladumor

353211

This question has an open bounty worth +50
reputation from Bharti Ladumor ending in 6 days.

Looking for an answer drawing from credible and/or official sources.

i want to install hadoop in my windows machine, please provide solution if anyone knows

Note: The blog you are reading uses Hadoop 2.8, and you are using Hadoop 3.1.1, which has differernces in how services are configured and ran
– cricket_007
Dec 28 '18 at 18:12

@cricket_007 i changed by hadoop version than also i got same error
– Bharti Ladumor
21 hours ago

add a comment |

I am trying to install hadoop in my windows 10

Reference : https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10

Hadoop start-all.cmd command start namenode , resourceManager and nodeManager successfully but datanode not started

Error ::

checker.StorageLocationChecker: Exception checking StorageLocation [DISK]file:/C:/hadoop-3.1.1/data/datanode

java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;

        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)

        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:455)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:796)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:710)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:678)

        at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:233)

        at org.apache.hadoop.util.DiskChecker.checkDirInternal(DiskChecker.java:141)

        at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:116)

        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:239)

        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:52)

        at org.apache.hadoop.hdfs.server.datanode.checker.ThrottledAsyncChecker$1.call(ThrottledAsyncChecker.java:142)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

2018-12-28 11:19:03,023 ERROR datanode.DataNode: Exception in secureMain

org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

        at org.apache.hadoop.hdfs.server.datanode.checker.StorageLocationChecker.check(StorageLocationChecker.java:220)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2762)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)

2018-12-28 11:19:03,031 INFO util.ExitUtil: Exiting with status 1: org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

2018-12-28 11:19:03,079 INFO datanode.DataNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down DataNode at BHARTI/192.168.2.161

************************************************************/

edited Dec 28 '18 at 18:13

cricket_007

79.6k1142110

asked Dec 28 '18 at 6:02

Bharti Ladumor

353211

I am trying to install hadoop in my windows 10

Reference : https://github.com/MuhammadBilalYar/Hadoop-On-Window/wiki/Step-by-step-Hadoop-2.8.0-installation-on-Window-10

Hadoop start-all.cmd command start namenode , resourceManager and nodeManager successfully but datanode not started

Error ::

checker.StorageLocationChecker: Exception checking StorageLocation [DISK]file:/C:/hadoop-3.1.1/data/datanode

java.lang.UnsatisfiedLinkError: org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Ljava/lang/String;)Lorg/apache/hadoop/io/nativeio/NativeIO$POSIX$Stat;

        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.stat(Native Method)

        at org.apache.hadoop.io.nativeio.NativeIO$POSIX.getStat(NativeIO.java:455)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfoByNativeIO(RawLocalFileSystem.java:796)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.loadPermissionInfo(RawLocalFileSystem.java:710)

        at org.apache.hadoop.fs.RawLocalFileSystem$DeprecatedRawLocalFileStatus.getPermission(RawLocalFileSystem.java:678)

        at org.apache.hadoop.util.DiskChecker.mkdirsWithExistsAndPermissionCheck(DiskChecker.java:233)

        at org.apache.hadoop.util.DiskChecker.checkDirInternal(DiskChecker.java:141)

        at org.apache.hadoop.util.DiskChecker.checkDir(DiskChecker.java:116)

        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:239)

        at org.apache.hadoop.hdfs.server.datanode.StorageLocation.check(StorageLocation.java:52)

        at org.apache.hadoop.hdfs.server.datanode.checker.ThrottledAsyncChecker$1.call(ThrottledAsyncChecker.java:142)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

        at java.lang.Thread.run(Thread.java:748)

2018-12-28 11:19:03,023 ERROR datanode.DataNode: Exception in secureMain

org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

        at org.apache.hadoop.hdfs.server.datanode.checker.StorageLocationChecker.check(StorageLocationChecker.java:220)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2762)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2677)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2719)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2863)

        at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2887)

2018-12-28 11:19:03,031 INFO util.ExitUtil: Exiting with status 1: org.apache.hadoop.util.DiskChecker$DiskErrorException: Too many failed volumes - current valid volumes: 0, volumes configured: 1, volumes failed: 1, volume failures tolerated: 0

2018-12-28 11:19:03,079 INFO datanode.DataNode: SHUTDOWN_MSG:

/************************************************************

SHUTDOWN_MSG: Shutting down DataNode at BHARTI/192.168.2.161

************************************************************/

windows hadoop namenode datanode

edited Dec 28 '18 at 18:13

cricket_007

79.6k1142110

asked Dec 28 '18 at 6:02

Bharti Ladumor

353211

edited Dec 28 '18 at 18:13

cricket_007

79.6k1142110

asked Dec 28 '18 at 6:02

Bharti Ladumor

353211

edited Dec 28 '18 at 18:13

cricket_007

79.6k1142110

edited Dec 28 '18 at 18:13

cricket_007

79.6k1142110

edited Dec 28 '18 at 18:13

cricket_007

79.6k1142110

asked Dec 28 '18 at 6:02

Bharti Ladumor

353211

asked Dec 28 '18 at 6:02

Bharti Ladumor

353211

asked Dec 28 '18 at 6:02

Bharti Ladumor

353211

This question has an open bounty worth +50
reputation from Bharti Ladumor ending in 6 days.

Looking for an answer drawing from credible and/or official sources.

i want to install hadoop in my windows machine, please provide solution if anyone knows

This question has an open bounty worth +50
reputation from Bharti Ladumor ending in 6 days.

Looking for an answer drawing from credible and/or official sources.

i want to install hadoop in my windows machine, please provide solution if anyone knows

Note: The blog you are reading uses Hadoop 2.8, and you are using Hadoop 3.1.1, which has differernces in how services are configured and ran
– cricket_007
Dec 28 '18 at 18:12

@cricket_007 i changed by hadoop version than also i got same error
– Bharti Ladumor
21 hours ago

add a comment |

Note: The blog you are reading uses Hadoop 2.8, and you are using Hadoop 3.1.1, which has differernces in how services are configured and ran
– cricket_007
Dec 28 '18 at 18:12

@cricket_007 i changed by hadoop version than also i got same error
– Bharti Ladumor
21 hours ago

Note: The blog you are reading uses Hadoop 2.8, and you are using Hadoop 3.1.1, which has differernces in how services are configured and ran
– cricket_007
Dec 28 '18 at 18:12

@cricket_007 i changed by hadoop version than also i got same error
– Bharti Ladumor
21 hours ago

add a comment |

0

active

oldest

votes

Your Answer

StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});

}
});

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53954308%2fhadoop-start-all-cmd-command-datanode-shutting-down%23new-answer', 'question_page');
}
);

Post as a guest

Name

Required, but never shown

0

active

oldest

votes

0

active

oldest

votes

draft saved

draft discarded

Thanks for contributing an answer to Stack Overflow!

Please be sure to answer the question. Provide details and share your research!

But avoid …

Asking for help, clarification, or responding to other answers.

Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.

Some of your past answers have not been well-received, and you're in danger of being blocked from answering.

Please pay close attention to the following guidance:

Please be sure to answer the question. Provide details and share your research!

But avoid …

Asking for help, clarification, or responding to other answers.

Making statements based on opinion; back them up with references or personal experience.

To learn more, see our tips on writing great answers.

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Post as a guest

Name

Required, but never shown

Name

Required, but never shown

Name

Required, but never shown

This page is only for reference, If you need detailed information, please check here

搜尋此網誌

Bdtjtk