0% found this document useful (0 votes)
60 views

How To Save Namespace and Perform Checkpoint

The document describes how to save the namespace on the namenode and perform a checkpoint on the secondary namenode in Hadoop. It involves putting the namenode in safe mode, saving the namespace, leaving safe mode, and then forcing a checkpoint operation on the secondary namenode after renaming the checkpoint directory.
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
60 views

How To Save Namespace and Perform Checkpoint

The document describes how to save the namespace on the namenode and perform a checkpoint on the secondary namenode in Hadoop. It involves putting the namenode in safe mode, saving the namespace, leaving safe mode, and then forcing a checkpoint operation on the secondary namenode after renaming the checkpoint directory.
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 11

How to save namespace and perform

checkpoint
Save namespace on namenode and perform checkpoint on secondary namenode.

Namenode

Enter safe mode.

$ sudo -u hadoop -i hdfs dfsadmin -safemode enter


Safe mode is ON

Ensure that safe mode is active.

$ sudo -u hadoop -i hdfs dfsadmin -safemode get


Safe mode is ON

Save current namespace into storage directories and reset edits log.

$ sudo -u hadoop -i hdfs dfsadmin -saveNamespace


Save namespace successful

Leave safe mode.

$ sudo -u hadoop -i hdfs dfsadmin -safemode leave


Safe mode is OFF

Inspect namenode logs.

2021-06-08 23:30:25,296 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe


mode is ON.
It was turned on manually. Use "hdfs dfsadmin -safemode leave" to turn safe
mode off.
2021-06-08 23:30:25,296 INFO org.apache.hadoop.hdfs.server.namenode.FSImage:
Save namespace ...
2021-06-08 23:30:25,296 INFO
org.apache.hadoop.hdfs.server.namenode.FSEditLog: Ending log segment 76693,
76693
2021-06-08 23:30:25,297 INFO
org.apache.hadoop.hdfs.server.namenode.FSEditLog: Number of transactions: 2
Total time for transactions(ms): 0 Number of transactions batched in Syncs:
76692 Number of syncs: 3 SyncTimes(ms): 18
2021-06-08 23:30:25,298 INFO
org.apache.hadoop.hdfs.server.namenode.FileJournalManager: Finalizing edits
file
/opt/hadoop/local_data/namenode/current/edits_inprogress_0000000000000076693
-> /opt/hadoop/local_data/namenode/current/edits_0000000000000076693-
0000000000000076694
2021-06-08 23:30:25,334 INFO
org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf: Saving image
file /opt/hadoop/local_data/namenode/current/fsimage.ckpt_0000000000000076694
using no compression
2021-06-08 23:30:25,492 INFO
org.apache.hadoop.hdfs.server.namenode.FSImageFormatProtobuf: Image file
/opt/hadoop/local_data/namenode/current/fsimage.ckpt_0000000000000076694 of
size 765058 bytes saved in 0 seconds .
2021-06-08 23:30:25,509 INFO
org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Going to
retain 2 images with txid >= 76675
2021-06-08 23:30:25,509 INFO
org.apache.hadoop.hdfs.server.namenode.NNStorageRetentionManager: Purging old
image
FSImageFile(file=/opt/hadoop/local_data/namenode/current/fsimage_000000000000
0076671, cpktTxId=0000000000000076671)
2021-06-08 23:30:25,568 INFO
org.apache.hadoop.hdfs.server.namenode.FSEditLog: Starting log segment at
76695
2021-06-08 23:30:25,592 INFO
org.apache.hadoop.hdfs.server.namenode.FSNamesystem: New namespace image has
been created
2021-06-08 23:30:31,286 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Leaving safe mode after 1031 secs
2021-06-08 23:30:31,286 INFO org.apache.hadoop.hdfs.StateChange: STATE*
Network topology has 1 racks and 3 datanodes
2021-06-08 23:30:31,286 INFO org.apache.hadoop.hdfs.StateChange: STATE*
UnderReplicatedBlocks has 0 blocks

Secondary namenode

Determine checkpoint directory.

$ hdfs getconf -confKey dfs.namenode.checkpoint.dir


/opt/hadoop/local_data/secondarynamenode

Stop secondary namenode.

$ systemctl stop hadoop-secondarynamenode.service

Rename current checkpoint directory.

$ mv /opt/hadoop/local_data/secondarynamenode
/opt/hadoop/local_data/secondarynamenode.$(date +"%Y%m%d_%H%M")

Force checkpoint operation.

$ sudo -u hadoop -i hdfs secondarynamenode -checkpoint force


2021-06-08 23:38:42,104 INFO namenode.SecondaryNameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting SecondaryNameNode
STARTUP_MSG: host = secondarynamenode/192.168.8.171
STARTUP_MSG: args = [-checkpoint, force]
STARTUP_MSG: version = 3.2.2
STARTUP_MSG: classpath = /opt/hadoop/hadoop-
3.2.2/etc/hadoop:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jsr305-
3.0.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/commons-io-
2.5.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/paranamer-
2.3.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerb-simplekdc-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jetty-security-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/curator-recipes-2.13.0.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jersey-core-1.19.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jsr311-api-1.1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/gson-2.2.4.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/slf4j-api-1.7.25.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/avro-1.7.7.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/commons-cli-1.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jettison-1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jackson-databind-
2.9.10.4.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerb-admin-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jackson-core-
2.9.10.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerb-common-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerb-client-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/commons-lang3-
3.7.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/commons-beanutils-
1.9.4.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/asm-
5.0.4.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/netty-
3.10.6.Final.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/json-smart-
2.3.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/snappy-java-
1.0.5.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/commons-text-
1.4.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/stax2-api-
3.1.4.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerby-xdr-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jackson-core-asl-
1.9.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jaxb-api-
2.2.11.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/zookeeper-
3.4.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/log4j-
1.2.17.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/dnsjava-
2.1.7.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jersey-json-
1.19.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jul-to-slf4j-
1.7.25.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/nimbus-jose-jwt-
7.9.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jetty-xml-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jetty-
http-9.4.20.v20190813.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/kerb-crypto-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/j2objc-annotations-1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/httpclient-4.5.13.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jersey-server-1.19.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/animal-sniffer-annotations-
1.17.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerby-asn1-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jetty-webapp-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerby-
util-1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/commons-
collections-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jersey-servlet-1.19.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/commons-configuration2-
2.1.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jackson-jaxrs-
1.9.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerby-config-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/checker-qual-
2.5.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/hadoop-auth-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jetty-server-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerb-
util-1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/metrics-core-
3.2.4.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/slf4j-log4j12-
1.7.25.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jetty-util-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jackson-mapper-asl-
1.9.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jackson-
annotations-2.9.10.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/guava-27.0-jre.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jsch-0.1.55.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/kerb-server-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/commons-net-3.6.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/commons-math3-3.1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/jcip-annotations-1.0-1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/htrace-core4-4.1.0-
incubating.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/commons-
compress-1.19.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jsp-api-
2.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/curator-framework-
2.13.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/token-provider-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/accessors-smart-
1.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/audience-
annotations-0.5.0.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/failureaccess-1.0.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/kerb-core-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/woodstox-core-5.0.3.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/listenablefuture-9999.0-empty-to-avoid-
conflict-with-guava.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/error_prone_annotations-
2.2.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/commons-codec-
1.11.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/hadoop-annotations-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerby-pkix-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/kerb-identity-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/protobuf-java-
2.5.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/httpcore-
4.4.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/re2j-
1.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jetty-servlet-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jetty-
io-9.4.20.v20190813.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/common/lib/javax.activation-api-
1.2.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/commons-logging-
1.1.3.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/jackson-xc-
1.9.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/lib/curator-client-
2.13.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/hadoop-common-3.2.2-
tests.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/hadoop-nfs-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/hadoop-kms-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/common/hadoop-common-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jsr305-3.0.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/commons-io-2.5.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/paranamer-2.3.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/kerb-simplekdc-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jetty-security-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/curator-
recipes-2.13.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jetty-util-
ajax-9.4.20.v20190813.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/json-simple-1.1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jersey-core-1.19.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jsr311-api-1.1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jaxb-impl-2.2.3-1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/gson-2.2.4.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/avro-1.7.7.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/commons-cli-1.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jettison-1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jackson-databind-2.9.10.4.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/kerb-admin-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jackson-core-2.9.10.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/kerb-common-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/kerb-client-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/commons-lang3-3.7.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/leveldbjni-all-1.8.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/commons-beanutils-1.9.4.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/asm-5.0.4.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/netty-3.10.6.Final.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/json-smart-2.3.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/snappy-java-1.0.5.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/commons-text-1.4.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/stax2-api-3.1.4.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/kerby-xdr-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jackson-core-asl-1.9.13.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jaxb-api-2.2.11.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/zookeeper-3.4.13.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/netty-all-4.1.48.Final.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/log4j-1.2.17.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/dnsjava-2.1.7.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jersey-json-1.19.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/okhttp-2.7.5.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/nimbus-jose-jwt-7.9.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jetty-xml-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jetty-
http-9.4.20.v20190813.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/kerb-crypto-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/j2objc-annotations-1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/httpclient-4.5.13.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jersey-server-1.19.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/animal-sniffer-annotations-
1.17.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/kerby-asn1-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jetty-webapp-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/kerby-
util-1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/okio-
1.6.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/commons-collections-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jersey-servlet-
1.19.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/commons-
configuration2-2.1.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jackson-jaxrs-1.9.13.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/kerby-config-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/checker-qual-2.5.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/hadoop-auth-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/jetty-server-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/kerb-
util-1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jetty-util-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jackson-
mapper-asl-1.9.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jackson-
annotations-2.9.10.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/guava-
27.0-jre.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jsch-
0.1.55.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/commons-daemon-
1.0.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/kerb-server-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/commons-net-
3.6.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/commons-math3-
3.1.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jcip-annotations-
1.0-1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/htrace-core4-4.1.0-
incubating.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/commons-
compress-1.19.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/curator-
framework-2.13.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/token-
provider-1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/accessors-
smart-1.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/audience-
annotations-0.5.0.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/javax.servlet-api-3.1.0.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/failureaccess-1.0.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/kerb-core-1.0.1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/woodstox-core-5.0.3.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/listenablefuture-9999.0-empty-to-avoid-conflict-
with-guava.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/error_prone_annotations-
2.2.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/commons-codec-
1.11.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/hadoop-annotations-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/kerby-pkix-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/kerb-identity-
1.0.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/protobuf-java-
2.5.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/httpcore-
4.4.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/re2j-
1.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jetty-servlet-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jetty-io-
9.4.20.v20190813.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/hdfs/lib/javax.activation-api-
1.2.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/commons-logging-
1.1.3.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/jackson-xc-
1.9.13.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/lib/curator-client-
2.13.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-native-
client-3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-
3.2.2-tests.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-
client-3.2.2-tests.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-
hdfs-nfs-3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-
rbf-3.2.2-tests.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-
httpfs-3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-rbf-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-client-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/hdfs/hadoop-hdfs-native-
client-3.2.2-tests.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/mapreduce/lib/hamcrest-core-1.3.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/mapreduce/lib/junit-4.11.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-
client-nativetask-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-client-app-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-
client-jobclient-3.2.2-tests.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-
client-jobclient-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-client-uploader-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-
client-hs-plugins-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-client-core-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-mapreduce-
examples-3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/mapreduce/hadoop-
mapreduce-client-common-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/json-
io-2.5.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/jackson-jaxrs-
base-2.9.10.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/snakeyaml-
1.16.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/javax.inject-
1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/HikariCP-java7-
2.4.12.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/ehcache-
3.3.1.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/bcprov-jdk15on-
1.60.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/jersey-client-
1.19.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/fst-
2.50.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/objenesis-
1.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/mssql-jdbc-
6.2.1.jre7.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/swagger-
annotations-1.5.4.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/jackson-
jaxrs-json-provider-2.9.10.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/lib/guice-servlet-4.0.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/lib/jackson-module-jaxb-annotations-
2.9.10.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/jersey-guice-
1.19.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/metrics-core-
3.2.4.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/java-util-
1.9.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/bcpkix-jdk15on-
1.60.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/aopalliance-
1.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/guice-
4.0.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/lib/geronimo-
jcache_1.0_spec-1.0-alpha-1.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/hadoop-yarn-client-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/hadoop-yarn-server-applicationhistoryservice-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-
applications-distributedshell-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/hadoop-yarn-server-common-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-
applications-unmanaged-am-launcher-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-server-web-
proxy-3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-
registry-3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-
services-api-3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-
yarn-server-nodemanager-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/hadoop-yarn-common-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/hadoop-yarn-server-sharedcachemanager-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-api-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-server-
router-3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-
server-timeline-pluginstorage-3.2.2.jar:/opt/hadoop/hadoop-
3.2.2/share/hadoop/yarn/hadoop-yarn-services-core-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-submarine-
3.2.2.jar:/opt/hadoop/hadoop-3.2.2/share/hadoop/yarn/hadoop-yarn-server-
tests-3.2.2.jar
STARTUP_MSG: build = Unknown -r 7a3bc90b05f257c8ace2f76d74264906f0f7a932;
compiled by 'hexiaoqiao' on 2021-01-03T09:26Z
STARTUP_MSG: java = 11.0.11
************************************************************/
2021-06-08 23:38:42,128 INFO namenode.SecondaryNameNode: registered UNIX
signal handlers for [TERM, HUP, INT]
2021-06-08 23:38:42,678 INFO impl.MetricsConfig: Loaded properties from
hadoop-metrics2.properties
2021-06-08 23:38:42,856 INFO impl.MetricsSystemImpl: Scheduled Metric
snapshot period at 10 second(s).
2021-06-08 23:38:42,856 INFO impl.MetricsSystemImpl: SecondaryNameNode
metrics system started
2021-06-08 23:38:43,427 INFO common.Util: Assuming 'file' scheme for path
/opt/hadoop/local_data/secondarynamenode in configuration.
2021-06-08 23:38:43,438 INFO common.Util: Assuming 'file' scheme for path
/opt/hadoop/local_data/secondarynamenode in configuration.
2021-06-08 23:38:43,505 INFO namenode.FSEditLog: Edit logging is async:true
2021-06-08 23:38:43,535 INFO common.Storage: Lock on
/opt/hadoop/local_data/secondarynamenode/in_use.lock acquired by nodename
10567@secondarynamenode
2021-06-08 23:38:43,570 INFO namenode.FSNamesystem: KeyProvider: null
2021-06-08 23:38:43,571 INFO namenode.FSNamesystem: fsLock is fair: true
2021-06-08 23:38:43,571 INFO namenode.FSNamesystem: Detailed lock hold time
metrics enabled: false
2021-06-08 23:38:43,582 INFO namenode.FSNamesystem: fsOwner =
hadoop (auth:SIMPLE)
2021-06-08 23:38:43,582 INFO namenode.FSNamesystem: supergroup =
supergroup
2021-06-08 23:38:43,582 INFO namenode.FSNamesystem: isPermissionEnabled =
true
2021-06-08 23:38:43,582 INFO namenode.FSNamesystem: HA Enabled: false
2021-06-08 23:38:43,627 INFO common.Util:
dfs.datanode.fileio.profiling.sampling.percentage set to 0. Disabling file IO
profiling
2021-06-08 23:38:43,633 INFO blockmanagement.DatanodeManager:
dfs.block.invalidate.limit: configured=1000, counted=60, effected=1000
2021-06-08 23:38:43,633 INFO blockmanagement.DatanodeManager:
dfs.namenode.datanode.registration.ip-hostname-check=true
2021-06-08 23:38:43,638 INFO blockmanagement.BlockManager:
dfs.namenode.startup.delay.block.deletion.sec is set to 000:00:00:00.000
2021-06-08 23:38:43,638 INFO blockmanagement.BlockManager: The block deletion
will start around 2021 Jun 08 23:38:43
2021-06-08 23:38:43,640 INFO util.GSet: Computing capacity for map BlocksMap
2021-06-08 23:38:43,640 INFO util.GSet: VM type = 64-bit
2021-06-08 23:38:43,641 INFO util.GSet: 2.0% max memory 247.5 MB = 4.9 MB
2021-06-08 23:38:43,641 INFO util.GSet: capacity = 2^19 = 524288 entries
2021-06-08 23:38:43,653 INFO blockmanagement.BlockManager: Storage policy
satisfier is disabled
2021-06-08 23:38:43,653 INFO blockmanagement.BlockManager:
dfs.block.access.token.enable = false
2021-06-08 23:38:43,667 INFO Configuration.deprecation: No unit for
dfs.namenode.safemode.extension(30000) assuming MILLISECONDS
2021-06-08 23:38:43,668 INFO blockmanagement.BlockManagerSafeMode:
dfs.namenode.safemode.threshold-pct = 0.9990000128746033
2021-06-08 23:38:43,668 INFO blockmanagement.BlockManagerSafeMode:
dfs.namenode.safemode.min.datanodes = 0
2021-06-08 23:38:43,668 INFO blockmanagement.BlockManagerSafeMode:
dfs.namenode.safemode.extension = 30000
2021-06-08 23:38:43,669 INFO blockmanagement.BlockManager: defaultReplication
= 3
2021-06-08 23:38:43,669 INFO blockmanagement.BlockManager: maxReplication
= 512
2021-06-08 23:38:43,669 INFO blockmanagement.BlockManager: minReplication
= 1
2021-06-08 23:38:43,669 INFO blockmanagement.BlockManager:
maxReplicationStreams = 2
2021-06-08 23:38:43,669 INFO blockmanagement.BlockManager:
redundancyRecheckInterval = 3000ms
2021-06-08 23:38:43,669 INFO blockmanagement.BlockManager:
encryptDataTransfer = false
2021-06-08 23:38:43,669 INFO blockmanagement.BlockManager: maxNumBlocksToLog
= 1000
2021-06-08 23:38:43,696 INFO namenode.FSDirectory: GLOBAL serial map: bits=29
maxEntries=536870911
2021-06-08 23:38:43,696 INFO namenode.FSDirectory: USER serial map: bits=24
maxEntries=16777215
2021-06-08 23:38:43,696 INFO namenode.FSDirectory: GROUP serial map: bits=24
maxEntries=16777215
2021-06-08 23:38:43,696 INFO namenode.FSDirectory: XATTR serial map: bits=24
maxEntries=16777215
2021-06-08 23:38:43,704 INFO util.GSet: Computing capacity for map INodeMap
2021-06-08 23:38:43,704 INFO util.GSet: VM type = 64-bit
2021-06-08 23:38:43,704 INFO util.GSet: 1.0% max memory 247.5 MB = 2.5 MB
2021-06-08 23:38:43,704 INFO util.GSet: capacity = 2^18 = 262144 entries
2021-06-08 23:38:43,709 INFO namenode.FSDirectory: ACLs enabled? false
2021-06-08 23:38:43,709 INFO namenode.FSDirectory: POSIX ACL inheritance
enabled? true
2021-06-08 23:38:43,709 INFO namenode.FSDirectory: XAttrs enabled? true
2021-06-08 23:38:43,710 INFO namenode.NameNode: Caching file names occurring
more than 10 times
2021-06-08 23:38:43,713 INFO snapshot.SnapshotManager: Loaded config
captureOpenFiles: false, skipCaptureAccessTimeOnlyChange: false,
snapshotDiffAllowSnapRootDescendant: true, maxSnapshotLimit: 65536
2021-06-08 23:38:43,715 INFO snapshot.SnapshotManager: SkipList is disabled
2021-06-08 23:38:43,725 INFO util.GSet: Computing capacity for map
cachedBlocks
2021-06-08 23:38:43,725 INFO util.GSet: VM type = 64-bit
2021-06-08 23:38:43,725 INFO util.GSet: 0.25% max memory 247.5 MB = 633.6 KB
2021-06-08 23:38:43,725 INFO util.GSet: capacity = 2^16 = 65536 entries
2021-06-08 23:38:43,732 INFO metrics.TopMetrics: NNTop conf:
dfs.namenode.top.window.num.buckets = 10
2021-06-08 23:38:43,734 INFO metrics.TopMetrics: NNTop conf:
dfs.namenode.top.num.users = 10
2021-06-08 23:38:43,734 INFO metrics.TopMetrics: NNTop conf:
dfs.namenode.top.windows.minutes = 1,5,25
2021-06-08 23:38:43,758 INFO namenode.SecondaryNameNode: Checkpoint Period
:3600 secs (60 min)
2021-06-08 23:38:43,759 INFO namenode.SecondaryNameNode: Log Size Trigger
:1000000 txns
2021-06-08 23:38:43,896 INFO namenode.SecondaryNameNode: Image has changed.
Downloading updated image from NN.
2021-06-08 23:38:43,920 INFO namenode.TransferFsImage: Opening connection to
http://namenode.example.org:9870/imagetransfer?getimage=1&txid=76694&storageI
nfo=-65:1373659126:1620683988326:CID-5d1164fe-f8a5-4982-a503-
096898971b41&bootstrapstandby=false
2021-06-08 23:38:43,986 INFO common.Util: Combined time for file download and
fsync to all disks took 0.03s. The file download took 0.03s at 29880.00 KB/s.
Synchronous (fsync) write to disk of
/opt/hadoop/local_data/secondarynamenode/current/fsimage.ckpt_000000000000007
6694 took 0.00s.
2021-06-08 23:38:43,986 INFO namenode.TransferFsImage: Downloaded file
fsimage.ckpt_0000000000000076694 size 765058 bytes.
2021-06-08 23:38:43,994 INFO namenode.TransferFsImage: Opening connection to
http://namenode.example.org:9870/imagetransfer?getedit=1&startTxId=76695&endT
xId=76695&storageInfo=-65:1373659126:1620683988326:CID-5d1164fe-f8a5-4982-
a503-096898971b41
2021-06-08 23:38:44,006 INFO common.Util: Combined time for file download and
fsync to all disks took 0.00s. The file download took 0.00s at 512000.00
KB/s. Synchronous (fsync) write to disk of
/opt/hadoop/local_data/secondarynamenode/current/edits_tmp_000000000000007669
5-0000000000000076695_0000000001312727778 took 0.00s.
2021-06-08 23:38:44,007 INFO namenode.TransferFsImage: Downloaded file
edits_tmp_0000000000000076695-0000000000000076695_0000000001312727778 size 0
bytes.
2021-06-08 23:38:44,007 INFO namenode.TransferFsImage: Opening connection to
http://namenode.example.org:9870/imagetransfer?getedit=1&startTxId=76696&endT
xId=76697&storageInfo=-65:1373659126:1620683988326:CID-5d1164fe-f8a5-4982-
a503-096898971b41
2021-06-08 23:38:44,013 INFO common.Util: Combined time for file download and
fsync to all disks took 0.00s. The file download took 0.00s at 0.00 KB/s.
Synchronous (fsync) write to disk of
/opt/hadoop/local_data/secondarynamenode/current/edits_tmp_000000000000007669
6-0000000000000076697_0000000001312727791 took 0.00s.
2021-06-08 23:38:44,013 INFO namenode.TransferFsImage: Downloaded file
edits_tmp_0000000000000076696-0000000000000076697_0000000001312727791 size 0
bytes.
2021-06-08 23:38:44,014 INFO namenode.TransferFsImage: Opening connection to
http://namenode.example.org:9870/imagetransfer?getedit=1&startTxId=76698&endT
xId=76699&storageInfo=-65:1373659126:1620683988326:CID-5d1164fe-f8a5-4982-
a503-096898971b41
2021-06-08 23:38:44,019 INFO common.Util: Combined time for file download and
fsync to all disks took 0.00s. The file download took 0.00s at 0.00 KB/s.
Synchronous (fsync) write to disk of
/opt/hadoop/local_data/secondarynamenode/current/edits_tmp_000000000000007669
8-0000000000000076699_0000000001312727798 took 0.00s.
2021-06-08 23:38:44,019 INFO namenode.TransferFsImage: Downloaded file
edits_tmp_0000000000000076698-0000000000000076699_0000000001312727798 size 0
bytes.
2021-06-08 23:38:44,102 INFO namenode.FSImageFormatPBINode: Loading 10962
INodes.
2021-06-08 23:38:44,322 INFO namenode.FSImageFormatProtobuf: Loaded FSImage
in 0 seconds.
2021-06-08 23:38:44,322 INFO namenode.FSImage: Loaded image for txid 76694
from
/opt/hadoop/local_data/secondarynamenode/current/fsimage_0000000000000076694
2021-06-08 23:38:44,323 INFO namenode.NameCache: initialized with 287 entries
10879 lookups
2021-06-08 23:38:44,339 INFO namenode.Checkpointer: Checkpointer about to
load edits from 3 stream(s).
2021-06-08 23:38:44,342 INFO namenode.FSImage: Reading
/opt/hadoop/local_data/secondarynamenode/current/edits_0000000000000076695-
0000000000000076695 expecting start txid #76695
2021-06-08 23:38:44,343 INFO namenode.FSImage: Start loading edits file
/opt/hadoop/local_data/secondarynamenode/current/edits_0000000000000076695-
0000000000000076695 maxTxnsToRead = 9223372036854775807
2021-06-08 23:38:44,386 INFO namenode.FSImage: Loaded 1 edits file(s) (the
last named
/opt/hadoop/local_data/secondarynamenode/current/edits_0000000000000076695-
0000000000000076695) of total size 1048576.0, total edits 1.0, total load
time 28.0 ms
2021-06-08 23:38:44,430 INFO namenode.FSImageFormatProtobuf: Saving image
file
/opt/hadoop/local_data/secondarynamenode/current/fsimage.ckpt_000000000000007
6699 using no compression
2021-06-08 23:38:44,618 INFO namenode.FSImageFormatProtobuf: Image file
/opt/hadoop/local_data/secondarynamenode/current/fsimage.ckpt_000000000000007
6699 of size 765058 bytes saved in 0 seconds .
2021-06-08 23:38:44,623 INFO namenode.FSImageTransactionalStorageInspector:
No version file in /opt/hadoop/local_data/secondarynamenode
2021-06-08 23:38:44,627 INFO namenode.FSImageTransactionalStorageInspector:
No version file in /opt/hadoop/local_data/secondarynamenode
2021-06-08 23:38:44,668 INFO namenode.TransferFsImage: Image Transfer timeout
configured to 60000 milliseconds
2021-06-08 23:38:44,672 INFO namenode.TransferFsImage: Sending fileName:
/opt/hadoop/local_data/secondarynamenode/current/fsimage_0000000000000076699,
fileSize: 765058. Sent total: 765058 bytes. Size of last segment intended to
send: -1 bytes.
2021-06-08 23:38:44,674 WARN namenode.SecondaryNameNode: Checkpoint done. New
Image Size: 765058
2021-06-08 23:38:44,688 INFO namenode.FSImage: FSImageSaver clean checkpoint:
txid=76699 when meet shutdown.
2021-06-08 23:38:44,688 INFO namenode.SecondaryNameNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down SecondaryNameNode at
secondarynamenode/192.168.8.171
************************************************************/

Start secondary namenode.

$ systemctl start hadoop-secondarynamenode.service

You might also like