You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/hdinsight/hdinsight-troubleshoot-hive.md
+26-33Lines changed: 26 additions & 33 deletions
Original file line number
Diff line number
Diff line change
@@ -3,20 +3,18 @@ title: Troubleshoot Hive by using Azure HDInsight
3
3
description: Get answers to common questions about working with Apache Hive and Azure HDInsight.
4
4
keywords: Azure HDInsight, Hive, FAQ, troubleshooting guide, common questions
5
5
ms.service: hdinsight
6
-
author: dharmeshkakadia
7
-
ms.author: dkakadia
8
-
ms.topic: conceptual
9
-
ms.date: 11/2/2017
6
+
author: hrasheed-msft
7
+
ms.author: hrasheed
8
+
ms.topic: troubleshooting
9
+
ms.date: 08/15/2019
10
10
---
11
11
12
12
# Troubleshoot Apache Hive by using Azure HDInsight
13
13
14
14
Learn about the top questions and their resolutions when working with Apache Hive payloads in Apache Ambari.
15
15
16
-
17
16
## How do I export a Hive metastore and import it on another cluster?
18
17
19
-
20
18
### Resolution steps
21
19
22
20
1. Connect to the HDInsight cluster by using a Secure Shell (SSH) client. For more information, see [Additional reading](#additional-reading-end).
@@ -31,17 +29,16 @@ Learn about the top questions and their resolutions when working with Apache Hiv
31
29
32
30
3. Copy the file alltables.sql to the new HDInsight cluster, and then run the following command:
33
31
34
-
```apache
35
-
hive -f alltables.sql
36
-
```
32
+
```apache
33
+
hive -f alltables.sql
34
+
```
37
35
38
-
The code in the resolution steps assumes that data paths on the new cluster are the same as the data paths on the old cluster. If the data paths are different, you can manually edit the generated alltables.sql file to reflect any changes.
36
+
The code in the resolution steps assumes that data paths on the new cluster are the same as the data paths on the old cluster. If the data paths are different, you can manually edit the generated `alltables.sql` file to reflect any changes.
39
37
40
38
### Additional reading
41
39
42
40
- [Connect to an HDInsight cluster by using SSH](hdinsight-hadoop-linux-use-ssh-unix.md)
43
41
44
-
45
42
## How do I locate Hive logs on a cluster?
46
43
47
44
### Resolution steps
@@ -51,34 +48,33 @@ The code in the resolution steps assumes that data paths on the new cluster are
51
48
2. To view Hive client logs, use the following command:
52
49
53
50
```apache
54
-
/tmp/<username>/hive.log
51
+
/tmp/<username>/hive.log
55
52
```
56
53
57
54
3. To view Hive metastore logs, use the following command:
58
55
59
56
```apache
60
-
/var/log/hive/hivemetastore.log
57
+
/var/log/hive/hivemetastore.log
61
58
```
62
59
63
-
4. To view Hiveserver logs, use the following command:
60
+
4. To view Hive server logs, use the following command:
64
61
65
62
```apache
66
-
/var/log/hive/hiveserver2.log
63
+
/var/log/hive/hiveserver2.log
67
64
```
68
65
69
66
### Additional reading
70
67
71
68
-[Connect to an HDInsight cluster by using SSH](hdinsight-hadoop-linux-use-ssh-unix.md)
72
69
73
-
74
70
## How do I launch the Hive shell with specific configurations on a cluster?
75
71
76
72
### Resolution steps
77
73
78
74
1. Specify a configuration key-value pair when you start the Hive shell. For more information, see [Additional reading](#additional-reading-end).
79
75
80
76
```apache
81
-
hive -hiveconf a=b
77
+
hive -hiveconf a=b
82
78
```
83
79
84
80
2. To list all effective configurations on Hive shell, use the following command:
@@ -90,23 +86,21 @@ The code in the resolution steps assumes that data paths on the new cluster are
90
86
For example, use the following command to start Hive shell with debug logging enabled on the console:
## <aname="how-do-i-analyze-tez-dag-data-on-a-cluster-critical-path"></a>How do I analyze Apache Tez DAG data on a cluster-critical path?
102
97
103
-
104
98
### Resolution steps
105
-
99
+
106
100
1. To analyze an Apache Tez directed acyclic graph (DAG) on a cluster-critical graph, connect to the HDInsight cluster by using SSH. For more information, see [Additional reading](#additional-reading-end).
107
101
108
102
2. At a command prompt, run the following command:
109
-
103
+
110
104
```apache
111
105
hadoop jar /usr/hdp/current/tez-client/tez-job-analyzer-*.jar CriticalPath --saveResults --dagId <DagId> --eventFileName <DagData.zip>
112
106
```
@@ -132,42 +126,41 @@ The code in the resolution steps assumes that data paths on the new cluster are
132
126
-**TaskConcurrencyAnalyzer**: Print the task concurrency details in a DAG
133
127
-**VertexLevelCriticalPathAnalyzer**: Find the critical path at vertex level in a DAG
134
128
135
-
136
129
### Additional reading
137
130
138
131
-[Connect to an HDInsight cluster by using SSH](hdinsight-hadoop-linux-use-ssh-unix.md)
139
132
140
-
141
133
## How do I download Tez DAG data from a cluster?
142
134
143
-
144
135
#### Resolution steps
145
136
146
137
There are two ways to collect the Tez DAG data:
147
138
148
139
- From the command line:
149
-
140
+
150
141
Connect to the HDInsight cluster by using SSH. At the command prompt, run the following command:
151
142
152
143
```apache
153
-
hadoop jar /usr/hdp/current/tez-client/tez-history-parser-*.jar org.apache.tez.history.ATSImportTool -downloadDir . -dagId <DagId>
144
+
hadoop jar /usr/hdp/current/tez-client/tez-history-parser-*.jar org.apache.tez.history.ATSImportTool -downloadDir . -dagId <DagId>
154
145
```
155
146
156
147
- Use the Ambari Tez view:
157
-
158
-
1. Go to Ambari.
159
-
2. Go to Tez view (under the tiles icon in the upper-right corner).
148
+
149
+
1. Go to Ambari.
150
+
2. Go to Tez view (under the tiles icon in the upper-right corner).
[Connect to an HDInsight cluster by using SSH](hdinsight-hadoop-linux-use-ssh-unix.md)
166
157
158
+
## Next steps
167
159
168
-
### See Also
169
-
[Troubleshoot by Using Azure HDInsight](hdinsight-troubleshoot-guide.md)
170
-
160
+
If you didn't see your problem or are unable to solve your issue, visit one of the following channels for more support:
171
161
162
+
- Get answers from Azure experts through [Azure Community Support](https://azure.microsoft.com/support/community/).
172
163
164
+
- Connect with [@AzureSupport](https://twitter.com/azuresupport) - the official Microsoft Azure account for improving customer experience. Connecting the Azure community to the right resources: answers, support, and experts.
173
165
166
+
- If you need more help, you can submit a support request from the [Azure portal](https://portal.azure.com/?#blade/Microsoft_Azure_Support/HelpAndSupportBlade/). Select **Support** from the menu bar or open the **Help + support** hub. For more detailed information, review [How to create an Azure support request](https://docs.microsoft.com/azure/azure-supportability/how-to-create-azure-support-request). Access to Subscription Management and billing support is included with your Microsoft Azure subscription, and Technical Support is provided through one of the [Azure Support Plans](https://azure.microsoft.com/support/plans/).
0 commit comments