Skip to content

Commit c71511c

Browse files
authored
Merge pull request #83422 from Samantha-Yu/adfdocupdate0726
Updating" Tutorials - Copy on-premises data to cloud"
2 parents 90fadb8 + 20167ca commit c71511c

23 files changed

+34
-83
lines changed
Binary file not shown.

articles/data-factory/tutorial-hybrid-copy-data-tool.md

+34-76
Original file line numberDiff line numberDiff line change
@@ -75,15 +75,14 @@ You use the name and key of your storage account in this tutorial. To get the na
7575
7676
1. Sign in to the [Azure portal](https://portal.azure.com) with your Azure user name and password.
7777
78-
1. In the left pane, select **More services**. Filter by using the **Storage** keyword, and then select **Storage accounts**.
78+
1. In the left pane, select **All services**. Filter by using the **Storage** keyword, and then select **Storage accounts**.
7979
80-
![Storage account search](media/tutorial-hybrid-copy-powershell/search-storage-account.png)
80+
![Storage account search](media/doc-common-process/search-storage-account.png)
8181
8282
1. In the list of storage accounts, filter for your storage account, if needed. Then select your storage account.
8383
8484
1. In the **Storage account** window, select **Access keys**.
8585
86-
![Access keys](media/tutorial-hybrid-copy-powershell/storage-account-name-key.png)
8786
8887
1. In the **Storage account name** and **key1** boxes, copy the values, and then paste them into Notepad or another editor for later use in the tutorial.
8988
@@ -92,37 +91,27 @@ In this section, you create a blob container named **adftutorial** in your Blob
9291
9392
1. In the **Storage account** window, switch to **Overview**, and then select **Blobs**.
9493
95-
![Select Blobs option](media/tutorial-hybrid-copy-powershell/select-blobs.png)
94+
1. In the **Blobs** window, select **+ Container**.
9695
97-
1. In the **Blob service** window, select **Container**.
98-
99-
![Container button](media/tutorial-hybrid-copy-powershell/add-container-button.png)
100-
101-
1. In the **New container** window, in the **Name** box, enter **adftutorial**, and then select **OK**.
102-
103-
![New container](media/tutorial-hybrid-copy-powershell/new-container-dialog.png)
96+
1. In the **New container** window, under **Name**, enter **adftutorial**, and then select **OK**.
10497
10598
1. In the list of containers, select **adftutorial**.
10699
107-
![Container selection](media/tutorial-hybrid-copy-powershell/select-adftutorial-container.png)
108100
109-
1. Keep the **Container** window for **adftutorial** open. You use it verify the output at the end of the tutorial. Data Factory automatically creates the output folder in this container, so you don't need to create one.
110-
111-
![Container window](media/tutorial-hybrid-copy-powershell/container-page.png)
101+
1. Keep the **Container** window for **adftutorial** open. You use it to verify the output at the end of the tutorial. Data Factory automatically creates the output folder in this container, so you don't need to create one.
112102

113103

114104
## Create a data factory
115105

116-
1. On the menu on the left, select **New** > **Data + Analytics** > **Data Factory**.
106+
1. On the menu on the left, select **+ Create a resource** > **Analytics** > **Data Factory**.
117107

118-
![New data factory creation](./media/tutorial-hybrid-copy-data-tool/new-azure-data-factory-menu.png)
108+
![New data factory creation](./media/doc-common-process/new-azure-data-factory-menu.png)
109+
119110
1. On the **New data factory** page, under **Name**, enter **ADFTutorialDataFactory**.
120-
121-
![New data factory](./media/tutorial-hybrid-copy-data-tool/new-azure-data-factory.png)
122111

123112
The name of the data factory must be *globally unique*. If you see the following error message for the name field, change the name of the data factory (for example, yournameADFTutorialDataFactory). For naming rules for Data Factory artifacts, see [Data Factory naming rules](naming-rules.md).
124113

125-
![New data factory name](./media/tutorial-hybrid-copy-data-tool/name-not-available-error.png)
114+
![New data factory name](./media/doc-common-process/name-not-available-error.png)
126115
1. Select the Azure **subscription** in which you want to create the data factory.
127116
1. For **Resource Group**, take one of the following steps:
128117

@@ -131,61 +120,46 @@ In this section, you create a blob container named **adftutorial** in your Blob
131120
- Select **Create new**, and enter the name of a resource group.
132121

133122
To learn about resource groups, see [Use resource groups to manage your Azure resources](../azure-resource-manager/resource-group-overview.md).
134-
1. Under **Version**, select **V2 **.
123+
1. Under **Version**, select **V2**.
135124
1. Under **Location**, select the location for the data factory. Only locations that are supported are displayed in the drop-down list. The data stores (for example, Azure Storage and SQL Database) and computes (for example, Azure HDInsight) used by Data Factory can be in other locations/regions.
136-
1. Select **Pin to dashboard**.
137125
1. Select **Create**.
138-
1. On the dashboard, you see the following tile with the status **Deploying Data Factory**:
139126

140-
![Deploying data factory tile](media/tutorial-hybrid-copy-data-tool/deploying-data-factory.png)
141127
1. After the creation is finished, you see the **Data Factory** page as shown in the image.
142128

143-
![Data factory home page](./media/tutorial-hybrid-copy-data-tool/data-factory-home-page.png)
129+
![Data factory home page](./media/doc-common-process/data-factory-home-page.png)
144130
1. Select **Author & Monitor** to launch the Data Factory user interface in a separate tab.
145131

146132
## Use the Copy Data tool to create a pipeline
147133

148134
1. On the **Let's get started** page, select **Copy Data** to launch the Copy Data tool.
149135
150-
![Copy Data tool tile](./media/tutorial-hybrid-copy-data-tool/copy-data-tool-tile.png)
136+
![Get started page](./media/doc-common-process/get-started-page.png)
151137
152138
1. On the **Properties** page of the Copy Data tool, under **Task name**, enter **CopyFromOnPremSqlToAzureBlobPipeline**. Then select **Next**. The Copy Data tool creates a pipeline with the name you specify for this field.
153-
154-
![Task name](./media/tutorial-hybrid-copy-data-tool/properties-page.png)
139+
![Task name](./media/tutorial-hybrid-copy-data-tool/properties-page.png)
155140
156141
1. On the **Source data store** page, click on **Create new connection**.
157142
158-
![Create new linked service](./media/tutorial-hybrid-copy-data-tool/create-new-source-data-store.png)
159-
160-
1. Under **New Linked Service**, search for **SQL Server**, and then select **Next**.
161-
162-
![SQL Server selection](./media/tutorial-hybrid-copy-data-tool/select-source-data-store.png)
163143
164-
1. Under New Linked Service (SQL Server) **Name**, enter **SqlServerLinkedService**. Select **+New** under **Connect via integration runtime**. You must create a self-hosted integration runtime, download it to your machine, and register it with Data Factory. The self-hosted integration runtime copies data between your on-premises environment and the cloud.
144+
1. Under **New Linked Service**, search for **SQL Server**, and then select **Continue**.
165145
166-
![Create self-hosted integration runtime](./media/tutorial-hybrid-copy-data-tool/create-integration-runtime-link.png)
146+
1. In the **New Linked Service (SQL Server)** dialog box, under **Name**, enter **SqlServerLinkedService**. Select **+New** under **Connect via integration runtime**. You must create a self-hosted integration runtime, download it to your machine, and register it with Data Factory. The self-hosted integration runtime copies data between your on-premises environment and the cloud.
167147
168-
1. In the **Integration Runtime Setup** dialog box, Select **Private Network**. Then select **Next**.
169148
170-
![](./media/tutorial-hybrid-copy-data-tool/create-integration-runtime-dialog0.png)
149+
1. In the **Integration Runtime Setup** dialog box, Select **Self-Hosted**. Then select **Next**.
171150
172-
1. In the **Integration Runtime Setup** dialog box under **Name**, enter **TutorialIntegrationRuntime**. Then select **Next**.
151+
![Create integration runtime](./media/tutorial-hybrid-copy-data-tool/create-integration-runtime-dialog0.png)
173152
174-
![Integration runtime name](./media/tutorial-hybrid-copy-data-tool/create-integration-runtime-dialog.png)
153+
1. In the **Integration Runtime Setup** dialog box, under **Name**, enter **TutorialIntegrationRuntime**. Then select **Next**.
175154
176-
1. Select **Click here to launch the express setup for this computer**. This action installs the integration runtime on your machine and registers it with Data Factory. Alternatively, you can use the manual setup option to download the installation file, run it, and use the key to register the integration runtime.
177155
178-
![lLaunch express setup on this computer link](./media/tutorial-hybrid-copy-data-tool/launch-express-setup-link.png)
156+
1. In the **Integration Runtime Setup** dialog box, select **Click here to launch the express setup for this computer**. This action installs the integration runtime on your machine and registers it with Data Factory. Alternatively, you can use the manual setup option to download the installation file, run it, and use the key to register the integration runtime.
179157
180158
1. Run the downloaded application. You see the status of the express setup in the window.
181159
182160
![Express setup status](./media/tutorial-hybrid-copy-data-tool/express-setup-status.png)
183161
184-
1. Confirm that **TutorialIntegrationRuntime** is selected for the **Integration Runtime** field.
185-
186-
![Integration runtime selected](./media/tutorial-hybrid-copy-data-tool/integration-runtime-selected.png)
187-
188-
1. In **Specify the on-premises SQL Server database**, take the following steps:
162+
1. In the **New Linked Service (SQL Server)** dialog box, confirm that **TutorialIntegrationRuntime** is selected for the Integration Runtime field. Then, take the following steps:
189163
190164
a. Under **Name**, enter **SqlServerLinkedService**.
191165
@@ -197,71 +171,55 @@ In this section, you create a blob container named **adftutorial** in your Blob
197171
198172
e. Under **User name**, enter the name of user with access to on-premises SQL Server.
199173
200-
f. Enter the **password** for the user. Select **Finish**.
174+
f. Enter the **password** for the user.
201175
202-
1. Select **Next**.
176+
g. Test connection and select **Finish**.
203177
204-
![](./media/tutorial-hybrid-copy-data-tool/select-source-linked-service.png)
178+
![Integration runtime selected](./media/tutorial-hybrid-copy-data-tool/integration-runtime-selected.png)
205179
206-
1. On the **Select tables from which to copy the data or use a custom query** page, select the **[dbo].[emp]** table in the list, and select **Next**. You can select any other table based on your database.
180+
1. On the **Source data store** page, select **Next**.
207181
208-
![The Product table selection](./media/tutorial-hybrid-copy-data-tool/select-emp-table.png)
182+
1. On the **Select tables from which to copy the data or use a custom query** page, select the **[dbo].[emp]** table in the list, and select **Next**. You can select any other table based on your database.
209183
210184
1. On the **Destination data store** page, select **Create new connection**
211185
212-
![Create Destination linked service](./media/tutorial-hybrid-copy-data-tool/create-new-sink-connection.png)
213186
214-
1. In **New Linked Service**, Search and Select **Azure Blob**, then **Continue**.
187+
1. In **New Linked Service**, Search and Select **Azure Blob**, and then select **Continue**.
215188
216189
![Blob storage selection](./media/tutorial-hybrid-copy-data-tool/select-destination-data-store.png)
217190
218191
1. On the **New Linked Service (Azure Blob Storage)** dialog, take the following steps:
219192
220-
a. Under **Name****, enter **AzureStorageLinkedService**.
193+
a. Under **Name**, enter **AzureStorageLinkedService**.
221194
222-
b. Under **Connect via integration runtime**, select **TutorialIntegrationRuntime**
195+
b. Under **Connect via integration runtime**, select **TutorialIntegrationRuntime**
223196
224-
c. Under **Storage account name**, select your storage account from the drop-down list.
197+
c. Under **Storage account name**, select your storage account from the drop-down list.
225198
226-
d. Select **Next**.
199+
d. Select **Finish**.
227200
228-
![Specify the storage account](./media/tutorial-hybrid-copy-data-tool/specify-azure-blob-storage-account.png)
201+
1. In **Destination data store** dialog, make sure that **Azure Blob Storage** is selected. Then select **Next**.
229202
230-
1. In **Destination data store** dialog, select **Next**. In **Connection properties**, select **Azure storage service** as **Azure Blob Storage**. Select **Next**.
231-
232-
![connection properties](./media/tutorial-hybrid-copy-data-tool/select-connection-properties.png)
233-
234-
1. In the **Choose the output file or folder** dialog, under **Folder path**, enter **adftutorial/fromonprem**. You created the **adftutorial** container as part of the prerequisites. If the output folder doesn't exist (in this case **fromonprem**), Data Factory automatically creates it. You also can use the **Browse** button to browse the blob storage and its containers/folders. If you do not specify any value under **File name**, by default the name from the source would be used (in this case **dbo.emp**).
203+
1. In the **Choose the output file or folder** dialog, under **Folder path**, enter **adftutorial/fromonprem**. You created the **adftutorial** container as part of the prerequisites. If the output folder doesn't exist (in this case **fromonprem**), Data Factory automatically creates it. You can also use the **Browse** button to browse the blob storage and its containers/folders. If you do not specify any value under **File name**, by default the name from the source would be used (in this case **dbo.emp**).
235204

236205
![Choose the output file or folder](./media/tutorial-hybrid-copy-data-tool/choose-output-file-folder.png)
237206

238207
1. On the **File format settings** dialog, select **Next**.
239208

240-
![File format settings page](./media/tutorial-hybrid-copy-data-tool/file-format-settings-page.png)
241-
242209
1. On the **Settings** dialog, select **Next**.
243210

244-
![Settings page](./media/tutorial-hybrid-copy-data-tool/settings-page.png)
245-
246211
1. On the **Summary** dialog, review values for all the settings, and select **Next**.
247212

248-
![Summary page](./media/tutorial-hybrid-copy-data-tool/summary-page.png)
249-
250213
1. On the **Deployment** page, select **Monitor** to monitor the pipeline or task you created.
251214

252215
![Deployment page](./media/tutorial-hybrid-copy-data-tool/deployment-page.png)
253216

254217
1. On the **Monitor** tab, you can view the status of the pipeline you created. You can use the links in the **Action** column to view activity runs associated with the pipeline run and to rerun the pipeline.
255-
256-
![Monitor pipeline runs](./media/tutorial-hybrid-copy-data-tool/monitor-pipeline-runs.png)
257-
258-
1. Select the **View Activity Runs** link in the **Actions** column to see activity runs associated with the pipeline run. To see details about the copy operation, select the **Details** link (eyeglasses icon) in the **Actions** column. To switch back to the **Pipeline Runs** view, select **Pipelines** at the top.
259-
260-
![Monitor activity runs](./media/tutorial-hybrid-copy-data-tool/monitor-activity-runs.png)
218+
219+
1. Select the **View Activity Runs** link in the **Actions** column to see activity runs associated with the pipeline run. To see details about the copy operation, select the **Details** link (eyeglasses icon) in the **Actions** column. To switch back to the **Pipeline Runs** view, select **Pipeline Runs** at the top.
261220

262221
1. Confirm that you see the output file in the **fromonprem** folder of the **adftutorial** container.
263222

264-
![Output blob](./media/tutorial-hybrid-copy-data-tool/output-blob.png)
265223

266224
1. Select the **Edit** tab on the left to switch to the editor mode. You can update the linked services, datasets, and pipelines created by the tool by using the editor. Select **Code** to view the JSON code associated with the entity opened in the editor. For details on how to edit these entities in the Data Factory UI, see [the Azure portal version of this tutorial](tutorial-copy-data-portal.md).
267225

articles/data-factory/tutorial-hybrid-copy-portal.md

-4
Original file line numberDiff line numberDiff line change
@@ -87,7 +87,6 @@ You use the name and key of your storage account in this tutorial. To get the na
8787

8888
1. In the **Storage account** window, select **Access keys**.
8989

90-
![Access keys](media/tutorial-hybrid-copy-powershell/storage-account-name-key.png)
9190

9291
1. In the **Storage account name** and **key1** boxes, copy the values, and then paste them into Notepad or another editor for later use in the tutorial.
9392

@@ -112,9 +111,6 @@ In this section, you create a blob container named **adftutorial** in your Blob
112111

113112
1. Keep the **container** window for **adftutorial** open. You use it verify the output at the end of the tutorial. Data Factory automatically creates the output folder in this container, so you don't need to create one.
114113

115-
![Container window](media/tutorial-hybrid-copy-powershell/container-page.png)
116-
117-
118114
## Create a data factory
119115
In this step, you create a data factory and start the Data Factory UI to create a pipeline in the data factory.
120116

articles/data-factory/tutorial-hybrid-copy-powershell.md

-3
Original file line numberDiff line numberDiff line change
@@ -78,8 +78,6 @@ You use the name and key of your Azure storage account in this tutorial. Get the
7878

7979
1. In the **Storage account** window, select **Access keys**.
8080

81-
![Get storage account name and key](media/tutorial-hybrid-copy-powershell/storage-account-name-key.png)
82-
8381
1. In the **Storage account name** and **key1** boxes, copy the values, and then paste them into Notepad or another editor for later use in the tutorial.
8482

8583
#### Create the adftutorial container
@@ -103,7 +101,6 @@ In this section, you create a blob container named **adftutorial** in your Azure
103101

104102
1. Keep the **container** window for **adftutorial** open. You use it verify the output at the end of the tutorial. Data Factory automatically creates the output folder in this container, so you don't need to create one.
105103

106-
![Container window](media/tutorial-hybrid-copy-powershell/container-page.png)
107104

108105
### Windows PowerShell
109106

0 commit comments

Comments
 (0)