You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/tutorial-incremental-copy-overview.md
+9-4Lines changed: 9 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -25,10 +25,12 @@ In this case, you define a watermark in your source database. A watermark is a c
25
25
26
26
27
27
For step-by-step instructions, see the following tutorials:
28
-
29
28
-[Incrementally copy data from one table in Azure SQL Database to Azure Blob storage](tutorial-incremental-copy-powershell.md)
30
29
-[Incrementally copy data from multiple tables in on-premises SQL Server to Azure SQL Database](tutorial-incremental-copy-multiple-tables-powershell.md)
31
30
31
+
For templates, see the following:
32
+
-[Delta copy with control table](solution-template-delta-copy-with-control-table.md)
33
+
32
34
## Delta data loading from SQL DB by using the Change Tracking technology
33
35
Change Tracking technology is a lightweight solution in SQL Server and Azure SQL Database that provides an efficient change tracking mechanism for applications. It enables an application to easily identify data that was inserted, updated, or deleted.
34
36
@@ -37,19 +39,22 @@ The workflow for this approach is depicted in the following diagram:
37
39
38
40
39
41
For step-by-step instructions, see the following tutorial: <br/>
40
-
[Incrementally copy data from Azure SQL Database to Azure Blob storage by using Change Tracking technology](tutorial-incremental-copy-change-tracking-feature-powershell.md)
42
+
-[Incrementally copy data from Azure SQL Database to Azure Blob storage by using Change Tracking technology](tutorial-incremental-copy-change-tracking-feature-powershell.md)
41
43
42
44
## Loading new and changed files only by using LastModifiedDate
43
45
You can copy the new and changed files only by using LastModifiedDate to the destination store. ADF will scan all the files from the source store, apply the file filter by their LastModifiedDate, and only copy the new and updated file since last time to the destination store. Please be aware if you let ADF scan huge amounts of files but only copy a few files to destination, you would still expect the long duration due to file scanning is time consuming as well.
44
46
45
47
For step-by-step instructions, see the following tutorial: <br/>
46
-
[Incrementally copy new and changed files based on LastModifiedDate from Azure Blob storage to Azure Blob storage](tutorial-incremental-copy-lastmodified-copy-data-tool.md)
48
+
-[Incrementally copy new and changed files based on LastModifiedDate from Azure Blob storage to Azure Blob storage](tutorial-incremental-copy-lastmodified-copy-data-tool.md)
49
+
50
+
For templates, see the following:
51
+
-[Copy new files by LastModifiedDate](solution-template-copy-new-files-lastmodifieddate.md)
47
52
48
53
## Loading new files only by using time partitioned folder or file name.
49
54
You can copy new files only, where files or folders has already been time partitioned with timeslice information as part of the file or folder name (for example, /yyyy/mm/dd/file.csv). It is the most performance approach for incremental loading new files.
50
55
51
56
For step-by-step instructions, see the following tutorial: <br/>
52
-
[Incrementally copy new files based on time partitioned folder or file name from Azure Blob storage to Azure Blob storage](tutorial-incremental-copy-partitioned-file-name-copy-data-tool.md)
57
+
-[Incrementally copy new files based on time partitioned folder or file name from Azure Blob storage to Azure Blob storage](tutorial-incremental-copy-partitioned-file-name-copy-data-tool.md)
0 commit comments