Skip to content

Enable duplicate detection on cursor comparison using join by #1295

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Apr 3, 2025

Conversation

lwasylow
Copy link
Member

@lwasylow lwasylow commented Apr 3, 2025

Resolves #1293
In certain scenarios when the data sets are identical but have an duplicate rows, the cursors join_by when doing join in SQL joined only by PK which resulted on full match from differences query.
Extended a PK join by to the duplicate number to make sure we match on the rows number.

Testing case was added however due to issue with a cursor comparison inside the logic the case will fail until merged into develop.

lwasylow added 2 commits April 2, 2025 20:41
…e sure that we have same amount of rows when rows are identical but row counts is different.
@lwasylow lwasylow requested a review from jgebal April 3, 2025 17:45
@lwasylow lwasylow self-assigned this Apr 3, 2025
Copy link
Contributor

github-actions bot commented Apr 3, 2025

Unit Test Results

       1 files  ±  0         2 suites  ±0   1m 57s ⏱️ - 1m 24s
1 090 tests +34  1 086 ✔️ +34  4 💤 ±0  0 ±0 
1 094 runs  +34  1 086 ✔️ +34  8 💤 ±0  0 ±0 

Results for commit 6f273df. ± Comparison against base commit 31604c6.

♻️ This comment has been updated with latest results.

Copy link

codecov bot commented Apr 3, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.97%. Comparing base (31604c6) to head (6f273df).
Report is 4 commits behind head on develop.

Additional details and impacted files
@@           Coverage Diff            @@
##           develop    #1295   +/-   ##
========================================
  Coverage    94.97%   94.97%           
========================================
  Files          111      111           
  Lines         5396     5396           
  Branches        34       34           
========================================
  Hits          5125     5125           
  Misses         271      271           
Flag Coverage Δ
11XE 94.44% <100.00%> (+0.07%) ⬆️
12.1EE 94.50% <100.00%> (+0.15%) ⬆️
18XE 95.09% <100.00%> (ø)
21XE 95.24% <100.00%> (ø)
23free 94.98% <100.00%> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@jgebal
Copy link
Member

jgebal commented Apr 3, 2025

Build is failing on 11 and 12 because procedure name is too long.
Until we officially drop support for 11, 12, we need main the compatibility.

@lwasylow
Copy link
Member Author

lwasylow commented Apr 3, 2025

People getting use to good things to quickly :) Updated

@jgebal jgebal merged commit e872b30 into develop Apr 3, 2025
20 of 24 checks passed
@lwasylow lwasylow deleted the feature/issue_1293 branch April 4, 2025 20:17
@lwasylow lwasylow restored the feature/issue_1293 branch April 4, 2025 20:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Cursor comparison not detecting duplicate rows
2 participants