Skip to content

chore: Upgrade datafusion to version 49 #1200

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Aug 19, 2025

Conversation

nuno-faria
Copy link
Contributor

Which issue does this PR close?

N/A.

Rationale for this change

Upgrades to the latest version of datafusion and related crates.
Marked as a draft for now while we wait for 49.0.1, which fixes a bug that is causing some tests to fail: apache/datafusion#17036.

What changes are included in this PR?

  • Upgraded datafusion and related crates to version 49.
  • Migrated code per the upgrade guide.

Are there any user-facing changes?

The Python API remains the same. One thing to notice is that md5 type is now string_view instead of string.

@timsaucer
Copy link
Contributor

Thank you for taking this on! I was just thinking today it was time to kick off the 49 release. I suspect that failing test is due to the upstream changes.

@nuno-faria
Copy link
Contributor Author

I suspect that failing test is due to the upstream changes.

Yes, the specific bug causing the errors is being tracked here: apache/datafusion#17011.

@timsaucer
Copy link
Contributor

Looks like the new clippy version is complaining. We had to make these same changes in other repos

@nuno-faria nuno-faria marked this pull request as ready for review August 19, 2025 19:45
@nuno-faria
Copy link
Contributor Author

@timsaucer should be ready now.

Copy link
Contributor

@timsaucer timsaucer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Excellent! Thank you!

@timsaucer timsaucer merged commit fd84556 into apache:main Aug 19, 2025
17 checks passed
@nuno-faria nuno-faria deleted the upgrade_datafusion branch August 20, 2025 08:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants