Skip to content

Add FocalNet arch, refactor Swin V1/V2 for better feature extraction and HF hub multi-weight support #1628

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 14 commits into from
Mar 19, 2023
Merged

Add FocalNet arch, refactor Swin V1/V2 for better feature extraction and HF hub multi-weight support #1628

merged 14 commits into from
Mar 19, 2023

Conversation

rwightman
Copy link
Collaborator

@rwightman rwightman commented Jan 10, 2023 •
edited
Loading

Since FocalNet and Swin related (and both need refactoring for better feat extraction support), combining

  • Introduction of FocalNet arch
  • Refactor Swin V1/V2, possibly other similar arch that could see improved features_only support
  • Add multi-weight support and push weights to HF hub when done (checkpoints need remap)

@rwightman rwightman changed the title Add FocalNet arch, refactor Swin V1/V2 for better feature extraction and HF hub weights Add FocalNet arch, refactor Swin V1/V2 for better feature extraction and HF hub multi-weight support Jan 10, 2023
@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Jan 10, 2023 •
edited
Loading

The documentation is not available anymore as the PR was closed or merged.

@rwightman
Merge branch 'main' into focalnet_and_swin_refactor
7266c5c
@rwightman
Overhaul FocalNet implementation
848d200
@rwightman
Fix grad checkpointing in focalnet
cf324ea
@rwightman
Merge branch 'main' into focalnet_and_swin_refactor
947c1d7
@rwightman
Merge remote-tracking branch 'origin/main' into focalnet_and_swin_ref…
c30a160 
…actor
@rwightman
All swin models support spatial output, add output_fmt to v1/v2 and u…
acfd85a 
…se ClassifierHead.

* update ClassifierHead to allow different input format
* add output format support to patch embed
* fix some flatten issues for a few conv head models
* add Format enum and helpers for tensor format (layout) choices
@rwightman
return_map back to out_map for _feature helpers
5aebad3
@rwightman
Exclude the large models from default_cfgs, failing github CI
2fc5ac3
@rwightman
Swin and FocalNet weights on HF hub. Add model deprecation functional…
572f050 
…ity w/ some registry tweaks.
@rwightman
Add Microsoft FocalNet specific ('ms') ImageNet-22k classifier layout
9fcfb8b
@rwightman
Use gather (fancy indexing) for valid labels instead of bool mask in …
3448cc6 
…validate.py
@rwightman
Version 0.8.16dev0
fafac33
@rwightman rwightman merged commit 0d5c5c3 into main Mar 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@rwightman @HuggingFaceDocBuilderDev