Skip to content

Set up CI #87

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 10 commits into from
Apr 24, 2024
Merged

Set up CI #87

merged 10 commits into from
Apr 24, 2024

Conversation

zou3519
Copy link
Contributor

@zou3519 zou3519 commented Apr 10, 2024

[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 10, 2024
ghstack-source-id: 13b391e
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 10, 2024
Copied from torchvision.

ghstack-source-id: 49241f2
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 10, 2024
Copied from torchvision.

ghstack-source-id: 03d5555
Pull Request resolved: #87
[ghstack-poisoned]
@zou3519 zou3519 mentioned this pull request Apr 11, 2024
zou3519 added a commit that referenced this pull request Apr 11, 2024
Copied from torchvision.

ghstack-source-id: f6e39ce
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 11, 2024
Copied from torchvision.

ghstack-source-id: 88f3d09
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: 81b6c2d
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: 8ed228d
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: 48e2c2c
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: e089ccf
Pull Request resolved: #87
[ghstack-poisoned]
zou3519 added a commit that referenced this pull request Apr 18, 2024
Copied from torchvision.

ghstack-source-id: 2158902
Pull Request resolved: #87
@zou3519 zou3519 marked this pull request as ready for review April 19, 2024 02:37
@zou3519 zou3519 requested review from albanD and drisspg April 19, 2024 15:11
runner: ["linux.12xlarge"]
gpu-arch-type: ["cpu"]
include:
- python-version: 3.8
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

3.11 above?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I did 3.8 for coverage

eval "$($(which conda) shell.bash hook)" && conda deactivate && conda activate ci

echo '::group::Install testing utilities'
pip install --progress-bar=off pytest pytest-mock pytest-cov expecttest numpy
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

uv?

set +x && eval "$($(which conda) shell.bash hook)" && set -x

# Setup the OS_TYPE environment variable that should be used for conditions involving the OS below.
case $(uname) in
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are you planning to extend CI to other platforms? Because this file seems a lot more general than what we use it for right now?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe, I'm not sure. Leaving it just in case


echo '::group::Install PyTorch'
# TODO: Can we maybe have this as environment variable in the job template? For example, `IS_RELEASE`.
if [[ (${GITHUB_EVENT_NAME} = 'pull_request' && (${GITHUB_BASE_REF} = 'release'*)) || (${GITHUB_REF} = 'refs/heads/release'*) ]]; then
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we plan to have "releases"

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe? We could set up an example binary release for this

- python-version: 3.8
runner: linux.g5.4xlarge.nvidia.gpu
gpu-arch-type: cuda
gpu-arch-version: "11.8"
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

maybe 12.1?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure this is possible, it depends on what github runners are offered to the pytorch org

Copy link

@drisspg drisspg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some nits

@zou3519
Copy link
Contributor Author

zou3519 commented Apr 24, 2024

Re the comments about the github workflows: these are not copy-paste-able for OSS developers because the github workflow only works if you're in the pytorch org. Because of that I'm fine with not having the cleanest setup for now

@zou3519 zou3519 merged commit f5d8e55 into gh/zou3519/2/base Apr 24, 2024
3 checks passed
zou3519 added a commit that referenced this pull request Apr 24, 2024
Copied from torchvision.

ghstack-source-id: 2158902
Pull Request resolved: #87
@zou3519 zou3519 deleted the gh/zou3519/2/head branch April 24, 2024 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants