Add Workflow Summaries #12619
Add Workflow Summaries #12619
Conversation
cba002e to
3b5ed55
Compare
S3 Image Test Results (AMD64 / ARM64) 2 files 2 suites 8m 29s ⏱️ Results for commit f2140ee. ♻️ This comment has been updated with latest results. |
e8dc64c to
e3d6b35
Compare
Test Results (amd64, MA/MR) - Acceptance7 tests 5 ✅ 3m 16s ⏱️ Results for commit f2140ee. ♻️ This comment has been updated with latest results. |
Test Results (MA/MR) - Alternative Providers587 tests 407 ✅ 14m 41s ⏱️ Results for commit f2140ee. ♻️ This comment has been updated with latest results. |
Preflight- & Unit-Test Results21 601 tests 19 955 ✅ 6m 12s ⏱️ Results for commit e3d6b35. ♻️ This comment has been updated with latest results. |
Test Results (amd64) - Acceptance7 tests 5 ✅ 3m 5s ⏱️ Results for commit f2140ee. ♻️ This comment has been updated with latest results. |
Test Results (MA/MR) - Preflight, Unit21 601 tests 19 955 ✅ 6m 13s ⏱️ Results for commit f2140ee. ♻️ This comment has been updated with latest results. |
Test Results - Preflight, Unit21 601 tests 19 955 ✅ 6m 23s ⏱️ Results for commit f2140ee. |
Test Results - Alternative Providers587 tests 407 ✅ 14m 45s ⏱️ Results for commit f2140ee. |
Test Results (amd64, MA/MR) - Integration, Bootstrap 5 files 5 suites 2h 21m 59s ⏱️ For more details on these errors, see this check. Results for commit f2140ee. |
Test Results (amd64) - Integration, Bootstrap 5 files 5 suites 2h 22m 16s ⏱️ Results for commit f2140ee. |
| @@ -93,7 +93,7 @@ start: ## Manually start the local infrastructure for testing | |||
| docker-run-tests: ## Initializes the test environment and runs the tests in a docker container | |||
| docker run -e LOCALSTACK_INTERNAL_TEST_COLLECT_METRIC=1 --entrypoint= -v `pwd`/.git:/opt/code/localstack/.git -v `pwd`/requirements-test.txt:/opt/code/localstack/requirements-test.txt -v `pwd`/tests/:/opt/code/localstack/tests/ -v `pwd`/dist/:/opt/code/localstack/dist/ -v `pwd`/target/:/opt/code/localstack/target/ -v /var/run/docker.sock:/var/run/docker.sock -v /tmp/localstack:/var/lib/localstack \ | |||
| $(IMAGE_NAME):$(DEFAULT_TAG) \ | |||
| bash -c "make install-test && DEBUG=$(DEBUG) PYTEST_LOGLEVEL=$(PYTEST_LOGLEVEL) PYTEST_ARGS='$(PYTEST_ARGS)' COVERAGE_FILE='$(COVERAGE_FILE)' TEST_PATH='$(TEST_PATH)' LAMBDA_IGNORE_ARCHITECTURE=1 LAMBDA_INIT_POST_INVOKE_WAIT_MS=50 TINYBIRD_PYTEST_ARGS='$(TINYBIRD_PYTEST_ARGS)' TINYBIRD_DATASOURCE='$(TINYBIRD_DATASOURCE)' TINYBIRD_TOKEN='$(TINYBIRD_TOKEN)' TINYBIRD_URL='$(TINYBIRD_URL)' CI_REPOSITORY_NAME='$(CI_REPOSITORY_NAME)' CI_WORKFLOW_NAME='$(CI_WORKFLOW_NAME)' CI_COMMIT_BRANCH='$(CI_COMMIT_BRANCH)' CI_COMMIT_SHA='$(CI_COMMIT_SHA)' CI_JOB_URL='$(CI_JOB_URL)' CI_JOB_NAME='$(CI_JOB_NAME)' CI_JOB_ID='$(CI_JOB_ID)' CI='$(CI)' TEST_AWS_REGION_NAME='${TEST_AWS_REGION_NAME}' TEST_AWS_ACCESS_KEY_ID='${TEST_AWS_ACCESS_KEY_ID}' TEST_AWS_ACCOUNT_ID='${TEST_AWS_ACCOUNT_ID}' make test-coverage" | |||
| bash -c "make install-test && DEBUG=$(DEBUG) PYTEST_LOGLEVEL=$(PYTEST_LOGLEVEL) PYTEST_ARGS='$(PYTEST_ARGS)' COVERAGE_FILE='$(COVERAGE_FILE)' JUNIT_REPORTS_FILE=$(JUNIT_REPORTS_FILE) TEST_PATH='$(TEST_PATH)' LAMBDA_IGNORE_ARCHITECTURE=1 LAMBDA_INIT_POST_INVOKE_WAIT_MS=50 TINYBIRD_PYTEST_ARGS='$(TINYBIRD_PYTEST_ARGS)' TINYBIRD_DATASOURCE='$(TINYBIRD_DATASOURCE)' TINYBIRD_TOKEN='$(TINYBIRD_TOKEN)' TINYBIRD_URL='$(TINYBIRD_URL)' CI_REPOSITORY_NAME='$(CI_REPOSITORY_NAME)' CI_WORKFLOW_NAME='$(CI_WORKFLOW_NAME)' CI_COMMIT_BRANCH='$(CI_COMMIT_BRANCH)' CI_COMMIT_SHA='$(CI_COMMIT_SHA)' CI_JOB_URL='$(CI_JOB_URL)' CI_JOB_NAME='$(CI_JOB_NAME)' CI_JOB_ID='$(CI_JOB_ID)' CI='$(CI)' TEST_AWS_REGION_NAME='${TEST_AWS_REGION_NAME}' TEST_AWS_ACCESS_KEY_ID='${TEST_AWS_ACCESS_KEY_ID}' TEST_AWS_ACCOUNT_ID='${TEST_AWS_ACCOUNT_ID}' make test-coverage" | |||
There was a problem hiding this comment.
Thank you for adding JUNIT_REPORTS_FILE 🚀
| with: | ||
| pattern: test-results-cloudformation-v2 | ||
|
|
||
| - name: Download Cloudformation v2 Artifacts |
There was a problem hiding this comment.
This and some step names below must be renamed :)
Motivation
For nicer usability, we can add workflow summaries for the test runs so that we can quickly find which tests are failing
Changes
Testing
Check the auto-generated messages below for correctness (I've deleted some of the old ones which did not fit the proper scheme yet)
TODO
What's left to do: