Skip to content

CI for performance tests #992

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 25 commits into from
Feb 13, 2020
Merged

CI for performance tests #992

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
c9505df
attempted to add performance tests to CI
lostmsu Oct 22, 2019
949b55f
attempt to fix PerformanceTests xplat CI build
lostmsu Nov 21, 2019
1c92d0c
enabling building PerformanceTests for Mono
lostmsu Nov 21, 2019
4deda8b
use Ubuntu 18.04 Bionic Beaver image in Travis CI
lostmsu Nov 21, 2019
a7b9417
fixed AppVeyor path to Python.PerformanceTests.dll
lostmsu Nov 21, 2019
400ea33
fixed Mono deb sources to bionic
lostmsu Nov 21, 2019
01ea645
slightly relaxed perf target for WriteInt64Property
lostmsu Nov 21, 2019
419bddf
PerformanceTests: explicitly specify platform
lostmsu Nov 21, 2019
f36318f
use framework-specific build of perf tests in xplat and generic other…
lostmsu Nov 21, 2019
265b363
added reference to net461 reference assemblies nuget to perf tests
lostmsu Nov 21, 2019
e17f64e
added perf tests run to Travis CI
lostmsu Nov 21, 2019
433c016
fixed perf tests being build for Any CPU instead of x86
lostmsu Nov 21, 2019
74ba9d3
only run perf tests in Travis on Python 3.5
lostmsu Nov 21, 2019
54f9698
added performance tests to the old solution
lostmsu Nov 21, 2019
e2f192f
better error message for a failure to run benchmarks
lostmsu Nov 21, 2019
f69baf5
Revert "added performance tests to the old solution"
lostmsu Nov 21, 2019
618b841
appveyor: don't run perf tests in unsupported configurations
lostmsu Nov 21, 2019
123a701
commented out perf tests from Travis, as they are Windows-only due to…
lostmsu Nov 21, 2019
1993598
missing brace in appveyor_run_tests.ps1
lostmsu Nov 21, 2019
c46701d
fixed performance test Python version condition in AppVeyor
lostmsu Nov 21, 2019
340a6d1
explicitly notify when performance tests are skipped in AppVeyor
lostmsu Nov 21, 2019
a6c55d4
relax performance targets to ~10%, improve perf failure message
lostmsu Dec 19, 2019
171643c
Merge branch 'master' into features/PerfTests-CI
lostmsu Feb 12, 2020
031e8bb
travis: revert to xenial, as in bionic some tests crash
lostmsu Feb 12, 2020
0af4937
switch to the release of Microsoft.NETFramework.ReferenceAssemblies p…
lostmsu Feb 13, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
added perf tests run to Travis CI
  • Loading branch information
@lostmsu
lostmsu committed Jan 31, 2020
commit e17f64ef9b5be1770d773dee47e56ada6abbdc0d
5 changes: 3 additions & 2 deletions .travis.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,8 @@ python:

env:
matrix:
- BUILD_OPTS=--xplat NUNIT_PATH="~/.nuget/packages/nunit.consolerunner/3.*/tools/nunit3-console.exe" RUN_TESTS=dotnet EMBED_TESTS_PATH=netcoreapp2.0_publish/
- BUILD_OPTS="" NUNIT_PATH="./packages/NUnit.*/tools/nunit3-console.exe" RUN_TESTS="mono $NUNIT_PATH" EMBED_TESTS_PATH=""
- BUILD_OPTS=--xplat NUNIT_PATH="~/.nuget/packages/nunit.consolerunner/3.*/tools/nunit3-console.exe" RUN_TESTS=dotnet EMBED_TESTS_PATH=netcoreapp2.0_publish/ PERF_TESTS_PATH=net461/
- BUILD_OPTS="" NUNIT_PATH="./packages/NUnit.*/tools/nunit3-console.exe" RUN_TESTS="mono $NUNIT_PATH" EMBED_TESTS_PATH="" PERF_TESTS_PATH=""

global:
- LD_PRELOAD=/lib/x86_64-linux-gnu/libSegFault.so
Expand Down Expand Up @@ -45,6 +45,7 @@ install:
script:
- python -m pytest
- $RUN_TESTS src/embed_tests/bin/$EMBED_TESTS_PATH/Python.EmbeddingTest.dll
- $RUN_TESTS src/perf_tests/bin/$PERF_TESTS_PATH/Python.PerformanceTests.dll

after_script:
# Waiting on mono-coverage, SharpCover or xr.Baboon
Expand Down
1 change: 1 addition & 0 deletions pythonnet.15.sln
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ Project("{2150E333-8FDC-42A3-9474-1A3956D46DE8}") = "Repo", "Repo", "{441A0123-F
EndProject
Project("{2150E333-8FDC-42A3-9474-1A3956D46DE8}") = "CI", "CI", "{D301657F-5EAF-4534-B280-B858D651B2E5}"
ProjectSection(SolutionItems) = preProject
.travis.yml = .travis.yml
ci\appveyor_build_recipe.ps1 = ci\appveyor_build_recipe.ps1
ci\appveyor_run_tests.ps1 = ci\appveyor_run_tests.ps1
EndProjectSection
Expand Down