Skip to content

Updated conformance results for mypy 1.16. #2019

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jun 5, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 2 additions & 7 deletions conformance/results/mypy/classes_override.toml
Original file line number Diff line number Diff line change
@@ -1,16 +1,11 @@
conformant = "Partial"
notes = """
Does not handle case where parent class derives from Any.
"""
conformant = "Pass"
output = """
classes_override.py:53: error: Method "method3" is marked as an override, but no base method was found with this name [misc]
classes_override.py:56: error: Method "method4" is marked as an override, but no base method was found with this name [misc]
classes_override.py:79: error: Method "static_method1" is marked as an override, but no base method was found with this name [misc]
classes_override.py:84: error: Method "class_method1" is marked as an override, but no base method was found with this name [misc]
classes_override.py:89: error: Method "property1" is marked as an override, but no base method was found with this name [misc]
classes_override.py:101: error: Method "method1" is marked as an override, but no base method was found with this name [misc]
"""
conformance_automated = "Fail"
conformance_automated = "Pass"
errors_diff = """
Line 101: Unexpected errors ['classes_override.py:101: error: Method "method1" is marked as an override, but no base method was found with this name [misc]']
"""
4 changes: 2 additions & 2 deletions conformance/results/mypy/dataclasses_frozen.toml
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,8 @@ conformant = "Pass"
output = """
dataclasses_frozen.py:16: error: Property "a" defined in "DC1" is read-only [misc]
dataclasses_frozen.py:17: error: Property "b" defined in "DC1" is read-only [misc]
dataclasses_frozen.py:23: error: Cannot inherit non-frozen dataclass from a frozen one [misc]
dataclasses_frozen.py:33: error: Cannot inherit frozen dataclass from a non-frozen one [misc]
dataclasses_frozen.py:23: error: Non-frozen dataclass cannot inherit from a frozen dataclass [misc]
dataclasses_frozen.py:33: error: Frozen dataclass cannot inherit from a non-frozen dataclass [misc]
"""
conformance_automated = "Pass"
errors_diff = """
Expand Down
2 changes: 1 addition & 1 deletion conformance/results/mypy/dataclasses_transform_class.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
conformant = "Pass"
output = """
dataclasses_transform_class.py:51: error: Cannot inherit non-frozen dataclass from a frozen one [misc]
dataclasses_transform_class.py:51: error: Non-frozen dataclass cannot inherit from a frozen dataclass [misc]
dataclasses_transform_class.py:63: error: Property "id" defined in "Customer1" is read-only [misc]
dataclasses_transform_class.py:66: error: Too many positional arguments for "Customer1" [misc]
dataclasses_transform_class.py:72: error: Unsupported left operand type for < ("Customer1") [operator]
Expand Down
2 changes: 1 addition & 1 deletion conformance/results/mypy/dataclasses_transform_func.toml
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ dataclasses_transform_func.py:53: error: Too many positional arguments for "Cust
dataclasses_transform_func.py:57: error: Incompatible types in assignment (expression has type "int", variable has type "str") [assignment]
dataclasses_transform_func.py:65: error: Unexpected keyword argument "salary" for "Customer1" [call-arg]
dataclasses_transform_func.py:71: error: Too many positional arguments for "Customer2" [misc]
dataclasses_transform_func.py:90: error: Cannot inherit non-frozen dataclass from a frozen one [misc]
dataclasses_transform_func.py:90: error: Non-frozen dataclass cannot inherit from a frozen dataclass [misc]
dataclasses_transform_func.py:97: error: Property "id" defined in "Customer3" is read-only [misc]
"""
conformance_automated = "Fail"
Expand Down
2 changes: 1 addition & 1 deletion conformance/results/mypy/dataclasses_transform_meta.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
conformant = "Pass"
output = """
dataclasses_transform_meta.py:51: error: Cannot inherit non-frozen dataclass from a frozen one [misc]
dataclasses_transform_meta.py:51: error: Non-frozen dataclass cannot inherit from a frozen dataclass [misc]
dataclasses_transform_meta.py:63: error: Property "id" defined in "Customer1" is read-only [misc]
dataclasses_transform_meta.py:66: error: Too many positional arguments for "Customer1" [misc]
dataclasses_transform_meta.py:73: error: Unsupported left operand type for < ("Customer1") [operator]
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,23 +2,21 @@ conformant = "Partial"
notes = """
Incorrectly specializes generic alias that includes a TypeVar and TypeVarTuple if no type arguments are provided.
Rejects specialization of generic type alias defined as a tuple containing a TypeVar.
"More than one Unpack" error message has no line number.
"""
output = """
generics_typevartuple_specialization.py: error: More than one Unpack in a type is not allowed [misc]
generics_typevartuple_specialization.py:85: error: Argument 1 to "takes_float_array_with_specific_shape" has incompatible type "Array2[float, *tuple[Any, ...]]"; expected "Array2[float, Height, Width]" [arg-type]
generics_typevartuple_specialization.py:108: error: Type application is only supported for generic classes [misc]
generics_typevartuple_specialization.py:109: error: Type application is only supported for generic classes [misc]
generics_typevartuple_specialization.py:109: error: Unpack is only valid in a variadic position [valid-type]
generics_typevartuple_specialization.py:110: error: Type application is only supported for generic classes [misc]
generics_typevartuple_specialization.py:110: error: Unpack is only valid in a variadic position [valid-type]
generics_typevartuple_specialization.py:121: error: More than one Unpack in a type is not allowed [misc]
generics_typevartuple_specialization.py:122: error: More than one Unpack in a type is not allowed [misc]
generics_typevartuple_specialization.py:127: error: Bad number of arguments for type alias, expected at least 2, given 1 [type-arg]
generics_typevartuple_specialization.py:163: error: TypeVarTuple cannot be split [type-arg]
"""
conformance_automated = "Fail"
errors_diff = """
Line 121: Expected 1 errors
Line 122: Expected 1 errors
Line 85: Unexpected errors ['generics_typevartuple_specialization.py:85: error: Argument 1 to "takes_float_array_with_specific_shape" has incompatible type "Array2[float, *tuple[Any, ...]]"; expected "Array2[float, Height, Width]" [arg-type]']
Line 108: Unexpected errors ['generics_typevartuple_specialization.py:108: error: Type application is only supported for generic classes [misc]']
"""
3 changes: 0 additions & 3 deletions conformance/results/mypy/overloads_definitions.toml
Original file line number Diff line number Diff line change
@@ -1,17 +1,14 @@
conformant = "Partial"
conformance_automated = "Fail"
notes = """
Does not allow an overload with no implementation in an abstract base class.
Allows @override to be on all overloads and implementation, instead of just implementation.
"""
errors_diff = """
Lines 220, 221, 222, 225, 226: Expected error (tag 'override_impl')
Line 47: Unexpected errors ['overloads_definitions.py:47: error: An overloaded function outside a stub file must have an implementation [no-overload-impl]']
"""
output = """
overloads_definitions.py:15: error: Single overload definition, multiple required [misc]
overloads_definitions.py:27: error: An overloaded function outside a stub file must have an implementation [no-overload-impl]
overloads_definitions.py:47: error: An overloaded function outside a stub file must have an implementation [no-overload-impl]
overloads_definitions.py:58: error: An overloaded function outside a stub file must have an implementation [no-overload-impl]
overloads_definitions.py:71: error: Overload does not consistently use the "@staticmethod" decorator on all function signatures. [misc]
overloads_definitions.py:84: error: Overload does not consistently use the "@classmethod" decorator on all function signatures. [misc]
Expand Down
2 changes: 1 addition & 1 deletion conformance/results/mypy/specialtypes_never.toml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@ conformant = "Pass"
output = """
specialtypes_never.py:19: error: Implicit return in function which does not return [misc]
specialtypes_never.py:86: error: Incompatible types in assignment (expression has type "list[Never]", variable has type "list[int]") [assignment]
specialtypes_never.py:86: note: "List" is invariant -- see https://mypy.readthedocs.io/en/stable/common_issues.html#variance
specialtypes_never.py:86: note: "list" is invariant -- see https://mypy.readthedocs.io/en/stable/common_issues.html#variance
specialtypes_never.py:86: note: Consider using "Sequence" instead, which is covariant
specialtypes_never.py:105: error: Incompatible return value type (got "ClassC[Never]", expected "ClassC[U]") [return-value]
"""
Expand Down
7 changes: 3 additions & 4 deletions conformance/results/mypy/tuples_unpacked.toml
Original file line number Diff line number Diff line change
@@ -1,15 +1,14 @@
conformant = "Partial"
notes = """
"More than one unpack" error is missing a line number.
"More than one unpack" error is missing in some cases.
"""
output = """
tuples_unpacked.py: error: More than one Unpack in a type is not allowed [misc]
tuples_unpacked.py:40: error: More than one Unpack in a type is not allowed [misc]
tuples_unpacked.py:51: error: More than one Unpack in a type is not allowed [misc]
tuples_unpacked.py:59: error: More than one Unpack in a type is not allowed [misc]
"""
conformance_automated = "Fail"
errors_diff = """
Line 40: Expected 1 errors
Line 41: Expected 1 errors
Line 51: Expected 1 errors
Lines 60, 61: Expected error (tag 't14')
"""
4 changes: 2 additions & 2 deletions conformance/results/mypy/version.toml
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
version = "mypy 1.15.0"
test_duration = 1.4
version = "mypy 1.16.0"
test_duration = 1.7
21 changes: 11 additions & 10 deletions conformance/results/pyre/aliases_newtype.toml
Original file line number Diff line number Diff line change
Expand Up @@ -11,18 +11,19 @@ Does not reject use of NewType with Any.
output = """
aliases_newtype.py:11:7 Incompatible parameter type [6]: In call `UserId.__init__`, for 1st positional argument, expected `int` but got `str`.
aliases_newtype.py:12:0 Incompatible variable type [9]: u1 is declared to have type `UserId` but is used as type `int`.
aliases_newtype.py:38:5 Invalid type parameters [24]: Non-generic type `GoodNewType1` cannot take parameters.
aliases_newtype.py:44:37 Invalid inheritance [39]: `typing.Union[int, str]` is not a valid parent class.
aliases_newtype.py:51:37 Invalid inheritance [39]: `typing_extensions.Literal[7]` is not a valid parent class.
aliases_newtype.py:60:14 Too many arguments [19]: Call `NewType.__init__` expects 2 positional arguments, 3 were provided.
aliases_newtype.py:41:5 Invalid type parameters [24]: Non-generic type `GoodNewType1` cannot take parameters.
aliases_newtype.py:47:37 Invalid inheritance [39]: `typing.Union[int, str]` is not a valid parent class.
aliases_newtype.py:54:37 Invalid inheritance [39]: `typing_extensions.Literal[7]` is not a valid parent class.
aliases_newtype.py:63:14 Too many arguments [19]: Call `NewType.__init__` expects 2 positional arguments, 3 were provided.
"""
conformance_automated = "Fail"
errors_diff = """
Line 20: Expected 1 errors
Line 18: Expected 1 errors
Line 23: Expected 1 errors
Line 32: Expected 1 errors
Line 47: Expected 1 errors
Line 49: Expected 1 errors
Line 58: Expected 1 errors
Line 62: Expected 1 errors
Line 26: Expected 1 errors
Line 35: Expected 1 errors
Line 50: Expected 1 errors
Line 52: Expected 1 errors
Line 61: Expected 1 errors
Line 65: Expected 1 errors
"""
2 changes: 1 addition & 1 deletion conformance/results/pyre/version.toml
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
version = "pyre 0.9.23"
test_duration = 10.7
test_duration = 5.7
2 changes: 1 addition & 1 deletion conformance/results/pyright/version.toml
Original file line number Diff line number Diff line change
@@ -1,2 +1,2 @@
version = "pyright 1.1.401"
test_duration = 1.0
test_duration = 1.1
8 changes: 4 additions & 4 deletions conformance/results/results.html
Original file line number Diff line number Diff line change
Expand Up @@ -158,14 +158,14 @@ <h3>Python Type System Conformance Test Results</h3>
</header>
<div class="table_container"><table><tbody>
<tr><th class="col1">&nbsp;</th>
<th class='tc-header'><div class='tc-name'>mypy 1.15.0</div>
<div class='tc-time'>1.4sec</div>
<th class='tc-header'><div class='tc-name'>mypy 1.16.0</div>
<div class='tc-time'>1.7sec</div>
</th>
<th class='tc-header'><div class='tc-name'>pyright 1.1.401</div>
<div class='tc-time'>1.0sec</div>
<div class='tc-time'>1.1sec</div>
</th>
<th class='tc-header'><div class='tc-name'>pyre 0.9.23</div>
<div class='tc-time'>0.6sec</div>
<div class='tc-time'>5.7sec</div>
</th>
</tr>
<tr><th class="column" colspan="4">
Expand Down