Using pydantic? #5707

starpit · 2025-04-17T10:33:24Z

starpit
Apr 17, 2025

Importing pydantic seems to be problematic, possibly because pydantic_core is a native module: _pydantic_core.cpython-312-darwin.so. What approach is suggested for these scenarios? Must one manually use the vm.add_native_module() API for these? I was expecting the rustpython loader to handle these transparently, but this does not appear to be the case?

Thanks!

rustpython -c 'import pydantic'
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "...venv/lib/python3.12/site-packages/pydantic/__init__.py", line 5, in <module>
    from ._migration import getattr_migration
  File "...venv/lib/python3.12/site-packages/pydantic/_migration.py", line 4, in <module>
    from .version import version_short
  File "...venv/lib/python3.12/site-packages/pydantic/version.py", line 5, in <module>
    from pydantic_core import __version__ as __pydantic_core_version__
  File "...venv/lib/python3.12/site-packages/pydantic_core/__init__.py", line 6, in <module>
    from ._pydantic_core import (
ModuleNotFoundError: No module named 'pydantic_core._pydantic_core'

starpit · 2025-04-17T10:53:47Z

starpit
Apr 17, 2025
Author

More detail, collected with -vv:

# code object from ...venv/lib/python3.12/site-packages/pydantic_core/__init__.py
# created '...venv/lib/python3.12/site-packages/pydantic_core/__pycache__/__init__.rustpython-01.pyc'
# trying ...venv/lib/python3.12/site-packages/pydantic_core/_pydantic_core.py
# trying ...venv/lib/python3.12/site-packages/pydantic_core/_pydantic_core.pyc
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "_frozen_importlib", line 1461, in __import__
  File "_frozen_importlib", line 1382, in _gcd_import
  File "_frozen_importlib", line 1352, in _find_and_load
  File "_frozen_importlib", line 1355, in _find_and_load
  File "_frozen_importlib", line 1329, in _find_and_load_unlocked
  File "_frozen_importlib", line 1326, in _find_and_load_unlocked
  File "_frozen_importlib", line 1326, in _find_and_load_unlocked
  File "_frozen_importlib", line 945, in _load_unlocked
  File "_frozen_importlib", line 943, in _load_unlocked
  File "_frozen_importlib", line 936, in _load_unlocked
  File "_frozen_importlib", line 930, in _load_unlocked
  File "_frozen_importlib_external", line 994, in exec_module
  File "_frozen_importlib", line 488, in _call_with_frames_removed
  File "...venv/lib/python3.1
2/site-packages/pydantic_core/__init__.py", line 6, in <module>
    from ._pydantic_core import (
  File "_frozen_importlib", line 1465, in __import__
  File "_frozen_importlib", line 1382, in _gcd_import
  File "_frozen_importlib", line 1352, in _find_and_load
  File "_frozen_importlib", line 1355, in _find_and_load
  File "_frozen_importlib", line 1319, in _find_and_load_unlocked

0 replies

youknowone · 2025-04-17T11:00:10Z

youknowone
Apr 17, 2025
Maintainer

vm.add_native_module() is desinged to load rust-written libraries. It won't work.
Currently RustPython only supports pure python libraries.

0 replies

arihant2math · 2025-04-17T14:40:54Z

arihant2math
Apr 17, 2025
Collaborator

To clarify this pydantic_core is written in rust, but uses the C-api to communicate/register it’s module. I will get module loading working in #5604 at some point, but it’s likely not going to be complete enough for pydantic_core to be used (atleast for a bit).

2 replies

arihant2math Apr 17, 2025
Collaborator

Note that older versions of pydantic are pure-python consider downgrading by 1 major version.

starpit Apr 17, 2025
Author

thanks for the info!

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Using pydantic? #5707

{{title}}

{{editor}}'s edit

{{editor}}'s edit

Replies: 3 comments 2 replies

{{title}}

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

Using pydantic? #5707

starpit Apr 17, 2025

Replies: 3 comments · 2 replies

starpit Apr 17, 2025 Author

youknowone Apr 17, 2025 Maintainer

arihant2math Apr 17, 2025 Collaborator

arihant2math Apr 17, 2025 Collaborator

starpit Apr 17, 2025 Author

starpit
Apr 17, 2025

Replies: 3 comments 2 replies

starpit
Apr 17, 2025
Author

youknowone
Apr 17, 2025
Maintainer

arihant2math
Apr 17, 2025
Collaborator

arihant2math Apr 17, 2025
Collaborator

starpit Apr 17, 2025
Author