Skip to content

genfromtxt and loadtxt fails with memory error with big csv #8523

Closed
@szppaks

Description

@szppaks

I tried load a csv containing xyz coordinates, about 27 million rows, and the numpy genformtxt (loadtxt too) exited with a memory error (only on windows wrote error; on fedora after <10 minutes the monitor was gone black, only the hdd worked very hard...). Loaded by the python csv module in a python list and create numpy array from this, that was ok.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions