Skip to content

ggml : set_rows type coverage #14661

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Jul 13, 2025
Merged

ggml : set_rows type coverage #14661

merged 1 commit into from
Jul 13, 2025
+4 −0

Conversation

ggerganov
Copy link
Member

@ggerganov ggerganov commented Jul 13, 2025 •
edited
Loading

Tracking supported types for the ggml_set_rows operator. When coverage is completed, we will enable this functionality (i.e. LLAMA_SET_ROWS) by default.

  • Metal
  • Vulkan
  • CUDA
    • F32
    • F16
    • BF16
    • Q8_0
    • Q5_1
    • Q5_0
    • Q4_1
    • Q4_0
    • IQ4_NL
  • OpenCL
    • FP32
    • F16
    • BF16
    • Q8_0
    • Q5_1
    • Q5_0
    • Q4_1
    • Q4_0
    • IQ4_NL
  • SYCL
    • FP32
    • F16
    • BF16
    • Q8_0
    • Q5_1
    • Q5_0
    • Q4_1
    • Q4_0
    • IQ4_NL
  • CANN
    • F32
    • F16
    • BF16
    • Q8_0
    • Q5_1
    • Q5_0
    • Q4_1
    • Q4_0
    • IQ4_NL

@github-actions github-actions bot added Nvidia GPU Issues specific to Nvidia GPUs ggml changes relating to the ggml tensor library for machine learning labels Jul 13, 2025
@ggerganov ggerganov force-pushed the gg/set-rows-pragmas branch from d7c48e5 to 926c95f Compare July 13, 2025 07:14
@github-actions github-actions bot added SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language Ascend NPU issues specific to Ascend NPUs OpenCL Issues specific to the OpenCL backend labels Jul 13, 2025
@ggerganov ggerganov merged commit 05fec5b into master Jul 13, 2025
56 checks passed
@ggerganov ggerganov deleted the gg/set-rows-pragmas branch July 13, 2025 07:36
@ggerganov ggerganov mentioned this pull request Jul 16, 2025
Merged
23 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
Ascend NPU issues specific to Ascend NPUs ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs OpenCL Issues specific to the OpenCL backend SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@ggerganov