Potential deadlock/race condition introduced with v8.17 #4622

dloebl · 2025-08-04T14:39:29Z

dloebl
Aug 4, 2025

We started to see various crashes/hangs after upgrading from v8.16 to v8.17. It occurs on a very rare cadence. The crashes appear to be random and not reliable reproducibly with specific images. Here are a few stack traces from crashes (SIGSEGV) that I can share:

Stack trace 1

  | #5  <signal handler called 11 - SIGSEGV>
--
  | #6  0x00007f09e4bbdf10 in g_list_find () from lib/x86_64-linux-gnu/libglib-2.0.so.0
  | #7  0x00007f09e4bdd66a in g_queue_remove () from lib/x86_64-linux-gnu/libglib-2.0.so.0
  | #8  0x00007f09e4ee353d in vips_tile_ref (tile=0x3665f390) at ../libvips/conversion/tilecache.c:540
  | #9  vips_tile_cache_ref (r=<optimized out>, cache=0x7f09707959a0) at ../libvips/conversion/tilecache.c:582
  | #10 vips_tile_cache_gen (out_region=0x340c0930, seq=0x34099f60, a=<optimized out>, b=0x7f09707959a0, stop=0x7f0958157214) at ../libvips/conversion/tilecache.c:639
  | #11 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x340c0930, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #12 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x340c0930, r=r@entry=0x374c6088, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #13 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x340c0930, r=r@entry=0x374c6088) at ../libvips/iofuncs/region.c:1684
  | #14 0x00007f09e4ee4727 in vips_sequential_generate (out_region=0x374c6030, seq=0x340c0930, a=<optimized out>, b=0x7f0970484a80, stop=<optimized out>) at ../libvips/conversion/sequential.c:172
  | #15 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x374c6030, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #16 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x374c6030, r=r@entry=0x7f09581573f0, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #17 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x374c6030, r=r@entry=0x7f09581573f0) at ../libvips/iofuncs/region.c:1684
  | #18 0x00007f09e4efea98 in vips_extract_area_gen (out_region=0x359bd390, seq=0x374c6030, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/extract.c:124
  | #19 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x359bd390, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #20 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x359bd390, r=r@entry=0x36e2c358, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #21 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x359bd390, r=r@entry=0x36e2c358) at ../libvips/iofuncs/region.c:1684
  | #22 0x00007f09e4f8a96d in vips_image_write_gen (out_region=0x36e2c300, seq=0x359bd390, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #23 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x36e2c300, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #24 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x36e2c300, r=r@entry=0x35ffb668, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #25 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x36e2c300, r=r@entry=0x35ffb668) at ../libvips/iofuncs/region.c:1684
  | #26 0x00007f09e4d9421d in vips_foreign_load_generate (out_region=0x35ffb610, seq=0x36e2c300, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/foreign/foreign.c:1074
  | #27 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x35ffb610, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #28 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x35ffb610, r=r@entry=0x34795518, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #29 0x00007f09e4faa15d in vips_region_prepare (reg=0x35ffb610, r=r@entry=0x34795518) at ../libvips/iofuncs/region.c:1684
  | #30 0x00007f09e4f80eb4 in vips_reorder_prepare_many (image=<optimized out>, regions=regions@entry=0x3772d3b0, r=r@entry=0x34795518) at ../libvips/iofuncs/reorder.c:344
  | #31 0x00007f09e4e91626 in vips_colour_gen (out_region=0x347954c0, seq=0x3772d3b0, a=<optimized out>, b=0x7f0994233aa0, stop=<optimized out>) at ../libvips/colour/colour.c:137
  | #32 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x347954c0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #33 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x347954c0, r=r@entry=0x394241c8, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #34 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x347954c0, r=r@entry=0x394241c8) at ../libvips/iofuncs/region.c:1684
  | #35 0x00007f09e4ef911d in vips_copy_gen (out_region=0x39424170, seq=0x347954c0, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #36 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x39424170, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #37 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x39424170, r=r@entry=0x397d9028, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #38 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x39424170, r=r@entry=0x397d9028) at ../libvips/iofuncs/region.c:1684
  | #39 0x00007f09e4ef911d in vips_copy_gen (out_region=0x397d8fd0, seq=0x39424170, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #40 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x397d8fd0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #41 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x397d8fd0, r=r@entry=0x7f0958157cc0, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #42 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x397d8fd0, r=r@entry=0x7f0958157cc0) at ../libvips/iofuncs/region.c:1684
  | #43 0x00007f09e4efa1d2 in vips_embed_base_gen (out_region=0x370cd160, seq=0x397d8fd0, a=<optimized out>, b=0x7f0994576e60, stop=<optimized out>) at ../libvips/conversion/embed.c:250
  | #44 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x370cd160, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #45 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x370cd160, r=r@entry=0x7f0958157e10, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #46 0x00007f09e4faa15d in vips_region_prepare (reg=0x370cd160, r=0x7f0958157e10) at ../libvips/iofuncs/region.c:1684
  | #47 0x00007f09e4e72652 in vips_reducev_uchar_vector_gen (out_region=0x364c3f50, vseq=<optimized out>, a=<optimized out>, b=0x7f0994e340b0, stop=<optimized out>) at ../libvips/resample/reducev.cpp:613
  | #48 0x00007f09e4f9bcdc in vips_region_generate (a=0x0, reg=0x364c3f50) at ../libvips/iofuncs/region.c:1616
  | #49 vips_region_prepare_to_generate (reg=reg@entry=0x364c3f50, dest=dest@entry=0x34efc080, r=r@entry=0x7f0958157f20, x=x@entry=0, y=y@entry=530) at ../libvips/iofuncs/region.c:1739
  | #50 0x00007f09e4faa374 in vips_region_prepare_to (reg=reg@entry=0x364c3f50, dest=0x34efc080, r=r@entry=0x3600e0ac, x=0, y=530) at ../libvips/iofuncs/region.c:1878
  | #51 0x00007f09e4ee36a2 in vips_tile_cache_gen (out_region=0x377814f0, seq=0x364c3f50, a=<optimized out>, b=0x7f0970a10ca0, stop=0x7f0958158034) at ../libvips/conversion/tilecache.c:693
  | #52 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x377814f0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #53 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x377814f0, r=r@entry=0x36cc7d88, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #54 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x377814f0, r=r@entry=0x36cc7d88) at ../libvips/iofuncs/region.c:1684
  | #55 0x00007f09e4ee4727 in vips_sequential_generate (out_region=0x36cc7d30, seq=0x377814f0, a=<optimized out>, b=0x7f09965a7250, stop=<optimized out>) at ../libvips/conversion/sequential.c:172
  | #56 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x36cc7d30, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #57 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x36cc7d30, r=r@entry=0x35efe018, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #58 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x36cc7d30, r=r@entry=0x35efe018) at ../libvips/iofuncs/region.c:1684
  | #59 0x00007f09e4f8a96d in vips_image_write_gen (out_region=0x35efdfc0, seq=0x36cc7d30, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #60 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x35efdfc0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #61 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x35efdfc0, r=r@entry=0x35b1e5e8, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #62 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x35efdfc0, r=r@entry=0x35b1e5e8) at ../libvips/iofuncs/region.c:1684
  | #63 0x00007f09e4ef911d in vips_copy_gen (out_region=0x35b1e590, seq=0x35efdfc0, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #64 0x00007f09e4f9bcdc in vips_region_generate (a=0x0, reg=0x35b1e590) at ../libvips/iofuncs/region.c:1616
  | #65 vips_region_prepare_to_generate (reg=reg@entry=0x35b1e590, dest=dest@entry=0x35a56810, r=r@entry=0x7f09581583c0, x=x@entry=4, y=y@entry=528) at ../libvips/iofuncs/region.c:1739
  | #66 0x00007f09e4faa374 in vips_region_prepare_to (reg=reg@entry=0x35b1e590, dest=dest@entry=0x35a56810, r=r@entry=0x7f09581584d0, x=4, y=528) at ../libvips/iofuncs/region.c:1878
  | #67 0x00007f09e4efa337 in vips_embed_base_gen (out_region=0x35a56810, seq=0x35b1e590, a=<optimized out>, b=0x7f0995e4c380, stop=<optimized out>) at ../libvips/conversion/embed.c:266
  | #68 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x35a56810, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #69 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x35a56810, r=r@entry=0x7f0958158640, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #70 0x00007f09e4faa15d in vips_region_prepare (reg=0x35a56810, r=0x7f0958158640) at ../libvips/iofuncs/region.c:1684
  | #71 0x00007f09e4e6f1bd in vips_reduceh_uchar_vector_gen (out_region=0x340691e0, seq=0x35a56810, a=0x7f0994228040, b=0x7f0997792690, stop=<optimized out>) at ../libvips/resample/reduceh.cpp:361
  | #72 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x340691e0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #73 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x340691e0, r=r@entry=0x383a1578, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #74 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x340691e0, r=r@entry=0x383a1578) at ../libvips/iofuncs/region.c:1684
  | #75 0x00007f09e4f8a96d in vips_image_write_gen (out_region=0x383a1520, seq=0x340691e0, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #76 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x383a1520, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #77 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x383a1520, r=r@entry=0x3627b778, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #78 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x383a1520, r=r@entry=0x3627b778) at ../libvips/iofuncs/region.c:1684
  | #79 0x00007f09e4ef911d in vips_copy_gen (out_region=0x3627b720, seq=0x383a1520, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #80 0x00007f09e4f9a655 in vips_region_generate (reg=reg@entry=0x3627b720, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #81 0x00007f09e4f9b399 in vips_region_fill (reg=reg@entry=0x3627b720, r=r@entry=0x36236bc8, fn=fn@entry=0x7f09e4f9a600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #82 0x00007f09e4faa15d in vips_region_prepare (reg=reg@entry=0x3627b720, r=r@entry=0x36236bc8) at ../libvips/iofuncs/region.c:1684
  | #83 0x00007f09e4f8a96d in vips_image_write_gen (out_region=0x36236b70, seq=0x3627b720, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #84 0x00007f09e4f9bcdc in vips_region_generate (a=0x0, reg=0x36236b70) at ../libvips/iofuncs/region.c:1616
  | #85 vips_region_prepare_to_generate (reg=reg@entry=0x36236b70, dest=dest@entry=0x7f099514cc60, r=r@entry=0x7f09581589f0, x=x@entry=0, y=y@entry=528) at ../libvips/iofuncs/region.c:1739
  | #86 0x00007f09e4faa374 in vips_region_prepare_to (reg=0x36236b70, dest=0x7f099514cc60, r=<optimized out>, x=0, y=528) at ../libvips/iofuncs/region.c:1878
  | #87 0x00007f09e4f927cc in sink_memory_area_work_fn (state=<optimized out>, a=<optimized out>) at ../libvips/iofuncs/sinkmemory.c:264
  | #88 0x00007f09e4f7b2ef in vips_worker_work_unit (worker=0x7f0972c71a20) at ../libvips/iofuncs/threadpool.c:368
  | #89 vips_thread_main_loop (a=0x7f0972c71a20, b=<optimized out>) at ../libvips/iofuncs/threadpool.c:395
  | #90 0x00007f09e4f7aa7c in vips_threadset_work (pointer=0x33f9c8a0) at ../libvips/iofuncs/threadset.c:187
  | #91 0x00007f09e4f7a643 in vips_thread_run (data=0x7f09977434b0) at ../libvips/iofuncs/thread.c:108
  | #92 0x00007f09e4bfc6e3 in g_thread_proxy () from lib/x86_64-linux-gnu/libglib-2.0.so.0
  | #93 0x00007f09e3641aa4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:447
  | #94 0x00007f09e36cea34 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:100

Stack trace 2

  | #5  <signal handler called 11 - SIGSEGV>
--
  | #6  __tls_get_addr () at ../sysdeps/x86_64/tls_get_addr.S:39
  | #7  0x0000798cbd7d716b in g_object_ref () from lib/x86_64-linux-gnu/libgobject-2.0.so.0
  | #8  0x0000798cbd7dc995 in g_object_set_valist () from lib/x86_64-linux-gnu/libgobject-2.0.so.0
  | #9  0x0000798cbd7ddc1f in g_object_set () from lib/x86_64-linux-gnu/libgobject-2.0.so.0
  | #10 0x0000798cbda740fa in vips_object_real_build (object=0x798c6d4eba90) at ../libvips/iofuncs/object.c:1443
  | #11 0x0000798cbda894f0 in vips_region_build (object=0x798c6d4eba90) at ../libvips/iofuncs/region.c:431
  | #12 0x0000798cbda7421b in vips_object_build (object=object@entry=0x798c6d4eba90) at ../libvips/iofuncs/object.c:369
  | #13 0x0000798cbda89be2 in vips_region_new (image=0xe251580) at ../libvips/iofuncs/region.c:504
  | #14 0x0000798cbd9d20f9 in vips_tile_new (cache=cache@entry=0xdaf26e0, x=x@entry=0, y=y@entry=460) at ../libvips/conversion/tilecache.c:225
  | #15 0x0000798cbd9d257e in vips_tile_find (y=460, x=0, cache=0xdaf26e0) at ../libvips/conversion/tilecache.c:326
  | #16 vips_tile_cache_ref (r=<optimized out>, cache=0xdaf26e0) at ../libvips/conversion/tilecache.c:577
  | #17 vips_tile_cache_gen (out_region=0x798c6c612050, seq=0x798c4bf7e9e0, a=<optimized out>, b=0xdaf26e0, stop=0x798c5c094bd4) at ../libvips/conversion/tilecache.c:639
  | #18 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6c612050, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #19 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6c612050, r=r@entry=0x798c497b9148, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #20 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c6c612050, r=r@entry=0x798c497b9148) at ../libvips/iofuncs/region.c:1684
  | #21 0x0000798cbd9d3727 in vips_sequential_generate (out_region=0x798c497b90f0, seq=0x798c6c612050, a=<optimized out>, b=0xd97bac0, stop=<optimized out>) at ../libvips/conversion/sequential.c:172
  | #22 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c497b90f0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #23 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c497b90f0, r=r@entry=0x798c498c43c8, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #24 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c497b90f0, r=r@entry=0x798c498c43c8) at ../libvips/iofuncs/region.c:1684
  | #25 0x0000798cbda7996d in vips_image_write_gen (out_region=0x798c498c4370, seq=0x798c497b90f0, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #26 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c498c4370, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #27 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c498c4370, r=r@entry=0x798c4931f3a8, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #28 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c498c4370, r=r@entry=0x798c4931f3a8) at ../libvips/iofuncs/region.c:1684
  | #29 0x0000798cbd9e811d in vips_copy_gen (out_region=0x798c4931f350, seq=0x798c498c4370, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #30 0x0000798cbda8acdc in vips_region_generate (a=0x0, reg=0x798c4931f350) at ../libvips/iofuncs/region.c:1616
  | #31 vips_region_prepare_to_generate (reg=reg@entry=0x798c4931f350, dest=dest@entry=0x798c6eb3bdd0, r=r@entry=0x798c5c094f60, x=x@entry=7, y=y@entry=448) at ../libvips/iofuncs/region.c:1739
  | #32 0x0000798cbda99374 in vips_region_prepare_to (reg=reg@entry=0x798c4931f350, dest=dest@entry=0x798c6eb3bdd0, r=r@entry=0x798c5c095070, x=7, y=448) at ../libvips/iofuncs/region.c:1878
  | #33 0x0000798cbd9e9337 in vips_embed_base_gen (out_region=0x798c6eb3bdd0, seq=0x798c4931f350, a=<optimized out>, b=0x11110f20, stop=<optimized out>) at ../libvips/conversion/embed.c:266
  | #34 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6eb3bdd0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #35 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6eb3bdd0, r=r@entry=0x798c5c0951e0, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #36 0x0000798cbda9915d in vips_region_prepare (reg=0x798c6eb3bdd0, r=0x798c5c0951e0) at ../libvips/iofuncs/region.c:1684
  | #37 0x0000798cbd95e1bd in vips_reduceh_uchar_vector_gen (out_region=0x798c6c236e10, seq=0x798c6eb3bdd0, a=0x1315aaa0, b=0xdb2fd50, stop=<optimized out>) at ../libvips/resample/reduceh.cpp:361
  | #38 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6c236e10, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #39 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6c236e10, r=r@entry=0x798c496ce5d8, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #40 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c6c236e10, r=r@entry=0x798c496ce5d8) at ../libvips/iofuncs/region.c:1684
  | #41 0x0000798cbda7996d in vips_image_write_gen (out_region=0x798c496ce580, seq=0x798c6c236e10, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #42 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c496ce580, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #43 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c496ce580, r=r@entry=0x798c6c1505e8, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #44 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c496ce580, r=r@entry=0x798c6c1505e8) at ../libvips/iofuncs/region.c:1684
  | #45 0x0000798cbd9e811d in vips_copy_gen (out_region=0x798c6c150590, seq=0x798c496ce580, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #46 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6c150590, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #47 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6c150590, r=r@entry=0x798c6d9b9a38, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #48 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c6c150590, r=r@entry=0x798c6d9b9a38) at ../libvips/iofuncs/region.c:1684
  | #49 0x0000798cbda7996d in vips_image_write_gen (out_region=0x798c6d9b99e0, seq=0x798c6c150590, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #50 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6d9b99e0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #51 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6d9b99e0, r=r@entry=0x798c6c6db3f8, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #52 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c6d9b99e0, r=r@entry=0x798c6c6db3f8) at ../libvips/iofuncs/region.c:1684
  | #53 0x0000798cbda7996d in vips_image_write_gen (out_region=0x798c6c6db3a0, seq=0x798c6d9b99e0, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #54 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6c6db3a0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #55 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6c6db3a0, r=r@entry=0x798c6c552178, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #56 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c6c6db3a0, r=r@entry=0x798c6c552178) at ../libvips/iofuncs/region.c:1684
  | #57 0x0000798cbda7996d in vips_image_write_gen (out_region=0x798c6c552120, seq=0x798c6c6db3a0, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #58 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6c552120, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #59 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6c552120, r=r@entry=0x798c6c2c7b78, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #60 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c6c552120, r=r@entry=0x798c6c2c7b78) at ../libvips/iofuncs/region.c:1684
  | #61 0x0000798cbd9e811d in vips_copy_gen (out_region=0x798c6c2c7b20, seq=0x798c6c552120, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #62 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6c2c7b20, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #63 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6c2c7b20, r=r@entry=0x798c6c3c8dc8, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #64 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c6c2c7b20, r=r@entry=0x798c6c3c8dc8) at ../libvips/iofuncs/region.c:1684
  | #65 0x0000798cbda7996d in vips_image_write_gen (out_region=0x798c6c3c8d70, seq=0x798c6c2c7b20, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #66 0x0000798cbda89655 in vips_region_generate (reg=reg@entry=0x798c6c3c8d70, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #67 0x0000798cbda8a399 in vips_region_fill (reg=reg@entry=0x798c6c3c8d70, r=r@entry=0x798c6df63178, fn=fn@entry=0x798cbda89600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #68 0x0000798cbda9915d in vips_region_prepare (reg=reg@entry=0x798c6c3c8d70, r=r@entry=0x798c6df63178) at ../libvips/iofuncs/region.c:1684
  | #69 0x0000798cbda7996d in vips_image_write_gen (out_region=0x798c6df63120, seq=0x798c6c3c8d70, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #70 0x0000798cbda8acdc in vips_region_generate (a=0x0, reg=0x798c6df63120) at ../libvips/iofuncs/region.c:1616
  | #71 vips_region_prepare_to_generate (reg=reg@entry=0x798c6df63120, dest=dest@entry=0xeead920, r=r@entry=0x798c5c0959f0, x=x@entry=0, y=y@entry=448) at ../libvips/iofuncs/region.c:1739
  | #72 0x0000798cbda99374 in vips_region_prepare_to (reg=0x798c6df63120, dest=0xeead920, r=r@entry=0x798c4930b570, x=0, y=448) at ../libvips/iofuncs/region.c:1878
  | #73 0x0000798cbda81dec in wbuffer_work_fn (state=0x798c4930b510, a=<optimized out>) at ../libvips/iofuncs/sinkdisc.c:438
  | #74 0x0000798cbda6a2ef in vips_worker_work_unit (worker=0xf1cc420) at ../libvips/iofuncs/threadpool.c:368
  | #75 vips_thread_main_loop (a=0xf1cc420, b=<optimized out>) at ../libvips/iofuncs/threadpool.c:395
  | #76 0x0000798cbda69a7c in vips_threadset_work (pointer=0x798c6c008510) at ../libvips/iofuncs/threadset.c:187
  | #77 0x0000798cbda69643 in vips_thread_run (data=0x798c6d7458a0) at ../libvips/iofuncs/thread.c:108
  | #78 0x0000798cbd6eb6e3 in g_thread_proxy () from lib/x86_64-linux-gnu/libglib-2.0.so.0
  | #79 0x0000798cbc130aa4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:447
  | #80 0x0000798cbc1bda34 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:100

Stack trace 3

  | #5 <signal handler called 11 - SIGSEGV>
--
  | #6  _mm512_add_epi32(long long __vector(8), long long __vector(8)) (__B=..., __A=...) at /usr/lib/gcc/x86_64-linux-gnu/13/include/avx512fintrin.h:895
  | #7  hwy::N_AVX3_SPR::operator+ (b=..., a=...) at include/hwy/ops/x86_512-inl.h:1086
  | #8  hwy::N_AVX3_SPR::Add<hwy::N_AVX3_SPR::Vec512<unsigned int> > (b=..., a=...) at include/hwy/ops/generic_ops-inl.h:6958
  | #9  N_AVX3_SPR::vips_shrinkv_add_line_uchar_hwy (pin=pin@entry=0x100dca38 "\226lm\226lm\226nn\227oo\230pp\231qq\232rr\233ss\232rr\232rr\231qq\231qq\230pp\230pp\230no\230no\231op\231op\230no\230no\230no\227mn\227mn\227mn\227mn\227mn\227mn\230no\231op\233qr\234rs\235st\232rr\232rr\231qq\230pp\231qq\231qq\232rr\233ss\232rr\232rr\233ss\235uu\240xx\241yy\240xx\236xw\235vw\234xx\235yy\237{{\240\|\|\240\|\|\237}~\236\|}\234z{\234z{\233{\|\235}~\237\177\202\236~\201\231y\|\225ux\216no\222po\221o"..., ne=ne@entry=12726, sum=sum@entry=0x10015ca0) at ../libvips/resample/shrinkv_hwy.cpp:104
  | #10 0x0000791f82b0f6f9 in vips_shrinkv_add_line_uchar_hwy(VipsPel *, int, unsigned int * __restrict__) (pin=0x100dca38 "\226lm\226lm\226nn\227oo\230pp\231qq\232rr\233ss\232rr\232rr\231qq\231qq\230pp\230pp\230no\230no\231op\231op\230no\230no\230no\227mn\227mn\227mn\227mn\227mn\227mn\230no\231op\233qr\234rs\235st\232rr\232rr\231qq\230pp\231qq\231qq\232rr\233ss\232rr\232rr\233ss\235uu\240xx\241yy\240xx\236xw\235vw\234xx\235yy\237{{\240\|\|\240\|\|\237}~\236\|}\234z{\234z{\233{\|\235}~\237\177\202\236~\201\231y\|\225ux\216no\222po\221o"..., ne=ne@entry=12726, sum=0x10015ca0) at ../libvips/resample/shrinkv_hwy.cpp:200
  | #11 0x0000791f82b0eca9 in vips_shrinkv_uchar_vector_gen (out_region=0xd9d4db0, vseq=0x1062d830, a=<optimized out>, b=0x791f3038ca30, stop=<optimized out>) at ../libvips/resample/shrinkv.c:440
  | #12 0x0000791f82c3ccdc in vips_region_generate (a=0x0, reg=0xd9d4db0) at ../libvips/iofuncs/region.c:1616
  | #13 vips_region_prepare_to_generate (reg=reg@entry=0xd9d4db0, dest=dest@entry=0xd353bf0, r=r@entry=0x791f1f8e63f0, x=x@entry=0, y=y@entry=1120) at ../libvips/iofuncs/region.c:1739
  | #14 0x0000791f82c4b374 in vips_region_prepare_to (reg=reg@entry=0xd9d4db0, dest=0xd353bf0, r=r@entry=0xda6002c, x=0, y=1120) at ../libvips/iofuncs/region.c:1878
  | #15 0x0000791f82b846a2 in vips_tile_cache_gen (out_region=0xe055340, seq=0xd9d4db0, a=<optimized out>, b=0x791f30f68270, stop=0x791f1f8e6504) at ../libvips/conversion/tilecache.c:693
  | #16 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xe055340, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #17 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xe055340, r=r@entry=0xda04c68, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #18 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xe055340, r=r@entry=0xda04c68) at ../libvips/iofuncs/region.c:1684
  | #19 0x0000791f82b85727 in vips_sequential_generate (out_region=0xda04c10, seq=0xe055340, a=<optimized out>, b=0x791f31271cc0, stop=<optimized out>) at ../libvips/conversion/sequential.c:172
  | #20 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xda04c10, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #21 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xda04c10, r=r@entry=0xee040a8, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #22 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xda04c10, r=r@entry=0xee040a8) at ../libvips/iofuncs/region.c:1684
  | #23 0x0000791f82c2b96d in vips_image_write_gen (out_region=0xee04050, seq=0xda04c10, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #24 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xee04050, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #25 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xee04050, r=r@entry=0xd559f08, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #26 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xee04050, r=r@entry=0xd559f08) at ../libvips/iofuncs/region.c:1684
  | #27 0x0000791f82b9a11d in vips_copy_gen (out_region=0xd559eb0, seq=0xee04050, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #28 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xd559eb0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #29 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xd559eb0, r=r@entry=0x791f1f8e6980, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #30 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xd559eb0, r=r@entry=0x791f1f8e6980) at ../libvips/iofuncs/region.c:1684
  | #31 0x0000791f82b9b1d2 in vips_embed_base_gen (out_region=0xd9e1260, seq=0xd559eb0, a=<optimized out>, b=0x791f304d2ee0, stop=<optimized out>) at ../libvips/conversion/embed.c:250
  | #32 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xd9e1260, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #33 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xd9e1260, r=r@entry=0x791f1f8e6ac0, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #34 0x0000791f82c4b15d in vips_region_prepare (reg=0xd9e1260, r=0x791f1f8e6ac0) at ../libvips/iofuncs/region.c:1684
  | #35 0x0000791f82b13652 in vips_reducev_uchar_vector_gen (out_region=0xd31b740, vseq=<optimized out>, a=<optimized out>, b=0x791f3148ed30, stop=<optimized out>) at ../libvips/resample/reducev.cpp:613
  | #36 0x0000791f82c3ccdc in vips_region_generate (a=0x0, reg=0xd31b740) at ../libvips/iofuncs/region.c:1616
  | #37 vips_region_prepare_to_generate (reg=reg@entry=0xd31b740, dest=dest@entry=0xd2333c0, r=r@entry=0x791f1f8e6bd0, x=x@entry=0, y=y@entry=470) at ../libvips/iofuncs/region.c:1739
  | #38 0x0000791f82c4b374 in vips_region_prepare_to (reg=reg@entry=0xd31b740, dest=0xd2333c0, r=r@entry=0xd23339c, x=0, y=470) at ../libvips/iofuncs/region.c:1878
  | #39 0x0000791f82b846a2 in vips_tile_cache_gen (out_region=0xd4dc4f0, seq=0xd31b740, a=<optimized out>, b=0x791f3019d5b0, stop=0x791f1f8e6ce4) at ../libvips/conversion/tilecache.c:693
  | #40 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xd4dc4f0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #41 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xd4dc4f0, r=r@entry=0xd55eaa8, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #42 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xd4dc4f0, r=r@entry=0xd55eaa8) at ../libvips/iofuncs/region.c:1684
  | #43 0x0000791f82b85727 in vips_sequential_generate (out_region=0xd55ea50, seq=0xd4dc4f0, a=<optimized out>, b=0x791f30710300, stop=<optimized out>) at ../libvips/conversion/sequential.c:172
  | #44 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xd55ea50, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #45 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xd55ea50, r=r@entry=0xd335938, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #46 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xd55ea50, r=r@entry=0xd335938) at ../libvips/iofuncs/region.c:1684
  | #47 0x0000791f82c2b96d in vips_image_write_gen (out_region=0xd3358e0, seq=0xd55ea50, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #48 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xd3358e0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #49 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xd3358e0, r=r@entry=0x791f1f8e7080, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #50 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xd3358e0, r=r@entry=0x791f1f8e7080) at ../libvips/iofuncs/region.c:1684
  | #51 0x0000791f82b9b1d2 in vips_embed_base_gen (out_region=0xe10f130, seq=0xd3358e0, a=<optimized out>, b=0x791f335aa990, stop=<optimized out>) at ../libvips/conversion/embed.c:250
  | #52 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xe10f130, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #53 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xe10f130, r=r@entry=0x791f1f8e71d0, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #54 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xe10f130, r=r@entry=0x791f1f8e71d0) at ../libvips/iofuncs/region.c:1684
  | #55 0x0000791f82b0bf34 in vips_shrinkh_uchar_vector_gen (out_region=0xd3366a0, seq=0xe10f130, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/resample/shrinkh.c:308
  | #56 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xd3366a0, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #57 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xd3366a0, r=r@entry=0xd25c548, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #58 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xd3366a0, r=r@entry=0xd25c548) at ../libvips/iofuncs/region.c:1684
  | #59 0x0000791f82b9a11d in vips_copy_gen (out_region=0xd25c4f0, seq=0xd3366a0, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #60 0x0000791f82c3ccdc in vips_region_generate (a=0x0, reg=0xd25c4f0) at ../libvips/iofuncs/region.c:1616
  | #61 vips_region_prepare_to_generate (reg=reg@entry=0xd25c4f0, dest=dest@entry=0x10b51460, r=r@entry=0x791f1f8e73c0, x=x@entry=7, y=y@entry=384) at ../libvips/iofuncs/region.c:1739
  | #62 0x0000791f82c4b374 in vips_region_prepare_to (reg=reg@entry=0xd25c4f0, dest=dest@entry=0x10b51460, r=r@entry=0x791f1f8e74d0, x=7, y=384) at ../libvips/iofuncs/region.c:1878
  | #63 0x0000791f82b9b337 in vips_embed_base_gen (out_region=0x10b51460, seq=0xd25c4f0, a=<optimized out>, b=0x791f3132fc60, stop=<optimized out>) at ../libvips/conversion/embed.c:266
  | #64 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0x10b51460, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #65 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0x10b51460, r=r@entry=0x791f1f8e7640, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #66 0x0000791f82c4b15d in vips_region_prepare (reg=0x10b51460, r=0x791f1f8e7640) at ../libvips/iofuncs/region.c:1684
  | #67 0x0000791f82b101bd in vips_reduceh_uchar_vector_gen (out_region=0xd2c4900, seq=0x10b51460, a=0x791f30ed5930, b=0x791f311cb070, stop=<optimized out>) at ../libvips/resample/reduceh.cpp:361
  | #68 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xd2c4900, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #69 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xd2c4900, r=r@entry=0xe0aa8d8, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #70 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xd2c4900, r=r@entry=0xe0aa8d8) at ../libvips/iofuncs/region.c:1684
  | #71 0x0000791f82c2b96d in vips_image_write_gen (out_region=0xe0aa880, seq=0xd2c4900, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #72 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xe0aa880, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #73 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xe0aa880, r=r@entry=0xd1b6668, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #74 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xe0aa880, r=r@entry=0xd1b6668) at ../libvips/iofuncs/region.c:1684
  | #75 0x0000791f82b9a11d in vips_copy_gen (out_region=0xd1b6610, seq=0xe0aa880, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/conversion/copy.c:140
  | #76 0x0000791f82c3b655 in vips_region_generate (reg=reg@entry=0xd1b6610, a=a@entry=0x0) at ../libvips/iofuncs/region.c:1616
  | #77 0x0000791f82c3c399 in vips_region_fill (reg=reg@entry=0xd1b6610, r=r@entry=0xd31bf48, fn=fn@entry=0x791f82c3b600 <vips_region_generate>, a=a@entry=0x0) at ../libvips/iofuncs/region.c:867
  | #78 0x0000791f82c4b15d in vips_region_prepare (reg=reg@entry=0xd1b6610, r=r@entry=0xd31bf48) at ../libvips/iofuncs/region.c:1684
  | #79 0x0000791f82c2b96d in vips_image_write_gen (out_region=0xd31bef0, seq=0xd1b6610, a=<optimized out>, b=<optimized out>, stop=<optimized out>) at ../libvips/iofuncs/image.c:2611
  | #80 0x0000791f82c3ccdc in vips_region_generate (a=0x0, reg=0xd31bef0) at ../libvips/iofuncs/region.c:1616
  | #81 vips_region_prepare_to_generate (reg=reg@entry=0xd31bef0, dest=dest@entry=0x791f335a92b0, r=r@entry=0x791f1f8e79f0, x=x@entry=0, y=y@entry=384) at ../libvips/iofuncs/region.c:1739
  | #82 0x0000791f82c4b374 in vips_region_prepare_to (reg=0xd31bef0, dest=0x791f335a92b0, r=<optimized out>, x=0, y=384) at ../libvips/iofuncs/region.c:1878
  | #83 0x0000791f82c337cc in sink_memory_area_work_fn (state=<optimized out>, a=<optimized out>) at ../libvips/iofuncs/sinkmemory.c:264
  | #84 0x0000791f82c1c2ef in vips_worker_work_unit (worker=0x791f31260bc0) at ../libvips/iofuncs/threadpool.c:368
  | #85 vips_thread_main_loop (a=0x791f31260bc0, b=<optimized out>) at ../libvips/iofuncs/threadpool.c:395
  | #86 0x0000791f82c1ba7c in vips_threadset_work (pointer=0x791f300087c0) at ../libvips/iofuncs/threadset.c:187
  | #87 0x0000791f82c1b643 in vips_thread_run (data=0xd33fa00) at ../libvips/iofuncs/thread.c:108
  | #88 0x0000791f8289d6e3 in g_thread_proxy () from lib/x86_64-linux-gnu/libglib-2.0.so.0
  | #89 0x0000791f812e2aa4 in start_thread (arg=<optimized out>) at ./nptl/pthread_create.c:447
  | #90 0x0000791f8136fa34 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:100

Maybe someone has an idea which recent change could have caused this?

jcupitt · 2025-08-04T15:00:02Z

jcupitt
Aug 4, 2025
Maintainer

Hi @dloebl,

Oooof what a horrible bug. tilecache seems to be in all the traces, it saw some changes in 8.17, and it's a very tricky bit of code.

Would it be possible to copy the tilecache.c from 8.16 into 8.17 and see if that fixes it? That would narrow down the search.

10 replies

jcupitt Aug 5, 2025
Maintainer

I find helgrind difficult to use, it generates so many false positives.

clang has an integrated threadsanitiser that I think works a little better, it might be worth trying that.

kleisauke Aug 5, 2025
Maintainer

I'm not sure if you're using the ImageMagick loader, but I think I found something with ThreadSanitizer related to vips_foreign_load_magick7_finalize() (and possibly vips_foreign_load_magick_finalize() as well).

kleisauke Aug 5, 2025
Maintainer

I'm not entirely sure of the cause, but it might be related to commit a7e8f46. Reverting the changes to colour.c in that commit makes ThreadSanitizer pass on the test suite (using the updated suppressions from PR #4623). I tried this because vips_colour_gen kept appearing in the TSan traces.

I think I found something with ThreadSanitizer related to vips_foreign_load_magick7_finalize() (and possibly vips_foreign_load_magick_finalize() as well).

This was likely a false positive related to the following warning:

Warning: please export TSAN_OPTIONS='ignore_noninstrumented_modules=1' to avoid false positive reports from the OpenMP runtime!

Setting that option caused the suspicious lock-order-inversion (potential deadlock) warnings to disappear.

dloebl Aug 6, 2025
Author

Thanks for looking into this! I've also started a PR to add a TSan CI workflow #4624 based on your PR, to make sure that the TSan suppression file is continuously tested and concurrency issues are caught early on. It's still failing, but maybe we can get this figured out after your PR gets merged.

kleisauke Aug 7, 2025
Maintainer

That colour.c TSan report was likely a false positive, probably due to mixing runtimes (I was preloading libtsan.so.2 from GCC instead of libclang_rt.tsan-x86_64.so from Clang).

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

Potential deadlock/race condition introduced with v8.17 #4622

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment 10 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Uh oh!

Potential deadlock/race condition introduced with v8.17 #4622

Uh oh!

dloebl Aug 4, 2025

Replies: 1 comment · 10 replies

Uh oh!

jcupitt Aug 4, 2025 Maintainer

Uh oh!

jcupitt Aug 5, 2025 Maintainer

Uh oh!

kleisauke Aug 5, 2025 Maintainer

Uh oh!

kleisauke Aug 5, 2025 Maintainer

Uh oh!

dloebl Aug 6, 2025 Author

Uh oh!

kleisauke Aug 7, 2025 Maintainer

dloebl
Aug 4, 2025

Replies: 1 comment 10 replies

jcupitt
Aug 4, 2025
Maintainer

jcupitt Aug 5, 2025
Maintainer

kleisauke Aug 5, 2025
Maintainer

kleisauke Aug 5, 2025
Maintainer

dloebl Aug 6, 2025
Author

kleisauke Aug 7, 2025
Maintainer