================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x00000080e540 by main thread: #0 SOS_init_existing_runtime /home/khuck/src/sos_flow/src/sos.c:500 (libsos.so+0x87ed) #1 main /home/khuck/src/sos_flow/src/sosd.c:305 (sosd+0x41de5c) Previous read of size 8 at 0x00000080e540 by thread T3: #0 SOSD_cloud_listen_loop /home/khuck/src/sos_flow/src/sosd_cloud_evpath.c:814 (sosd+0x42b164) #1 SOSD_THREAD_cloud_recv /home/khuck/src/sos_flow/src/sosd.c:1182 (sosd+0x41eb52) #2 (libtsan.so.0+0x2970d) Location is global 'SOSD' of size 1528 at 0x00000080e540 (sosd+0x00000080e540) Thread T3 (tid=22005, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:286 (sosd+0x41dd18) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos.c:500 in SOS_init_existing_runtime ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 4 at 0x7b3400000080 by thread T3: #0 SOSD_cloud_listen_loop /home/khuck/src/sos_flow/src/sosd_cloud_evpath.c:814 (sosd+0x42b1bb) #1 SOSD_THREAD_cloud_recv /home/khuck/src/sos_flow/src/sosd.c:1182 (sosd+0x41eb52) #2 (libtsan.so.0+0x2970d) Previous write of size 4 at 0x7b3400000080 by main thread: #0 SOS_init_existing_runtime /home/khuck/src/sos_flow/src/sos.c:214 (libsos.so+0x8554) #1 main /home/khuck/src/sos_flow/src/sosd.c:305 (sosd+0x41de5c) Location is heap block of size 208 at 0x7b3400000000 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 main /home/khuck/src/sos_flow/src/sosd.c:269 (sosd+0x41dc73) Thread T3 (tid=22005, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:286 (sosd+0x41dd18) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosd_cloud_evpath.c:814 in SOSD_cloud_listen_loop ================== ================================================================================== ---------------------------------------------------------------------------------- _/_/_/ _/_/ _/_/_/ ||[]||[]}))))}]|[]|||| Scalable _/ _/ _/ _/ |||||[][{(((({[]|[]||| Observation _/_/ _/ _/ _/_/ |[][]|[]}))))}][]|||[] System _/ _/ _/ _/ []|||[][{(((({[]|[]||| for Scientific _/_/_/ _/_/ _/_/_/ ||[]||[]}))))}][]||[]| Workflows Version: 1.18 Target machine: ktau Compiled on: Jun 28 2018 at 12:28:34 by khuck@ktau Build environment: GNU/Linux 4.4.0-128-generic x86_64 Commit head: 4bb32bc23634be0ed2bea560336dc7ab6e7605fa ---------------------------------------------------------------------------------- ================================================================================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00002310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M41 (0x7b0c00002310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: unlock of an unlocked mutex (or by a wrong thread) (pid=22000) #0 pthread_mutex_unlock (libtsan.so.0+0x3fca9) #1 SOS_target_disconnect /home/khuck/src/sos_flow/src/sos_target.c:360 (libsos.so+0x1c7ba) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:647 (sosd+0x4264a7) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00000000 allocated by main thread: #0 calloc (libtsan.so.0+0x2b023) #1 main /home/khuck/src/sos_flow/src/sosd.c:135 (sosd+0x41d78a) Mutex M11 (0x7b0c00000000) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 main /home/khuck/src/sos_flow/src/sosd.c:136 (sosd+0x41d7a4) SUMMARY: ThreadSanitizer: unlock of an unlocked mutex (or by a wrong thread) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fca9) in __interceptor_pthread_mutex_unlock ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b4000000630 by main thread (mutexes: write M37, write M36): #0 __pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:915 (libsos.so+0x1a2bf) #1 pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:939 (libsos.so+0x1a520) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1412 (sosd+0x4210d1) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous read of size 8 at 0x7b4000000630 by thread T5 (mutexes: write M38, write M35): #0 make_snapshot /home/khuck/src/sos_flow/src/sos_pipe.c:399 (libsos.so+0x1aabd) #1 wait_for_elements /home/khuck/src/sos_flow/src/sos_pipe.c:965 (libsos.so+0x1aabd) #2 __pipe_pop /home/khuck/src/sos_flow/src/sos_pipe.c:1080 (libsos.so+0x1aabd) #3 pipe_pop_eager /home/khuck/src/sos_flow/src/sos_pipe.c:1132 (libsos.so+0x1aabd) #4 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:749 (sosd+0x41f22e) #5 (libtsan.so.0+0x2970d) Location is heap block of size 248 at 0x7b4000000600 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:582 (libsos.so+0x19903) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M37 (0x7b0c00002190) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:60 (libsos.so+0x19de5) #2 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #3 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M36 (0x7b4000000670) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:614 (libsos.so+0x19a1d) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M38 (0x7b0c000021f0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M35 (0x7b4000000648) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:613 (libsos.so+0x19a12) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos_pipe.c:915 in __pipe_push ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c3a80 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M42 (0x7b0c000c3a80) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7fd912965008 by thread T5 (mutexes: write M38, write M35): #0 memcpy (libtsan.so.0+0x32565) #1 memcpy /usr/include/x86_64-linux-gnu/bits/string3.h:53 (libsos.so+0x1ab20) #2 offset_memcpy /home/khuck/src/sos_flow/src/sos_pipe.c:469 (libsos.so+0x1ab20) #3 pop_without_locking /home/khuck/src/sos_flow/src/sos_pipe.c:995 (libsos.so+0x1ab20) #4 __pipe_pop /home/khuck/src/sos_flow/src/sos_pipe.c:1091 (libsos.so+0x1ab20) #5 pipe_pop_eager /home/khuck/src/sos_flow/src/sos_pipe.c:1132 (libsos.so+0x1ab20) #6 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:749 (sosd+0x41f22e) #7 (libtsan.so.0+0x2970d) Previous write of size 8 at 0x7fd912965008 by main thread (mutexes: write M37, write M36): #0 memcpy (libtsan.so.0+0x32565) #1 memcpy /usr/include/x86_64-linux-gnu/bits/string3.h:53 (libsos.so+0x1a28d) #2 offset_memcpy /home/khuck/src/sos_flow/src/sos_pipe.c:469 (libsos.so+0x1a28d) #3 process_push /home/khuck/src/sos_flow/src/sos_pipe.c:847 (libsos.so+0x1a28d) #4 __pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:915 (libsos.so+0x1a28d) #5 pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:939 (libsos.so+0x1a520) #6 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1412 (sosd+0x4210d1) #7 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #8 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 80000000 at 0x7fd912965000 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:587 (libsos.so+0x1990e) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M38 (0x7b0c000021f0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M35 (0x7b4000000648) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:613 (libsos.so+0x19a12) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M37 (0x7b0c00002190) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:60 (libsos.so+0x19de5) #2 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #3 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M36 (0x7b4000000670) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:614 (libsos.so+0x19a1d) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x32565) in memcpy ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b4000000628 by thread T5 (mutexes: write M38, write M35): #0 pop_without_locking /home/khuck/src/sos_flow/src/sos_pipe.c:1019 (libsos.so+0x1ab55) #1 __pipe_pop /home/khuck/src/sos_flow/src/sos_pipe.c:1091 (libsos.so+0x1ab55) #2 pipe_pop_eager /home/khuck/src/sos_flow/src/sos_pipe.c:1132 (libsos.so+0x1ab55) #3 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:749 (sosd+0x41f22e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b4000000628 by main thread (mutexes: write M37, write M36): #0 make_snapshot /home/khuck/src/sos_flow/src/sos_pipe.c:398 (libsos.so+0x1a0a5) #1 wait_for_room /home/khuck/src/sos_flow/src/sos_pipe.c:871 (libsos.so+0x1a0a5) #2 __pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:902 (libsos.so+0x1a0a5) #3 pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:939 (libsos.so+0x1a520) #4 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1412 (sosd+0x4210d1) #5 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #6 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 248 at 0x7b4000000600 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:582 (libsos.so+0x19903) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M38 (0x7b0c000021f0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M35 (0x7b4000000648) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:613 (libsos.so+0x19a12) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M37 (0x7b0c00002190) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:60 (libsos.so+0x19de5) #2 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #3 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Mutex M36 (0x7b4000000670) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:614 (libsos.so+0x19a1d) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos_pipe.c:1019 in pop_without_locking ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c00003090 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M43 (0x7b0c00003090) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M12238715468394640 (0x000000000000) => M38 Mutex M12238715468394640 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M12238715468394640 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M44 (0x7b0c00005310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c00003090 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M45 (0x7b0c00003090) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M12801665421815952 (0x000000000000) => M38 Mutex M12801665421815952 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M12801665421815952 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M46 (0x7b0c00005310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M47 (0x7b0c00005310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M48 (0x7b0c00005310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M49 (0x7b0c00005310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M50 (0x7b0c00005310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M51 (0x7b0c00005310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005310 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M52 (0x7b0c00005310) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b4000000530 by main thread (mutexes: write M33, write M32): #0 __pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:915 (libsos.so+0x1a2bf) #1 pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:939 (libsos.so+0x1a520) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:613 (sosd+0x426558) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous read of size 8 at 0x7b4000000530 by thread T4 (mutexes: write M34, write M31): #0 make_snapshot /home/khuck/src/sos_flow/src/sos_pipe.c:399 (libsos.so+0x1aabd) #1 wait_for_elements /home/khuck/src/sos_flow/src/sos_pipe.c:965 (libsos.so+0x1aabd) #2 __pipe_pop /home/khuck/src/sos_flow/src/sos_pipe.c:1080 (libsos.so+0x1aabd) #3 pipe_pop_eager /home/khuck/src/sos_flow/src/sos_pipe.c:1132 (libsos.so+0x1aabd) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1014 (sosd+0x427a13) #5 (libtsan.so.0+0x2970d) Location is heap block of size 248 at 0x7b4000000500 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:582 (libsos.so+0x19903) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M33 (0x7b0c000020d0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:60 (libsos.so+0x19de5) #2 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #3 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M32 (0x7b4000000570) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:614 (libsos.so+0x19a1d) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M31 (0x7b4000000548) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:613 (libsos.so+0x19a12) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos_pipe.c:915 in __pipe_push ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7fd917db3008 by thread T4 (mutexes: write M34, write M31): #0 memcpy (libtsan.so.0+0x32565) #1 memcpy /usr/include/x86_64-linux-gnu/bits/string3.h:53 (libsos.so+0x1ab20) #2 offset_memcpy /home/khuck/src/sos_flow/src/sos_pipe.c:469 (libsos.so+0x1ab20) #3 pop_without_locking /home/khuck/src/sos_flow/src/sos_pipe.c:995 (libsos.so+0x1ab20) #4 __pipe_pop /home/khuck/src/sos_flow/src/sos_pipe.c:1091 (libsos.so+0x1ab20) #5 pipe_pop_eager /home/khuck/src/sos_flow/src/sos_pipe.c:1132 (libsos.so+0x1ab20) #6 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1014 (sosd+0x427a13) #7 (libtsan.so.0+0x2970d) Previous write of size 8 at 0x7fd917db3008 by main thread (mutexes: write M13083140398535440, write M13364615375246096, write M13646090351956752, write M13927565328667408, write M14209040305378064, write M14490515282088720, write M14771990258799376, write M33, write M32): #0 memcpy (libtsan.so.0+0x32565) #1 memcpy /usr/include/x86_64-linux-gnu/bits/string3.h:53 (libsos.so+0x1a28d) #2 offset_memcpy /home/khuck/src/sos_flow/src/sos_pipe.c:469 (libsos.so+0x1a28d) #3 process_push /home/khuck/src/sos_flow/src/sos_pipe.c:847 (libsos.so+0x1a28d) #4 __pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:915 (libsos.so+0x1a28d) #5 pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:939 (libsos.so+0x1a520) #6 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:613 (sosd+0x426558) #7 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 80000000 at 0x7fd917db3000 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:587 (libsos.so+0x1990e) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M31 (0x7b4000000548) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:613 (libsos.so+0x19a12) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M13083140398535440 is already destroyed. Mutex M13364615375246096 is already destroyed. Mutex M13646090351956752 is already destroyed. Mutex M13927565328667408 is already destroyed. Mutex M14209040305378064 is already destroyed. Mutex M14490515282088720 is already destroyed. Mutex M14771990258799376 is already destroyed. Mutex M33 (0x7b0c000020d0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:60 (libsos.so+0x19de5) #2 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #3 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M32 (0x7b4000000570) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:614 (libsos.so+0x19a1d) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x32565) in memcpy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00005400 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M53 (0x7b0c00005400) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b4000000528 by thread T4 (mutexes: write M34, write M31): #0 pop_without_locking /home/khuck/src/sos_flow/src/sos_pipe.c:1019 (libsos.so+0x1ab55) #1 __pipe_pop /home/khuck/src/sos_flow/src/sos_pipe.c:1091 (libsos.so+0x1ab55) #2 pipe_pop_eager /home/khuck/src/sos_flow/src/sos_pipe.c:1132 (libsos.so+0x1ab55) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1014 (sosd+0x427a13) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b4000000528 by main thread (mutexes: write M13083140398535440, write M13364615375246096, write M13646090351956752, write M13927565328667408, write M14209040305378064, write M14490515282088720, write M14771990258799376, write M33, write M32): #0 make_snapshot /home/khuck/src/sos_flow/src/sos_pipe.c:398 (libsos.so+0x1a0a5) #1 wait_for_room /home/khuck/src/sos_flow/src/sos_pipe.c:871 (libsos.so+0x1a0a5) #2 __pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:902 (libsos.so+0x1a0a5) #3 pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:939 (libsos.so+0x1a520) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:613 (sosd+0x426558) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 248 at 0x7b4000000500 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:582 (libsos.so+0x19903) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M31 (0x7b4000000548) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:613 (libsos.so+0x19a12) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M13083140398535440 is already destroyed. Mutex M13364615375246096 is already destroyed. Mutex M13646090351956752 is already destroyed. Mutex M13927565328667408 is already destroyed. Mutex M14209040305378064 is already destroyed. Mutex M14490515282088720 is already destroyed. Mutex M14771990258799376 is already destroyed. Mutex M33 (0x7b0c000020d0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:60 (libsos.so+0x19de5) #2 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #3 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M32 (0x7b4000000570) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:614 (libsos.so+0x19a1d) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos_pipe.c:1019 in pop_without_locking ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b4000000528 by main thread (mutexes: write M33, write M32): #0 make_snapshot /home/khuck/src/sos_flow/src/sos_pipe.c:398 (libsos.so+0x1a0a5) #1 wait_for_room /home/khuck/src/sos_flow/src/sos_pipe.c:871 (libsos.so+0x1a0a5) #2 __pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:902 (libsos.so+0x1a0a5) #3 pipe_push /home/khuck/src/sos_flow/src/sos_pipe.c:939 (libsos.so+0x1a520) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:613 (sosd+0x426558) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b4000000528 by thread T4 (mutexes: write M34, write M31): #0 pop_without_locking /home/khuck/src/sos_flow/src/sos_pipe.c:1019 (libsos.so+0x1ab55) #1 __pipe_pop /home/khuck/src/sos_flow/src/sos_pipe.c:1091 (libsos.so+0x1ab55) #2 pipe_pop_eager /home/khuck/src/sos_flow/src/sos_pipe.c:1132 (libsos.so+0x1ab55) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1014 (sosd+0x427a13) #4 (libtsan.so.0+0x2970d) Location is heap block of size 248 at 0x7b4000000500 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:582 (libsos.so+0x19903) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M33 (0x7b0c000020d0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:60 (libsos.so+0x19de5) #2 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #3 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M32 (0x7b4000000570) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:614 (libsos.so+0x19a1d) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M31 (0x7b4000000548) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 pipe_new /home/khuck/src/sos_flow/src/sos_pipe.c:613 (libsos.so+0x19a12) #2 SOS_pipe_init /home/khuck/src/sos_flow/src/sos_pipe.c:48 (libsos.so+0x19d41) #3 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2640 (sosd+0x424f99) #4 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos_pipe.c:398 in make_snapshot ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x00000080eb30 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:37 (libsos.so+0x13a65) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x00000080eb30 by thread T4 (mutexes: write M34): #0 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2110 (sosd+0x426d9e) #1 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #2 (libtsan.so.0+0x2970d) Location is global 'SOSD' of size 1528 at 0x00000080e540 (sosd+0x00000080eb30) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:37 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b0400002810 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:73 (libsos.so+0x13d12) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b0400002810 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2107 (sosd+0x426d4c) #2 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #3 (libtsan.so.0+0x2970d) Location is heap block of size 16 at 0x7b0400002810 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2107 (sosd+0x426d4c) #2 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #3 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:73 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 4 at 0x7b6c0001025c by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:77 (libsos.so+0x13d4b) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b6c00010258 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1362 (libsos.so+0x947d) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Location is heap block of size 1656 at 0x7b6c0000fc00 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1362 (libsos.so+0x947d) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:77 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 4 at 0x7b6c0000fd54 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:80 (libsos.so+0x13d9a) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b6c0000fd50 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1362 (libsos.so+0x947d) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Location is heap block of size 1656 at 0x7b6c0000fc00 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1362 (libsos.so+0x947d) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:80 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b0400002818 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:179 (libsos.so+0x1425f) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b0400002818 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2107 (sosd+0x426d4c) #2 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #3 (libtsan.so.0+0x2970d) Location is heap block of size 16 at 0x7b0400002810 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2107 (sosd+0x426d4c) #2 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #3 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:179 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c00003090 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M59 (0x7b0c00003090) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c58b0 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M58 (0x7b0c000c58b0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M16742315095765136 (0x000000000000) => M38 Mutex M16742315095765136 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M16742315095765136 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b48001f76e0 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:83 (libsos.so+0x13e25) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b48001f76e0 by thread T4: [failed to restore the stack] Location is heap block of size 360 at 0x7b48001f7580 allocated by thread T4: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1413 (libsos.so+0x9741) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:83 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b18000147e0 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:89 (libsos.so+0x13e54) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b18000147e0 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b18000147c0 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:89 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b1800014818 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:101 (libsos.so+0x13e7d) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800014818 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b18000147c0 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:101 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b1800015380 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:89 (libsos.so+0x13e54) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800015380 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b1800015360 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:89 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b18000153b8 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:101 (libsos.so+0x13e7d) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b18000153b8 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b1800015360 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:101 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c0000b7c0 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M105 (0x7b0c0000b7c0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c00003090 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M106 (0x7b0c00003090) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M29971639001165968 (0x000000000000) => M38 Mutex M29971639001165968 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M29971639001165968 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b48001f9f60 by thread T4 (mutexes: write M34): #0 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2424 (libsos.so+0xd1d9) #1 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #2 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #3 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b48001f9f60 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:83 (libsos.so+0x13e25) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 360 at 0x7b48001f9e00 allocated by thread T4: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1413 (libsos.so+0x9741) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos.c:2424 in SOS_val_snap_queue_from_buffer ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b1800019768 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:118 (libsos.so+0x13f33) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800019768 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b1800019740 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:118 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b1800019778 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:119 (libsos.so+0x13f66) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800019778 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b1800019740 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:119 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b1800019758 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:121 (libsos.so+0x13fcb) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800019758 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b1800019740 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:121 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 4 at 0x7b1800019784 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:123 (libsos.so+0x13ff9) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800019780 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b1800019740 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:123 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b1800019748 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:124 (libsos.so+0x14028) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800019748 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b1800019740 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:124 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b1800019790 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:133 (libsos.so+0x143f8) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800019790 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b1800019740 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:133 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b1800019798 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:171 (libsos.so+0x1420b) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b1800019798 by thread T4: [failed to restore the stack] Location is heap block of size 96 at 0x7b1800019740 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:171 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b180001a368 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:118 (libsos.so+0x13f33) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b180001a368 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b180001a340 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:118 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b180001a378 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:119 (libsos.so+0x13f66) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b180001a378 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b180001a340 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:119 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b180001a358 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:121 (libsos.so+0x13fcb) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b180001a358 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b180001a340 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:121 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 4 at 0x7b180001a384 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:123 (libsos.so+0x13ff9) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b180001a380 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b180001a340 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:123 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b180001a348 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:124 (libsos.so+0x14028) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b180001a348 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b180001a340 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:124 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b180001a390 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:133 (libsos.so+0x143f8) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b180001a390 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b180001a340 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:133 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b180001a398 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:171 (libsos.so+0x1420b) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b180001a398 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b180001a340 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:171 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000b6280 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M108 (0x7b0c000b6280) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c0000b760 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M107 (0x7b0c0000b760) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M30253113977911136 (0x000000000000) => M38 Mutex M30253113977911136 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M30253113977911136 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000b62e0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M109 (0x7b0c000b62e0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c88b0 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M110 (0x7b0c000c88b0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M30816063932031712 (0x000000000000) => M38 Mutex M30816063932031712 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M30816063932031712 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c8e80 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M111 (0x7b0c000c8e80) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000c8850 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M112 (0x7b0c000c8850) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M31660488862238800 (0x000000000000) => M38 Mutex M31660488862238800 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M31660488862238800 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c7350 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M113 (0x7b0c000c7350) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000bae70 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M114 (0x7b0c000bae70) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M32223438815604336 (0x000000000000) => M38 Mutex M32223438815604336 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M32223438815604336 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 4 at 0x7b18000229d0 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:130 (libsos.so+0x14390) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b18000229d0 by thread T4 (mutexes: write M34): #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Location is heap block of size 96 at 0x7b1800022980 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosa.c:130 in SOSA_cache_to_results ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000bfb20 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M115 (0x7b0c000bfb20) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000c73b0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M116 (0x7b0c000c73b0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M32786388769076144 (0x000000000000) => M38 Mutex M32786388769076144 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M32786388769076144 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00007860 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M117 (0x7b0c00007860) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000bfac0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M118 (0x7b0c000bfac0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M33349338722466496 (0x000000000000) => M38 Mutex M33349338722466496 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M33349338722466496 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000b4b10 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M119 (0x7b0c000b4b10) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c00007800 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M120 (0x7b0c00007800) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M33912288675133440 (0x000000000000) => M38 Mutex M33912288675133440 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M33912288675133440 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000bf250 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M121 (0x7b0c000bf250) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000b4b70 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M122 (0x7b0c000b4b70) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 4 at 0x7b6c00012020 by thread T4 (mutexes: write M34, write M67): #0 SOS_buffer_unpack /home/khuck/src/sos_flow/src/sos_buffer.c:636 (libsos.so+0x180be) #1 SOS_announce_from_buffer /home/khuck/src/sos_flow/src/sos.c:2732 (libsos.so+0xe33f) #2 SOSD_apply_announce /home/khuck/src/sos_flow/src/sosd.c:2692 (sosd+0x4268e8) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2122 (sosd+0x426c14) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Previous read of size 4 at 0x7b6c00012020 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:116 (libsos.so+0x13ece) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 1656 at 0x7b6c00011f00 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1362 (libsos.so+0x947d) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M67 (0x7b0c00006240) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1370 (libsos.so+0x94c2) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos_buffer.c:636 in SOS_buffer_unpack ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 4 at 0x7b6c00012028 by thread T4 (mutexes: write M34, write M67): #0 SOS_buffer_unpack /home/khuck/src/sos_flow/src/sos_buffer.c:636 (libsos.so+0x180be) #1 SOS_announce_from_buffer /home/khuck/src/sos_flow/src/sos.c:2732 (libsos.so+0xe33f) #2 SOSD_apply_announce /home/khuck/src/sos_flow/src/sosd.c:2692 (sosd+0x4268e8) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2122 (sosd+0x426c14) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Previous read of size 4 at 0x7b6c00012028 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:117 (libsos.so+0x13f01) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 1656 at 0x7b6c00011f00 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1362 (libsos.so+0x947d) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M67 (0x7b0c00006240) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1370 (libsos.so+0x94c2) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos_buffer.c:636 in SOS_buffer_unpack ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 4 at 0x7b6c0001255c by thread T4 (mutexes: write M34, write M67): #0 SOS_buffer_unpack /home/khuck/src/sos_flow/src/sos_buffer.c:636 (libsos.so+0x180be) #1 SOS_announce_from_buffer /home/khuck/src/sos_flow/src/sos.c:2732 (libsos.so+0xe33f) #2 SOSD_apply_announce /home/khuck/src/sos_flow/src/sosd.c:2692 (sosd+0x4268e8) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2122 (sosd+0x426c14) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Previous read of size 4 at 0x7b6c0001255c by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:77 (libsos.so+0x13d4b) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 1656 at 0x7b6c00011f00 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1362 (libsos.so+0x947d) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M67 (0x7b0c00006240) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1370 (libsos.so+0x94c2) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos_buffer.c:636 in SOS_buffer_unpack ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 4 at 0x7b6c00012054 by thread T4 (mutexes: write M34, write M67): #0 SOS_announce_from_buffer /home/khuck/src/sos_flow/src/sos.c:2775 (libsos.so+0xe3b3) #1 SOSD_apply_announce /home/khuck/src/sos_flow/src/sosd.c:2692 (sosd+0x4268e8) #2 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2122 (sosd+0x426c14) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #4 (libtsan.so.0+0x2970d) Previous read of size 4 at 0x7b6c00012054 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:80 (libsos.so+0x13d9a) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 1656 at 0x7b6c00011f00 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1362 (libsos.so+0x947d) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M67 (0x7b0c00006240) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1370 (libsos.so+0x94c2) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos.c:2775 in SOS_announce_from_buffer ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800015c20 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b1800015c20 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:89 (libsos.so+0x13e54) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M34475238629264240 (0x000000000000) => M38 Mutex M34475238629264240 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M34475238629264240 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800015e38 by thread T4 (mutexes: write M34): #0 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2459 (libsos.so+0xd25e) #1 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #2 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #3 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b1800015e38 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:171 (libsos.so+0x1420b) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 96 at 0x7b1800015de0 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos.c:2459 in SOS_val_snap_queue_from_buffer ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800015de8 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b1800015de8 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:124 (libsos.so+0x14028) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800015df8 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b1800015df8 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:121 (libsos.so+0x13fcb) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800015e08 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b1800015e08 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:118 (libsos.so+0x13f33) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800015e18 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b1800015e18 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:119 (libsos.so+0x13f66) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800015e20 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 4 at 0x7b1800015e24 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:123 (libsos.so+0x13ff9) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800015e30 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b1800015e30 by main thread: [failed to restore the stack] Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b1800016bb8 by thread T4 (mutexes: write M34): #0 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2459 (libsos.so+0xd25e) #1 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #2 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #3 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b1800016bb8 by main thread: [failed to restore the stack] Location is heap block of size 96 at 0x7b1800016b60 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos.c:2459 in SOS_val_snap_queue_from_buffer ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000cb580 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M127 (0x7b0c000cb580) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000bf2b0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M128 (0x7b0c000bf2b0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M36164088489570992 (0x000000000000) => M38 Mutex M36164088489570992 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M36164088489570992 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000b9b50 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M135 (0x7b0c000b9b50) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000cb520 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M136 (0x7b0c000cb520) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M38415888303306016 (0x000000000000) => M38 Mutex M38415888303306016 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M38415888303306016 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b180001cc18 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b180001cc18 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:101 (libsos.so+0x13e7d) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b180001e298 by thread T4 (mutexes: write M34): #0 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2459 (libsos.so+0xd25e) #1 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #2 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #3 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b180001e298 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:101 (libsos.so+0x13e7d) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 96 at 0x7b180001e240 allocated by thread T4: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2302 (libsos.so+0xcd4a) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sos.c:2459 in SOS_val_snap_queue_from_buffer ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c63f0 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M140 (0x7b0c000c63f0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000b9af0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M141 (0x7b0c000b9af0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M39823263186787056 (0x000000000000) => M38 Mutex M39823263186787056 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M39823263186787056 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000bfe80 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M145 (0x7b0c000bfe80) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000c6450 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M146 (0x7b0c000c6450) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M41230638070391888 (0x000000000000) => M38 Mutex M41230638070391888 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M41230638070391888 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00002f10 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M148 (0x7b0c00002f10) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000c6450 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M147 (0x7b0c000c6450) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M41512113047102544 (0x000000000000) => M38 Mutex M41512113047102544 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M41512113047102544 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c5ee0 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M149 (0x7b0c000c5ee0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c00002eb0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M150 (0x7b0c00002eb0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M42356537976434352 (0x000000000000) => M38 Mutex M42356537976434352 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M42356537976434352 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 8 at 0x7b180001fc70 by thread T4 (mutexes: write M34): #0 free (libtsan.so.0+0x2b196) #1 SOS_val_snap_queue_from_buffer /home/khuck/src/sos_flow/src/sos.c:2457 (libsos.so+0xd255) #2 SOSD_handle_val_snaps /home/khuck/src/sos_flow/src/sosd.c:1881 (sosd+0x4232fc) #3 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1040 (sosd+0x427b5e) #4 (libtsan.so.0+0x2970d) Previous read of size 8 at 0x7b180001fc70 by main thread: #0 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:133 (libsos.so+0x143f8) #1 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #2 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #3 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2b196) in free ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Read of size 8 at 0x7b4800204c60 by main thread: #0 strstr (libtsan.so.0+0x4ec9a) #1 SOSA_cache_to_results /home/khuck/src/sos_flow/src/sosa.c:82 (libsos.so+0x13e10) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1398 (sosd+0x421044) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous write of size 8 at 0x7b4800204c60 by thread T4 (mutexes: write M34, write M67): #0 vsnprintf (libtsan.so.0+0x3647b) #1 snprintf (libtsan.so.0+0x37457) #2 snprintf /usr/include/x86_64-linux-gnu/bits/stdio2.h:64 (libsos.so+0xe43f) #3 SOS_announce_from_buffer /home/khuck/src/sos_flow/src/sos.c:2810 (libsos.so+0xe43f) #4 SOSD_apply_announce /home/khuck/src/sos_flow/src/sosd.c:2692 (sosd+0x4268e8) #5 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2122 (sosd+0x426c14) #6 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #7 (libtsan.so.0+0x2970d) Location is heap block of size 360 at 0x7b4800204c00 allocated by thread T4: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1413 (libsos.so+0x9741) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Mutex M67 (0x7b0c00006240) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_pub_init_sized /home/khuck/src/sos_flow/src/sos.c:1370 (libsos.so+0x94c2) #2 SOS_pub_init /home/khuck/src/sos_flow/src/sos.c:1347 (libsos.so+0x9a76) #3 SOSD_handle_announce /home/khuck/src/sos_flow/src/sosd.c:2101 (sosd+0x426c9f) #4 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1038 (sosd+0x427b76) #5 (libtsan.so.0+0x2970d) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x4ec9a) in __interceptor_strstr ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000cd770 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M154 (0x7b0c000cd770) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c00002eb0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M153 (0x7b0c00002eb0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M43200962906566320 (0x000000000000) => M38 Mutex M43200962906566320 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M43200962906566320 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000cd7d0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M155 (0x7b0c000cd7d0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c7bf0 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M156 (0x7b0c000c7bf0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M43763912860817360 (0x000000000000) => M38 Mutex M43763912860817360 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M43763912860817360 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000c6d80 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M157 (0x7b0c000c6d80) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000cd7d0 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M158 (0x7b0c000cd7d0) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M44608337790949328 (0x000000000000) => M38 Mutex M44608337790949328 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M44608337790949328 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c00004b60 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M165 (0x7b0c00004b60) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000c6d20 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M166 (0x7b0c000c6d20) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M46860137604607264 (0x000000000000) => M38 Mutex M46860137604607264 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M46860137604607264 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1428 (sosd+0x42125c) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000b95b0 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M167 (0x7b0c000b95b0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_cache_grab /home/khuck/src/sos_flow/src/sosd.c:1418 (sosd+0x421139) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:639 (sosd+0x4264d2) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) and: #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_target_destroy /home/khuck/src/sos_flow/src/sos_target.c:284 (libsos.so+0x1c1c5) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:805 (sosd+0x41f958) #3 (libtsan.so.0+0x2970d) Location is heap block of size 40 at 0x7b0c000c6d20 allocated by thread T5: #0 calloc (libtsan.so.0+0x2b023) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:235 (libsos.so+0x1be29) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Mutex M168 (0x7b0c000c6d20) created at: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: lock-order-inversion (potential deadlock) (pid=22000) Cycle in lock order graph: M38 (0x7b0c000021f0) => M47423087558028576 (0x000000000000) => M38 Mutex M47423087558028576 acquired here while holding mutex M38 in thread T5: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_target_init /home/khuck/src/sos_flow/src/sos_target.c:236 (libsos.so+0x1be43) #2 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:767 (sosd+0x41f301) #3 (libtsan.so.0+0x2970d) Hint: use TSAN_OPTIONS=second_deadlock_stack=1 to get more informative warning message Mutex M38 acquired here while holding mutex M47423087558028576 in thread T5: #0 pthread_cond_timedwait (libtsan.so.0+0x4ce43) #1 SOSD_THREAD_feedback_sync /home/khuck/src/sos_flow/src/sosd.c:740 (sosd+0x41f1d4) #2 (libtsan.so.0+0x2970d) Thread T5 (tid=22007, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: lock-order-inversion (potential deadlock) (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x3fb3b) in __interceptor_pthread_mutex_lock ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:2015 (sosd+0x425983) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000aaa30 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M1139 (0x7b0c000aaa30) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_register /home/khuck/src/sos_flow/src/sosd.c:1913 (sosd+0x425584) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:605 (sosd+0x426678) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: data race (pid=22000) Write of size 4 at 0x7b3400000084 by main thread: #0 SOSD_handle_shutdown /home/khuck/src/sos_flow/src/sosd.c:2258 (sosd+0x42369d) #1 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:635 (sosd+0x4264f0) #2 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Previous read of size 4 at 0x7b3400000084 by thread T4 (mutexes: write M34): #0 SOSD_THREAD_local_sync /home/khuck/src/sos_flow/src/sosd.c:1008 (sosd+0x427972) #1 (libtsan.so.0+0x2970d) Location is heap block of size 208 at 0x7b3400000000 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 main /home/khuck/src/sos_flow/src/sosd.c:269 (sosd+0x41dc73) Mutex M34 (0x7b0c00002130) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2649 (sosd+0x424ff7) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) Thread T4 (tid=22006, running) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: data race /home/khuck/src/sos_flow/src/sosd.c:2258 in SOSD_handle_shutdown ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:153 (libsos.so+0x1627b) #2 SOSD_handle_shutdown /home/khuck/src/sos_flow/src/sosd.c:2260 (sosd+0x4236b9) #3 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:635 (sosd+0x4264f0) #4 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_buffer_lock /home/khuck/src/sos_flow/src/sos_buffer.c:111 (libsos.so+0x15e2b) #2 SOS_buffer_destroy /home/khuck/src/sos_flow/src/sos_buffer.c:151 (libsos.so+0x1626a) #3 SOSD_handle_shutdown /home/khuck/src/sos_flow/src/sosd.c:2260 (sosd+0x4236b9) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:635 (sosd+0x4264f0) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Location is heap block of size 40 at 0x7b0c000aaa30 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:70 (libsos.so+0x15915) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_shutdown /home/khuck/src/sos_flow/src/sosd.c:2233 (sosd+0x4234fb) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:635 (sosd+0x4264f0) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) Mutex M1140 (0x7b0c000aaa30) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_buffer_init_sized_locking /home/khuck/src/sos_flow/src/sos_buffer.c:75 (libsos.so+0x15938) #2 SOS_buffer_init_sized /home/khuck/src/sos_flow/src/sos_buffer.c:41 (libsos.so+0x15a69) #3 SOSD_handle_shutdown /home/khuck/src/sos_flow/src/sosd.c:2233 (sosd+0x4234fb) #4 SOSD_listen_loop /home/khuck/src/sos_flow/src/sosd.c:635 (sosd+0x4264f0) #5 main /home/khuck/src/sos_flow/src/sosd.c:396 (sosd+0x41dfb1) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 main /home/khuck/src/sos_flow/src/sosd.c:477 (sosd+0x41e15a) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 main /home/khuck/src/sos_flow/src/sosd.c:466 (sosd+0x41e0d0) Location is heap block of size 40 at 0x7b0c00002250 allocated by main thread: #0 calloc (libtsan.so.0+0x2b023) #1 main /home/khuck/src/sos_flow/src/sosd.c:378 (sosd+0x41df60) Mutex M39 (0x7b0c00002250) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 main /home/khuck/src/sos_flow/src/sosd.c:379 (sosd+0x41df80) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=22000) #0 pthread_mutex_destroy (libtsan.so.0+0x2c759) #1 SOS_uid_destroy /home/khuck/src/sos_flow/src/sos.c:1249 (libsos.so+0x7a9c) #2 main /home/khuck/src/sos_flow/src/sosd.c:484 (sosd+0x41e1b6) and: #0 pthread_mutex_lock (libtsan.so.0+0x3fb3b) #1 SOS_uid_destroy /home/khuck/src/sos_flow/src/sos.c:1248 (libsos.so+0x7a8b) #2 main /home/khuck/src/sos_flow/src/sosd.c:484 (sosd+0x41e1b6) Location is heap block of size 40 at 0x7b0c000020a0 allocated by main thread: #0 malloc (libtsan.so.0+0x2ae63) #1 SOS_uid_init /home/khuck/src/sos_flow/src/sos.c:1236 (libsos.so+0x788f) #2 SOSD_init /home/khuck/src/sos_flow/src/sosd.c:2605 (sosd+0x424ce0) #3 main /home/khuck/src/sos_flow/src/sosd.c:309 (sosd+0x41de61) Mutex M30 (0x7b0c000020a0) created at: #0 pthread_mutex_init (libtsan.so.0+0x2c60d) #1 SOS_uid_init /home/khuck/src/sos_flow/src/sos.c:1237 (libsos.so+0x78a9) #2 SOSD_init /home/khuck/src/sos_flow/src/sosd.c:2605 (sosd+0x424ce0) #3 main /home/khuck/src/sos_flow/src/sosd.c:309 (sosd+0x41de61) SUMMARY: ThreadSanitizer: destroy of a locked mutex (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2c759) in pthread_mutex_destroy ================== ** SHUTDOWN **: sosd(0) is exiting cleanly! ================== WARNING: ThreadSanitizer: thread leak (pid=22000) Thread T3 (tid=22005, finished) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:286 (sosd+0x41dd18) SUMMARY: ThreadSanitizer: thread leak (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2bd4e) in __interceptor_pthread_create ================== ================== WARNING: ThreadSanitizer: thread leak (pid=22000) Thread T4 (tid=22006, finished) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:363 (sosd+0x41df16) SUMMARY: ThreadSanitizer: thread leak (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2bd4e) in __interceptor_pthread_create ================== ================== WARNING: ThreadSanitizer: thread leak (pid=22000) Thread T5 (tid=22007, finished) created by main thread at: #0 pthread_create (libtsan.so.0+0x2bd4e) #1 SOSD_sync_context_init /home/khuck/src/sos_flow/src/sosd.c:2651 (sosd+0x425023) #2 main /home/khuck/src/sos_flow/src/sosd.c:375 (sosd+0x41df51) SUMMARY: ThreadSanitizer: thread leak (/usr/lib/x86_64-linux-gnu/libtsan.so.0+0x2bd4e) in __interceptor_pthread_create ================== ThreadSanitizer: reported 139 warnings