Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

UNSOLVED: got a segv in this log file: /reg/neh/home/cpo/2020/06/15_18:39:03_daq-tst-dev03.pcdsn:hsdpva.log.  restarting the process fixed it.  also here: /reg/neh/home/cpo/2020/06/15_18:54:00_daq-tst-dev03.pcdsn:xpmpva.log.  Later, generated a core:

Code Block
(ps-3.1.11) daq-tst-dev03:lcls2$ gdb `which python` ./psdaq/psdaq/cnf/core.hsdpva.23738
GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-100.el7
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /reg/g/psdm/sw/conda2/inst/envs/ps-3.1.11/bin/python3.7...done.
warning: core file may not match specified executable file.
[New LWP 23738]
[New LWP 24583]
[New LWP 24585]
[New LWP 24580]
[New LWP 24589]
[New LWP 24579]
[New LWP 24630]
[New LWP 24582]
[New LWP 24581]
[New LWP 24584]
[New LWP 24615]
[New LWP 25101]
[New LWP 24619]
[New LWP 25163]
[New LWP 25156]
[New LWP 25099]
[New LWP 24617]
[New LWP 25716]
[New LWP 25441]
[New LWP 25758]
[New LWP 25160]
[New LWP 25783]
[New LWP 25771]
[New LWP 25784]
[New LWP 25803]
[New LWP 25798]
[New LWP 25757]
[New LWP 25772]
[New LWP 25155]
[New LWP 25752]
[New LWP 25715]
[New LWP 25801]
[New LWP 25799]
[New LWP 25440]
[New LWP 25751]
[New LWP 25787]
[New LWP 25782]
[New LWP 24629]
[New LWP 24634]
Missing separate debuginfo for /lib64/libpthread.so.0
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/60/91139b61d901aa8425dbc16b7f51d455a416b4.debug
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Missing separate debuginfo for /lib64/libc.so.6
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/ff/1d2de4cf353118960c5ea195ceb13699929c14.debug
Missing separate debuginfo for /lib64/libdl.so.2
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/ef/023e0c16991e8957337c90b0e51025fe27c897.debug
Missing separate debuginfo for /lib64/libutil.so.1
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/b8/082f4480af5af680a0ad0ab4818cae1c077a0b.debug
Missing separate debuginfo for /lib64/librt.so.1
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/76/c4765826961c60be913f5549ebbc7bbe506899.debug
Missing separate debuginfo for /lib64/libm.so.6
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/6a/344a5ce77a247399aa2f22f92c698f574a7134.debug
Missing separate debuginfo for /lib64/ld-linux-x86-64.so.2
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/a9/980cf253c79740e69f70dcb8fea7b8c2f641b5.debug
Missing separate debuginfo for /lib64/libGL.so.1
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/a2/f537e16380004afe5920223ba4837a7cf9193f.debug
Missing separate debuginfo for /lib64/libxshmfence.so.1
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/09/4eafa9d4305b9d112a97d33a68361fe72073b7.debug
Missing separate debuginfo for /lib64/libglapi.so.0
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/74/370865c18663a14d50292b39ba4589a049e4e7.debug
Missing separate debuginfo for /lib64/libselinux.so.1
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/6a/5ef7a05f7e488fcd280bfadd96083bec9fd416.debug
Missing separate debuginfo for /lib64/libXdamage.so.1
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/f2/709bb30b8496f436775e13d2250d5565fa8b64.debug
Missing separate debuginfo for /lib64/libXfixes.so.3
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/07/062d2deb4d533956a51bcf82f487e2bcd14c11.debug
Missing separate debuginfo for /lib64/libXxf86vm.so.1
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/56/9cf7657010c08e28262476726d80eb9bb8ea02.debug
Missing separate debuginfo for /lib64/libdrm.so.2
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/37/7b9e3631cf45fa052067dce55171b3c0340bfa.debug
Missing separate debuginfo for /lib64/libXcursor.so.1
Try: yum --enablerepo='*debug*' install /usr/lib/debug/.build-id/27/ce4043698294568faa1373d44a82f74e49f08b.debug
Core was generated by `/reg/g/psdm/sw/conda2/inst/envs/ps-3.1.11/bin/python /reg/neh/home/cpo/git/lcls'.
Program terminated with signal 11, Segmentation fault.
#0  0x00005618d53cb360 in ?? ()
(gdb) where
#0  0x00005618d53cb360 in ?? ()
#1  0x00005618d2da2c5f in visit_decref (op=<optimized out>, 
    data=<optimized out>, op=<optimized out>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/gcmodule.c:306
#2  0x00005618d2e3bde7 in list_traverse (o=0x7f31f805ad70, 
    visit=0x5618d2e3fc40 <visit_decref>, arg=0x0)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/listobject.c:2583
#3  0x00005618d2e68f74 in subtract_refs ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/gcmodule.c:296
#4  collect ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/gcmodule.c:853
#5  0x00005618d2e69a24 in collect_with_callback ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/gcmodule.c:1025
#6  0x00005618d2f2f939 in collect_generations ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/gcmodule.c:1048
#7  0x00005618d2e69b84 in _PyObject_GC_Alloc (basicsize=<optimized out>, 
    use_calloc=0)
---Type <return> to continue, or q <return> to quit---
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/gcmodule.c:1705
#8  _PyObject_GC_Malloc ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/gcmodule.c:1715
#9  0x00005618d2e69bae in _PyObject_GC_New (
    tp=tp@entry=0x5618d3083ce0 <PyMethod_Type>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/gcmodule.c:1727
#10 0x00005618d2e6dd92 in PyMethod_New ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/classobject.c:62
#11 0x00005618d2ea6cf0 in super_getattro ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/typeobject.c:7570
#12 0x00005618d2f08c0c in _PyObject_GetMethod ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/object.c:1137
#13 0x00005618d2f1238e in _PyEval_EvalFrameDefault ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3040
#14 0x00005618d2e5abda in _PyEval_EvalCodeWithName ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Pyth---Type <return> to continue, or q <return> to quit---
on/ceval.c:3930
#15 0x00005618d2ea99e7 in _PyFunction_FastCallKeywords ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:433
#16 0x00005618d2f124a0 in call_function (kwnames=0x0, oparg=<optimized out>, 
    pp_stack=<synthetic pointer>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:4616
#17 _PyEval_EvalFrameDefault ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3110
#18 0x00005618d2e5b0b8 in _PyEval_EvalCodeWithName ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3930
#19 0x00005618d2e5bc60 in _PyFunction_FastCallDict ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:376
#20 0x00005618d2e5bdd6 in _PyObject_FastCallDict ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:98
#21 0x00005618d2e79e03 in _PyObject_Call_Prepend ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:908
---Type <return> to continue, or q <return> to quit---
#22 0x00005618d2eb05fa in slot_tp_init ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/typeobject.c:6636
#23 0x00005618d2eb1208 in type_call (kwds=0x7f31bc7ba820, args=0x7f32024c1b90, 
    type=<optimized out>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/typeobject.c:971
#24 _PyObject_FastCallKeywords ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:199
#25 0x00005618d2f175c6 in call_function (kwnames=0x7f32024fe250, 
    oparg=<optimized out>, pp_stack=<synthetic pointer>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:4619
#26 _PyEval_EvalFrameDefault ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3139
#27 0x00005618d2e5a8f9 in _PyEval_EvalCodeWithName ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3930
#28 0x00005618d2ea9985 in _PyFunction_FastCallKeywords ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:433
---Type <return> to continue, or q <return> to quit---
#29 0x00005618d2f12216 in call_function (kwnames=0x0, oparg=<optimized out>, 
    pp_stack=<synthetic pointer>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:4616
#30 _PyEval_EvalFrameDefault ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3124
#31 0x00005618d2e5abda in _PyEval_EvalCodeWithName ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3930
#32 0x00005618d2e5bc60 in _PyFunction_FastCallDict ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:376
#33 0x00005618d2e5bdd6 in _PyObject_FastCallDict ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:98
#34 0x00005618d2e79e03 in _PyObject_Call_Prepend ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:908
#35 0x00005618d2eb05fa in slot_tp_init ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/typeobject.c:6636
#36 0x00005618d2eb1208 in type_call (kwds=0x7f31bc7ad230, args=0x7f320248cc30, 
---Type <return> to continue, or q <return> to quit---
    type=<optimized out>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/typeobject.c:971
#37 _PyObject_FastCallKeywords ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:199
#38 0x00005618d2f175c6 in call_function (kwnames=0x7f3239f77410, 
    oparg=<optimized out>, pp_stack=<synthetic pointer>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:4619
#39 _PyEval_EvalFrameDefault ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3139
#40 0x00005618d2e5abda in _PyEval_EvalCodeWithName ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3930
#41 0x00005618d2e5ba35 in _PyFunction_FastCallDict ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:376
#42 0x00005618d2e5bdd6 in _PyObject_FastCallDict ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:98
#43 0x00005618d2e79e03 in _PyObject_Call_Prepend ()
---Type <return> to continue, or q <return> to quit---
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:908
#44 0x00005618d2eb05fa in slot_tp_init ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/typeobject.c:6636
#45 0x00005618d2eb1208 in type_call (kwds=0x0, args=0x7f31f805c450, 
    type=<optimized out>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/typeobject.c:971
#46 _PyObject_FastCallKeywords ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:199
#47 0x00005618d2f16a16 in call_function (kwnames=0x0, oparg=<optimized out>, 
    pp_stack=<synthetic pointer>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:4619
#48 _PyEval_EvalFrameDefault ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3124
#49 0x00005618d2ea975b in function_code_fastcall (globals=<optimized out>, 
    nargs=3, args=<optimized out>, co=<optimized out>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:283
---Type <return> to continue, or q <return> to quit---
#50 _PyFunction_FastCallKeywords ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:408
#51 0x00005618d2f124a0 in call_function (kwnames=0x0, oparg=<optimized out>, 
    pp_stack=<synthetic pointer>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:4616
#52 _PyEval_EvalFrameDefault ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3110
#53 0x00005618d2ea975b in function_code_fastcall (globals=<optimized out>, 
    nargs=0, args=<optimized out>, co=<optimized out>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:283
#54 _PyFunction_FastCallKeywords ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Objects/call.c:408
#55 0x00005618d2f12216 in call_function (kwnames=0x0, oparg=<optimized out>, 
    pp_stack=<synthetic pointer>)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:4616
#56 _PyEval_EvalFrameDefault ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Pyth---Type <return> to continue, or q <return> to quit---
on/ceval.c:3124
#57 0x00005618d2e5a8f9 in _PyEval_EvalCodeWithName ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3930
#58 0x00005618d2e5b824 in PyEval_EvalCodeEx ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:3959
#59 0x00005618d2e5b84c in PyEval_EvalCode (co=co@entry=0x7f3241dee8a0, 
    globals=globals@entry=0x7f3241e241e0, locals=locals@entry=0x7f3241e241e0)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/ceval.c:524
#60 0x00005618d2f71684 in run_mod ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/pythonrun.c:1035
#61 0x00005618d2f7bab1 in PyRun_FileExFlags ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/pythonrun.c:988
#62 0x00005618d2f7bca3 in PyRun_SimpleFileExFlags ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/pythonrun.c:429
#63 0x00005618d2f7bd6d in PyRun_AnyFileExFlags ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Python/pythonrun.c:84
---Type <return> to continue, or q <return> to quit---
#64 0x00005618d2f7cd95 in pymain_run_file (p_cf=0x7ffc94cc9950, 
    filename=0x5618d4c77980 L"/reg/neh/home/cpo/git/lcls2/install/bin/hsdpva", 
    fp=0x5618d4cd38c0)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/main.c:428
#65 pymain_run_filename (cf=0x7ffc94cc9950, pymain=0x7ffc94cc9a60)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/main.c:1607
#66 pymain_run_python (pymain=0x7ffc94cc9a60)
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/main.c:2868
#67 pymain_main ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/main.c:3029
#68 0x00005618d2f7cebc in _Py_UnixMain ()
    at /home/conda/feedstock_root/build_artifacts/python_1585001848288/work/Modules/main.c:3064
#69 0x00007f32416e8c05 in __libc_start_main () from /lib64/libc.so.6
#70 0x00005618d2f21bd0 in _start () at ../sysdeps/x86_64/elf/start.S:103
(gdb) 



UNSOLVED: Saw this error in /reg/neh/home/cpo/2020/06/15_14:39:26_daq-tst-dev07:hsdioc_89.log when starting up processes after a power-cycle (for new hsd firmware for the interrupt-holdoff):

...