Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segmentation Fault after upgrade 2.1.3 -> 2.1.4 [CORE3409] #3773

Closed
firebird-automations opened this issue Mar 24, 2011 · 49 comments
Closed

Comments

@firebird-automations
Copy link
Collaborator

Submitted by: Fernando Guidorizzi (mephisty)

Is duplicated by CORE3655

Attachments:
core.13455.7z

After a upgrade to newest version.
The following msg was received...........

fbserver[12394]: segfault at aa121000 ip 0027e6d7 sp 07aaa668 error 4 in http://libc-2.12.2.so[150000+184000]
fbserver[13238]: segfault at aa918000 ip 0047d6f5 sp 06735688 error 4 in http://libc-2.12.2.so[34f000+184000]

localhost.localdomain (Client) Thu Mar 24 08:21:35 2011
/opt/firebird/bin/fbguard: /opt/firebird/bin/fbserver terminated abnormally (-1)
localhost.localdomain (Client) Thu Mar 24 08:21:35 2011
/opt/firebird/bin/fbguard: guardian starting bin/fbserver

Now, i disabled the Sweep Interval ....

Any ideas???

Tks in advance!

Commits: a406f32

@firebird-automations
Copy link
Collaborator Author

Commented by: @pmakowski

why don't you use the Fedora package ?
it was in testing since one week and I just asked the push to stable update
https://admin.fedoraproject.org/updates/firebird?_csrf_token=b7ca1a6a2860631e2cf6f754e4e2e86f0019f038

@firebird-automations
Copy link
Collaborator Author

Commented by: @dyemanov

All you need to do is to provide us (the developers) with a crash dump. See here:
http://ibphoenix.com/resources/documents/development/doc_36

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Philippe, i was using the 2.1.3 rpm from http://firebirdsql.org
i will try the fedora package.

Disabling sweep doesnt work,
again
fbserver[13333]: segfault at a8710000 ip 006ac6f0 sp 02151668 error 4 in http://libc-2.12.2.so[57e000+184000]

I have a 'agressive' DefaultDbCachePages with 50000, changed to 5000 ...
let me see

@firebird-automations
Copy link
Collaborator Author

Commented by: @pmakowski

before switching to fedora package, provide the crash dum, it may be useful
as it may be useful to see if the crash also append with the Fedora package

IMHO DefaultDbCachePages with 50000 under Linux is really not necessary
let work the kernel and the FS

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Dmitry, im waiting the next segfault and will attach the dump

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Before BugCheckAbort =1 and DefaultDbCachePages=5000
localhost.localdomain (Server) Thu Mar 24 09:36:27 2011
Database: /opt/xxxxx
internal gds software consistency check (Attempt to call GlobalRWLock::unlock() while not holding a valid lock for logical owner)

Waiting to get the dump file...

@firebird-automations
Copy link
Collaborator Author

Modified by: @AlexPeshkoff

assignee: Alexander Peshkov [ alexpeshkoff ]

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Could i post a compressed 15mb crash dump here?

Edited:
Only 10MB

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Sorry, im unable to install debuginfo.

Just the core dump could help?

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

Are you using SF binaries? If yes - can. Upload it here as an attachment.
If not SF - afraid it's useless.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Crash Dump With SF binaries.

Sorry 7z format.

@firebird-automations
Copy link
Collaborator Author

Modified by: Fernando Guidorizzi (mephisty)

Attachment: core.13455.7z [ 11921 ]

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

7z not a problem
Unfortunately I can't get correct stack traces on my box using this core dump.
What a problem with installing debuginfo? Just download FirebirdSS-debuginfo-2.5.0.26074-0.i686.tar.gz from SF and untar it in the root direcrtory.

@firebird-automations
Copy link
Collaborator Author

Commented by: @pmakowski

Alex you mean 2.1.4.18393-0 from there http://firebirdsql.org/index.php?op=files&id=engine_214

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Alex,
Just permission problems
I will install and send the trace!

tks!

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Im waiting to access the production server.
Meanwhile, i install debuginfo in a test server,

and get thisgdb /opt/firebird/bin/.debug/fbserver.debug core.13455
GNU gdb (GDB) Fedora (7.2-46.fc14)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "i686-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /opt/firebird/bin/.debug/fbserver.debug...done.

warning: core file may not match specified executable file.
[New Thread 13469]
[New Thread 13472]
[New Thread 13477]
[New Thread 13478]
[New Thread 13473]
[New Thread 13474]
[New Thread 13460]
[New Thread 13494]
[New Thread 13493]
[New Thread 13471]
[New Thread 13458]
[New Thread 13499]
[New Thread 13455]

warning: .dynamic section for "/lib/libncurses.so.5" is not at the expected address (wrong library or version mismatch?)

warning: .dynamic section for "/lib/libpthread.so.0" is not at the expected address (wrong library or version mismatch?)

warning: .dynamic section for "/lib/libgcc_s.so.1" is not at the expected address (wrong library or version mismatch?)

warning: .dynamic section for "/lib/ld-linux.so.2" is not at the expected address (wrong library or version mismatch?)

warning: .dynamic section for "/lib/libtinfo.so.5" is not at the expected address (wrong library or version mismatch?)
Missing separate debuginfo for
Try: yum --disablerepo='*' --enablerepo='*-debuginfo' install /usr/lib/debug/.build-id/66/12b38ac51e28cf2e4008a8bc88acbaa07d6e11
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libncurses.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libncurses.so.5
Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
[Thread debugging using libthread_db enabled]
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /opt/firebird/lib/libicuuc.so.30...Reading symbols from /opt/firebird/lib/.debug/libicuuc.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicuuc.so.30
Reading symbols from /opt/firebird/lib/libicudata.so.30...Reading symbols from /opt/firebird/lib/.debug/libicudata.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicudata.so.30
Reading symbols from /opt/firebird/lib/libicui18n.so.30...Reading symbols from /opt/firebird/lib/.debug/libicui18n.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicui18n.so.30
Reading symbols from /usr/lib/libstdc++.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libstdc++.so.5
Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.6
Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/libtinfo.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libtinfo.so.5
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /opt/firebird/intl/fbintl...Reading symbols from /opt/firebird/intl/.debug/fbintl.debug...done.
done.
Loaded symbols for /opt/firebird/intl/fbintl
Cannot find new threads: generic error
Core was generated by `/opt/firebird/bin/fbserver'.
Program terminated with signal 11, Segmentation fault.
#⁠0 0x00c9b6d7 in __bcopy_ssse3 () from /lib/libc.so.6
Missing separate debuginfos, use: debuginfo-install compat-libstdc++-33-3.2.3-68.i686 glibc-2.13-1.i686 libgcc-4.5.1-4.fc14.i686 ncurses-libs-5.7-9.20100703.fc14.i686
(gdb) thread apply all bt
Cannot find new threads: generic error
(gdb)

If could help....

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Production server Core dump ....

[root@localhost .debug]#⁠ gdb /opt/firebird/bin/.debug/fbserver.debug core.1725
GNU gdb (GDB) Fedora (7.1-34.fc13)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "i686-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /opt/firebird/bin/.debug/fbserver.debug...done.

warning: core file may not match specified executable file.
[New Thread 1732]
[New Thread 1738]
[New Thread 1794]
[New Thread 1797]
[New Thread 1740]
[New Thread 1810]
[New Thread 1809]
[New Thread 1811]
[New Thread 2193]
[New Thread 1739]
[New Thread 2194]
[New Thread 1728]
[New Thread 1741]
[New Thread 1725]
Missing separate debuginfo for
Try: yum --disablerepo='*' --enablerepo='*-debuginfo' install /usr/lib/debug/.build-id/66/12b38ac51e28cf2e4008a8bc88acbaa07d6e11
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libncurses.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libncurses.so.5
Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /opt/firebird/lib/libicuuc.so.30...Reading symbols from /opt/firebird/lib/.debug/libicuuc.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicuuc.so.30
Reading symbols from /opt/firebird/lib/libicudata.so.30...Reading symbols from /opt/firebird/lib/.debug/libicudata.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicudata.so.30
Reading symbols from /opt/firebird/lib/libicui18n.so.30...Reading symbols from /opt/firebird/lib/.debug/libicui18n.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicui18n.so.30
Reading symbols from /usr/lib/libstdc++.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libstdc++.so.5
Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.6
Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/libtinfo.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libtinfo.so.5
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /opt/firebird/intl/fbintl...Reading symbols from /opt/firebird/intl/.debug/fbintl.debug...done.
done.
Loaded symbols for /opt/firebird/intl/fbintl
Core was generated by `/opt/firebird/bin/fbserver'.
Program terminated with signal 11, Segmentation fault.
#⁠0 0x005426e1 in __memmove_ssse3_rep () from /lib/libc.so.6
Missing separate debuginfos, use: debuginfo-install compat-libstdc++-33-3.2.3-68.i686 glibc-2.12.2-1.i686 libgcc-4.4.5-2.fc13.i686 ncurses-libs-5.7-7.20100130.fc13.i686
(gdb) thread apply all bt

Thread 14 (Thread 1725):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x004e9201 in select () from /lib/libc.so.6
#⁠2 0x08263fc1 in select_wait (main_port=0xb789a1b8, selct=0x83ea8c0) at ../src/remote/inet.cpp:2834
#⁠3 0x08263bdf in select_multi (main_port=0xb789a1b8, buffer=0xbfbd3870 "", bufsize=8192, length=0xbfbd386e,
port=@0xbfbd384c) at ../src/remote/inet.cpp:2565
#⁠4 0x0827661c in rem_port::select_multi (this=0x83ea8cc, buffer=0xfffffdfe <Address 0xfffffdfe out of bounds>, bufsize=0,
length=0xfffffdfe, port=@0xfffffdfe) at ../src/remote/remote.cpp:785
#⁠5 0x08050e6c in SRVR_multi_thread (main_port=0xb789a1b8, flags=2) at ../src/remote/server.cpp:480
#⁠6 0x080504ba in server_main (argc=-514, argv=0x1) at ../src/remote/inet_server.cpp:448
#⁠7 0x08059a09 in main (argc=-514, argv=0xfffffdfe) at ../src/remote/server_stub.cpp:12

Thread 13 (Thread 1741):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d045d4 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cd4e in ISC_event_wait (count=-516, events=0x322c128, values=0x322c12c, micro_seconds=10000000,
timeout_handler=0, handler_arg=0x0) at ../src/jrd/isc_sync.cpp:671
#⁠3 0x081eb652 in garbage_collector (arg=0xb772d81c) at ../src/jrd/vio.cpp:4134
#⁠4 0x08071a40 in threadStart (arg=0xb772d81c) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 12 (Thread 1728):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d06675 in sem_wait@@GLIBC_2.1 () from /lib/libpthread.so.0
#⁠2 0x08050978 in shutdown_thread (arg=0x0) at ../src/common/classes/semaphore.h:169
#⁠3 0x08071a40 in threadStart (arg=0x0) at ../src/jrd/ThreadData.cpp:274
#⁠4 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠5 0x004f0d4e in clone () from /lib/libc.so.6

Thread 11 (Thread 2194):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=-1315122528)
at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
---Type <return> to continue, or q <return> to quit---
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 10 (Thread 1739):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d045d4 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cd4e in ISC_event_wait (count=-516, events=0x44ce128, values=0x44ce12c, micro_seconds=10000000,
timeout_handler=0, handler_arg=0x0) at ../src/jrd/isc_sync.cpp:671
#⁠3 0x081eb652 in garbage_collector (arg=0xb639381c) at ../src/jrd/vio.cpp:4134
#⁠4 0x08071a40 in threadStart (arg=0xb639381c) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 9 (Thread 2193):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=-1304632672)
at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 8 (Thread 1811):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=-1259228512)
at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 7 (Thread 1809):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=103617184) at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
---Type <return> to continue, or q <return> to quit---
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 6 (Thread 1810):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=-1223691616)
at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 5 (Thread 1740):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d045d4 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cd4e in ISC_event_wait (count=-516, events=0x6e49198, values=0x6e4919c, micro_seconds=10000000,
timeout_handler=0, handler_arg=0x0) at ../src/jrd/isc_sync.cpp:671
#⁠3 0x081105bc in cache_writer (arg=0xb772d81c) at ../src/jrd/cch.cpp:4360
#⁠4 0x08071a40 in threadStart (arg=0xb772d81c) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 4 (Thread 1797):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=93127328) at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 3 (Thread 1794):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=82637472) at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
---Type <return> to continue, or q <return> to quit---
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 2 (Thread 1738):
#⁠0 0x00e1e424 in __kernel_vsyscall ()
#⁠1 0x00d045d4 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cd4e in ISC_event_wait (count=-516, events=0x94bf198, values=0x94bf19c, micro_seconds=10000000,
timeout_handler=0, handler_arg=0x0) at ../src/jrd/isc_sync.cpp:671
#⁠3 0x081105bc in cache_writer (arg=0xb639381c) at ../src/jrd/cch.cpp:4360
#⁠4 0x08071a40 in threadStart (arg=0xb639381c) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x004f0d4e in clone () from /lib/libc.so.6

Thread 1 (Thread 1732):
#⁠0 0x005426e1 in __memmove_ssse3_rep () from /lib/libc.so.6
#⁠1 0x08109f2f in LocksCacheJrd::CachedLock\::get (this=0xb450bc3c, tdbb=0x7fccc70, key=0x7fca740 "\365z\b")
at ../src/common/classes/array.h:172
#⁠2 0x080fac7f in BtrPageGCLock::disablePageGC (this=0xb354afc4, tdbb=0x7fccc70, page=...) at ../src/jrd/btr.cpp:268
#⁠3 0x081855b0 in set_page (impure=0xb34a96e8, window=0x7fccc70) at ../src/jrd/nav.cpp:1165
#⁠4 0x081848c2 in NAV_get_record (tdbb=0x7fccc70, rsb=0xb2cd0fdc, impure=0xb34a96e8, rpb=0xb34a91bc,
direction=RSE_get_forward) at ../src/jrd/nav.cpp:1192
#⁠5 0x081b5bc7 in get_record (tdbb=0x7fccc70, rsb=0xb2cd0fdc, parent_rsb=0xb3ac0ccc, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:1972
#⁠6 0x081b5774 in get_record (tdbb=0x7fccc70, rsb=0xb3ac0ccc, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2217
#⁠7 0x081b7b28 in fetch_record (tdbb=0x7fccc70, rsb=0xb3f1fba4, n=0) at ../src/jrd/rse.cpp:766
#⁠8 0x081b7b69 in fetch_record (tdbb=0x7fccc70, rsb=0xb3f1fba4, n=1) at ../src/jrd/rse.cpp:784
#⁠9 0x081b7b69 in fetch_record (tdbb=0x7fccc70, rsb=0xb3f1fba4, n=2) at ../src/jrd/rse.cpp:784
#⁠10 0x081b587f in get_record (tdbb=0x7fccc70, rsb=0xb3f1fba4, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2425
#⁠11 0x081b4a33 in RSE_get_record (tdbb=0x7fccc70, rsb=0xb3f1fba4, mode=RSE_get_forward) at ../src/jrd/rse.cpp:316
#⁠12 0x08143f0e in looper (tdbb=0x7fccc70, request=0xb34a8ed4, in_node=0x7fccc70) at ../src/jrd/exe.cpp:1963
#⁠13 0x08143148 in execute_looper (tdbb=0x7fccc70, request=0xb34a8ed4, transaction=0xb282ce08, next_state=3008671684)
at ../src/jrd/exe.cpp:1461
#⁠14 0x08142672 in EXE_receive (tdbb=0x7fccc70, request=0xb34a8ed4, msg=1, length=263, buffer=0xb7517aa4 "\001",
top_level=true) at ../src/jrd/exe.cpp:749
#⁠15 0x08177f9f in jrd8_receive (user_status=0x7fccff0, req_handle=0xb354afc4, msg_type=1, msg_length=263,
---Type <return> to continue, or q <return> to quit---
msg=0xb354afc4 "OQ ,DTBLOQUEIO ,USER_BLOQ FROM CLIENTE WHERE CDCLIENTE=?", level=0) at ../src/jrd/jrd.cpp:3193
#⁠16 0x0807ec65 in isc_receive (user_status=0x7fccff0, req_handle=0xb354afc4, msg_type=1, msg_length=263,
msg=0xb354afc0 "O_BLOQ ,DTBLOQUEIO ,USER_BLOQ FROM CLIENTE WHERE CDCLIENTE=?", level=0) at ../src/jrd/why.cpp:450
#⁠17 0x08220bab in GDS_DSQL_FETCH_CPP (user_status=0xb354afc4, req_handle=0xb354afc4, blr_length=57,
blr=0xb3d60a60 "\004\002\004", msg_type=0, msg_length=262, dsql_msg_buf=0xb356be00 "") at ../src/dsql/dsql.cpp:1124
#⁠18 0x0807b939 in isc_dsql_fetch_m (user_status=0x7fccff0, stmt_handle=0xb354afc4, blr_length=57,
blr=0xb3d60a60 "\004\002\004", msg_type=0, msg_length=262, msg=0xb356be00 "") at ../src/jrd/why.cpp:450
#⁠19 0x0805372d in rem_port::fetch (this=0xb37ccf6c, sqldata=0xb3c97ea0, sendL=0xb3c979b4) at ../src/remote/server.cpp:2330
#⁠20 0x0805591f in process_packet2 (port=0xb37ccf6c, sendL=0xb3c979b4, receive=0xb3c97c68, result=0x7fcd30c)
at ../src/remote/server.cpp:3649
#⁠21 0x08055298 in process_packet (port=0xb37ccf6c, sendL=0xb354afc4, receive=0xb354afc4, result=0x7fcd30c)
at ../src/remote/server.cpp:3391
#⁠22 0x08057f8d in loopThread (flags=0x2) at ../src/remote/server.cpp:5435
#⁠23 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠24 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠25 0x004f0d4e in clone () from /lib/libc.so.6
(gdb)
(gdb)
(gdb)
(gdb)
(gdb) quit

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

This is what was needed. Please keep that core dump together with debuginfo - may be some more info will be needed.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Maybe related with ticket
CORE3053

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Alex!
I need to restore 2.13 on my server.
Do u need some more information?

tks!!!

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

Fernando, please rename /opt/firebird with 2.5 to something else and keep core in it - if it will become required, we will get required info from it.

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

Fernando - one more question. Is it hard to reproduce a bug? I.e. can you provide us with a database and a scipt (or some program) running which say during a day the bug will be reproduced.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Alexander, just to confirm 2.5? will coexist with 2.1.3?

The bug occurred about 20 times yesterday, in random querys and time intervals.
Made a fresh boot and got a Segfault before SELInux initialized.

Tomorrow I will restore the 2.1.4 version and try to reproduce.

Tks!

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

About coexistance of 2.5 and 2.1.3 - it's offtopic here in the tracker, please contact me privately or in fb-devel.

That's nice (for us) that bug is easy to reproduce. But can you provide a database to try to reproduce at developers box? (Do not care much about size - main problem is does it contatin critical data.)

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

I cant provide the database, sorry.
But, i will go deep in this problem trying a reproducible way.
I dont now if mean but im using a SSD to storage.

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

Understandable thing with database.
Will be nice if you find a publically available way to reproduce

What about SSD - if 2.1.3 works fine with your SSD - that's not a problem.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

I tried to reproduce with no success.
Running several queries with large datasets(>1000000),
other instances running updates, and the server worked without errors.

is there a scenario where a non-updated client library could cause a SegFault?

@firebird-automations
Copy link
Collaborator Author

Commented by: @hvlad

Are you sure it was really 2.1.4 ? Stack backtrace you provided looks similar to this bug : CORE3050.

And no, client library can't cause such AV.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Vlad, my unique confirmation was in the FlameRobin reporting 2.1.4
Maybe, a library can't be updated in the process

I will uninstall the 2.1.3 and rename firebird folder to make sure.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

2.1.4 package already did the job ..archiving firebird folder....
I'm running 2.1.4 let me see if i get some more information.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

New core dump.
I saw when the error was raised . and did same steps...and nothing to reproduce

root@localhost .debug]#⁠ gdb fbserver.debug core.30557
GNU gdb (GDB) Fedora (7.1-34.fc13)
Copyright (C) 2010 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "i686-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /opt/firebird/bin/.debug/fbserver.debug...done.

warning: core file may not match specified executable file.
[New Thread 20882]
[New Thread 21013]
[New Thread 4788]
[New Thread 21016]
[New Thread 5086]
[New Thread 30560]
[New Thread 20879]
[New Thread 5085]
[New Thread 5088]
[New Thread 5087]
[New Thread 30567]
[New Thread 20880]
[New Thread 21015]
[New Thread 30557]
[New Thread 20881]
[New Thread 21014]
Missing separate debuginfo for
Try: yum --disablerepo='*' --enablerepo='*-debuginfo' install /usr/lib/debug/.build-id/66/12b38ac51e28cf2e4008a8bc88acbaa07d6e11
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libncurses.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libncurses.so.5
Reading symbols from /lib/libpthread.so.0...(no debugging symbols found)...done.
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /opt/firebird/lib/libicuuc.so.30...Reading symbols from /opt/firebird/lib/.debug/libicuuc.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicuuc.so.30
Reading symbols from /opt/firebird/lib/libicudata.so.30...Reading symbols from /opt/firebird/lib/.debug/libicudata.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicudata.so.30
Reading symbols from /opt/firebird/lib/libicui18n.so.30...Reading symbols from /opt/firebird/lib/.debug/libicui18n.so.30.0.debug...done.
done.
Loaded symbols for /opt/firebird/lib/libicui18n.so.30
Reading symbols from /usr/lib/libstdc++.so.5...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libstdc++.so.5
Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.6
Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/libtinfo.so.5...(no debugging symbols found)...done.
Loaded symbols for /lib/libtinfo.so.5
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /opt/firebird/intl/fbintl...Reading symbols from /opt/firebird/intl/.debug/fbintl.debug...done.
done.
Loaded symbols for /opt/firebird/intl/fbintl
Core was generated by `/opt/firebird/bin/fbserver'.
Program terminated with signal 11, Segmentation fault.
#⁠0 0x00c9b6d3 in __memmove_ssse3_rep () from /lib/libc.so.6
Missing separate debuginfos, use: debuginfo-install compat-libstdc++-33-3.2.3-68.i686 glibc-2.12.2-1.i686 libgcc-4.4.5-2.fc13.i686 ncurses-libs-5.7-7.20100130.fc13.i686
(gdb) thread apply all bt

Thread 16 (Thread 21014):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d06f89 in __lll_lock_wait () from /lib/libpthread.so.0
#⁠2 0x00d02330 in _L_lock_698 () from /lib/libpthread.so.0
#⁠3 0x00d02201 in pthread_mutex_lock () from /lib/libpthread.so.0
#⁠4 0x0810bc58 in GlobalRWLock::unlock (this=0xb6f01ec4, tdbb=0xaf465ac0, level=LCK_read, owner_handle=64880)
at ../src/common/classes/locks.h:133
#⁠5 0x081f099e in BackupManager::unlock_shared_database (this=0xfffffe00, tdbb=0xaf465ac0) at ../src/jrd/GlobalRWLock.h:115
#⁠6 0x0810d5d3 in CCH_fetch_page (tdbb=0xaf465ac0, window=0xace26ae4, compute_checksum=1, read_shadow=true)
at ../src/jrd/cch.cpp:1067
#⁠7 0x0810e2b4 in CCH_handoff (tdbb=0xaf465ac0, window=0xace26ae4, page=1, lock=1, page_type=5 '\005', latch_wait=1,
release_tail=0) at ../src/jrd/cch_proto.h:97
#⁠8 0x0808896d in DPM_fetch_fragment (tdbb=0xaf465ac0, rpb=0xace26a98, lock=3) at ../src/jrd/cch_proto.h:121
#⁠9 0x081e217b in VIO_data (tdbb=0xaf465ac0, rpb=0xace26a98, pool=0xfffffe00) at ../src/jrd/vio.cpp:1078
#⁠10 0x081e623a in VIO_next_record (tdbb=0xaf465ac0, rpb=0xace26a98, rsb=0xace29924, transaction=0xb5e76d44,
pool=0xb3b6d26c, onepage=false) at ../src/jrd/vio.cpp:2489
#⁠11 0x081b52fd in get_record (tdbb=0xaf465ac0, rsb=0xace29924, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:1898
#⁠12 0x081b664d in open_sort (tdbb=0xaf465ac0, rsb=0xace298c8, impure=0xace2708c, max_records=12629881988587886884)
at ../src/jrd/rse.cpp:2979
#⁠13 0x081b4f18 in RSE_open (tdbb=0xaf465ac0, rsb=0xace298c8) at ../src/jrd/rse.cpp:478
#⁠14 0x08143f54 in looper (tdbb=0xaf465ac0, request=0xace267b0, in_node=0xaf465ac0) at ../src/jrd/exe.cpp:1955
#⁠15 0x08142d60 in EXE_start (tdbb=0xaf465ac0, request=0xace267b0, transaction=0xb5e76d44) at ../src/jrd/exe.cpp:1113
#⁠16 0x0817a520 in jrd8_start_request (user_status=0xaf465ff0, req_handle=0xfffffe00, tra_handle=0xfffffe00, level=0)
at ../src/jrd/jrd.cpp:3851
#⁠17 0x0808103d in isc_start_request (user_status=0xaf465ff0, req_handle=0xfffffe00, tra_handle=0xfffffe00, level=0)
at ../src/jrd/why.cpp:450
#⁠18 0x08222dd2 in execute_request (request=0xac01ef24, trans_handle=0xac01ef7c, in_blr_length=0,
in_blr=0xb5b9cd1c "\004\002\004", in_msg_length=24128, in_msg=0x0, out_blr_length=0, out_blr=0x0, out_msg_length=0,
out_msg=0x0, singleton=false) at ../src/dsql/dsql.cpp:3402
#⁠19 0x082202ef in GDS_DSQL_EXECUTE_CPP (user_status=0xfffffe00, trans_handle=0xaf465fec, req_handle=0xfffffe00,
in_blr_length=0, in_blr=0xfffffe00 <Address 0xfffffe00 out of bounds>, in_msg_type=0, in_msg_length=0,
in_msg=0xfffffe00 <Address 0xfffffe00 out of bounds>, out_blr_length=0,
out_blr=0xfffffe00 <Address 0xfffffe00 out of bounds>, out_msg_type=0, out_msg_length=0,
out_msg=0xfffffe00 <Address 0xfffffe00 out of bounds>) at ../src/dsql/dsql.cpp:561
#⁠20 0x0807a562 in isc_dsql_execute2_m (user_status=0xaf465ff0, tra_handle=0xaf465fec, stmt_handle=0xfffffe00,
in_blr_length=0, in_blr=0xb5b9cd1c "\004\002\004", in_msg_type=0, in_msg_length=0, in_msg=0x0, out_blr_length=0,
out_blr=0x0, out_msg_type=0, out_msg_length=0, out_msg=0x0) at ../src/jrd/why.cpp:450
---Type <return> to continue, or q <return> to quit---
#⁠21 0x080530ae in rem_port::execute_statement (this=0xb5e47a24, op=op_execute, sqldata=0xaf465ff0, sendL=0xb396117c)
at ../src/remote/server.cpp:2178
#⁠22 0x08055a48 in process_packet2 (port=0xb5e47a24, sendL=0xb396117c, receive=0xb3961430, result=0xaf46630c)
at ../src/remote/server.cpp:3640
#⁠23 0x08055298 in process_packet (port=0xb5e47a24, sendL=0xfffffe00, receive=0xfffffe00, result=0xaf46630c)
at ../src/remote/server.cpp:3391
#⁠24 0x08057f8d in loopThread (flags=0x2) at ../src/remote/server.cpp:5435
#⁠25 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠26 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠27 0x00c49d4e in clone () from /lib/libc.so.6

Thread 15 (Thread 20881):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d06f89 in __lll_lock_wait () from /lib/libpthread.so.0
#⁠2 0x00d02330 in _L_lock_698 () from /lib/libpthread.so.0
#⁠3 0x00d02201 in pthread_mutex_lock () from /lib/libpthread.so.0
#⁠4 0x0810b525 in GlobalRWLock::lock (this=0xb6f01ec4, tdbb=0x5ddbc70, level=LCK_read, wait=1, owner_handle=82736)
at ../src/common/classes/locks.h:133
#⁠5 0x081f092c in BackupManager::lock_shared_database (this=0xfffffe00, tdbb=0x5ddbc70, wait=1)
at ../src/jrd/GlobalRWLock.h:107
#⁠6 0x0810d466 in CCH_fetch_page (tdbb=0x5ddbc70, window=0xb3a89ef4, compute_checksum=1, read_shadow=true)
at ../src/jrd/cch.cpp:967
#⁠7 0x0810e2b4 in CCH_handoff (tdbb=0x5ddbc70, window=0xb3a89ef4, page=1, lock=1, page_type=5 '\005', latch_wait=1,
release_tail=0) at ../src/jrd/cch_proto.h:97
#⁠8 0x08089056 in DPM_get (tdbb=0x5ddbc70, rpb=0xb3a89ea8, lock_type=3) at ../src/jrd/cch_proto.h:121
#⁠9 0x081e43c5 in VIO_get (tdbb=0x5ddbc70, rpb=0xb3a89ea8, rsb=0xfffffe00, transaction=0xfffffe00, pool=0xb3a91bf8)
at ../src/jrd/vio.cpp:1760
#⁠10 0x0818505e in get_record (rsb=0xb3a89060, impure=0xb3a8a3d4, rpb=0xb3a89ea8, key=0x5dda880, inhibit_cleanup=false)
at ../src/jrd/nav.cpp:919
#⁠11 0x08184960 in NAV_get_record (tdbb=0x5ddbc70, rsb=0xb3a89060, impure=0xb3a8a3d4, rpb=0xb3a89ea8,
direction=RSE_get_forward) at ../src/jrd/nav.cpp:437
#⁠12 0x081b5bc7 in get_record (tdbb=0x5ddbc70, rsb=0xb3a89060, parent_rsb=0xb3a89380, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:1972
#⁠13 0x081b5774 in get_record (tdbb=0x5ddbc70, rsb=0xb3a89380, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2217
#⁠14 0x081b7b28 in fetch_record (tdbb=0x5ddbc70, rsb=0xb3a89840, n=0) at ../src/jrd/rse.cpp:766
#⁠15 0x081b581e in get_record (tdbb=0x5ddbc70, rsb=0xb3a89840, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2391
#⁠16 0x081b4a33 in RSE_get_record (tdbb=0x5ddbc70, rsb=0xb3a89840, mode=RSE_get_forward) at ../src/jrd/rse.cpp:316
---Type <return> to continue, or q <return> to quit---
#⁠17 0x08143f0e in looper (tdbb=0x5ddbc70, request=0xb3a89bc0, in_node=0x5ddbc70) at ../src/jrd/exe.cpp:1963
#⁠18 0x08143148 in execute_looper (tdbb=0x5ddbc70, request=0xb3a89bc0, transaction=0xb225a0b8, next_state=4294966784)
at ../src/jrd/exe.cpp:1461
#⁠19 0x08142672 in EXE_receive (tdbb=0x5ddbc70, request=0xb3a89bc0, msg=1, length=263, buffer=0xabce8aa4 "", top_level=true)
at ../src/jrd/exe.cpp:749
#⁠20 0x08177f9f in jrd8_receive (user_status=0x5ddbff0, req_handle=0xfffffe00, msg_type=1, msg_length=263,
msg=0xfffffe00 <Address 0xfffffe00 out of bounds>, level=0) at ../src/jrd/jrd.cpp:3193
#⁠21 0x0807ec65 in isc_receive (user_status=0x5ddbff0, req_handle=0xfffffe00, msg_type=1, msg_length=263,
msg=0xb6f01ed8 "\002", level=0) at ../src/jrd/why.cpp:450
#⁠22 0x08220bab in GDS_DSQL_FETCH_CPP (user_status=0xfffffe00, req_handle=0xfffffe00, blr_length=57,
blr=0xb43d1660 "\004\002\004", msg_type=0, msg_length=262, dsql_msg_buf=0xb60efa28 "") at ../src/dsql/dsql.cpp:1124
#⁠23 0x0807b939 in isc_dsql_fetch_m (user_status=0x5ddbff0, stmt_handle=0xfffffe00, blr_length=57,
blr=0xb43d1660 "\004\002\004", msg_type=0, msg_length=262, msg=0xb60efa28 "") at ../src/jrd/why.cpp:450
#⁠24 0x0805372d in rem_port::fetch (this=0xb38999f4, sqldata=0xb5e508c8, sendL=0xb5e503dc) at ../src/remote/server.cpp:2330
#⁠25 0x0805591f in process_packet2 (port=0xb38999f4, sendL=0xb5e503dc, receive=0xb5e50690, result=0x5ddc30c)
at ../src/remote/server.cpp:3649
#⁠26 0x08055298 in process_packet (port=0xb38999f4, sendL=0xfffffe00, receive=0xfffffe00, result=0x5ddc30c)
at ../src/remote/server.cpp:3391
#⁠27 0x08057f8d in loopThread (flags=0x2) at ../src/remote/server.cpp:5435
#⁠28 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠29 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠30 0x00c49d4e in clone () from /lib/libc.so.6

Thread 14 (Thread 30557):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00c42201 in select () from /lib/libc.so.6
#⁠2 0x08263fc1 in select_wait (main_port=0xb77b61cc, selct=0x83ea8c0) at ../src/remote/inet.cpp:2834
#⁠3 0x08263bdf in select_multi (main_port=0xb77b61cc, buffer=0xbf834c50 "", bufsize=8192, length=0xbf834c4e,
port=@0xbf834c2c) at ../src/remote/inet.cpp:2565
#⁠4 0x0827661c in rem_port::select_multi (this=0x83ea8cc, buffer=0xfffffdfe <Address 0xfffffdfe out of bounds>, bufsize=0,
length=0xfffffdfe, port=@0xfffffdfe) at ../src/remote/remote.cpp:785
#⁠5 0x08050e6c in SRVR_multi_thread (main_port=0xb77b61cc, flags=2) at ../src/remote/server.cpp:480
#⁠6 0x080504ba in server_main (argc=-514, argv=0x1) at ../src/remote/inet_server.cpp:448
#⁠7 0x08059a09 in main (argc=-514, argv=0xfffffdfe) at ../src/remote/server_stub.cpp:12

Thread 13 (Thread 21015):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d0422c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cda4 in ISC_event_wait (count=-512, events=0xaea54d88, values=0xaea54d8c, micro_seconds=0, timeout_handler=0,
---Type <return> to continue, or q <return> to quit---
handler_arg=0x0) at ../src/jrd/isc_sync.cpp:697
#⁠3 0x0806f5a8 in stall (thread=0xb77baeb8) at ../src/jrd/sch.cpp:965
#⁠4 0x0806e9a6 in SCH_enter () at ../src/jrd/sch.cpp:444
#⁠5 0x0807b8dd in isc_dsql_fetch_m (user_status=0xaea54ff0, stmt_handle=0xfffffe00, blr_length=0,
blr=0xb3901700 "\004\002\004", msg_type=0, msg_length=2330, msg=0xb5909458 "\005") at ../src/jrd/thread_proto.h:12
#⁠6 0x080535e0 in rem_port::fetch (this=0xb60aecb0, sqldata=0xb5ca9a84, sendL=0xb5ca9598) at ../src/remote/server.cpp:2416
#⁠7 0x0805591f in process_packet2 (port=0xb60aecb0, sendL=0xb5ca9598, receive=0xb5ca984c, result=0xaea5530c)
at ../src/remote/server.cpp:3649
#⁠8 0x08055298 in process_packet (port=0xb60aecb0, sendL=0xfffffe00, receive=0xfffffe00, result=0xaea5530c)
at ../src/remote/server.cpp:3391
#⁠9 0x08057f8d in loopThread (flags=0x2) at ../src/remote/server.cpp:5435
#⁠10 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠11 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠12 0x00c49d4e in clone () from /lib/libc.so.6

Thread 12 (Thread 20880):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d0422c in pthread_cond_wait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cda4 in ISC_event_wait (count=-512, events=0x49d74e8, values=0x49d74ec, micro_seconds=0, timeout_handler=0,
handler_arg=0x0) at ../src/jrd/isc_sync.cpp:697
#⁠3 0x0806f5a8 in stall (thread=0xb77b6050) at ../src/jrd/sch.cpp:965
#⁠4 0x0806e9a6 in SCH_enter () at ../src/jrd/sch.cpp:444
#⁠5 0x0810bc6f in GlobalRWLock::unlock (this=0xb6f01ec4, tdbb=0x49d9c70, level=LCK_read, owner_handle=81196)
at ../src/common/classes/locks.h:134
#⁠6 0x081f099e in BackupManager::unlock_shared_database (this=0xfffffe00, tdbb=0x49d9c70) at ../src/jrd/GlobalRWLock.h:115
#⁠7 0x0810d5d3 in CCH_fetch_page (tdbb=0x49d9c70, window=0x49d9890, compute_checksum=1, read_shadow=true)
at ../src/jrd/cch.cpp:1067
#⁠8 0x0810e2b4 in CCH_handoff (tdbb=0x49d9c70, window=0x49d9890, page=1, lock=1, page_type=7 '\a', latch_wait=1,
release_tail=0) at ../src/jrd/cch_proto.h:97
#⁠9 0x08184b64 in NAV_get_record (tdbb=0x49d9c70, rsb=0xb3f9789c, impure=0xb3f98c10, rpb=0xb3f986e4,
direction=RSE_get_forward) at ../src/jrd/cch_proto.h:121
#⁠10 0x081b5bc7 in get_record (tdbb=0x49d9c70, rsb=0xb3f9789c, parent_rsb=0xb3f97bbc, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:1972
#⁠11 0x081b5774 in get_record (tdbb=0x49d9c70, rsb=0xb3f97bbc, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2217
#⁠12 0x081b7b28 in fetch_record (tdbb=0x49d9c70, rsb=0xb3f9807c, n=0) at ../src/jrd/rse.cpp:766
#⁠13 0x081b581e in get_record (tdbb=0x49d9c70, rsb=0xb3f9807c, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2391
#⁠14 0x081b4a33 in RSE_get_record (tdbb=0x49d9c70, rsb=0xb3f9807c, mode=RSE_get_forward) at ../src/jrd/rse.cpp:316
---Type <return> to continue, or q <return> to quit---
#⁠15 0x08143f0e in looper (tdbb=0x49d9c70, request=0xb3f983fc, in_node=0x49d9c70) at ../src/jrd/exe.cpp:1963
#⁠16 0x08143148 in execute_looper (tdbb=0x49d9c70, request=0xb3f983fc, transaction=0xb5c04c54, next_state=4294966784)
at ../src/jrd/exe.cpp:1461

#⁠17 0x08142672 in EXE_receive (tdbb=0x49d9c70, request=0xb3f983fc, msg=1, length=263, buffer=0xacbe4aa4 "", top_level=true)
at ../src/jrd/exe.cpp:749
#⁠18 0x08177f9f in jrd8_receive (user_status=0x49d9ff0, req_handle=0xfffffe00, msg_type=1, msg_length=263,
msg=0xfffffe00 <Address 0xfffffe00 out of bounds>, level=0) at ../src/jrd/jrd.cpp:3193
#⁠19 0x0807ec65 in isc_receive (user_status=0x49d9ff0, req_handle=0xfffffe00, msg_type=1, msg_length=263,
msg=0x7a59dd <Address 0x7a59dd out of bounds>, level=0) at ../src/jrd/why.cpp:450
#⁠20 0x08220bab in GDS_DSQL_FETCH_CPP (user_status=0xfffffe00, req_handle=0xfffffe00, blr_length=57,
blr=0xb6012238 "\004\002\004", msg_type=0, msg_length=262, dsql_msg_buf=0xb61ef598 "") at ../src/dsql/dsql.cpp:1124
#⁠21 0x0807b939 in isc_dsql_fetch_m (user_status=0x49d9ff0, stmt_handle=0xfffffe00, blr_length=57,
blr=0xb6012238 "\004\002\004", msg_type=0, msg_length=262, msg=0xb61ef598 "") at ../src/jrd/why.cpp:450
#⁠22 0x0805372d in rem_port::fetch (this=0xb5b4ff9c, sqldata=0xb40850e8, sendL=0xb4084bfc) at ../src/remote/server.cpp:2330
#⁠23 0x0805591f in process_packet2 (port=0xb5b4ff9c, sendL=0xb4084bfc, receive=0xb4084eb0, result=0x49da30c)
at ../src/remote/server.cpp:3649
#⁠24 0x08055298 in process_packet (port=0xb5b4ff9c, sendL=0xfffffe00, receive=0xfffffe00, result=0x49da30c)
at ../src/remote/server.cpp:3391
#⁠25 0x08057f8d in loopThread (flags=0x2) at ../src/remote/server.cpp:5435
#⁠26 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠27 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠28 0x00c49d4e in clone () from /lib/libc.so.6

Thread 11 (Thread 30567):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d06f89 in __lll_lock_wait () from /lib/libpthread.so.0
#⁠2 0x00d02330 in _L_lock_698 () from /lib/libpthread.so.0
#⁠3 0x00d02201 in pthread_mutex_lock () from /lib/libpthread.so.0
#⁠4 0x0810b525 in GlobalRWLock::lock (this=0xb6f01ec4, tdbb=0x2bd6ac0, level=LCK_read, wait=1, owner_handle=61332)
at ../src/common/classes/locks.h:133
#⁠5 0x081f092c in BackupManager::lock_shared_database (this=0xfffffe00, tdbb=0x2bd6ac0, wait=1)
at ../src/jrd/GlobalRWLock.h:107
#⁠6 0x0810d466 in CCH_fetch_page (tdbb=0x2bd6ac0, window=0xb65d9048, compute_checksum=1, read_shadow=true)
at ../src/jrd/cch.cpp:967
#⁠7 0x0810e2b4 in CCH_handoff (tdbb=0x2bd6ac0, window=0xb65d9048, page=1, lock=1, page_type=5 '\005', latch_wait=1,
release_tail=0) at ../src/jrd/cch_proto.h:97
#⁠8 0x0808896d in DPM_fetch_fragment (tdbb=0x2bd6ac0, rpb=0xb65d8ffc, lock=3) at ../src/jrd/cch_proto.h:121
#⁠9 0x081e217b in VIO_data (tdbb=0x2bd6ac0, rpb=0xb65d8ffc, pool=0xfffffe00) at ../src/jrd/vio.cpp:1078
#⁠10 0x081e623a in VIO_next_record (tdbb=0x2bd6ac0, rpb=0xb65d8ffc, rsb=0xb64818fc, transaction=0xb5bce558, pool=0xb36616e4,
---Type <return> to continue, or q <return> to quit---
onepage=false) at ../src/jrd/vio.cpp:2489
#⁠11 0x081b52fd in get_record (tdbb=0x2bd6ac0, rsb=0xb64818fc, parent_rsb=0xb60dfedc, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:1898
#⁠12 0x081b5774 in get_record (tdbb=0x2bd6ac0, rsb=0xb60dfedc, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2217
#⁠13 0x081b4a33 in RSE_get_record (tdbb=0x2bd6ac0, rsb=0xb60dfedc, mode=RSE_get_forward) at ../src/jrd/rse.cpp:316
#⁠14 0x08143f0e in looper (tdbb=0x2bd6ac0, request=0xb65d8d14, in_node=0x2bd6ac0) at ../src/jrd/exe.cpp:1963
#⁠15 0x08142d60 in EXE_start (tdbb=0x2bd6ac0, request=0xb65d8d14, transaction=0xb5bce558) at ../src/jrd/exe.cpp:1113
#⁠16 0x0817a520 in jrd8_start_request (user_status=0x2bd6ff0, req_handle=0xfffffe00, tra_handle=0xfffffe00, level=0)
at ../src/jrd/jrd.cpp:3851
#⁠17 0x0808103d in isc_start_request (user_status=0x2bd6ff0, req_handle=0xfffffe00, tra_handle=0xfffffe00, level=0)
at ../src/jrd/why.cpp:450
#⁠18 0x08222dd2 in execute_request (request=0xb0ef2f24, trans_handle=0xb0ef2f7c, in_blr_length=0,
in_blr=0xb6017d60 "\004\002\004", in_msg_length=28224, in_msg=0x0, out_blr_length=0, out_blr=0x0, out_msg_length=0,
out_msg=0x0, singleton=false) at ../src/dsql/dsql.cpp:3402
#⁠19 0x082202ef in GDS_DSQL_EXECUTE_CPP (user_status=0xfffffe00, trans_handle=0x2bd6fec, req_handle=0xfffffe00,
in_blr_length=0, in_blr=0xfffffe00 <Address 0xfffffe00 out of bounds>, in_msg_type=0, in_msg_length=0,
in_msg=0xfffffe00 <Address 0xfffffe00 out of bounds>, out_blr_length=0,
out_blr=0xfffffe00 <Address 0xfffffe00 out of bounds>, out_msg_type=0, out_msg_length=0,
out_msg=0xfffffe00 <Address 0xfffffe00 out of bounds>) at ../src/dsql/dsql.cpp:561
#⁠20 0x0807a562 in isc_dsql_execute2_m (user_status=0x2bd6ff0, tra_handle=0x2bd6fec, stmt_handle=0xfffffe00,
in_blr_length=0, in_blr=0xb6017d60 "\004\002\004", in_msg_type=0, in_msg_length=0, in_msg=0x0, out_blr_length=0,
out_blr=0x0, out_msg_type=0, out_msg_length=0, out_msg=0x0) at ../src/jrd/why.cpp:450
#⁠21 0x080530ae in rem_port::execute_statement (this=0xb5b540a4, op=op_execute, sqldata=0x2bd6ff0, sendL=0xb2a8e378)
at ../src/remote/server.cpp:2178
#⁠22 0x08055a48 in process_packet2 (port=0xb5b540a4, sendL=0xb2a8e378, receive=0xb2a8e62c, result=0x2bd730c)
at ../src/remote/server.cpp:3640
#⁠23 0x08055298 in process_packet (port=0xb5b540a4, sendL=0xfffffe00, receive=0xfffffe00, result=0x2bd730c)
at ../src/remote/server.cpp:3391
#⁠24 0x08057f8d in loopThread (flags=0x2) at ../src/remote/server.cpp:5435
#⁠25 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠26 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠27 0x00c49d4e in clone () from /lib/libc.so.6

Thread 10 (Thread 5087):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d045d4 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cd4e in ISC_event_wait (count=-516, events=0x8dee198, values=0x8dee19c, micro_seconds=10000000,
timeout_handler=0, handler_arg=0x0) at ../src/jrd/isc_sync.cpp:671
---Type <return> to continue, or q <return> to quit---
#⁠3 0x081105bc in cache_writer (arg=0xb705d81c) at ../src/jrd/cch.cpp:4360
#⁠4 0x08071a40 in threadStart (arg=0xb705d81c) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x00c49d4e in clone () from /lib/libc.so.6

Thread 9 (Thread 5088):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d045d4 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cd4e in ISC_event_wait (count=-516, events=0x3fd9128, values=0x3fd912c, micro_seconds=10000000,
timeout_handler=0, handler_arg=0x0) at ../src/jrd/isc_sync.cpp:671
#⁠3 0x081eb652 in garbage_collector (arg=0xb705d81c) at ../src/jrd/vio.cpp:4134
#⁠4 0x08071a40 in threadStart (arg=0xb705d81c) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x00c49d4e in clone () from /lib/libc.so.6

Thread 8 (Thread 5085):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d045d4 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cd4e in ISC_event_wait (count=-516, events=0x7386198, values=0x738619c, micro_seconds=10000000,
timeout_handler=0, handler_arg=0x0) at ../src/jrd/isc_sync.cpp:671
#⁠3 0x081105bc in cache_writer (arg=0xb700d81c) at ../src/jrd/cch.cpp:4360
#⁠4 0x08071a40 in threadStart (arg=0xb700d81c) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x00c49d4e in clone () from /lib/libc.so.6

Thread 7 (Thread 20879):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=56459936) at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x00c49d4e in clone () from /lib/libc.so.6

Thread 6 (Thread 30560):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d06675 in sem_wait@@GLIBC_2.1 () from /lib/libpthread.so.0
#⁠2 0x08050978 in shutdown_thread (arg=0x0) at ../src/common/classes/semaphore.h:169
#⁠3 0x08071a40 in threadStart (arg=0x0) at ../src/jrd/ThreadData.cpp:274
---Type <return> to continue, or q <return> to quit---
#⁠4 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠5 0x00c49d4e in clone () from /lib/libc.so.6

Thread 5 (Thread 5086):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d045d4 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib/libpthread.so.0
#⁠2 0x0806cd4e in ISC_event_wait (count=-516, events=0x7d87128, values=0x7d8712c, micro_seconds=10000000,
timeout_handler=0, handler_arg=0x0) at ../src/jrd/isc_sync.cpp:671
#⁠3 0x081eb652 in garbage_collector (arg=0xb700d81c) at ../src/jrd/vio.cpp:4134
#⁠4 0x08071a40 in threadStart (arg=0xb700d81c) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x00c49d4e in clone () from /lib/libc.so.6

Thread 4 (Thread 21016):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=-1375386976)
at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x00c49d4e in clone () from /lib/libc.so.6

Thread 3 (Thread 4788):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=87929504) at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x00c49d4e in clone () from /lib/libc.so.6

Thread 2 (Thread 21013):
#⁠0 0x00743424 in __kernel_vsyscall ()
#⁠1 0x00d06818 in sem_timedwait () from /lib/libpthread.so.0
#⁠2 0x0805991c in SignalSafeSemaphore::tryEnter (this=0x83e07b4, seconds=-1343851872)
at ../src/common/classes/semaphore.h:220
#⁠3 0x080582da in loopThread (flags=0x2) at ../src/remote/server.cpp:5545
#⁠4 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
---Type <return> to continue, or q <return> to quit---
#⁠5 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠6 0x00c49d4e in clone () from /lib/libc.so.6

Thread 1 (Thread 20882):
#⁠0 0x00c9b6d3 in __memmove_ssse3_rep () from /lib/libc.so.6

#⁠1 0x08109f2f in LocksCacheJrd::CachedLock\::get (this=0xb6f8edd4, tdbb=0x67dcc70, key=0x67da7a0 "Q\200\a")
at ../src/common/classes/array.h:172
#⁠2 0x080fac7f in BtrPageGCLock::disablePageGC (this=0xb2b2cff4, tdbb=0x67dcc70, page=...) at ../src/jrd/btr.cpp:268
#⁠3 0x081855b0 in set_page (impure=0xb267c41c, window=0x67dcc70) at ../src/jrd/nav.cpp:1165
#⁠4 0x081848c2 in NAV_get_record (tdbb=0x67dcc70, rsb=0xb267b0d4, impure=0xb267c41c, rpb=0xb267bef0,
direction=RSE_get_forward) at ../src/jrd/nav.cpp:1192
#⁠5 0x081b5bc7 in get_record (tdbb=0x67dcc70, rsb=0xb267b0d4, parent_rsb=0xb267d7f0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:1972
#⁠6 0x081b5774 in get_record (tdbb=0x67dcc70, rsb=0xb267d7f0, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2217
#⁠7 0x081b7b28 in fetch_record (tdbb=0x67dcc70, rsb=0xb264bdec, n=0) at ../src/jrd/rse.cpp:766
#⁠8 0x081b581e in get_record (tdbb=0x67dcc70, rsb=0xb264bdec, parent_rsb=0x0, mode=RSE_get_forward)
at ../src/jrd/rse.cpp:2391
#⁠9 0x081b4a33 in RSE_get_record (tdbb=0x67dcc70, rsb=0xb264bdec, mode=RSE_get_forward) at ../src/jrd/rse.cpp:316
#⁠10 0x08143f0e in looper (tdbb=0x67dcc70, request=0xb267bc08, in_node=0x67dcc70) at ../src/jrd/exe.cpp:1963
#⁠11 0x08143148 in execute_looper (tdbb=0x67dcc70, request=0xb267bc08, transaction=0xb5aeb444, next_state=2998063092)
at ../src/jrd/exe.cpp:1461
#⁠12 0x08142672 in EXE_receive (tdbb=0x67dcc70, request=0xb267bc08, msg=1, length=263, buffer=0xb2d4aaa4 "", top_level=true)
at ../src/jrd/exe.cpp:749
#⁠13 0x08177f9f in jrd8_receive (user_status=0x67dcff0, req_handle=0xb2b2cff4, msg_type=1, msg_length=263,
msg=0xb2b2cff4 "", level=0) at ../src/jrd/jrd.cpp:3193
#⁠14 0x0807ec65 in isc_receive (user_status=0x67dcff0, req_handle=0xb2b2cff4, msg_type=1, msg_length=263,
msg=0xb2b2cff0 "\377\377", level=0) at ../src/jrd/why.cpp:450
#⁠15 0x08220bab in GDS_DSQL_FETCH_CPP (user_status=0xb2b2cff4, req_handle=0xb2b2cff4, blr_length=57,
blr=0xb38975d4 "\004\002\004", msg_type=0, msg_length=262, dsql_msg_buf=0xb62e5764 "") at ../src/dsql/dsql.cpp:1124
#⁠16 0x0807b939 in isc_dsql_fetch_m (user_status=0x67dcff0, stmt_handle=0xb2b2cff4, blr_length=57,
blr=0xb38975d4 "\004\002\004", msg_type=0, msg_length=262, msg=0xb62e5764 "") at ../src/jrd/why.cpp:450
#⁠17 0x0805372d in rem_port::fetch (this=0xb37afdfc, sqldata=0xb5e4272c, sendL=0xb5e42240) at ../src/remote/server.cpp:2330
#⁠18 0x0805591f in process_packet2 (port=0xb37afdfc, sendL=0xb5e42240, receive=0xb5e424f4, result=0x67dd30c)
at ../src/remote/server.cpp:3649
#⁠19 0x08055298 in process_packet (port=0xb37afdfc, sendL=0xb2b2cff4, receive=0xb2b2cff4, result=0x67dd30c)
at ../src/remote/server.cpp:3391
#⁠20 0x08057f8d in loopThread (flags=0x2) at ../src/remote/server.cpp:5435
#⁠21 0x08071a40 in threadStart (arg=0x2) at ../src/jrd/ThreadData.cpp:274
---Type <return> to continue, or q <return> to quit---
#⁠22 0x00d00919 in start_thread () from /lib/libpthread.so.0
#⁠23 0x00c49d4e in clone () from /lib/libc.so.6
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb)
(gdb) quit

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Philippe,
same error on Fedora Package.

Probably, i have isolated the problematic table.
I will execute specific queries against it.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

I cant reproduce the workload to generate the error in a test server.

Any ideas?

Tks

@firebird-automations
Copy link
Collaborator Author

Commented by: @hvlad

Classic shouldn't have this issue.
v2.5 (any architecture) also shouldn't.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

i was making a backup (gbak), and the following error occurred

fbserver[4623]: segfault at 4c1c3b0d ip 009f26d7 sp b65e8424 error 4 in http://libpthread-2.13.so[9e9000+17000]
[ 2617.495528]
fbserver[5100]: segfault at 0 ip 0831543f sp b463a150 error 4 in fbserver[8048000+3c4000]

And in a random way this on gbak "ERROR:gds_$open_blob failed"

But happened in both versions(2.1.3, 2.1.4).

Could my database are corrupted and generating this main issue?

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

Your database appears corrupted (did you try gfix?), but this should not be a reason for segfaults.

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

I will gfix&gbak the production database...and try the 2.1.4

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

I did the gfix, and repaired the problems encoutered.
- gbak to backup
- gbak to restore
- installed 2.1.4
and again the AV error was raised

I tried ;/
If need some information, im watching this post

Thanks! to everyone that was involved

@firebird-automations
Copy link
Collaborator Author

Commented by: @hvlad

Could you try Classic Server ?

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Yes, tomorrow i return with the result of the test

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

This weekend, i will do the classic test

@firebird-automations
Copy link
Collaborator Author

Commented by: Fernando Guidorizzi (mephisty)

Im unable to install classic version,

The server was rejecting the incoming connections and returning with the message
"connection rejected by remote interface"
and several fb_inet_server with 'defunct' status...

I searched for some solution, not found anything....
I know doesn't meet with the thread purpose ...
maybe a especific rigths to firebird user

Any help?!

tks!

@firebird-automations
Copy link
Collaborator Author

Commented by: @AlexPeshkoff

Tracker is not good place for discussing install problems. Please contact me privately, peshkoff at mail dot ru, to solve your problems.

@firebird-automations
Copy link
Collaborator Author

Modified by: @hvlad

assignee: Alexander Peshkov [ alexpeshkoff ] => Vlad Khorsun [ hvlad ]

@firebird-automations
Copy link
Collaborator Author

Modified by: @hvlad

status: Open [ 1 ] => Resolved [ 5 ]

resolution: Fixed [ 1 ]

Fix Version: 2.1.5 [ 10420 ]

@firebird-automations
Copy link
Collaborator Author

Modified by: @dyemanov

Link: This issue is duplicated by CORE3655 [ CORE3655 ]

@firebird-automations
Copy link
Collaborator Author

Modified by: @pcisar

status: Resolved [ 5 ] => Closed [ 6 ]

@firebird-automations
Copy link
Collaborator Author

Modified by: @pavel-zotov

status: Closed [ 6 ] => Closed [ 6 ]

QA Status: Cannot be tested

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants