Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure Data Factory crash issues when using Firebird ODBC driver [ODBC218] #200

Open
firebird-automations opened this issue Jun 11, 2020 · 3 comments

Comments

@firebird-automations
Copy link

Submitted by: Pedro Innecco (pmdci)

Attachments:
microsoft_firebirdODBC_bug_screenshot.jpg

We are using the ODBC driver to load data from Firebird SQL into an Azure database using Azure Data Factory.

For that, we created a Windows 10 VM on-premise, which can access the Firebird SQL, and installed the Azure Data Factory Integrated Runtime, which works as the gateway to surface data to Azure Data Factory.

We noticed that with a particular dataset, the ADF process crashes on the local VM. After long sessions with the Microsoft product team for Azure Data Factory, they managed to isolate the issue to a bug in the Firebird ODBC driver.

Here is what Microsoft has to say. I'd be happy to share more information if required, but I'm afraid I will not do so in a public forum.

~~~~

So we have figured out the root cause after several times' on-call with you (thanks for your patience!). Here are the summary:

- First, this is a crash issue of the using 3rd party driver: Firebird ODBC driver. The following gives the call stack from the crash dump. So this is a bug in the 3rd party driver.

- - BTW, this seems an obsolete driver which hasn't been updated since 2017.

- Second, as far as we know, the Firebird driver bug only happens when using C#⁠ ADO .Net ODBC with big data set. If using native version of ODBC, the issue doesn't repro. As ADF Copy activity is using ADO .Net ODBC, you would hit the driver issue.

- Based on the current situation, ADF Copy activity cannot work well on the problematic driver, and a workaround suggestion is to use SSIS or other tools that don't use ADO .Net ODBC. Sorry for the inconvenience.

@firebird-automations
Copy link
Author

Commented by: Pedro Innecco (pmdci)

Screenshot of debugging process showing the bug raised by the Firebird ODBC driver.

@firebird-automations
Copy link
Author

Modified by: Pedro Innecco (pmdci)

Attachment: microsoft_firebirdODBC_bug_screenshot.jpg [ 13475 ]

@irodushka
Copy link

irodushka commented Feb 29, 2024

Hi there

Can anyone check if the version 3.0.0.8 (or later) has the same issue?
I mean https://github.com/FirebirdSQL/firebird-odbc-driver/wiki

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants