New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversion from numeric literals to DECFLOAT adds precision that is not originally present [CORE5697] #5963
Comments
Modified by: @mrotteveeldescription: When inserting into a table with a DECFLOAT(16) column, Using insert into decfloat16 (column1) values (1E300); and then select cast(column1 as varchar(30)) from decfloat16 will result in: 1.000000000000000E+300 In other words, the conversion from literal adds 15 digits of precision that weren't actually present in the literal. => When inserting into a table with a DECFLOAT(16) column, Using insert into decfloat16 (column1) values (1E300); and then select cast(column1 as varchar(30)) from decfloat16 will result in: 1.000000000000000E+300 In other words, the conversion from literal adds 15 digits of precision that weren't actually present in the literal. The value resulting from string conversion is what I expect to get from the literal. |
Modified by: @AlexPeshkoffassignee: Alexander Peshkov [ alexpeshkoff ] |
Modified by: @AlexPeshkoff |
Commented by: @mrotteveel This works OK now. |
Modified by: @AlexPeshkoffstatus: Open [ 1 ] => Resolved [ 5 ] resolution: Fixed [ 1 ] Fix Version: 4.0 Beta 2 [ 10888 ] |
Modified by: @pavel-zotovstatus: Resolved [ 5 ] => Resolved [ 5 ] QA Status: No test => Done successfully |
Modified by: @pavel-zotovstatus: Resolved [ 5 ] => Closed [ 6 ] |
Submitted by: @mrotteveel
Depends on CORE6060
When inserting into a table with a DECFLOAT(16) column,
Using
insert into decfloat16 (column1) values (1E300);
insert into decfloat16 (column1) values ('1E300');
and then select cast(column1 as varchar(30)) from decfloat16 will result in:
1.000000000000000E+300
1E+300
In other words, the conversion from literal adds 15 digits of precision that weren't actually present in the literal. The value resulting from string conversion is what I expect to get from the literal.
Commits: 5d70d4a
The text was updated successfully, but these errors were encountered: