IBM Data and AI Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com


Add a new idea Subscribe
Status Not under consideration
Workspace Connectivity
Created by Guest
Created on Oct 30, 2020

RELATED IDEAS

Snowflake Connector Error handling

1) We encountered an issue while using the insert or update option. The continue on error option does not work and the job fails if it encounters bad data. We opened a case with IBM. There is no reject capture mechanism.

Workaround:

Two step solution.

1- COPY INTO "TEST"."PUBLIC"."LOADBADDATA" FROM @AZUREBLOBV2/BadFile.csv FILE_FORMAT = '"TEST"."PUBLIC"."CSV2"' on_error = CONTINUE ;

2- INSERT INTO ERRORS_TABLE (select * from table(validate("TEST"."PUBLIC"."LOADBADDATA", job_id => '_last')) );

3- MERGE INTO FINALTABLE FROM LOADBADDATA



I have attached the datastage job export (.dsx file) BaseLoadOrigLoan.dsx which ran successfully after including the solution suggested by IBM.

I have also attached the job that failed which is BaseLoadOrigLoan_Beforechange.dsx.

I have also attached the query which is part of the job.

Suggested_Query...
BaseLoadOrigLoa...
BaseLoadOrigLoa...
Suggested_Query_snowflake.txt
 Suggested_Query_snowflake.txt
Open full size
BaseLoadOrigLoan_Beforechange.dsx
 BaseLoadOrigLoan_Beforechange.dsx
Open full size
BaseLoadOrigLoan.dsx
 BaseLoadOrigLoan.dsx
Open full size
Suggested_Query_snowflake.txt BaseLoadOrigLoan_Beforechange.dsx BaseLoadOrigLoan.dsx
Needed by Date Nov 27, 2020
  • Guest
    Reply
    |     Feb 23, 2022

    Can anyone help me to understand - Inside Snowflake Connector when we select write_mode as INSERT and UPDATE and use MERGE=YES. Can we able to select GENERATE RUN TIME SQL = NO ???


    If this is possible, we no need to create the temp table like mentioned in above content and can perform, all checks on bad records using Validation_mode and exclude the same from the MERGE load.

    Kindly update me, if this is possible --> Can we able to select GENERATE RUN TIME SQL = NO ???


  • Guest
    Reply
    |     Nov 10, 2021

    Is there any possibility that the reject links are being added anytime soon? The above workaround doesn't seem to be working using the load from file option doesn't seem to work. I get the error - SQL Compilation error: Expression 'XXXXX' not supported within a VALIDATE expression

  • Guest
    Reply
    |     Oct 29, 2021

    This has my vote!

    We have a requirement to load data to Snowflake DW for more than 500 DataStage jobs.

  • Guest
    Reply
    |     Dec 3, 2020

    Thank you for submitting this idea. We'll run a feasibility analysis and consider this enhancement for a future release of the product, based on this.

  • Guest
    Reply
    |     Nov 16, 2020

    This certainly has my vote!

  • Guest
    Reply
    |     Nov 16, 2020

    This has my vote!

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.