IBM Data and AI Ideas Portal for Customers
Hide about this portal


This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com


Add a new idea Subscribe
Status Delivered
Workspace Connectivity
Created by Guest
Created on Dec 4, 2020

RELATED IDEAS

Enable Redshift Load from the S3 connector

See this idea on ideas.ibm.com

We at NYL planning to move from On Prem to Cloud environment. We did a multiple testings with the help of IBM Support team and noticed that the Redshift loads using Redshift connector/JDBC connector as dead slow.

This will impact all of our Target load jobs in NYL EDM environment.

Currently Redshift connector is taking 35 mins for 1 million records to insert and going at 2 rows/sec for updates.

Proposed Idea/Solution - After the data is written to the S3 connector, we request to have an option to load that data using native S3 copy command into Redshift database. This should work for both Insert and Updates

Needed by Date Dec 31, 2020
  • Guest
    Reply
    |     May 27, 2021

    We are also in the process of moving from an On-prem solution to Cloud and experiencing the same difficulties.

    It would be helpful if you can provide more details on this "short term" solution. How do we use the "Redshift" mode to write into Redshift. Some examples or steps to achieve this would be appreciated.

    Thanks in advance.

  • Guest
    Reply
    |     Jan 21, 2021

    Thank you for submitting this idea.

    Both Ideas were merged. Can you please confirm your main interest for this connector enhancement : would that be for Datastage or also in other parts of Cloud Pak for Data?

    As a short term solution within Datastage, DataStage has S3 Connector that support Redshift mode, which can be used to write the data and issue the Copy command using some AWS CLI tools in the job flow.

    https://www.ibm.com/support/producthub/ugi/docs/content/SSZJPZ_11.7.0/com.ibm.swg.im.iis.conn.s3.usage.doc/topics/properties_reference_amazon_s3.html

    We'll consider an enhancement to the Redshift connector available in Cloud pak for data for a future release.

  • Guest
    Reply
    |     Dec 11, 2020

    Please ignore this request. We have created a similar request under CloudPak for Redshift connector - CPDIDEAS-I-14

14 MERGED

Redshift connector slowness for Inserts, Updates and Deletes

When we started using Redshift connector for performing inserts, the performance was pretty slow - 470 rows/sec When we started using Redshift connector for performing updates, the performance was pretty slow - 2 rows/sec With these performances, ...
over 4 years ago in Connectivity 1 Delivered

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.