Skip to Main Content
IBM Data and AI Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com


Status Submitted
Workspace DataStage
Created by Guest
Created on Feb 9, 2024

#emea #csm #mea Integrate IBM Knowledge Catalog Governance into DataStage Flows

Issue:

Currently, in IBM Cloud Pak for Data, data protection rules defined within Watson Knowledge Catalog are not directly applied to DataStage flows, even when governed assets from the catalog are used. This creates confusion and a sense that not everything is truly governed. Today, data protection rules defined are only applicable if customer sources data from Watson Query connection. 

Suggestion:

Enhance the integration between IBM Knowledge Catalog and DataStage to enable automatic application of data protection rules within DataStage flows. This could be achieved through the following:

  1. DataStage integration with Knowledge Catalog: Develop a bidirectional connector between DataStage and Knowledge Catalog. This connector would allow DataStage to automatically retrieve and apply relevant data protection rules associated with assets used in flows.
  2. Visual indicators of governance: Implement visual indicators within DataStage that highlight when data protection rules are being applied to specific assets or stages within a flow. This would provide immediate feedback to data engineers and increase transparency.
  3. Policy enforcement integration: Integrate Knowledge Catalog policy enforcement capabilities directly into DataStage. This would enable real-time validation and potential blocking of actions within DataStage flows that violate defined policies.

Benefits:

  • Improved governance visibility and transparency: Data engineers will have clear insight into which assets and flows are governed and how rules are being applied.
  • Enhanced data quality and compliance: Automatic enforcement of data protection rules will help ensure data quality and compliance with regulations.
  • Increased trust and efficiency: Data engineers can work with greater confidence knowing that governance is being consistently applied, reducing rework and errors.
  • Simplified data management: Streamlined integration between Knowledge Catalog and DataStage will simplify data governance processes.

Implementation Considerations:

  • Prioritize integration based on frequently used assets and data protection rules.
  • Ensure compatibility with existing DataStage versions and configurations.
  • Provide clear documentation and training for data engineers on the new functionality.

Additional Notes:

  • This suggestion can be further refined by prioritizing specific data protection rules for initial integration based on user needs and impact.
  • Consider exploring the possibility of integrating with other Cloud Pak for Data components beyond DataStage, creating a more comprehensive governance experience.

By implementing this suggestion, the product team can significantly improve the user experience and effectiveness of data governance within IBM Cloud Pak for Data.

Needed By Quarter
  • Guest
    Reply
    |
    Mar 25, 2024

    I vote for this idea, indeed it will enable to better manage sensitive data when used within DataStage flows.

  • Guest
    Reply
    |
    Feb 12, 2024

    I vote for this idea

  • Guest
    Reply
    |
    Feb 9, 2024

    I vote for this idea