IBM Data Platform Ideas Portal for Customers


This portal is to open public enhancement requests against products and services offered by the IBM Data Platform organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).


Shape the future of IBM!

We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:


Search existing ideas

Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,


Post your ideas

Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,

  1. Post an idea

  2. Upvote ideas that matter most to you

  3. Get feedback from the IBM team to refine your idea


Specific links you will want to bookmark for future use

Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.

IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.

ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.

IBM Employees should enter Ideas at https://ideas.ibm.com



Add a new idea Subscribe
Status Functionality already exists
Workspace Data Lineage by Manta
Created by Guest
Created on Mar 5, 2025

RELATED IDEAS

Enable Export of Hive Lineage from Manta to Alation

At Truist, we use Manta to scan and Analyze data elements across various technologies - such as Oracle, MSSQL, Db2 LUW and more - and then export that lineage to Alation for Governance and auditing. However, it appears Hive lineage is not currently supported for export.

Key Observations Include:

  1. There is no Alation export related scenario for any hive connections unlike other export supported technologies eg MSSQL, Oracle etc.

  2. There is no presence of hive technology Alation mapping in Manta admin ui configuration.

  3. Existing Manta documentation references limitations on exporting hive lineage to Alation but does not provide any timeline for future support.

Business Impact:

  1. Missing Hive lineage in Alation prevents data stewards from tracking data elements from one end to end, impacting data quality.

  2. This limitation also hinders efforts to identify potential upstream or downstream impacts with hive-based data flow.

Expected Outcome:

  1. Provide full support for Hive lineage exports.

  2. Hive based dataflow should be exported to Alation without errors or issue.

Reference:

https://www.ibm.com/docs/en/manta-data-lineage?topic=integrations

Needed By Not sure -- Just thought it was cool
  • Guest
    Sep 3, 2025

    Found fixed in 42.13.5 
    However there are some minor issues (dataflow objects created in Alation do not have SQL details. This idea can be closed as delivered.

    Reply
  • Admin
    Jakub Moravec
    Jul 7, 2025

    Hi Amar,

    happy to confirm that we have identified the cause of the Hive issue and fix will be available in Manta 42.13. Please let me know if you have any questions.

    Thank you, Jakub

    Reply
  • Guest
    Jun 23, 2025

    Update from Jakub on 6/20/2025

    Hi Amar, 

         apologies, I did not realise this check will prevent you from entering the hostname. The reason why I wanted to do this is because Hive, unlike other databases, uses this Dictionary ID to match the Hive connection against the export mapping (using Hive hostname proved to be problematic in the past). As this validation cannot be circumvened, I believe we will need to make changes in the application to make the export work for you. We’re currently testing the approach internally, let me get back to you next week with updates. 

    Best Regards,
    Jakub

    Reply
  • Guest
    Jun 23, 2025

    Hi, 
    Amar tried the last suggestion, but Manta Admin UI don’t allow the special characters in the dictionary ID.

    Reply
  • Admin
    Jakub Moravec
    Jun 17, 2025

    Hi Amar,

    I reviewed the inputs we gathered with the engineering team, and the following change should help:

    • Edit your existing Hive connection, change Dictionary ID to devhive.bbtnet.com (it has to be the same as the server name you see in Manta Viewer)

    • Re-run the Hive extraction and analysis

    • Re-run the export to Alation

    Best Regards,
    Jakub

    Reply
  • Guest
    Jun 16, 2025

    As discussed,

    Although the functionality exists. Still it is not working in below two Manta releases.

    R42.10.2 and R42.12.0

    I had call with Jakub on 6/16 3.30 - 4 PM ET

    Summary from the discussion with Jakub:

    We validate the connection , workflow execution, and lineage. All looks good.

    Jakub looked at couple of configuration from Manta Admin UI: Hive alias mapping, Hive Alation Mapping. He took screenshots of the configs.

    Jakub collected the snippet from cli log. Nothing can be concluded from logs.

    Next steps: Jakub will check with engineering team and get us back by tomorrow with new updates 06/17

    Reply
  • Admin
    Jakub Moravec
    Jun 10, 2025

    Hi Dev, Hive export to Alation has beein implemented in Manta 42.5, unfortunatelly the documentation did not reflected which is now being fixed. You can test it out and get back if you encounter any problems.

    Best Regards,
    Jakub Moravec
    IBM Manta Data Lineage product team

    Reply
  • Guest
    May 16, 2025

    Correction: In Manta 42.10, there is now an alias mapping for Hive to Alation mapping in Manta admin ui configuration.

     

    Therefore it seems like this feature is partially implemented.

    image001.png
    image001.png
    Open full size
    image001.png
    Reply

By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.