This portal is to open public enhancement requests against products and services offered by the IBM Data & AI organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).
Shape the future of IBM!
We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:
Search existing ideas
Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,
Post your ideas
Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,
Post an idea
Upvote ideas that matter most to you
Get feedback from the IBM team to refine your idea
Specific links you will want to bookmark for future use
Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.
IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.
ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.
IBM Employees should enter Ideas at https://ideas.ibm.com
See this idea on ideas.ibm.com
In order to be able to use the CP4D Data Virtualization in combination with Watson Knowledge Catalog as a single, integrated governance layer over structured data (residing in Databases / Flat files) and unstructured data (residing in binary and character files in S3 Object Stores) we require the data types CLOB and BLOB to be available in Data Virtualization.
The Data Virtualization shall be able to read all sort of character and binary formats from files stored on S3 Object Stores. Data Virtualization shall be used to control access to the data of the underlying systems and present it as a CLOB/BLOB like data structure to the user, so they can use and combine it within a single SQL like interface.
This functionality corresponds to the "create external table […] LOCATION 's3a://<bucket>/folder'" functionality available in hive.
Additionally object metadata stored in the S3 Object Store should be made available within the Data Virtualization engine, e.g {"Filename":"s3://mybucket/99/99/5412259999_1.TIF","File size":"417","Last mod":"Wed, 20 Oct 2021 13:07:30 GMT","MIME type":"binary/octet-stream","Storage":"STANDARD","MD5 sum":"7cff955d4673633b95ec9517854d1dbb","SSE":"AES256","Policy":"none","CORS":"none","ACL":"everybody"}, so that it can be used in data queries against the DV.
Caching of the data passed through the Data Virtualization shall be possible in order to speed up access to the objects.
Currently WKC / DV can not be used as a single, integrated governance layer across various data locations. Instead the permissions on the S3 Object Storage have to be implemented separately. This process takes extra effort and is error prone.
The described functionality would enable us to use WKC / DV as integrated governance layer.
Needed By | Yesterday (Let's go already!) |
By clicking the "Post Comment" or "Submit Idea" button, you are agreeing to the IBM Ideas Portal Terms of Use.
Do not place IBM confidential, company confidential, or personal information into any field.