IBM Data Platform Ideas Portal for Customers
This portal is to open public enhancement requests against products and services offered by the IBM Data Platform organization. To view all of your ideas submitted to IBM, create and manage groups of Ideas, or create an idea explicitly set to be either visible by all (public) or visible only to you and IBM (private), use the IBM Unified Ideas Portal (https://ideas.ibm.com).
Shape the future of IBM!
We invite you to shape the future of IBM, including product roadmaps, by submitting ideas that matter to you the most. Here's how it works:
Search existing ideas
Start by searching and reviewing ideas and requests to enhance a product or service. Take a look at ideas others have posted, and add a comment, vote, or subscribe to updates on them if they matter to you. If you can't find what you are looking for,
Post your ideas
Post ideas and requests to enhance a product or service. Take a look at ideas others have posted and upvote them if they matter to you,
Post an idea
Upvote ideas that matter most to you
Get feedback from the IBM team to refine your idea
Specific links you will want to bookmark for future use
Welcome to the IBM Ideas Portal (https://www.ibm.com/ideas) - Use this site to find out additional information and details about the IBM Ideas process and statuses.
IBM Unified Ideas Portal (https://ideas.ibm.com) - Use this site to view all of your ideas, create new ideas for any IBM product, or search for ideas across all of IBM.
ideasibm@us.ibm.com - Use this email to suggest enhancements to the Ideas process or request help from IBM for submitting your Ideas.
IBM Employees should enter Ideas at https://ideas.ibm.com
@Guest it would be helpful to provide more information before we can decide on a course of action for this idea. For document extraction, there are many aspects that affect the overall quality of extraction.
The language of the documents
The languages supported the chosen LLM support
The language the extractor fields and schema are defined in
We have seen from limited testing that you can get good results when the language of a document is different than that of the language the extractor fields the schema is defined in.
I suggest doing some testing with sample documents in the target language(Chinese) first on IBM cloud.
The list of supported LLMs for the extractor changes over time. I suggest looking through the LLMs in the extractor dropdown to see if any of them specifically mention support for Chinese. If any of them state it explicitly, that's a good one to start with. If none of the LLMs state support for Chinese, it's worth still trying them. In many cases the LLM may have been trained on some Chinese content, but not enough for the model provider to explicitly claim support for a given language. However, depending on the documents being processed the results can still be acceptable.
Also try creating a schema in English at first, especially if the use case includes processing documents in more than one language. We have seen in testing cases where an schema defined in english does a good job extracting content from documents in a non english language. If this doesnt yield good results, you can try defining the extractor in the language of the target documents. To support this we'll soon be releasing support in the extractor UI where it allows a larger character set for the schema field input which should enable using chinese characters in the field names and descriptions.
If through testing you are able to identify a schema definition and an LLM that produces good results, please post an update here and we can then look at enabling this capability in the on-prem in a subsequent wxO release.
Note other related ideas on Chinese language support, please comment with more details, including customer/project name(s) and timeline(s) on any of those you see relevant, thanks!
additional LLMs strong with the Chinese language : https://watson-orchestrate.ideas.ibm.com/ideas/LSABER-I-999
Knowledge support : https://watson-orchestrate.ideas.ibm.com/ideas/LSABER-I-1325
Default chat welcome & prompts:
https://watson-orchestrate.ideas.ibm.com/ideas/LSABER-I-1277 for welcome message
https://watson-orchestrate.ideas.ibm.com/ideas/LSABER-I-1276 for start prompts
Gen AI: https://ibm-data-and-ai.ideas.ibm.com/ideas/LSABER-I-947 (let us know if this one is not good enough and brings us back to https://watson-orchestrate.ideas.ibm.com/ideas/LSABER-I-999)
UI translation: https://watson-orchestrate.ideas.ibm.com/ideas/LSABER-I-996
We appreciate your input, understanding the impact on ongoing or upcoming customers/projects will help prioritize those improvements, thank you!