Release 2024.03.00
Notable Changes
RACI claim change
Additional default claim for governance.globaldatamodel has been added to all default roles. Please make sure you apply this claim to these roles and any relevant roles yourself.
CluedIn.Controller
CluedIn
Features
- Can now enable or disable fuzzy matching per organization via the UI
- Deduplication performance improvements when matching using equality only
- Deduplication projects will use equality comparison that is case-sensitive by default to improve performance. To perform case-insensitive comparison add normalizations
- Introduced mechanism to throttle processing of large entities to avoid high memory usage and eventual
Out Of Memory exceptions
- Support the export of hierarchy trees as a csv file
- Return an error when attempting to add a duplicate provider
- Copilot can now create rules that target entity properties and not just vocabulary keys
- Copilot can now create streams that target entity properties and not just vocabulary keys
- Improved copilots handling of error responses
- Copilot now validates the export target when creating a stream
Fixes
- Manual merge ignores target entity under certain conditions
- Searching roles only searches from the start of the name
- Internal caching of
MergedCollection in some cases would be out-of-date
- Incoming edges could remain after split
- Multiple stream ingestion jobs get created simultaneously
- Stream
LoggingVersion is not being updated for legacy streams when starting and stopping a stream
- Vocabulary keys with large names cause issues with clean project generation
- The system fails to start if a vocabulary key’s parent vocabulary is missing
- Copilot can create streams using operators that are not valid for rules
- Copilot can create rules using operators that are not valid for stream
- Merge entities concurrency issue causing data inconsistency
CluedIn.MicroServices
Fixes
- Generation of clues with empty names replaces them with an unwanted value
- Existing mapping list only returns 10 values
CluedIn.UI
Features
- The data source edit panel allows you to remove the logo
- Filters have been added on the data set preview page
- Automatically switch the paging options when the datasets count is more than 10K
- Clean projects open within CluedIn’s main window rather than a new tab
- Can edit a data sets name
- Allow the use of vocabulary keys in multiple entity codes when mapping
- Allow the export of hierarchy trees as a csv file
- Display a more tailored message when the hierarchy list is empty
- Added new
governance.globaldatamodel claim for the global data model
- Mapping improvements to the UX flow
- Increased maximum number of columns for a data set
- Improved the vocabulary key selector throughout the system
- Improved the entity type selector throughout the system
Fixes
- Mapping visualization page flickers
- Select all hierarchy projects does not select all items
- Hierarchy properties panel shows the wrong message when there are no properties
- Error when refreshing hierarchy that contain entities that have been merged
- The group relations delete panel is missing links for grouped edges
- Relations tree view is missing links for grouped edges
- Incorrect tooltip on the search screen when you have an invalid lookup value
- Mapping layout and validation issues
- You cannot import data from tables, that only differ by their schema name
- The add export target button is still active when the form has failed validation
Runtime-Environment
Features
- Created DataSetFilterstable to allow filtering on the preview page of a data set
- Created DataSetOperations table to allow basic operations (such as inline-edit) on a value once the data set is in Edit mode
- Adding fields: editableIndex, editableIndexStatus, editableIndexAuthor to the DataSets table in order to keep track of the status when the data set is being transformed by the data source processing pods.
- Support for AnnotationPropertyCodes
- Global data model claim
governance.globaldatamodel
Fixes
- Clean projects with long vocabulary key names do not generate
Packages
For this release, kindly utilize the precise versions listed below for the following packages
Connectors
| Name |
Version |
| CluedIn.Connector.AzureDataLake |
4.0.0 |
| CluedIn.Connector.AzureDedicatedSqlPool |
4.0.0 |
| CluedIn.Connector.AzureEventHub |
4.0.0 |
| CluedIn.Connector.AzureServiceBus |
4.0.0 |
| CluedIn.Connector.Http |
4.0.0 |
| CluedIn.Connector.SqlServer |
4.0.0 |
| CluedIn.PowerApps |
4.0.1 |
| CluedIn.Connector.Dataverse |
4.0.1 |
Enrichers
| Name |
Version |
| CluedIn.ExternalSearch.Providers.DuckDuckGo.Provider |
4.0.0 |
| CluedIn.ExternalSearch.Providers.PermId.Provider |
4.0.0 |
| CluedIn.ExternalSearch.Providers.Web |
4.0.0 |
| CluedIn.Provider.ExternalSearch.Bregg |
4.0.0 |
| CluedIn.Provider.ExternalSearch.ClearBit |
4.0.0 |
| CluedIn.Provider.ExternalSearch.CompanyHouse |
4.0.0 |
| CluedIn.Provider.ExternalSearch.CVR |
4.0.0 |
| CluedIn.Provider.ExternalSearch.Gleif |
4.0.0 |
| CluedIn.Provider.ExternalSearch.GoogleMaps |
4.0.0 |
| CluedIn.Provider.ExternalSearch.KnowledgeGraph |
4.0.0 |
| CluedIn.Provider.ExternalSearch.Libpostal |
4.0.0 |
| CluedIn.Provider.ExternalSearch.OpenCorporates |
4.0.0 |
| CluedIn.Provider.ExternalSearch.Providers.VatLayer |
4.0.0 |
| CluedIn.Provider.MasterDataServices |
4.0.0 |
Crawlers
| Name |
Version |
| CluedIn.Crawling.MasterDataServices |
4.0.0 |
| CluedIn.Purview |
4.1.0 |
Other
| Name |
Version |
| CluedIn.Vocabularies.CommonDataModel |
4.0.1 |
| CluedIn.EventHub |
4.1.0 |
Clean
| Docker Image |
Tags |
| cluedin/cluedin-micro-clean |
2024.03.00, 2024.03, 4.1, 4.1.0, 4.1.0_80611 |
Controller
| Docker Image |
Tags |
| cluedin/controller |
2024.03.00, 2024.03, 4.1, 4.1.0, 4.1.0_80590 |
Docs
| Docker Image |
Tags |
| cluedin/cluedin-micro-documentation |
2024.03.00, 2024.03, 4.1, 4.1.0, 4.1.0_80589 |
Gql
| Docker Image |
Tags |
| cluedin/cluedin-ui-gql |
2024.03.00, 2024.03, 4.1, 4.1.0, 4.1.0_80588 |
Microservices
| Docker Image |
Tags |
| cluedin/data-source |
2024.03.00, 2024.03, 4.1, 4.1.1, 4.1.1_81187 |
| cluedin/data-source-processing |
2024.03.00, 2024.03, 4.1, 4.1.1, 4.1.1_81187 |
| cluedin/data-source |
2024.03.00, 2024.03, 4.1, 4.1.1, 4.1.1_81187 |
| cluedin/data-source-processing |
2024.03.00, 2024.03, 4.1, 4.1.1, 4.1.1_81187 |
| cluedin/data-source-submitter |
2024.03.00, 2024.03, 4.1, 4.1.1, 4.1.1_81187 |
| cluedin/data-source |
2024.03.00, 2024.03, 4.1, 4.1.1, 4.1.1_81187 |
Runtime
| Docker Image |
Tags |
| cluedin/neo4j |
2024.03.00, 2024.03, 4.1, 4.1.0, 4.1.0_80591 |
| cluedin/openrefine |
2024.03.00, 2024.03, 4.1, 4.1.0, 4.1.0_80591 |
Server
| Docker Image |
Tags |
| cluedin/cluedin-server |
2024.03.00, 2024.03, 4.1, 4.1.1, 4.1.1_81160, 4.1.1_81160-alpine, 4.1.1-alpine, 4.1-alpine |
| cluedin/cluedin-server |
2024.03.00, 2024.03, 4.1.1_81160-ubuntu, 4.1.1-ubuntu, 4.1-ubuntu |
| cluedin/nuget-installer |
2024.03.00, 2024.03, 4.1, 4.1.1, 4.1.1_81160, 4.1.1_81160-alpine, 4.1.1-alpine, 4.1-alpine |
| cluedin/nuget-installer |
2024.03.00, 2024.03, 4.1.1_81160-ubuntu, 4.1.1-ubuntu, 4.1-ubuntu |
Ui
| Docker Image |
Tags |
| cluedin/ui |
2024.03.00, 2024.03, 4.1, 4.1.0, 4.1.0_80587 |