Releases

Release 3.2.4

Please follow the Upgrade Guide to update databases for 3.2.4

Annotation

Docker Image	Tags
cluedin/cluedin-micro-annotation	`3.2.4_26266`, `3.2.4`, `master`, `latest`, `3.2`

Supporting release for the platform - no changes implemented.

App

Docker Image	Tags
cluedin/app	`3.2.4_26270`, `3.2.4`, `master`, `latest`, `3.2`

Supporting release for the platform - no changes implemented.

Clean

Docker Image	Tags
cluedin/cluedin-micro-clean	`3.2.4_26267`, `3.2.4`, `master`, `latest`, `3.2`

Supporting release for the platform - no changes implemented.

Controller

Docker Image	Tags
cluedin/controller	`3.2.4_26271`, `3.2.4`, `master`, `latest`, `3.2`

Features

Added watcher for features.api.cluedin.com (details in Helm repo with CRD definition)
Added EnableSSO + DisableSSO workflows

Datasource

Docker Image	Tags
cluedin/cluedin-micro-datasource	`3.2.4_26269`, `3.2.4`, `master`, `latest`, `3.2`

Fixes

Add a more sensible payload size limit for ingestion endpoint request (default to 1024kb). It can be overridden by using the variable environment called INGESTION_ENDPOINT_REQUEST_LIMIT.

Gql

Docker Image	Tags
cluedin/cluedin-ui-gql	`3.2.4_26265`, `3.2.4`, `master`, `latest`, `3.2`

Supporting release for the platform - no changes implemented.

Runtime

Docker Image	Tags
cluedin/neo4j	`3.2.4_26263`, `3.2.4`, `master`, `latest`, `3.2`
cluedin/openrefine	`3.2.4_26263`, `3.2.4`, `master`, `latest`, `3.2`
cluedin/sqlserver	`3.2.4_26263`, `3.2.4`, `master`, `latest`, `3.2`

Upgrade Guide

Features

Added OpenCommunication.dbo.DuplicateDetectionProject table
Added OpenCommunication.dbo.DuplicateDetectionProjectRule table
Added DuplicateDetectionProject table
Added DuplicateDetectionProjectRule table
Added DuplicateDetectionProjectRuleVocabularyKey table
Added ExpiryDate to the Authentication.dbo.ApiConfiguration table
Added ‘CluedIn Enrichment’ Reconciliation Extension
Added CluedIn clusting method to openrefine

Fixes

Removes Primary Key from StreamIngestionLog and adds Metric related indexes
Moved script lock file from /tmp to /var/opt/mssql/data

Server

Features

Added the ability to ‘Clean with history’ when creating a cleaning project.

Support token replacement inside rules engine (#2584) Tokens can be used as the whole or part of a value provided to a rule action. The following token formats are supported

{Yesterday:<format>} => Yesterdays date (format is optional)
{Today:<format>} => Todays date (format is optional)
{Vocabulary:<key>} => The value of the specified vocab
{Property:<key>} => The value of the specified property

Added an openrefine compatible controller to the public api to support manual reconciliation using CluedIn’s enrichers
Added Graphql actions for Delete, Split, Deduplicate, and ProcessVersionHistory (#2583)
New Ubuntu(20.04) images now supported. Consumers may now request images tags <version>-ubuntu or <version>-alpine to target different base operating systems (#2442) Requesting images tag <version> will default to alpine
All environment variables are now normalised to lowercase, _ separated strings when being resolved. This enables specifying POSIX standard environment variable names without impacting the ability for CluedIn to resolve the variable. (#2442) e.g. CLUEDIN_CONNECTIONSTRINGS__GRAPHSTORE_READ can be used to override the following connection string from the container.config
```
<?xml version="1.0" encoding="utf-8"?>
<configuration xmlns:urn="urn:schemas-microsoft-com:asm.v1" xmlns:xdt="http://schemas.microsoft.com/XML-Document-Transform">
<connectionStrings xdt:Transform="InsertIfMissing">
  <add name="GraphStore-Read"                 connectionString="http://neo4j:@localhost:7474/db/data" providerName="Neo4j" />
</connectionStrings>
```
Added OpenRefineClusteringController to the public api to support CluedIn clustering method in openrefine
Added RemoveTag rule action to support removing a specified tag when rules are invoked (#2635)
Added RemoveTags rule action to support removing all tags when rules are invoked (#2635)
Added dynamic De-Deuplication support. Allows creation of De-Duplication projects with multi-term rules through a public api (#2612)

Fixes

Added EntityType to EdgeSummary (#2595)
Removes Primary Key from StreamIngestionLog (#2535)
Upgraded dependency to NTextCat (#2598)
Add missing AgentServerUrl key to configuration (#2456)
Changes AuthenticationDbContext lifecycle from Scoped to Transient (#2591)
Add additional missing configuration keys (#2578)
Correctly mark core vocabs as core (#2086) (#2687)
Ensure calls to configuration use the correct configuration manager (#2576)
Newly created clean projects now contains the correct number of rows (#2624)
Filtering cleaning projects by organization id (#2558)
Cleaning projects are now ordered by created date descending (#2510)
Correct configuration key Feature.Metrics.Enabled -> Metrics.enabled (#2647)
Fixed escaping special characters in rules (#2652)
Added FromValue and ToValue to the audit change log (#2653)
Order on Rules not being updated correctly when rules are deactivated (#2654)
Activation/Deactivation of already activated/deactivated rules broke the Rules Order (#2676)
Reordering Rules Started Order Count from 0 but should start from 1 (#2675)
Entity Type and Number of Entities tiles on the Home page now show the same Entities when their additional information is displayed (#2685)
When attempting to access entity history a 403 error is now returned when access is not authorized (#2702)
Corrected logic of Feature.Security.AccountFilter.Enabled configuration setting to prevent access to non-authorised entities (#2702)
Role Request Task owners are now filtered by OrganizationId to stop multi tenant issue (#2694)
AccountController email signup changed error during EF Core attach (#2700)

Submitter

Docker Image	Tags
cluedin/cluedin-micro-submitter	`3.2.4_26268`, `3.2.4`, `master`, `latest`, `3.2`

Supporting release for the platform - no changes implemented.

UI

Docker Image	Tags
cluedin/ui	`3.2.4_26264`, `3.2.4`, `master`, `latest`, `3.2`

Features

Added ‘Clean with history’ option when creating cleaning projects

Fixes

Add the De-duplication beta module
Add duplication-project feature flag to enable/disable De-duplication beta module
Add search aggregation / total dedicated endpoint to the application
Add life-time for creation of an API token
Add ability to edit a Auth settings for a crawler (API token + credentials form)
Add SSO button (Sign in using Microsoft) when using SSO
Changed the URL that the Number of Entities Tile on the home page uses to exclude shadow Entities
Supporting nested object for condition preview and data preview on the stream detail page
Remove caching for the Entity Page when we get entity by id
Fix a paging issue in the main search
Fix the error screen when filtering by tag_name