Release 3.2.5
Please follow the Runtime Upgrade Guide to update databases for 3.2.5
Please follow the Server Upgrade Guide to update previous data for 3.2.5
Annotation
Features
- Add ability to generate sample clues for a Data set.
- Add data provider type name to entity.
App
| Docker Image |
Tags |
| cluedin/app |
3.2.5_31365, 3.2.5, master, latest, 3.2 |
Fixes
- Forgot password does not work ( internal in the app / external ) (AB#3350).
- Fix email templates styling and footer (AB#4454).
Clean
Fixes
- Amended Prepare - ‘Create Project’ so that it does not load endlessly/crash.
Controller
Fixes
- Improved performance when authorizing with CluedIn server.
Datasource
Features
- Add ability to generate sample clues for a dataset.
- Add ability to gather metrics over the loading and parsing time of the service.
- Added ConnectorService and Data Source changes for Integrations / Data Sources.
- Add data provider type name to entity.
Fixes
- Stringify nested oject to avoid error in indexing Elastic Search. Nested object should have “special” Mapper.
- Added error message on datasource and dataset level in case loading does not work.
- JSON files that are greater than 512MB are now handled correctly.
Gql
Features
- Add module for stream charts.
- Add a long description to a stream.
- Added description to InputRule.
- Added ‘Permissions’ tab inside Integrations/Data Sources. Users can now have their access granted or revoked.
Fixes
- Change analytics tab to monitoring.
- Added upload limit variable, and added to upload proxy config.
- Adjusted API token expiry dates.
- Added Access-Control-Max-Age to reduce pre-flight requests to the same url eg. /api/graphql.
- Add additional charts/gauges to monitoring.
Runtime
| Docker Image |
Tags |
| cluedin/neo4j |
3.2.5_31354, 3.2.5, master, latest, 3.2 |
| cluedin/openrefine |
3.2.5_31354, 3.2.5, master, latest, 3.2 |
| cluedin/sqlserver |
3.2.5_31354, 3.2.5, master, latest, 3.2 |
Upgrade Guide
Features
- Adds support for Stream Modes.
- Allow multi tenant support for Roles.
- Removed default Roles and Role Claim creation during post deployment.
- Dropped DataStore.Db.Authentication.dbo.Scopes and DataStore.Db.Authentication.dbo.RoleScopes tables.
- Added new claims preparation.meshcenter and preparation.prepare.
- Added long description to a stream.
- Added Organization Settings table.
Server
| Docker Image |
Tags |
| cluedin/cluedin-server |
3.2.5_31367-alpine, 3.2.5_31367, 3.2.5-alpine, 3.2.5, master-alpine, master, latest-alpine, latest, 3.2-alpine, 3.2 |
| cluedin/cluedin-server [ubuntu] |
3.2.5_31367-ubuntu, 3.2.5-ubuntu, master-ubuntu, latest-ubuntu, 3.2-ubuntu |
| cluedin/nuget-installer |
3.2.5_31367-alpine, 3.2.5_31367, 3.2.5-alpine, 3.2.5, master-alpine, master, latest-alpine, latest, 3.2-alpine, 3.2 |
| cluedin/nuget-installer [ubuntu] |
3.2.5_31367-ubuntu, 3.2.5-ubuntu, master-ubuntu, latest-ubuntu, 3.2-ubuntu |
Upgrade Guide
Features
- Entity Page History.
- Addition of prometheus package to enable the collection of metrics to monitor the cluedin-server performance.
- Configured prometheus metrics to use port 9013.
- Clean projects are now soft deleted.
- Upgraded ElasticSearch.NET/NEST to 7.10.0.
- New API endpoint for edge summary.
- Extend ApiToken controller to allow configure RACI role claims for generated token.
- Added dual mode support for Streams (Event Stream or Sync).
- api/v1/clean/createprojects/entities now accepts ProjectName, Source, VocabularyKeys, Providers and CleanDataParts parameters.
- Added
IConnectorUpgrade to allow in-situ schema modification of Export Target schema.
- Added Data Source Provider Definitions.
- Additional prometheus metrics to monitor the three queues per stream plus exceptions.
- Removed logging of the metrics scraping requests from prometheus.
- Account Security Filter now applied via DB/UI rather than env var.
- Allow for multi tenant Roles.
- Add long description to a stream.
- Add Async Endpoint for Clue Submission api/v2/clue.
- Increased performance of JSON serializer by using ordinal string comparison.
- Increased performance of base serializer.
- Added authentication endpoint for validating users into external CluedIn applications (e.g OpenRefine) - can use
Authentication header or querystring Bearer for initial validation.
- Changed Clean Projects to upload CSV files instead of JSON to OpenRefine.
- Add prometheus metrics to the clue submitter api.
- Allow batch submission of clues.
- Increased API token maximum expiry date to tolerate time skew and to render better expiry days messages.
- Increased performance of regex data extraction.
- Added ServerBlobUrl configuration key.
- When committing a clean project the clue author is now set to the active user.
- Support StartsWith/EndsWith querying in GraphQl (#2607).
- Add new fuzzy matching extension points:
IFuzzyEntityMatcherV2, IFuzzyClueToEntityMatcher, IFuzzyEntityDeduplicationMatcher.
- Add ability to score and sort fuzzy matching results in fuzzy clue to entity matching.
- Enable Clean Project Rules to be created by default.
- Add dead letter processing command queue and retry dead letter queue.
- Add configuration keys for retrying of processing commands.
- Add
Processing.ContextLocks.Enabled configuration key.
Fixes
- SVG provider icons will now render in the browser (#2643).
- SVG enricher icons will now render in the browser (#2785).
- IRelatedEnttiesProvider are now being resolved (#2669).
Administrator roles can add/remove roles from their own profile.- Add OriginEntityCode and Codes to EntityController.Get (#2720)
- Creating API Tokens now validates the name is unique.
- Search result thumbnails are now generated correctly on linux containers (#2798).
- Streams rules display in the order they were created (#530).
- Is Not Null not working when key does not exists in Properties bags (AB#487).
- Removed restriction of properties field for clean queries (AB#2508).
- Stopped the History of Clean projects from being populated on project creation (AB#2976).
- History endpoint throwing collection item missing error.
- Account Security Filter Off prevent Clean History Project being created (AB#3026).
- Rule Engine no longer invokes rules that contain no actions (AB#3330).
- Fixes issue where QueryBuilder trying to AND/OR boolean expression with Lambda expression (AB#2847).
- TermAggregationQuery changes in 3.2.4 causing breaking change (AB#1255).
- Neo4jEntityGraphDataStore.EntityWithIdExists return false when finding initial Organization entity (AB#2831).
- Editing Glossary Category wrongly returns HTTP 202 (#2840).
- Streams default mode set to null (AB#3491).
- Can authenticate with query parameter ‘access_token’ or ‘Bearer’ as the UI uses access_token for loading blobs.
- Rules now correctly remove Tags when the action is set to Remove Tag (AB#3725).
- History endpoint does not return source name for enrichers and clean projects (AB#3720).
- Some of organization entities do not contain basic properties (AB#3830).
- Wrong password sent to /connect/token results in 500 error (AB#4138).
- GDPR Breach Report links to invalid background picture (AB#4361).
- Mesh center messages are now cleared when their
id is provded when accepted (AB#4506).
- Fix email templates styling and footer (AB#4454).
- All entities in Cleaning Project get comitted (AB#4040).
- Fix Description field has not been saved after Clean (AB#4728).
- Fix
LastCrawlTime not updating correctly for FullCrawlerRunner (AB#4042).
- Update Mesh queries entity Ids to Merge target entity Id.
- Fix wrong task scheduler used for processing commands on initial start up.
- Fix persist hash check in blob & graph datastore update.
Submitter
Features
- Significantly improved message submission rates
Ui
| Docker Image |
Tags |
| cluedin/ui |
3.2.5_31355, 3.2.5, master, latest, 3.2 |
Features
- Clean button on search results now creates a clean project rather than a prepare project.
- Add streams monitoring.
- New History UI version.
- Adding ‘Permissions’ tab inside Integrations/Data Sources. Users can now have their access granted or revoked.
- Added ability to add a description to Rules.
- Add a long description to a stream.
- Added Entity Codes panel to Entity Page.
- Added Entity tab Relations with a Graph visualization of entity and edges.
- Add ability to select vocabulary when creating a Clean project from the search page.
Fixes
- Add a copy to clipboard icon to the URL so people do not need to use mouse to select the URL.
- Fix issue when you setup a stream configuration where the dialog to choose a vocabulary closes if you hit enter.
- Default icons now showing in search results for the organisation view.
- Fixed missing icon on export target list.
- Fix typo in deduplication project.
- Sort entity type by name when creating a clean project.
- Add validation message when you add negative value for the number of entities when creating a new clean project.
- Fix typo in deduplication project.
- Fix typo in stream list.
- Upload clues that have Preview crashes (#965).
- Fixed History UI opening toggle, and the first entry is now toggled open.
- Amended switches used to change User active statuses, as well as relevant User lists.
- Fixed Mesh Center not loading. Now requires a claim of at least preparation.meshcenter (AB#3420).
- Adjusted API token expiry dates.
- Amended Streams table and individual Stream page header showing incorrect/non-existant export target/streaming mode.
- Remove the link to the search for parent aggregation (Connections widget).
- Provide the
id for a mesh command so that it is cleared from the mesh command list (AB#4506).
- Add additional charts/gauges to monitoring.