Duke
Duke is a fast and flexible record linkage engine. It does not use the traditional blocking (sort by key) approach, but instead relies on Lucene. This makes it high-performance (able to process 1,000,000 records in ~10 minutes). Duke can be run from the command line, but also has an API allowing incremental linking applications to be built easily. It supports reading data from CSV, JDBC, SPARQL, and NTriples, and also supports a number of string comparators and string normalizers.
| Tags | Deduplication Record linkage Entity resolution |
|---|---|
| Licenses | Apache 2.0 |
| Operating Systems | Java Runtime Environment 1.5 |
| Implementation | Java Lucene |
| Translations | English |
Recent releases
- 02 Mar 2013 10:37
Release Notes: Support for multi-threading, an upgrade to Lucene 4.0, higher performance, more comparators, more cleaners, major improvements to the command line client, and more.
- 15 Sep 2012 10:35
Release Notes: New comparators, new cleaners, some bugfixes, an upgrade to Lucene 3.6.1, and some improvements in configurability.
- 28 Mar 2012 17:14
Release Notes: The internals have been cleaned and refactored, adding some performance tuning parameters. There are new cleaners, support for pluggable backends, a new naïve in-memory backend, and much more.
- 13 Jan 2012 16:18
Release Notes: This release adds a more flexible API, a new cleaner (for personal names), two new data sources (in-memory and JNDI), and a number of bugfixes. Some additional utilities have also been added.
- 11 Sep 2011 17:05
Release Notes: This release offers a cleaned-up API and more comparators.
larsga
19 May 2011 16:26
Heartbeat
- Popularity Score
- 131.42
- Vitality Score
- 7.89
- Subscriptions
- 7
