Commit Graph
17 Commits
Author SHA1 Message Date
Drew Farris c0e9cff9f8 Adds truthmark tables, for storing human-generated annotations (#3686) 2026-07-14 20:08:10 +00:00
Bill Oley 4bcde60ee5 Bugfix/configcheck (#3620)
these test failures were probably missed because configcheck by default
doesn't get built and tests run
2026-06-29 14:52:35 -04:00
alerman 896c4fa0cb Remove duplicative and error prone step (#3579) 2026-06-02 11:35:16 -04:00
Moriarty 744a6493c3 remove deprecated threshold options (#3560)
remove deprecated eventPerDayThreshold and shardsPerDayThreshold from
codebase
2026-05-19 09:47:04 +00:00
Moriarty 4683710530 Remove the unused LAZY_SET mechanism (#3547)
Update SetMembershipVisitor

The problem the IndexOnlyJexlContext was trying to solve was addressed
through more efficient query planning.
2026-05-11 14:15:51 +00:00
Bill Oley 89d0f74018 Use correct slf4j impl in wildfly and services, update versions of type-utils, metadata-utils, common-utils, accumulo-utils, base-rest-responses (#3382)
Use correct slf4j impl in wildfly and services, update versions of
type-utils, metadata-utils, common-utils, accumulo-utils,
base-rest-responses in microservice starters, apis, services to track
datawave version

The use of these dependencies under microservices (starters, services,
api) should track the datawave version instead of the version number
from when they were in separate repositories
Because the prior versions used a different groupId, we have the case
where multiple versions of the same artifact are being included in some
microservices.
For instance, this caused a serialization conflict once the
serializationId in BaseType (type-utils) changed in datawave version
7.30.0. When both versions are present on both sides of a serialization,
whether a serialization exception occurs is indeterminate.

gov.nsa.datawave.core:accumulo-utils
gov.nsa.datawave.core:type-utils
gov.nsa.datawave.core:metadata-utils
gov.nsa.datawave.core:common-utils
gov.nsa.datawave.core:base-rest-responses

After this PR is merged, the following should be done to make the
starters, apis, modules, and services depend on released version of each
other.

Release datawave-microservice-service-parent:5.0.8
In all modules with parent datawave-microservice-service-parent, update
to datawave-microservice-service-parent:5.0.8

Release authorization-api:4.0.2
In starter-datawave update to authorization-api:4.0.2

Release starter-datawave:4.0.6
Release query-metric-api:4.1.3
Release query-api:1.0.1
Release accumulo-api:4.0.1
Release modification-api:1.0.1
Release dictionary-api:4.0.6


In hazelcast-common update to starter-datawave:4.0.6
Release hazelcast-common:4.0.3

In hazelcast-client update to hazelcast-common:4.0.3
In starter-audit update to starter-datawave:4.0.6,
authorization-api:4.0.2
In starter-metadata update to starter-datawave:4.0.6 
In starter-query-metric update to starter-datawave:4.0.6,
query-metric-api:4.1.3, authorization-api:4.0.2

Release hazelcast-client:4.0.3
Release starter-audit:4.0.4
Release starter-metadata:3.0.3
Release starter-query-metric:3.0.4

In starter-query update to starter-datawave:4.0.6, query-api:1.0.1,
hazelcast-client:4.0.3, starter-metadata:3.0.3,
starter-query-metric:3.0.4
Release starter-query:1.0.9

In starter-cached-query update to starter-datawave:4.0.6,
hazelcast-client:4.0.3, starter-audit:4.0.4, starter-query:1.0.9
Release starter-cached-query:1.0.11

In mapreduce-query-core-job update to starter-query:1.0.9
Release mapreduce-query-core-job:1.0.5

In query-executor-api update to starter-datawave:4.0.6,
starter-query:1.0.9
Release query-executor-api:1.0.8

In accumulo-service update to starter-datawave:4.0.6, accumulo-api:4.0.1
In audit-service update to starter-datawave:4.0.6,
hazelcast-client:4.0.3
In authorization-service update to starter-datawave:4.0.6,
hazelcast-client:4.0.3, authorization-api:4.0.2
In config-service update to starter-datawave:4.0.6
In dictionary-service update to starter-datawave:4.0.6,
dictionary-api:4.0.6, starter-metadata:3.0.3
In file-provider-service update to starter-datawave:4.0.6
In hazelcast-service update to hazelcast-common:4.0.3
In mapreduce-query-service update to mapreduce-query-core-job:1.0.5,
starter-query:1.0.9
In modification-service update to starter-metadata:3.0.3,
query-api:1.0.1, modification-api:1.0.1
In query-service update to starter-datawave:4.0.6, query-api:1.0.1,
starter-cached-results:1.0.11, starter-query:1.0.9
In query-executor-service update to starter-query:1.0.9,
query-executor-api:1.0.8
In query-metric-service update to starter-datawave:4.0.6,
starter-metadata:3.0.3, hazelcast-common:4.0.3

Release accumulo-service:4.0.3
Release audit-service:4.0.3
Release authorization-service:4.0.5
Release config-service:4.0.2
Release dictionary-service:4.0.10
Release file-provider-service:1.0.1
Release hazelcast-service:4.0.3
Release mapreduce-query-service:1.0.5
Release modification-service:1.0.3
Release query-service:1.0.12
Release query-executor-service:1.0.10
Release query-metric-service:4.1.9
2026-02-10 15:09:20 +00:00
d7df805e14 Version7.29 loe1 rebase int (#3306)
Co-authored-by: Drew Farris <[email protected]>
Co-authored-by: alerman <[email protected]>
Co-authored-by: FineAndDandy <[email protected]>
Co-authored-by: Joseph Alphonso <[email protected]>
Co-authored-by: Joe Alphonso <[email protected]>
Co-authored-by: hgklohr <[email protected]>
2025-12-15 15:40:50 +00:00
Bill Oley 941c72b565 Remove MapReduce API from the webservice (#3231) 2025-10-28 17:48:19 +00:00
Drew Farris 3a60df6354 Annotation manager web service (#3173)
This builds on the framework in #3170 to provide a web-services layer
for managing annotations and performing general CRUD operations.
2025-10-27 16:35:08 +00:00
Joseph AlphonsoandJoe Alphonso 95eef4c744 Pom updates (#2803)
* 1st round

* 2nd round

* update mvn extensions.xml

* more plugin cleanup

* more plugin version bumps

* microservices use parent snapshot for development

* exclude log4j from yarn

* update contrib poms

* exclusions and plugin updates

* remove duplicate entry from dist.xml

* updates

* formatter version bump for in-memory-accumulo

* fix formatter config

* typo

* make formatter config consistent

* junit var and set removeTrailingWhitespace to true

* replace spotify docker plugin with fabric8

* fix web-services deploy

* remove several plugin warnings

* junit fixes

* contrib fixes

* revert datawave-code-style version

* remove several contrib warnings

* use relocated and updated git-commit-id-maven-plugin

* remove javadocVersion property to address warning

* add maven-install-plugin to microservice parent

* use jkube for docker builds on warehouse and web

* use spring-boot-maven-plugin native oci image build

* clean up plugins in in-memory-accumulo

* replace relative paths in quickstart with build-in var

* remove unused exec plugin

* Revert "use spring-boot-maven-plugin native oci image build"

This reverts commit b7b76587f52ee6893669771098bfad7226167e3a.

* fix banned exclusions

* remove deprecated javadoc conf option

* fix junit after rebase

* migrate a few test cases to JUnit5 and fix warnings

* use maven.multiModuleProjectDirectory instead of datawave.root

* revert accumulo version bump

* fix quickstart

* skuzzle plugin version bump

* remove duplicate dep

* remove duplicate repository declarations

* resolve spotbugs findings

* get rid of warning when using build-cache

* cleanup and fix web-service application pom

* revert accumulo version

* remove unused property

* formatting

* make docker rpm include less restrictive

---------

Co-authored-by: Joe Alphonso <[email protected]>
2025-05-05 21:43:36 +00:00
P.A. 9241a406ca Switching indexOf strings to char shortcut (#2780)
* Testing the pipeline on github. Tests work on my machine?

* Additional char conversions

* Additional edits for index

* Attempting to tweak fixed brain test

* Putting split brain back to default

* split disable
2025-04-09 15:36:23 +00:00
Ivan Bella 83e587fbf2 Feature/separate webservice hdfs config (#2453)
* fixes #2452: Added a local ivarator cache dir configuration
2025-03-28 08:41:04 -04:00
Ivan Bella 7f309fdb85 Feature/most recent unique (#2570)
* Refactored the mostRecentUnique functionality to avoid the ivarator paths
* Implementation a file backed sorted map
* Created additional document map for the return cache
2025-01-15 13:22:04 -05:00
2c2de3c0d0 Task/revert most recent unique (#2464)
* Revert "Updated to ensure the most recent unique functions parse correctly."

This reverts commit d0aa2660ea.

* Revert "Fixes to the most-recent-unique functionality (#2392)"

This reverts commit 5b4eb71deb.

* Revert "Fixed bug where unique results of null values failed to return (#2354)"

This reverts commit 15f08a3d06.

* Revert "Added most recent equivalent unique functions (#2339)"

This reverts commit bb8d3531a9.

* Revert "Most recent unique feature (#1991)"

This reverts commit a4587afa38.

* Updated centos dockerfiles to use yum repo mirror

* Update quickstart docker image to Rocky Linux 8 (#2454) (#2455)

* Update quickstart docker image to Rocky Linux 8 (#2454)

* Revert "Updated centos dockerfiles to use yum repo mirror"

This reverts commit d41e8861ae.

* Added the hdfs sorted set builder mechanism back in

---------

Co-authored-by: Whitney O'Meara <[email protected]>
Co-authored-by: Keith Ratcliffe <[email protected]>

Conflicts:
	warehouse/query-core/src/main/java/datawave/query/util/sortedset/RewritableSortedSetImpl.java
2024-07-10 17:38:07 +00:00
Ivan Bella bb8d3531a9 Added most recent equivalent unique functions (#2339)
* added MOST_RECENT_ in front of the function name
2024-04-18 09:02:42 -04:00
Ivan Bella 2dda04678a fixes #2102: Added a #RENAME function, or query parameter rename.fields (#2142)
* This will rename fields in the return set
* Added rename function to the list of LUCENE functions
* Added query options test for rename
* Moved the upper-casing of the configuration into the uppercase identifiers step of the planner
* Handle grouping contexts in the rename transform
* Ensure the transform iterator is not preserved whenever the logic is initialized
* Allow mappings to multiple fields
2024-03-05 10:14:12 -05:00
Whitney O'Meara ad05ae6207 Added config check CLI util (#2199)
* Added config check CLI util

* Made error handling more robust and updated comparison logic to work against simple or full analyses

* Added some basic class-level documentation

* Added github datawave package repo configuration
2024-01-26 15:51:46 +00:00