Commit Graph
175 Commits
Author SHA1 Message Date
Drew Farris eb05083900 CI/CD entries for annotation microservice, trivy entry for annotation-cache service (#4179) 2026-11-02 10:00:16 -05:00
FineAndDandyandDrew Farris addcd54dad Feature/annotation cache (#3957)
Co-authored-by: Drew Farris <[email protected]>
2026-10-29 19:45:39 +00:00
alerman 0a7cc31199 Use configured runner for Trivy image deployment (#4030) 2026-10-16 10:35:37 +00:00
Moriarty 4d7d23350c Tune microservice test JVM memory and concurrency (#3975) 2026-10-08 16:45:04 +00:00
alerman 0a03ee3bed Add trivvy scans (#3969) 2026-10-02 11:12:14 -04:00
MoriartyandClaude Opus 5 0ac549a3a2 Pre-split the shard table in docker compose (#3885)
The whole sharded schema sat in one tablet, so no number of tablet
servers, scan servers or compactors made any difference to a query.
Splits now come from a checked-in file, the deployment moves to three
shards per day, and verifySplits.sh guards that in CI.

Also fixes the num shards cache, which scanned a metadata table name no
deployment that renames its tables actually uses. The missing table was
swallowed, so a day expanded into no shards and the query silently
returned nothing.

---------

Co-authored-by: Claude Opus 5 <[email protected]>
2026-08-28 11:24:22 +00:00
9b2b652221 Codex assisted: Replace Quickstart container with using the container… (#3856)
…s from NationalSecurityAgency/datawave-stack-docker-images

---------

Co-authored-by: Moriarty <[email protected]>
Co-authored-by: Claude Opus 5 <[email protected]>
2026-08-19 16:36:02 +00:00
MoriartyandClaude Opus 5 b7330c689b Scope CI docker cleanup to each job's own compose project (#3845)
Compose derived its project name from the directory, so concurrent jobs
shared one stack and nothing tore it down; a blanket prune stood in for
teardown and deleted images other jobs were still using.

Co-authored-by: Claude Opus 5 <[email protected]>
2026-08-18 15:52:59 +00:00
alerman a6c1512b31 Updating merge queue checks to bybass cancel-in-progress (#3841) 2026-08-18 09:22:51 +00:00
alerman b15510506b Fix tag builds when tag has already been deployed (#3737) 2026-07-29 11:46:06 +00:00
alermanandOz 501f1f8033 Code review test (#3788)
Co-authored-by: Oz <[email protected]>
2026-07-29 07:41:55 -04:00
alerman 3ea3366795 ci: surface test results and flakiness in PR checks (#3606)
- Upload raw surefire/failsafe XML as build artifacts (always run).
- Publish a JUnit check run + job summary that surfaces tests which only
passed after a rerun (flakes), which the rerunFailingTestsCount flags
otherwise hide.
- Copy mikepenz/action-junit-report (v6, 3a81627) as a local action at
.github/actions/junit-report to satisfy the verified-actions-only
policy.
- Add the checks/pull-requests permissions the reporter needs.

Non-blocking: fail_on_failure:false + continue-on-error, so flakes
become visible without changing what fails the build.
2026-07-23 12:18:47 +00:00
MoriartyandClaude Sonnet 5 ad847bd65b Bump actions/github-script and actions/cache to Node 24 runtimes (#3702)
## Summary
- `actions/github-script@v7` and `actions/cache@v4` both still target
the deprecated Node.js 20 runtime, which GitHub now force-runs on Node
24 and flags with a warning annotation on every workflow run (seen
recently on PR #3683's checks).
- Bump both to their minimum Node 24-native releases:
`actions/github-script@v8` and `actions/cache@v5`. Neither introduces
breaking changes relevant to our usage (v8/v5 changelogs are Node
runtime bumps only; v9 of github-script would add breaking API changes
we don't need).

## Test plan
- [x] Confirm the `require-labels.yml` and `compose-tests.yml` workflows
run green on this PR
- [x] Confirm the Node.js 20 deprecation warning annotation no longer
appears on the check runs

Co-authored-by: Claude Sonnet 5 <[email protected]>
2026-07-20 17:22:24 +00:00
Joseph AlphonsoandJoe Alphonso 9e370c4427 use Google Cloud Maven Central Mirror (#3630)
addresses HTTP 429 Too Many Requests errors seen in CI jobs recently  
`actions/setup-java` will skip creating settings.xml  
`Skipping generation /home/ec2-user/.m2/settings.xml because file
already exists and overwriting is not required`

---------

Co-authored-by: Joe Alphonso <[email protected]>
2026-06-23 17:49:24 +00:00
Joseph AlphonsoandJoe Alphonso 78290aa421 disable maven cache local and remote (#3617)
disabling until we are able to fix

Co-authored-by: Joe Alphonso <[email protected]>
2026-06-18 19:44:32 +00:00
alerman 4a61061d7f Run compose tests on the releasing branch, not integration (#3587) 2026-06-05 12:49:17 +00:00
alerman b6976d8480 Update actions versions to node 24 versions (#3585) 2026-06-04 14:55:34 +00:00
alerman 6dfc647e44 Update versions due to failed release. Add logic to ignore modifier versions when running (#3580) 2026-06-04 05:46:09 -04:00
alerman 896c4fa0cb Remove duplicative and error prone step (#3579) 2026-06-02 11:35:16 -04:00
alerman ff8c08c598 Run cascade in temporary branch (#3577)
Run final releases in temporary branch. Upon completion, merge back if
you can. if you cannot open a pr
2026-06-02 14:03:51 +00:00
Moriarty 125ef5157c Update require-labels.yml (#3572)
The label 'no-downstream-affects' was deleted in favor of the more
grammatically correctly and aesthetically pleasing label
'no-downstream-effects'.

This commit updates our required-labels.yml to reflect this change.
2026-05-29 14:17:58 +00:00
Adam Lerman 54b748f443 Change process list for bump job 2026-05-13 11:41:00 -04:00
alerman b557e675e7 Dont commit nonfinal changes (#3551) 2026-05-12 12:28:36 +00:00
alerman b9cd9f92a4 Exclude parents from cascade (#3546) 2026-05-08 16:50:06 +00:00
Adam Lerman 5ae0942321 Another cascading release fix 2026-05-08 09:40:18 -04:00
alerman 57244775c8 Add cascaded version updates (#3543) 2026-05-08 09:06:57 -04:00
alerman adb3e77383 Fix cascading releases (#3541) 2026-05-08 11:28:37 +00:00
alerman 24140d83d1 Add cascading release workflow (#3526)
This PR aims to add a cascading release pipeline that will update each
project to release the entire tree (or part of it) starting from one
given repo.
2026-05-07 17:42:35 +00:00
Joseph AlphonsoandJoe Alphonso ebfd76f004 update microservices to use new parents (#3496)
bumps the microservice parent versions on the related modules that
reference them
re-enables formatting in CI now that all modules have the same plugin
configuration
verified there are no other commits in the microservice-parent and
microservice-service-parent besides the spotless plugin changes since
the last release

Co-authored-by: Joe Alphonso <[email protected]>
2026-04-02 15:43:05 +00:00
Joseph Alphonso fc05779672 Revert "spotless can format too" (#3495)
Reverts NationalSecurityAgency/datawave#3483
2026-04-02 09:13:58 -04:00
Joseph Alphonso 92ebbe013f Revert "bump microservice parents and enable formatting" (#3494)
Reverts NationalSecurityAgency/datawave#3490
2026-04-02 09:13:08 -04:00
Joseph AlphonsoandJoe Alphonso df83e5e5a4 bump microservice parents and enable formatting (#3490)
bumps the microservice parent versions on the related modules that
reference them
re-enables formatting in CI now that all modules have the same plugin
configuration
verified there are no other commits in the microservice-parent and
microservice-service-parent besides the spotless plugin change since the
last release

Co-authored-by: Joe Alphonso <[email protected]>
2026-04-01 16:12:04 +00:00
Joseph AlphonsoandJoe Alphonso 44b4033782 spotless can format too (#3483)
remove revelc formatter-maven-plugin and let spotless format all source
code

---------

Co-authored-by: Joe Alphonso <[email protected]>
2026-03-31 18:35:56 +00:00
Joseph AlphonsoandJoe Alphonso 8eea14eb98 Fix CI bug for compose jobs (#3486)
Here's what changed and why:

Root cause: When a reusable workflow is called via workflow_call, the
caller sees the overall workflow result as failure if any job in it
fails — even if the gate job (compose-check-jobs) succeeds. So when one
compose test fails but the other passes, the coordinator's gate
correctly succeeds, but required-checks.yml sees
needs.call-compose-tests.result == 'failure'.

Fix (two files):

1. compose-coordinator.yml — Added a workflow_call output
(compose-check-result) that exposes the gate job's explicit status. The
gate job now sets a status output to success when at least one test
passed (before potentially exiting with failure when neither passed).
Also replaced the actions/github-script step with a bash conditional for
consistency.
2. required-checks.yml — Changed compose-check-jobs to check
needs.call-compose-tests.outputs.compose-check-result instead of
needs.call-compose-tests.result, so it reads the gate's actual
determination rather than the overall workflow result.

Co-authored-by: Joe Alphonso <[email protected]>
2026-03-31 15:09:47 +00:00
cc9fd1caca Spotless maven plugin (#3478)
replace impsort with spotless maven plugin to automatically cleanup
unused imports
formatting is fast and occurs early in the maven lifecycle  
prevents checkstyle from failing later for unused imports

---------

Co-authored-by: Joe Alphonso <[email protected]>
Co-authored-by: alerman <[email protected]>
2026-03-27 14:03:39 +00:00
alerman 1707d6d256 Update runner scripts to use v6 (#3476) 2026-03-27 12:44:06 +00:00
Joseph AlphonsoandJoe Alphonso 5db03f424b correct log msg in github required-checks workflow (#3432)
Co-authored-by: Joe Alphonso <[email protected]>
2026-02-12 13:03:53 +00:00
Joseph AlphonsoandJoe Alphonso 5e7e471ab7 Github allow for readme/doc only changes (#3414)
Use a coordinator pattern to call workflows and process the results.  
Tested README.md change in a few places.  
Tested code change in main.  
Tested code change in microservices.  
Tested .github changes.

---------

Co-authored-by: Joe Alphonso <[email protected]>
2026-02-09 15:39:42 +00:00
d7df805e14 Version7.29 loe1 rebase int (#3306)
Co-authored-by: Drew Farris <[email protected]>
Co-authored-by: alerman <[email protected]>
Co-authored-by: FineAndDandy <[email protected]>
Co-authored-by: Joseph Alphonso <[email protected]>
Co-authored-by: Joe Alphonso <[email protected]>
Co-authored-by: hgklohr <[email protected]>
2025-12-15 15:40:50 +00:00
Joseph AlphonsoandJoe Alphonso 784d6c3ee5 a more accurate fix to the quickstart startup (#3259)
added zookeeper and tserver exposed ports  
added efficient accumulo and zookeeper healthcheck for quickstart
container in compose file
added quickstart as a dependent service to the metrics service and
adjusted its healthcheck configuration
updated CI compose-tests: simplified logic for faster more reliable
startup
fixed issue with quickstart image builds when using maven build cache

---------

Co-authored-by: Joe Alphonso <[email protected]>
2025-11-05 20:54:34 +00:00
Joseph AlphonsoandJoe Alphonso 26acca41d0 restore github workflow dummy checks (#3238)
Github CI merge_group checks are tied to the required status checks.
Restoring dummy jobs.

Co-authored-by: Joe Alphonso <[email protected]>
2025-10-20 17:54:54 +00:00
Joseph AlphonsoandJoe Alphonso 70e12202cd Update README with system environment details (#3236)
Added system environment requirements for RHEL and Docker versions.  
Also fixed the github workflow checks to bypass `**/*.md`

---------

Co-authored-by: Joe Alphonso <[email protected]>
2025-10-20 17:20:55 +00:00
alerman efc186ce8f Add cherry-pick as acceptable label 2025-10-09 06:51:06 -04:00
alermanandFineAndDandy 8edcbc8c36 reorganize and test self-hosted (#3139)
Co-authored-by: FineAndDandy <[email protected]>
2025-09-26 12:15:13 +00:00
alerman 6b67192d16 Update remote url for cache preload build (#3197) 2025-09-23 15:43:48 +00:00
alerman 0e969cb7ed Add required labels check (#3198) 2025-09-23 09:39:41 -04:00
alerman 27f684bdc0 Ad in memory accumulo to release options 2025-09-10 10:07:39 +00:00
Adam Lerman ea979365ff Revert "reorganize and test self-hosted"
This reverts commit 01758a8a7e.
2025-09-05 18:02:06 +00:00
Adam Lerman 01758a8a7e reorganize and test self-hosted 2025-09-05 18:01:03 +00:00
alerman 3c87552b00 Run builds on self hosted runner at interval to ensure cache stays up to date. (#3129) 2025-09-05 10:41:30 +00:00