DATAWAVE Useful Tools

DATAWAVE contains some very useful tools that can be applied to various problems and situations that may arise during use of the software. This document will attempt to list the tools, organized per Maven sub-project, with the intended use case.

Ingest-Base

Class Name	Accompanying Script	Description
datawave.ingest.util.GenerateShardSplits	bin/ingest/create_shards_since.sh	Pre-splits a DATAWAVE "sharded" table since yyyyMMdd
	/bin/ingest/create_tomorrows_shards.sh	Pre-splits a DATAWAVE "sharded" table for "tomorrow"
datawave.ingest.util.KillJobByRegex	bin/ingest/kill-jobs-regex.sh	Kills Hadoop jobs based off of a regular expression

Metrics

Class Name	Accompanying Script	Description
datawave.metrics.util.FileLatencySummary	bin/metrics/FileLatencySummary.sh	Prints a summary of the latency counts for all files in the metrics tables