JarCasting
JarCasting JarCasting

esque

Resembles an Elasticsearch Stateful Query Executor

License

License
GroupId

GroupId

org.loesak.esque
ArtifactId

ArtifactId

esque
Last Version

Last Version

0.1.2
Release Date

Release Date
Type

Type

pom
Description

Description

esque
Resembles an Elasticsearch Stateful Query Executor
Project URL

Project URL

https://github.com/loesak/esque
Source Code Management

Source Code Management

https://github.com/loesak/esque

Download esque

Filename Size
esque-0.1.2.pom 4 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/org.loesak.esque/esque/ -->
<dependency>
    <groupId>org.loesak.esque</groupId>
    <artifactId>esque</artifactId>
    <version>0.1.2</version>
    <type>pom</type>
</dependency>
// https://jarcasting.com/artifacts/org.loesak.esque/esque/
implementation 'org.loesak.esque:esque:0.1.2'
// https://jarcasting.com/artifacts/org.loesak.esque/esque/
implementation ("org.loesak.esque:esque:0.1.2")
'org.loesak.esque:esque:pom:0.1.2'
<dependency org="org.loesak.esque" name="esque" rev="0.1.2">
  <artifact name="esque" type="pom" />
</dependency>
@Grapes(
@Grab(group='org.loesak.esque', module='esque', version='0.1.2')
)
libraryDependencies += "org.loesak.esque" % "esque" % "0.1.2"
[org.loesak.esque/esque "0.1.2"]

Dependencies

There are no dependencies for this project. It is a standalone project that does not depend on any other jars.

Project Modules

  • esque-core
  • esque-examples

esque

Resembles an Elasticsearch Stateful Query Executor

What is it

A means of repeatable execution of pre-defined queries against your Elasticsearch cluster. Esque will remember which queries it ran against the cluster and only execute those that have not in the order they are defined.

It is Flyway-esque but for Elasticsearch.

What it does

  • Define queries in migration files using YAML
  • Executes the migration files in order as needed
  • Maintains state of which migration files have been executed
  • Ensures integrity between migration files and applied migrations
  • Locks migration operations across distributed systems to ensure single execution
  • Can supply your own distributed lock if needed (e.g. Hazelcast)
  • Allows for different logical separation of migration sets via a migration key

What it doesn't

  • Rollback in the face of failure. Back up your systems and test your migrations

Prerequisites

  • Elasticsearch 7+

Dependencies

  • org.elasticsearch.client:elasticsearch-rest-client
  • com.fasterxml.jackson.core:jackson-databind
  • com.fasterxml.jackson.module:jackson-module-parameter-names
  • com.fasterxml.jackson.datatype:jackson-datatype-jdk8
  • com.fasterxml.jackson.datatype:jackson-datatype-jsr310
  • com.fasterxml.jackson.dataformat:jackson-dataformat-yaml
  • org.slf4j:slf4j-api

Use cases

  • Executing all queries for bootstrapping a brand new Elasticsearch cluster. For example:
    • cluster settings
    • saved searches
    • visualizations
    • dashboards
    • creating indexes
    • creating users
  • Executing queries needed for a particular application. For example:
    • creating indexes
    • creating index templates
    • creating/modifying index aliases
    • index schema modification
    • etc.

It basically executes queries and remembers which queries have been run on a cluster for a given migration key. You can organize it's usage to your needs.

Install

Add the following to your maven dependencies. Make sure to check the releases or Maven Central for the latest version.

<dependency>
  <groupId>org.loesak.esque</groupId>
  <artifactId>esque-core</artifactId>
  <version>0.1.2</version>
</dependency>

Security

TODO: deal with Elasticsearch security as well as AWS ES security

Examples

Example projects exist in the esque-examples subdirectory

Future Features

  • may allow ability to define "undo" queries for each definition to allow for attempts to roll back in the face of partial failure
  • support other versions of Elasticsearch (5.6+ only) - may just ditch the elasticsearch rest client and move to straight HTTP queries...

Versions

Version
0.1.2