>dataworker sql parser

dataworker sql parser

License

License

Categories

Categories

Data
GroupId

GroupId

com.github.melin
ArtifactId

ArtifactId

dataworker-sql-parser
Last Version

Last Version

3.2.0
Release Date

Release Date

Type

Type

jar
Description

Description

>dataworker sql parser
dataworker sql parser
Project URL

Project URL

https://github.com/melin/dataworker-sql-parser
Source Code Management

Source Code Management

https://github.com/melin/dataworker-sql-parser

Download dataworker-sql-parser

How to add to project

<!-- https://jarcasting.com/artifacts/com.github.melin/dataworker-sql-parser/ -->
<dependency>
    <groupId>com.github.melin</groupId>
    <artifactId>dataworker-sql-parser</artifactId>
    <version>3.2.0</version>
</dependency>
// https://jarcasting.com/artifacts/com.github.melin/dataworker-sql-parser/
implementation 'com.github.melin:dataworker-sql-parser:3.2.0'
// https://jarcasting.com/artifacts/com.github.melin/dataworker-sql-parser/
implementation ("com.github.melin:dataworker-sql-parser:3.2.0")
'com.github.melin:dataworker-sql-parser:jar:3.2.0'
<dependency org="com.github.melin" name="dataworker-sql-parser" rev="3.2.0">
  <artifact name="dataworker-sql-parser" type="jar" />
</dependency>
@Grapes(
@Grab(group='com.github.melin', module='dataworker-sql-parser', version='3.2.0')
)
libraryDependencies += "com.github.melin" % "dataworker-sql-parser" % "3.2.0"
[com.github.melin/dataworker-sql-parser "3.2.0"]

Dependencies

compile (8)

Group / Artifact Type Version
org.antlr : antlr4-runtime jar 4.7.1
org.jetbrains.kotlin : kotlin-stdlib jar 1.4.0
org.apache.commons : commons-lang3 jar 3.12.0
com.alibaba : druid jar 1.2.5
org.slf4j : slf4j-api jar 1.7.30
org.slf4j : log4j-over-slf4j jar 1.7.30
ch.qos.logback : logback-core jar 1.2.3
ch.qos.logback : logback-classic jar 1.2.3

provided (1)

Group / Artifact Type Version
com.google.guava : guava jar 30.0-jre

test (1)

Group / Artifact Type Version
junit : junit jar 4.13.1

Project Modules

There are no modules declared in this project.

介绍

基于antlr4 statement 解析器,支持spark sql, tidb sql, flink sql, Spark/flink jar 运行命令解析。开发大数据平台和BI等系统时,需要解析用到的数据库SQL,获取SQL语句类型、表、函数等信息,校验权限或者限制某种sql不允许执行等需求,包括BI系统中需要表达式解析和校验。具体使用实例,请看TestCase

<dependency>
    <groupId>com.github.melin</groupId>
    <artifactId>dataworker-sql-parser</artifactId>
    <!-- 版本号与spark 最新版本对其 -->
    <version>3.2.0</version>
</dependency>

  1. MySQL
  2. PrestoSQL
  3. PostgreSQL
  4. Spark 3.0
  5. T-SQL
  6. ClickHouse

Spark Structed Streaming sql

create stream TABLE tdl_kafka_users (
    user_name "/name" string,
    age	    int,
    email   string
) WITH (
    kafka.bootstrap.servers = 'xxx.xxx.xxx.xxx:9092',
    kafka.group.id = 'dataworker-stream',
    subscribe = 'users',
    includeHeaders = true,
    startingOffsets = 'latest',
    failOnDataLoss = true,
    format='json'
);

insert into bigdata.test_delta_dt select * from tdl_kafka_users;

-- {name:'zhangsan', age: 28, email:'zhangsan@gmail.com'}

Versions

Version
3.2.0