datalake-spark3

Library built on top of Apache Spark to speed-up data lakes development..

License

License

Categories

Categories

Data
GroupId

GroupId

bio.ferlab
ArtifactId

ArtifactId

datalake-spark3_2.12
Last Version

Last Version

0.2.48
Release Date

Release Date

Type

Type

jar
Description

Description

datalake-spark3
Library built on top of Apache Spark to speed-up data lakes development..
Project URL

Project URL

https://github.com/Ferlab-Ste-Justine/datalake-lib
Project Organization

Project Organization

ferlab
Source Code Management

Source Code Management

https://github.com/Ferlab-Ste-Justine/datalake-lib

Download datalake-spark3_2.12

How to add to project

<!-- https://jarcasting.com/artifacts/bio.ferlab/datalake-spark3_2.12/ -->
<dependency>
    <groupId>bio.ferlab</groupId>
    <artifactId>datalake-spark3_2.12</artifactId>
    <version>0.2.48</version>
</dependency>
// https://jarcasting.com/artifacts/bio.ferlab/datalake-spark3_2.12/
implementation 'bio.ferlab:datalake-spark3_2.12:0.2.48'
// https://jarcasting.com/artifacts/bio.ferlab/datalake-spark3_2.12/
implementation ("bio.ferlab:datalake-spark3_2.12:0.2.48")
'bio.ferlab:datalake-spark3_2.12:jar:0.2.48'
<dependency org="bio.ferlab" name="datalake-spark3_2.12" rev="0.2.48">
  <artifact name="datalake-spark3_2.12" type="jar" />
</dependency>
@Grapes(
@Grab(group='bio.ferlab', module='datalake-spark3_2.12', version='0.2.48')
)
libraryDependencies += "bio.ferlab" % "datalake-spark3_2.12" % "0.2.48"
[bio.ferlab/datalake-spark3_2.12 "0.2.48"]

Dependencies

compile (9)

Group / Artifact Type Version
org.scala-lang : scala-library jar 2.12.14
bio.ferlab : datalake-commons_2.12 jar 0.2.48
com.github.pureconfig : pureconfig_2.12 jar 0.16.0
com.github.pureconfig : pureconfig-enum_2.12 jar 0.16.0
org.typelevel : cats-core_2.12 jar 2.6.1
dev.zio : zio-config-typesafe_2.12 jar 1.0.6
dev.zio : zio-config_2.12 jar 1.0.6
dev.zio : zio-config-magnolia_2.12 jar 1.0.6
org.scalatest : scalatest_2.12 jar 3.2.9

provided (9)

Group / Artifact Type Version
org.apache.spark : spark-core_2.12 jar 3.1.2
org.apache.spark : spark-sql_2.12 jar 3.1.2
io.delta : delta-core_2.12 jar 1.0.0
org.elasticsearch : elasticsearch-spark-30_2.12 jar 7.15.0
io.projectglow : glow-spark3_2.12 jar 1.1.0
software.amazon.awssdk : s3 jar 2.17.71
com.microsoft.sqlserver : mssql-jdbc jar 8.4.1.jre8
com.microsoft.aad : adal4j jar 0.0.2
com.microsoft.azure : spark-mssql-connector_2.12 jar 1.1.0

test (3)

Group / Artifact Type Version
com.dimafeng : testcontainers-scala-scalatest_2.12 jar 0.38.8
org.testcontainers : localstack jar 1.15.2
org.apache.spark : spark-hive_2.12 jar 3.1.2

Project Modules

There are no modules declared in this project.
bio.ferlab

Ferlab Ste-Justine

Centre de Recherche du CHU Sainte-Justine - Dr. Ferretti

Versions

Version
0.2.48
0.2.47
0.0.66
0.0.65
0.0.64
0.0.63
0.0.62
0.0.61
0.0.60
0.0.59
0.0.58
0.0.56
0.0.54
0.0.53
0.0.52
0.0.51
0.0.50
0.0.49
0.0.46
0.0.45
0.0.44
0.0.43
0.0.42
0.0.41
0.0.40
0.0.39
0.0.38
0.0.37
0.0.36
0.0.35
0.0.34
0.0.33
0.0.32
0.0.31
0.0.26