JarCasting
JarCasting JarCasting

rubix

Caching Framework for Big Data Engines

License

License
GroupId

GroupId

com.qubole.rubix
ArtifactId

ArtifactId

rubix-root
Last Version

Last Version

0.3.20
Release Date

Release Date
Type

Type

pom
Description

Description

rubix
Caching Framework for Big Data Engines
Project URL

Project URL

http://github.com/qubole/rubix
Project Organization

Project Organization

Qubole
Source Code Management

Source Code Management

http://github.com/qubole/rubix

Download rubix-root

Filename Size
rubix-root-0.3.20.pom 13 KB
Browse

How to add to project

<!-- https://jarcasting.com/artifacts/com.qubole.rubix/rubix-root/ -->
<dependency>
    <groupId>com.qubole.rubix</groupId>
    <artifactId>rubix-root</artifactId>
    <version>0.3.20</version>
    <type>pom</type>
</dependency>
// https://jarcasting.com/artifacts/com.qubole.rubix/rubix-root/
implementation 'com.qubole.rubix:rubix-root:0.3.20'
// https://jarcasting.com/artifacts/com.qubole.rubix/rubix-root/
implementation ("com.qubole.rubix:rubix-root:0.3.20")
'com.qubole.rubix:rubix-root:pom:0.3.20'
<dependency org="com.qubole.rubix" name="rubix-root" rev="0.3.20">
  <artifact name="rubix-root" type="pom" />
</dependency>
@Grapes(
@Grab(group='com.qubole.rubix', module='rubix-root', version='0.3.20')
)
libraryDependencies += "com.qubole.rubix" % "rubix-root" % "0.3.20"
[com.qubole.rubix/rubix-root "0.3.20"]

Dependencies

There are no dependencies for this project. It is a standalone project that does not depend on any other jars.

Project Modules

  • rubix-spi
  • rubix-core
  • rubix-client
  • rubix-common
  • rubix-presto
  • rubix-prestosql
  • rubix-hadoop2
  • rubix-bookkeeper
  • rubix-tests
  • assembly
  • rubix-rpm
  • rubix-presto-shaded
  • rubix-build

RubiX

[Build Status] codecov

RubiX is a light-weight data caching framework that can be used by Big-Data engines. RubiX uses local disks to provide the best I/O bandwidth to the Big Data Engines. RubiX is useful in shared storage architectures where the data execution engine is separate from storage. For example, on public clouds like AWS or Microsoft Azure, data is stored in cloud store and the engine accesses the data over a network. Similarly in data centers Presto runs on a separate cluster from HDFS and accesses data over the network.

RubiX can be extended to support any engine that accesses data using Hadoop FileSystem interface via plugins. There are plugins to access data on AWS S3, Microsoft Azure Blob Store and HDFS. RubiX can be extended to be used with any other storage systems including other cloud stores

Check the User and Developer manual for more more information on getting started.

Supported Engines and Cloud Stores

  • Presto: Amazon S3
  • Spark: Amazon S3
  • Any engine using hadoop-2 e.g. Hive can utilize RubiX. Amazon S3 is supported

Resources

Documentation
Getting Started Guide
User Group (Google)

Talks

Talk on Rubix at Strata 2017

Blog Posts

Developers

Slack Channel

The channel is restricted to a few domains. Send an email on the user group or contact us through Github issues. We will add you to the slack channel.

com.qubole.rubix

Qubole

A cloud based service that makes big data easy for analysts and data engineers.

Versions

Version
0.3.20
0.3.19
0.3.18
0.3.17.1
0.3.17
0.3.16
0.3.15
0.3.14
0.3.13
0.3.12
0.3.11
0.3.10
0.3.9
0.3.8
0.3.7
0.3.6
0.3.5
0.3.3.1
0.3.3
0.3.2
0.3.1
0.3.0
0.2.14
0.2.12.2
0.2.12.1
0.2.12
0.2.11
0.2.10
0.2.9
0.2.8
0.2.7
0.2.6
0.2.5
0.2.4
0.2.3
0.2.2
0.2.1
0.2.0
0.1.1