DJL NLP utilities for Huggingface tokenizers

Deep Java Library (DJL) NLP utilities for Huggingface tokenizers

License

License

Categories

Categories

DJL Business Logic Libraries Machine Learning
GroupId

GroupId

ai.djl.huggingface
ArtifactId

ArtifactId

tokenizers
Last Version

Last Version

0.17.0
Release Date

Release Date

Type

Type

jar
Description

Description

DJL NLP utilities for Huggingface tokenizers
Deep Java Library (DJL) NLP utilities for Huggingface tokenizers
Project URL

Project URL

http://www.djl.ai/extensions/tokenizers
Source Code Management

Source Code Management

https://github.com/deepjavalibrary/djl

Download tokenizers

How to add to project

<!-- https://jarcasting.com/artifacts/ai.djl.huggingface/tokenizers/ -->
<dependency>
    <groupId>ai.djl.huggingface</groupId>
    <artifactId>tokenizers</artifactId>
    <version>0.17.0</version>
</dependency>
// https://jarcasting.com/artifacts/ai.djl.huggingface/tokenizers/
implementation 'ai.djl.huggingface:tokenizers:0.17.0'
// https://jarcasting.com/artifacts/ai.djl.huggingface/tokenizers/
implementation ("ai.djl.huggingface:tokenizers:0.17.0")
'ai.djl.huggingface:tokenizers:jar:0.17.0'
<dependency org="ai.djl.huggingface" name="tokenizers" rev="0.17.0">
  <artifact name="tokenizers" type="jar" />
</dependency>
@Grapes(
@Grab(group='ai.djl.huggingface', module='tokenizers', version='0.17.0')
)
libraryDependencies += "ai.djl.huggingface" % "tokenizers" % "0.17.0"
[ai.djl.huggingface/tokenizers "0.17.0"]

Dependencies

compile (1)

Group / Artifact Type Version
ai.djl : api jar 0.17.0

Project Modules

There are no modules declared in this project.

Versions

Version
0.17.0
0.16.0
0.15.0