us.codecraft:webmagic-extension

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

License

License

Categories

Categories

webmagic Business Logic Libraries Web Crawling
GroupId

GroupId

us.codecraft
ArtifactId

ArtifactId

webmagic-extension
Last Version

Last Version

0.7.5
Release Date

Release Date

Type

Type

jar
Description

Description

A crawler framework. It covers the whole lifecycle of crawler: downloading, url management, content extraction and persistent. It can simply the development of a specific crawler.

Download webmagic-extension

How to add to project

<!-- https://jarcasting.com/artifacts/us.codecraft/webmagic-extension/ -->
<dependency>
    <groupId>us.codecraft</groupId>
    <artifactId>webmagic-extension</artifactId>
    <version>0.7.5</version>
</dependency>
// https://jarcasting.com/artifacts/us.codecraft/webmagic-extension/
implementation 'us.codecraft:webmagic-extension:0.7.5'
// https://jarcasting.com/artifacts/us.codecraft/webmagic-extension/
implementation ("us.codecraft:webmagic-extension:0.7.5")
'us.codecraft:webmagic-extension:jar:0.7.5'
<dependency org="us.codecraft" name="webmagic-extension" rev="0.7.5">
  <artifact name="webmagic-extension" type="jar" />
</dependency>
@Grapes(
@Grab(group='us.codecraft', module='webmagic-extension', version='0.7.5')
)
libraryDependencies += "us.codecraft" % "webmagic-extension" % "0.7.5"
[us.codecraft/webmagic-extension "0.7.5"]

Dependencies

compile (3)

Group / Artifact Type Version
redis.clients : jedis jar 3.6.0
com.google.guava : guava Optional jar 30.1-jre
us.codecraft : webmagic-core jar 0.7.5

test (1)

Group / Artifact Type Version
junit : junit jar 4.13.1

Project Modules

There are no modules declared in this project.

Versions

Version
0.7.5
0.7.4
0.7.3
0.7.2
0.7.1
0.7.0
0.7.0.alpha
0.6.1
0.6.0
0.5.3
0.5.2
0.5.1
0.5.0
0.4.3
0.4.2
0.4.1
0.4.0
0.3.2
0.3.1
0.3.0
0.2.1