gsh199449/DistributeCrawler gsh199449/DistributeCrawler

  • Stars
    star
    74
  • Rank 426,937 (Top 9 %)
  • Language
    Java
  • Created almost 11 years ago
  • Updated over 10 years ago
Twitter logo Share LinkedIn logo Share Facebook logo Share
gsh199449/DistributeCrawler
github

gsh199449

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

基于Map/Reduce爬虫,可抽取各大新闻网站的新闻正文并进行分类和聚类

More Repositories

1

spider

A configurable web spider with a easy-to-use web console
Java
987
star
2

stickerchat

Dataset for WWW 2020 paper "Learning to Respond with Stickers: A Framework of Unifying Multi-Modality in Multi-Turn Dialog"
Python
36
star
3

productqa

Product-Aware Answer Generation in E-Commerce Question-Answering
35
star
4

read-paper

25
star
5

proto-summ

Dataset proposed by ''How to Write Summaries with Patterns? Learning towards Abstractive Summarization through Prototype Editing''
17
star
6

DistributedCrawler

DistributeCrawler的Maven版
Java
10
star
7

HeteroQA

WSDM 2022 paper HeteroQA: Learning towards Question-and-Answering through Multiple Information Sources via Heterogeneous Graph Modeling
Python
9
star
8

gather_platform_pages

HTML
2
star
9

table-summ

BioGen: Generating Biography Summary under Table Guidance on Wikipedia
2
star
10

dialog-summ

Code for ACL 2023 paper "Dialogue Summarization with Structure-aware Graph Modeling via Static-Dynamic Fused Graph"
1
star