• Stars
    star
    147
  • Rank 243,102 (Top 5 %)
  • Language
    Python
  • Created over 8 years ago
  • Updated about 7 years ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Python3.5 async crawler example with aiohttp and asyncio

Tangrowth contributions welcome

Python3.6 Async Crawler Example with aiohttp and asyncio

Image of Tangrowth

Installation

Installation Python 3.6

sudo add-apt-repository ppa:fkrull/deadsnakes
sudo apt-get update
sudo apt-get install python3.6

In virtualenvwrapper

mkvirtualenv async_crawler --python=/usr/bin/python3.6
python async_crawler.py

or

Replace python3 with python3.6

sudo mv /usr/bin/python3 /usr/bin/python3-backup
sudo ln -s /usr/bin/python3.6 /usr/bin/python3

sudo apt-get install python3-pip
sudo pip3 install aiohttp
python3 async_crawler.py

More Repositories

1

react-websocket

Easy-to-use React component for websocket communications.
JavaScript
351
star
2

tornado-user-authentication-example

small code example for user login / logout
Python
25
star
3

tornado-uvloop

super simple uvloop class for tornado framework
Python
14
star
4

dict2form

python dictionary object to html5 json form generator
Python
9
star
5

sehir

A function that returns unified Turkish city names
TypeScript
5
star
6

f-keyboard

Turkish Classic F keyboard layout like MS & Linux
5
star
7

free-book-cover

Free Book Cover Mockup
5
star
8

skeleton-itcss

ITCSS blank scheme on gulp
JavaScript
3
star
9

pipi

shortcut install & freeze pip packages
Python
3
star
10

orion8

A blockchain database for BlockStack projects to keep relations on a trustable network which uses Websockets for p2p communication.
JavaScript
3
star
11

torethink

Rethinkdb Wrapper For Tornado Framework
Python
3
star
12

boilerplate

application boilerplate for cross development
Objective-C
3
star
13

blockchain-javascript-boilerplate

ES6 Blockchain Example
JavaScript
2
star
14

thinker

Rethinkdb wrapper for asyncio in Python 3.5+
Python
2
star
15

react-tab-bar

React sliding tab component
TypeScript
2
star
16

cython_boilerplate

Cython Boilerplate
Python
2
star
17

tornado-localization-demo

Tornado Localization Example
Python
2
star
18

dashboard-feature-flag

For demo purposes
TypeScript
2
star
19

angular-nativescript-firebase-akita-starter

This arose from the need to have a way to prototype cross-platform apps quickly. Thus, this starter app includes a basic angular app, with Material for UI, Akita for state management, firebase for a backend, and nativescript for mobile.
JavaScript
1
star
20

mehmetkose.github.io

Personal Website
HTML
1
star
21

huhu

An experimental script language for kids, written in Python
Python
1
star
22

my_git_project

a tryout project for the "Jump Start Git" book.
1
star
23

python_background_jobs

an example of python background jobs with bash
Python
1
star
24

nextjs-forestry

JavaScript
1
star
25

32dk

32dk.com Tutorial Files
1
star
26

fupio

Decentralized Autonomous Zone.
JavaScript
1
star
27

yazilimsal

1
star
28

react-drag-dealer

JavaScript
1
star