Top Rating
- Top Contributors
  Discover the Top Open Source contributors by country or by language
- Interviews
  Discover real stories from Open Source developers
Discover

Discover your Favorite Language
Discover the top trending repositories and projects on Github. Explore the latest trends in your preferred languages.

Haskell

Shell

Ruby

C++

PowerShell

Assembly

OCaml

HTML

More Languages
Awesome

Awesome repositories
Discover the most awesome repositories and projects of your favorite languages. Inspired by the Awesome-* lists trend in GitHub.

Rust

PowerShell

Dart

Perl

R

Shell

Go

Crystal

More Languages
By Country

Rankings by Country
Discover the community of talented open source contributors in each country.

🇹🇼 Taiwan

🇰🇮 Kiribati

🇦🇼 Aruba

🇨🇰 Cook Islands

🇨🇻 Cabo Verde

🇸🇴 Somalia

🇶🇦 Qatar

🇾🇹 Mayotte

All Countries Compare Countries

owainlewis/falkor

Stars
183
Rank 210,154 (Top 5 %)
Language
Clojure
License
Eclipse Public Li...
Created over 9 years ago
Updated almost 9 years ago

owainlewis/falkor

owainlewis

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Open Source web scraping API. Falkor turns web pages into queryable JSON

Falkor

A web service for turning HTML pages into traversable JSON documents

Very early stage development. If you have any feature requests just create an issue on the project

Getting started

Running the server locally

lein uberjar
docker build -t falkor .
docker run -t falkor

# Visit http://localhost:5000

Comming soon

Better error handling
CORS
Query filtering (return only certain attributes)
Fetching multiple elements in a single request ( e.g [h1 > a, .subtitle] )

Usage

Get all the title links from the Reddit.com home page

https://falkor-api.herokuapp.com/api/query?url=http://reddit.com&query=a.title

Grab all the news stories from Digg.com

https://falkor-api.herokuapp.com/api/query?url=http://digg.com&query=.story-title%20a

Extract all the images from Digg.com

https://falkor-api.herokuapp.com/api/query?url=http://digg.com&query=img[src]

TODO

Filters to remove some of the attribute cruft

For example if we just want to extract the text for an element and ignore the other attributes

&filter=[text]

License

Copyright © 2015 Forward Digital Limited

Distributed under the Eclipse Public License either version 1.0 or (at your option) any later version.

awesome-artificial-intelligence

A curated list of Artificial Intelligence (AI) courses, books, video lectures and papers.

emacs-color-themes

A collection of custom themes for Emacs. All the themes are named after famous programmers.

clojure-mail

A Clojure library for parsing, downloading and reading email from IMAP servers.

status

An open source, self hosted status page application for communicating service incidents to customers.

yaml

A fast, idiomatic and easy to use Clojure YAML library. Based on Snake YAML

http-dispatch

A high level HTTP client for Haskell that focuses on ease of use

ocaml-datastructures-algorithms

Data structures and algorithms in OCaml

salesforce

A Clojure library for interacting with Salesforce.com

digital-ocean

Idiomatic Clojure client for Digital Ocean that makes it easy to boot virtual servers from your REPL

slack

Slack Web and RTM API

apidoc

Generate professional looking, human readable documentation from Swagger or RAML

relay

Relay lets you write HTTP requests as easy to read, structured YAML and dispatch them easily using a CLI. Similar to tools like Postman

sendgrid-clj

A Clojure library for SendGrid

bridge

A type-safe, stack-based functional programming language

lambda-calculus

Lambda calculus parser in Haskell

yfinance

Haskell library for querying real time stock market data

activator-akka-http

A Typesafe Activator template for Akka HTTP microservices

forth

A micro compiler for the FORTH programming language

athena

A small but powerful library for mining data from web pages and HTML documents. Athena provides an easy to use DSL for crawling HTML pages and extracting information from them.

x2

An in browser (AI) artificial agent that can automate tasks and perform actions based on voice input

rage-db

A simple in memory no-sql database

semver

Clojure implementation of the Semantic Versioning 2.0.0 spec. Parse, validate, sort and modify semantic version strings

joy

Compiler for the functional stack based programming language Joy

sendgrid-hs

Haskell library for delivering email via SendGrid

variance

Statistics library

swagger-gen

Swagger code generation tool to generate boilerplate code from your swagger specs.

heroku-clj

Heroku API via Clojure

daenerys

Daenerys is a tool that lets you execute HTTP requests from static files

stocks

Clojure library for stock market analysis

convoy

Convoy is a Kubernetes controller that allows your team to receive notifications about specific events in your cluster.

software-engineering-management

Resources for software engineering management and software engineering leadership

oci-haskell-sdk

A Haskell SDK for working with Oracle Cloud Infrastructure

scala-yaml

A YAML library for Scala

ava

Ava is a programming language exploring the idea of programs that can mutate and write themselves

java-http-clj

A zero dependency HTTP library built on java.net.http.HttpClient.

hof

Higher order functions for Golang

oci-kubernetes-ingress

An Ingress Controller to enable full L7 load balancing on OCI Kubernetes.

prototype

Automatically generate domain models in multiple languages from a single typed schema

broadcaast

Broadcast lets you save and organise links, images and content into channels

akka-gateway

A library for writing bespoke API Gateways using Akka HTTP with support for AWS Lambda, Oracle Cloud Infrastructure, Google Cloud Functions, websockets and more.

frequency

A modular Continuous Integration (CI) platform built on top of Kubernetes.

markets

An API for financial markets. Index, currency, stock and historical data.

oci-sdk-clj

Clojure SDK for Oracle Cloud Infrastructure

circle-clj

Circle CI with Clojure

akka-http-clj

A high performance HTTP client for Clojure built on Akka HTTP

arch

Arch is a typed stack based functional programming language based on combinators

rss2json

A small service that turns RSS feeds into JSON

influx

An async client for Influx DB

delighted

A Haskell client for using the Delighted.com API

user-service

Demo application using Dropwizard, JWT authentication + MySQL

polyfunctors

A collection of experimental polyfunctor instances (bimap, trimap and quadmap)

shapes

Exotic shapes and types for Scala

emacs-theme-generator

A Haskell program that generates Emacs 24 colour themes

validated

A data type for simple validation

oci-kubeadm

Automation, documentation and tutorials for running Kubernetes on Oracle Cloud Infrastructure.

hdns

A DNS server written in Haskell

props

A small Clojure library for working with java.util.Properties

hashicorp-vault

Haskell interface for working with Hashicorp Vault

emacs

My Emacs config

forward

A fast, lightweight API Gateway written in Rust.

netty-reverse-proxy

A fast and extensible API Gateway based on netty. Supports configuration via YAML and a range of custom policies.

countdown

Countdown puzzles (words and numbers) in Haskell

development-environment

Setup development environment on Ubuntu 17.04

proof

A generic validation library for Scala

openapi

Parse, manipulate and construct OpenAPI specification documents using Haskell

osc

Scheme compiler

employee-service

Dropwizard example service using MySQL and JDBI

artifactory-clj

Clojure tools for working with JFrog Artifactory

akka-http-cloudant

A functional async client for IBM Cloudant based on Akka HTTP.

cloudant-hs

Haskell client for IBM Cloudant