• Stars
    star
    150
  • Rank 247,323 (Top 5 %)
  • Language
    Python
  • License
    MIT License
  • Created over 6 years ago
  • Updated about 2 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Deep learning applied to georeferenced datasets

Logo

About

The Geo-Deep-Learning project stems from an initiative at NRCan's CCMEO. Its aim is to allow using Convolutional Neural Networks (CNN) with georeferenced datasets.

In Geo-Deep-Learning, the learning process comprises two broad stages: tiling and training, followed by inference, which makes use of a trained model to make new predictions on unseen imagery.

Requirement

This project comprises a set of commands to be run at a shell command prompt. Examples used here are for a bash shell in an Ubuntu GNU/Linux environment.

Installation

To execute scripts in this project, first create and activate your python environment with the following commands:

$ conda env create -f environment.yml
$ conda activate geo_deep_env

Tested on Ubuntu 20.04 and Windows 10 using miniconda.

How to use?

This is an example of how to run GDL with hydra in simple steps with the massachusetts buildings dataset in the tests/data/ folder, for segmentation on buildings:

  1. Clone this github repo.
(geo_deep_env) $ git clone https://github.com/NRCan/geo-deep-learning.git
(geo_deep_env) $ cd geo-deep-learning
  1. Run the wanted script (for segmentation).
# Creating the patches from the raw data
(geo_deep_env) $ python GDL.py mode=tiling
# Training the neural network
(geo_deep_env) $ python GDL.py mode=train
# Inference on the data
(geo_deep_env) $ python GDL.py mode=inference

This example runs with a default configuration ./config/gdl_config_template.yaml. For further examples on configuration options see the configuration documentation. To see the different mode and task available go see the documentation here.

New task

If you want to introduce a new task like object detection, you only need to add the code in the main folder and name it object_detection_tiling.py for example. The principle is to name the code like {task}_{mode}.py and the GDL.py will deal with the rest. To run it, you will need to add a new parameter in the command line python GDL.py mode=tiling task=object_detection or change the parameter inside the ./config/gdl_config_template.yaml.

Contributing

We welcome all forms of user contributions including feature requests, bug reports, code, documentation requests, and code. Simply open an issue in the tracker.

If you think you're not skilled or experienced enough to contribute, this is not TRUE! Don't be affraid to help us, every one start somewhere, and it will be our pleasure to help you to help us.

You can find more information on how to create a good issue on a GitHub project Here.

After creating an issue, you can start working on the solution. When you have finish working on your code, it's time for the PR. All the information on how to create a good PR on a GitHub project Here.

Citing Geo Deep Learning

Citations help us justify the effort that goes into building and maintaining this project. If you used Geo Deep Learning for your research, please consider citing us.

@misc{NRCAN:2020,
  Author = {Natural Resources Canada, Government of Canada},
  Title = {Geo Deep Learning},
  Year = {2020},
  Publisher = {GitHub},
  Journal = {GitHub repository},
  Howpublished = {\url{https://github.com/NRCan/geo-deep-learning}}
}

Or you can also use the CITATION.cff file to cite this project.

Contacting us

The best way to get in touch is to open an issue or comment on any open issue or pull request.

License

Project is distributed under MIT License.


More Repositories

1

geo_sim_processing

Python
29
star
2

CanFlood

Flood Risk modelling toolbox for Canada
Python
28
star
3

geoscience_language_models

GloVe and BERT language models re-trained using geoscientific text.
Jupyter Notebook
23
star
4

chyf

Web application that provides hydrology services based on the Common Hydrology Features (CHyF) data model
Java
10
star
5

GSC-Field-Application

Geological Survey Canada on site data collection for geologists.
C#
9
star
6

energuide_api

An API for Natural Resources Canada's Energuide data.
Python
8
star
7

gsip

Groundwater Surface water Interop Experiment
Java
6
star
8

datahub-portal

C#
6
star
9

energuide_api_guide

Proof of concept for NRCAN house evaluation data
JavaScript
3
star
10

RICorDE

Gridded water depth estimates from flood inundation
Python
3
star
11

Legend-Renderer

A C# based set of tools intended for ArcGIS Desktop suite, delivered as an esriaddin format. This tool is meant to create a graphic legend inside Arc Map from a given legend table.
C#
3
star
12

geo-inference

A light-weight python package for extracting features from geospatial imagery
Python
2
star
13

gcweb-jekyll-demo

A mostly working demo of the GCWeb Jekyll theme
HTML
2
star
14

Q2Pipe

Qiime2 based pipeline designed to facilitate and standardise ecological studies by metabarcoding using Illumina Miseq data
Shell
1
star
15

hello

NRCan employee outside of Ottawa? Want to connect on GitHub?
1
star
16

nrwxt

NRCan Drupal 8/9 Composer project. Includes custom modules and themes
JavaScript
1
star
17

Geoscaler

A python base set of tools to be used with ArcGIS Desktop suite 10.1 that is meant to enable user upscaling bedrock or surficial maps.
Python
1
star