TorchSat is an open-source deep learning framework for satellite imagery analysis based on PyTorch.
This project is still work in progress. If you want to know the latest progress, please check the develop branch.
Hightlight
๐ Support multi-channels(> 3 channels, e.g. 8 channels) images and TIFF file as input.๐ Convenient data augmentation method for classification, sementic segmentation and object detection.๐ Lots of models for satellite vision tasks, such as ResNet, DenseNet, UNet, PSPNet, SSD, FasterRCNN ...๐ Lots of common satellite datasets loader.๐ฎ Training script for common satellite vision tasks.
Install
- source:
python3 setup.py install
How to use
- Introduction
- Image Classification Tutorial: Docs, Google Colab
- Semantic Segmentation Tutorial: Docs
- Data Augumentation: Docs, Google Colab
Features
Data augmentation
We suppose all the input images, masks and bbox should be NumPy ndarray. The data shape should be [height, width] or [height, width, channels].
pixel level
Pixel-level transforms only change the input image and will leave any additional targets such as masks, bounding boxes unchanged. It support all channel images. Some transforms only support specific input channles.
Transform | Image | masks | BBoxes |
---|---|---|---|
ToTensor | โ | โ | โ |
Normalize | โ | โ | โ |
ToGray | โ | โ | โ |
GaussianBlur | โ | โ | โ |
RandomNoise | โ | โ | โ |
RandomBrightness | โ | โ | โ |
RandomContrast | โ | โ | โ |
spatial-level
Spatial-level transforms will simultaneously change both an input image as well as additional targets such as masks, bounding boxes. It support all channel images.
Transform | Image | masks | BBoxes |
---|---|---|---|
Resize | โ | โ | โ |
Pad | โ | โ | โ |
RandomHorizontalFlip | โ | โ | โ |
RandomVerticalFlip | โ | โ | โ |
RandomFlip | โ | โ | โ |
CenterCrop | โ | โ | โ |
RandomCrop | โ | โ | โ |
RandomResizedCrop | โ | โ | โ |
ElasticTransform | โ | โ | |
RandomRotation | โ | โ | โ |
RandomShift | โ | โ | โ |
Models
Classification
All models support multi-channels as input (e.g. 8 channels).
- VGG:
vgg11
,vgg11_bn
,vgg13
,vgg13_bn
,vgg16
,vgg16_bn
,vgg19_bn
,vgg19
- ResNet:
resnet18
,resnet34
,resnet50
,resnet101
,resnet152
,resnext50_32x4d
,resnext101_32x8d
,wide_resnet50_2
,wide_resnet101_2
- DenseNet:
densenet121
,densenet169
,densenet201
- Inception:
inception_v3
- MobileNet:
mobilenet_v2
- EfficientNet:
efficientnet_b0
,efficientnet_b1
,efficientnet_b2
,efficientnet_b3
,efficientnet_b4
,efficientnet_b5
,efficientnet_b6
,efficientnet_b7
- ResNeSt:
resnest50
,resnest101
,resnest200
,resnest269
Sementic Segmentation
- UNet:
unet
,unet34
,unet101
,unet152
(with resnet as backbone.)
Dataloader
Classification
Showcase
If you extend this repository or build projects that use it, we'd love to hear from you.
Reference
Note
- If you are looking for the torchvision-enhance, please checkout the enhance branch. But it was deprecated.