Skip to content

weedNet: Dense semantic weed classification using multispectral images and MAV for smart farming

License

Notifications You must be signed in to change notification settings

inkyusa/weedNet

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

20 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Multispectral dataset

Please head to dataset for the multispectral images (NIR, Red, and NDVI with their labels).


Due to several requests for raw multi-spectral images (4ch), we unofficially made this available raw dataset (1.8GB) and you can checkout this branch for sample RGB images. Please note that these datasets do not have the corresponding labels and we couldn't guarantee the maintenance of them due to limited resources. Thank you for your understandings and hope this helps.


Training weedNet

If you want to know more about how to train a network (using a caffe framework) with this dataset, here we have an experimental repo that allows you to do this (courtesy by Marija Popovic).

Annotated ground truth images

The annotated ground truth images for training and testing are indexed images meaning that they were filled with class IDs rather than RGB values. For example, the background is 0, crop is 1, and weed is 2. You can directly use these indexed files for model training using Caffe SegNet (or other networks) without any data conversions. If you want to visualize these files (e.g., https://github.com/inkyusa/weedNet/blob/master/data/Sequoia/SequoiaRed_30/testannot/0000.png) the following MATLAB code snippet may help;

im=imread('./0000.png');
plantColor=[0 1 0]; %green
weedColor=[1 0 0]; %red
map=[plantColor;weedColor];
rgb=label2rgb(im,map,[0,0,0]); %label img, map, bg color
imshow(rgb);

screen shot 2018-09-28 at 17 44 11

Publications

If our work helps your works in an academic/research context, please cite the following publication(s):

  • I. Sa, Z. Chen, M. Popovic, R. Khanna, F. Liebisch, J. Nieto and R. Siegwart, "weedNet: Dense Semantic Weed Classification Using Multispectral Images and MAV for Smart Farming", 2018, IEEE Robotics and Automation Letters or (arxiv pdf)
@ARTICLE{8115245, 
author={I. Sa and Z. Chen and M. Popović and R. Khanna and F. Liebisch and J. Nieto and R. Siegwart}, 
journal={IEEE Robotics and Automation Letters}, 
title={weedNet: Dense Semantic Weed Classification Using Multispectral Images and MAV for Smart Farming}, 
year={2018}, 
volume={3}, 
number={1}, 
pages={588-595}, 
keywords={agriculture;agrochemicals;autonomous aerial vehicles;control engineering computing;convolution;crops;feature extraction;image classification;learning (artificial intelligence);neural nets;vegetation;MAV;SegNet;convolutional neural network;crop health;crop management;curve classification metrics;dense semantic classes;dense semantic weed classification;encoder-decoder;input image channels;multispectral images;selective weed treatment;vegetation index;weed detection;Agriculture;Cameras;Image segmentation;Robots;Semantics;Training;Vegetation mapping;Aerial systems;agricultural automation;applications;robotics in agriculture and forestry}, 
doi={10.1109/LRA.2017.2774979}, 
ISSN={}, 
month={Jan},}

Click to see a demonstration video

About

weedNet: Dense semantic weed classification using multispectral images and MAV for smart farming

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages