Multispectral Image Acquisition & Data Inference using UAVs

Position - Principal Engineer – State Estimation and Control at Technology Innovation Hub for IoT and IoE (TIH-IoT), IIT-Bombay
Technical skills - Python, Pytorch, Multispectral Imaging, Vegetation Indices, Deep learning, Machine learning

Drones equipped with multispectral cameras offer a powerful, non-invasive method for capturing high-resolution spectral data across large and inaccessible areas. These systems enable early detection of surface anomalies and plant stress by analyzing reflectance patterns beyond the visible spectrum.

I am currently leading a team focused on multispectral data acquisition and AI-based inferencing for two critical projects:

  1. Surface Detection of Oil and Water from Underground Pipelines – Utilizing spectral analysis to detect oil leaks and water contamination on the surface, supporting early intervention and environmental protection.
  2. AI-Based Farm Advisory System for Onion Cultivation – Applying drone phenotyping to monitor plant health, detect stress conditions like thrips and anthracnose, and provide yield predictions to assist farmers via the iSaarthi mobile platform.

These projects aim to solve real-world challenges in infrastructure safety and precision agriculture using drone-enabled multispectral intelligence.


Surface Detection of Oil and Water from Underground Pipelines

This project, in collaboration with HPCL, IOCL, and GAIL, focuses on detecting surface signatures of oil and water leaks originating from underground pipelines using multispectral imaging and AI-based analysis.

Problem Statement: Pilferage Detection

A significant challenge faced by oil and gas companies is the undetected pilferage and leakage of oil from underground pipelines. Early surface-level detection can prevent environmental damage, operational downtime, and economic losses.

oilvswater
Figure: Multispectral image analysis for oil vs water pipeline

Preliminary Spectral Analysis

Initial analysis focused on identifying spectral bands that effectively distinguish between oil and water on soil and vegetation. Multispectral imaging helped isolate key wavelengths where oil and water show distinct reflectance patterns.

oilvswater
Figure: Spectral band comparison of oil and water

Dataset Creation and Model Development

A custom multispectral dataset was created under controlled conditions using varying quantities of oil, water, and vegetation. This comprehensive dataset enabled the training of a robust deep learning model based on the YOLOv8 architecture. The model achieved an accuracy of 92.9% for oil detection and 96% for water detection, showcasing strong performance in surface leak classification tasks.

Phase 2: Real-World Deployment

In the second phase of the project, we plan to augment the current dataset with real-world data collected from actual pipeline leakage sites, in collaboration with industry partners such as IOCL, HPCL, and GAIL. This phase aims to validate and improve the model's performance under diverse environmental and terrain conditions. Field data will include site-specific spectral signatures, soil types, and contamination patterns to ensure the model generalizes well to operational settings.

In parallel, comparative benchmarking against other state-of-the-art deep learning algorithms is ongoing, and the results will contribute to a scientific publication currently under development.



AI-Based Farm Advisory System for Onion Cultivation

In collaboration with ICAR-DOGR (Indian Council of Agricultural Research - Directorate of Onion and Garlic Research), this project focuses on developing an AI-powered farm advisory system tailored for onion farming. Leveraging multispectral imaging and advanced machine learning models, the system aims to detect various forms of plant stress including thrips infestation, anthracnose disease, and water drought conditions. It also incorporates yield prediction models for improved crop management.

The ultimate goal is to integrate drone-based phenotyping with the iSaarthi mobile application, which aggregates data from ground control stations, onboard agro-sensors, and mobile imagery captured by farmers. This fusion of aerial and ground-level data supports real-time, location-specific advisories to empower farmers with actionable insights.

DOGR
Figure: AI-based farm advisory system pipeline

Dimple Bhuta
Dimple Bhuta
Principal Engineer – State Estimation and Control

My research interests include robotics, computer vision and bio-inspired design.