Abstract
Machine Learning (ML) algorithms have been widely used to estimate agricultural variables across diverse contexts. However, the quantity and quality of training data strongly influence the performance of ML algorithms, which can be constrained by limited or incomplete reference data. Synthetic Data Generation (SDG) offers a practical approach to address this issue by producing artificial but realistic samples that preserve key characteristics of the original data.
This study proposes a Task-Conditioned SDG (TCSDG) algorithm that pairs a Bayesian Network generator with a transformer-based tabular foundation model (TabICL), building on teacher-student knowledge transfer and in-context learning for tabular data. The proposed algorithm was evaluated on two agricultural prediction tasks: crop yield prediction and crop type classification. Six benchmark SDG algorithms were also utilized to compare their performance with that of TCSDG.
Across twelve study sites, two training-data fractions, four multiplication ratios, and three predictive ML algorithms, augmenting the original data with TCSDG-generated synthetic data improved ML performance in 89% of the crop type classification experiments and 74% of the crop yield prediction experiments. TCSDG also substantially outperformed benchmark SDG algorithms and was the only method to consistently improve ML performance across both tasks at the aggregate level.
The study demonstrates that carefully designed and processed synthetic data can improve ML performance in precision-agriculture applications. TCSDG offers a practical and extensible framework for generating synthetic data that supports downstream ML agricultural prediction. The full implementation of TCSDG is publicly available as open source at GitHub TCSDG.
Blogger's Review: This study highlights the significance of synthetic data generation in agriculture, especially under data scarcity conditions. The TCSDG algorithm effectively combines Bayesian networks and transformer models to generate efficient data, significantly enhancing ML prediction performance, indicating a promising avenue for agricultural forecasting optimization.