NeFut Logo NeFut
Admin Login

[CS.AI] Multi-Scale ViT Inference with kNN for Plant Identification

Published at: 2026-07-18 22:00 Last updated: 2026-07-22 01:24
#algorithm #AI #Machine Learning

This paper describes DS@GT ARC's third-place solution to the PlantCLEF 2026 challenge on multi-species plant identification in vegetation quadrat images, where systems must predict every species present in high-resolution (~3000 x 3000 pixel) plot photographs while training only on single-label images of individual plants.

The pipeline is built around a fine-tuned DINOv2 ViT-L/14 classifier applied over a multi-scale tile decomposition of each quadrat, with per-tile predictions blended with a FAISS kNN retriever and post-processed by source-aware temporal fusion across repeated plot visits, a habitat-fit demotion that injects geographic and altitude priors from the training data, and a South-Western Europe geographic mask.

Habitat-fit demotion and multi-scale aggregation are the largest individual contributors in the ablations. Two complementary training-centric directions, a cross-region transformer with noisy-student distillation on the LUCAS dataset and a label-as-query transformer decoder over synthetic CLS-domain pseudo-quadrats, yielded null results. An inference-time augmentation with instance-aware segmentation crops also did not improve performance.

The selected submission reaches a private-leaderboard macro-F1 of 0.43902 (third place; public 0.51096); an unselected configuration of the same pipeline scored above 0.45 on the private set. Code available at: GitHub.

Blogger's Review: This research showcases an innovative approach to multi-species plant identification in high-resolution images, particularly through the integration of multi-scale decomposition and kNN retrieval, significantly enhancing recognition performance. While some training strategies did not yield expected results, the emphasis on habitat fit provides a promising direction for future studies.

Original Source: https://arxiv.org/abs/2607.14509

[h] Back to Home