Antoni
Valls

I work on 

AI researcher and engineer with a background in theoretical physics and data science, working on computer vision, visual localization, and vision-language models. Experienced across the full pipeline from model design to real-world deployment.

Antoni Valls

Research & Projects

Selected
work

Spotter
IRI, CSIC-UPCOngoing

Spotter: Feature-Based Urban Visual Localization

Antoni Valls · Jordi Sanchez-Riera

A lightweight visual localization system for urban environments that estimates full 6-DoF camera pose from a single street-level image. Query images are matched against a compact, precomputed database of geo-referenced SuperPoint features extracted from Google Street View panoramas. An OSM road-graph-aware candidate filtering strategy and sequential prior propagation enable robust operation with and without GPS at 15–30 FPS. A patent application and RAL submission are in preparation.

SmartGaze II
IRI, CSIC-UPC · Biel GlassesOngoing

SmartGaze II: VO-GPS Fusion for Real-Time Urban Navigation on Smart Glasses

Antoni Valls · Jordi Sanchez-Riera

Visual-Inertial Odometry fused with GNSS correction for precise real-time urban localization and assistive navigation on wearable devices. Developed for the SMARTGAZE II project to enhance mobility for people with low vision, running on Biel Glasses hardware with on-device inference constraints.

VQA Risk Navigation
IRI, CSIC-UPC · IEEE Transactions on Intelligent Transportation Systems (IEEE T-ITS) Submitted

Urban Risk-Aware Navigation via VQA-Based Event Maps for People with Low Vision

Antoni Valls · Jordi Sanchez-Riera

A VQA-based framework for assistive urban navigation using a three-level hierarchical query structure to detect pedestrian hazards across eight safety categories. Model responses are aggregated into georeferenced risk event maps with four safety levels for route planning. We benchmark ViLT, LLaVA, InstructBLIP, and Qwen-VL on a dataset spanning 20 cities across six continents (800+ annotated images, 18k questions) — Qwen-VL achieves the best balance of precision and recall (F1: 0.69, accuracy: 0.77).

GNN
IIIA-CSIC · University of Padua MSc Thesis

Exploring the Influence of Graph Neural Network-Based Link Prediction on Social Contagion Dynamics

Antoni Valls · Jesus Cerquides · Alberto Testolin

Systematically analyzes how four GNN-based link prediction models (GCN, GAT, SEAL, Graph Transformer) reshape social network structures and their downstream effect on information diffusion. Evaluated across six diverse datasets using both simple and complex epidemic contagion frameworks. Results show LP consistently introduces structural shortcuts targeting hub nodes, accelerating diffusion in denser networks — attention-based models promote broader propagation while GCNs form localized clusters. Complex Path Centrality and node degree emerge as key predictors of contagion susceptibility.

BERT
IIIA-CSIC · Iberian Languages Evaluation Forum (IberLEF 2024) Published

Geopolitically-Informed Multimodal BERT for Propaganda Detection in Political Tweets

Antoni Valls · Björn Komander · Jesus Cerquides

Submission to DIPROMATS Task 1 at IberLEF 2024, targeting propaganda detection in diplomatic tweets in English and Spanish. Proposes a multimodal BERT-like model combining a pre-trained TwHIN-BERT encoder with geopolitical contextual features to capture the intentions behind propaganda use and mitigate spurious correlations and concept drift. Achieves competitive results in both language tracks with stronger performance in Spanish. Adding contextual features consistently improves F1 on the propaganda class, motivating further research in geopolitically-informed NLP.

Polyp
University of PaduaProject

UNet-Based Model Analysis for Polyp Segmentation in Colonoscopy Images

Antoni Valls · Eldar Eyvazov

Comparative analysis of UNet variants (UNet++, ResUNet, Attention-UNet) for medical image segmentation of colorectal polyps. Evaluates architectural choices, augmentation strategies, and loss functions on standard colonoscopy benchmark datasets.

Yashi
University of PaduaProject

SAT Solver for the Yashi Puzzle Game

Antoni Valls

Encodes the Yashi grid-connection puzzle as a Boolean satisfiability problem and solves it using a custom SAT solver. Translates game rules — non-crossing horizontal/vertical segments connecting numbered nodes — into CNF clauses for efficient constraint-based reasoning.

Work Experience

Where I've
worked

Apr 2025 — Present

IRI, CSIC – UPC
Barcelona

Robotic Engineer

  • Participation in the SMARTGAZE II project with Biel Glasses, enhancing mobility for people with low vision through AI-powered smart glasses.
  • Focused on visual urban localization in dynamic environments and adaptation of state-of-the-art models for precise navigation with and without GPS.
  • First-authored a paper submitted to IEEE-ITS benchmarking VLMs models for assistive navigation in urban environments.
Visual-Inertial OdometryMulti-Modal LLMsFeature MatchingDepth EstimationSfM & 3D ReconstructionKalman FiltersGNSS Correction

Apr 2024 — Oct 2024

IIIA – CSIC
Barcelona

Research Assistant

  • Co-authored an NLP project on geopolitically-informed BERT-based models for propaganda detection, published a in IberLEF 2024.
  • Collaborated on a computational sociology project on link-prediction algorithms and social contagion models using GNN models (GCN, GAT, SEAL).
NLPDeep LearningLLMsGraph Neural NetworksMulti Agent Reinforcement LearningEncoder-Decoder ModelsData Analytics

Apr 2022 — Sep 2022

Deloitte Advisory, S.L.
Barcelona

IT Risk Advisory Consultant

Advisory role in IT risk management and analysis within the Deloitte Advisory division working with Zurich CABA

Academic Background

Education &
training

University of Padua

MSc in Data Science

Oct 2022 — Dec 2024 · Padua, Italy

Curriculum in Machine Learning for Intelligent Systems. Specialised in Computer Vision, CNNs, Transformers, NLP, LLMs, and Variational Autoencoders.

Thesis: "Exploring the Effects of Graph Neural Network-Based Link Prediction on Social Contagion Dynamics."

Universitat de Barcelona

BSc in Theoretical Physics

Sep 2017 — Jan 2022 · Barcelona, Spain

Honors in Linear Algebra and Geometry. Strong mathematical foundation in quantum mechanics, computational physics, and field theory.

End-of-degree project: Nuclear Physics — "Atomic and nuclear Ξ− bound states."

Get in touch

Open to research collaborations, engineering roles, and interesting problems.

antonivalls@proton.me