Skip to content
AI News HubLIVE
Original source2 min read

Robustness as a Transferable Skill: Cross-Task Adversarial Defense for Vision-Language-Action Policies

Summary

This paper asks whether adversarial robustness learned on source manipulation tasks can protect independently specialized target VLA policies without target-side adversarial training, proposing SN-TRV to transfer source defense updates to the target visual encoder. It reports improved robustness across three VLA backbones and attack settings, and lifts average physical PiPER success under printed adversarial patches from 20.3% to 45.8%.

SourcearXiv RoboticsAuthor: Jinquan Zhang, Run Yang, Dongfu Yin, Qiang Lai, Yufeng Yan, Pengshuai Yin, F. Richard Yu
Robustness as a Transferable Skill: Cross-Task Adversarial Defense for Vision-Language-Action Policies
Report an error

The correction channel is not available yet. You can copy the article reference below for later.

Correction instructions
Read article

[Submitted on 6 Nov 2026]

Title:Robustness as a Transferable Skill: Cross-Task Adversarial Defense for Vision-Language-Action Policies

View a PDF of the paper titled Robustness as a Transferable Skill: Cross-Task Adversarial Defense for Vision-Language-Action Policies, by Jinquan Zhang and 6 other authors

View PDF HTML (experimental)

Abstract:Vision-Language-Action (VLA) policies are vulnerable to adversarial visual perturbations, while defenses often require task-specific adversarial fine-tuning. We investigate whether robustness learned on source manipulation tasks can protect independently specialized target policies without target-side adversarial training. We first show that even a single source defense update improves robustness on held-out tasks, establishing cross-task defense reuse independently of multi-source aggregation. To combine source updates, we introduce Source-Norm Transferable Robustness Vector (SN-TRV), which retains the direction of their mean while calibrating its magnitude using source-update norms. The resulting update is applied to the target visual encoder without target adversarial data, target-side gradient optimization, or additional inference modules. Evaluations across three VLA backbones, fixed and adaptive attacks, and different source defense recipes show improved robustness over naive averaging and identify limits in attack coverage. Physical PiPER trials increase average success under printed adversarial patches from 20.3% to 45.8%.

Subjects:

Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

Cite as: arXiv:2611.18702 [cs.RO]

(or arXiv:2611.18702v1 [cs.RO] for this version)

https://doi.org/10.48550/arXiv.2611.18702

arXiv-issued DOI via DataCite (pending registration)

Submission history

From: Jinquan Zhang [view email] [v1] Fri, 6 Nov 2026 06:24:41 UTC (1,124 KB)

Full-text links:

Access Paper:

View a PDF of the paper titled Robustness as a Transferable Skill: Cross-Task Adversarial Defense for Vision-Language-Action Policies, by Jinquan Zhang and 6 other authors

View PDF

HTML (experimental)

TeX Source

view license

Additional Features

Audio Summary

Current browse context:

cs.RO

new | recent | 2026-11

Change to browse by:

cs cs.CV

References & Citations

SciX

Google Scholar

Semantic Scholar

Loading...

Data provided by:

Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author

Venue

Institution

Topic

About arXivLabs

arXivLabs: experimental projects with community collaborators

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.

Which authors of this paper are endorsers? | Disable MathJax (What is MathJax?)

Key points and analysis

Article intelligence

InvestorsAdvanced

Key points

  • A single source defense update already improves robustness on held-out tasks, establishing cross-task defense reuse
  • SN-TRV keeps the direction of the source-update mean while calibrating magnitude with source-update norms
  • It improves on naive averaging across three VLA backbones under fixed and adaptive attacks, and identifies limits in attack coverage
  • Physical PiPER trials raise average success under printed adversarial patches from 20.3% to 45.8%

Highlights and analysis are generated automatically and may contain errors. Check the original source.