Skip to content

model agnostic vit - tested Qwen, Groot, llama Vision on RTX 5090#4241

Open
micwill755 wants to merge 1 commit intopytorch:mainfrom
micwill755:4108-vit
Open

model agnostic vit - tested Qwen, Groot, llama Vision on RTX 5090#4241
micwill755 wants to merge 1 commit intopytorch:mainfrom
micwill755:4108-vit

Conversation

@micwill755
Copy link
Copy Markdown

Description

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Fixes # (issue)

Type of change

  • Added model agnostic attention vit - tested with GROOT, Qwen and Llama Vision

@meta-cla meta-cla Bot added the cla signed label May 8, 2026
Copy link
Copy Markdown
Collaborator

@narendasan narendasan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we able to use: https://huggingface.co/docs/transformers/v5.5.0/en/serialization#exporting-to-production to avoid as much patching on the model side?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants