Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Allow Passing Model Keyword Arguments Through the parallelize Interface #97

Open
wants to merge 1 commit into
base: develop
Choose a base branch
from
Open

Allow Passing Model Keyword Arguments Through the parallelize Interface #97

wants to merge 1 commit into from

Conversation

Dando18
Copy link

@Dando18 Dando18 commented Sep 17, 2024

Allow passing model keyword arguments through parallelize to AutoConfig.from_pretrained.

This primarily came about because AutoConfig.from_pretrained needs to be passed trust_remote_code=True when a model repo has custom code, otherwise the config loading will fail. This will simply allow passing any custom params to the AutoConfig interface.

@Dando18 Dando18 added enhancement New feature or request ready-for-review labels Sep 17, 2024
@siddharth9820
Copy link
Collaborator

siddharth9820 commented Sep 18, 2024 •
edited
Loading

lgtm. Will run the CI and merge this. Thank you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@siddharth9820 siddharth9820 siddharth9820 approved these changes

Assignees

@Dando18 Dando18

@siddharth9820 siddharth9820

Labels
enhancement New feature or request ready-for-review
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@Dando18 @siddharth9820