Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixing mlvm test for presubmits #1216

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

prince-cs
Copy link
Collaborator

No description provided.

@prince-cs
Copy link
Collaborator Author

/gcbrun

2 similar comments
@prince-cs
Copy link
Collaborator Author

/gcbrun

@prince-cs
Copy link
Collaborator Author

/gcbrun

@prince-cs
Copy link
Collaborator Author

I have verified locally, the test is passing for 2.0 debian and ubuntu images.

@prince-cs
Copy link
Collaborator Author

/gcbrun

1 similar comment
@prince-cs
Copy link
Collaborator Author

/gcbrun

@prince-cs prince-cs marked this pull request as ready for review August 9, 2024 13:44
import dask.array as da

import numpy as np

client = Client("localhost:8786")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no. you need to change the environment so that this test passes. You cannot remove the test and claim that you have fixed the test suite.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They were not being used in the script, so thought of removing them.

df['a'] = [0, 1, 2]
df['b'] = [1, 2, 3]
df['c'] = df.a * df.b + 100
dmat = xgboost.DMatrix(df)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you cannot remove the test for xgboost and claim that you are testing xgboost

Copy link
Contributor

@cjac cjac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The tests generally need to be unchanged. Fix the environment so that the tests run.

@@ -147,7 +149,8 @@ def test_mlvm_gpu(self, configuration, dask_runtime, rapids_runtime):
master_accelerator="type=nvidia-tesla-t4",
worker_accelerator="type=nvidia-tesla-t4",
timeout_in_minutes=60,
metadata=metadata)
metadata=metadata,
boot_disk_size="500GB")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it shouldn't be that much. Maybe 80GB or 100GB if you want to be excessively careful. Don't waste half a TB of pd-ssd on this, please.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ack.

import dask.array as da

import numpy as np

cluster = YarnCluster()
client = Client(cluster)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please stop. You can't change the tests unless the API has changed. The tests need to stay the same or may be changed to use more modern API methods if those have changed.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

They were not being used in the script, so thought of removing them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants