-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DM-48560 : Allocate Resources during Daemon Iteration #162
DM-48560 : Allocate Resources during Daemon Iteration #162
Conversation
807e3c6
to
a1ff78e
Compare
2b8d70c
to
9d696be
Compare
c476b40
to
54e9697
Compare
791f535
to
ddd6efd
Compare
81980e4
to
7116838
Compare
ddd6efd
to
1397c3f
Compare
7116838
to
fc2c0e3
Compare
1397c3f
to
d36e6d3
Compare
fc2c0e3
to
336a370
Compare
e900a60
to
931a0c3
Compare
9a0cc96
to
d8a2179
Compare
5275051
to
d9e51e5
Compare
931a0c3
to
b9cdf53
Compare
d9e51e5
to
2d3f8c3
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It looks like the code will submit the Condor jobs for allocateNodes, chnages approved. i had one comment about the current and future use of "batch_name", though i think we all agreed to kick the can down the road on "subsets of jobs int the queue".
), | ||
"environment": f'"{submission_environment}"', | ||
"initialdir": config.htcondor.working_directory, | ||
"batch_name": config.htcondor.batch_name, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
One question here on the 'batch_name'. it seems to be sent here as an attribute for the condor job, and I am not sure how this would be used. I suspect it could just be a placeholder, as the future. possible intention could be to add --constraint batch_name to the allocateNodes invocation. As is not sure what the job attribute will do.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For now it is for potential bookkeeping as a potential future constraint.
2d3f8c3
to
de63992
Compare
feat(allocate): Allocate wms resources at end of daemon iteration
Note: this resource allocation is gated through a feature flag in the application's configuration, so it may be turned off when not needed. For instance, in the presence of an "official" allocateNodes loop for the production user account, this loop may not be required, but if an integration test needs to run as "quickly as possible" then it can be enabled for the duration; or, if running as a non-production account in a Dev environment, the allocation can be enabled for that specific deployment.