Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-48560 : Allocate Resources during Daemon Iteration #162

Merged
merged 1 commit into from
Feb 12, 2025

Conversation

tcjennings
Copy link
Contributor

@tcjennings tcjennings commented Jan 29, 2025

feat(allocate): Allocate wms resources at end of daemon iteration

Note: this resource allocation is gated through a feature flag in the application's configuration, so it may be turned off when not needed. For instance, in the presence of an "official" allocateNodes loop for the production user account, this loop may not be required, but if an integration test needs to run as "quickly as possible" then it can be enabled for the duration; or, if running as a non-production account in a Dev environment, the allocation can be enabled for that specific deployment.

@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch 3 times, most recently from 807e3c6 to a1ff78e Compare January 29, 2025 18:16
@tcjennings tcjennings force-pushed the tickets/DM-48099/no_templates branch from 2b8d70c to 9d696be Compare January 29, 2025 18:26
@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch 5 times, most recently from c476b40 to 54e9697 Compare January 30, 2025 14:19
@tcjennings tcjennings marked this pull request as ready for review January 30, 2025 15:15
@tcjennings tcjennings force-pushed the tickets/DM-48099/no_templates branch 4 times, most recently from 791f535 to ddd6efd Compare January 30, 2025 19:51
@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch 2 times, most recently from 81980e4 to 7116838 Compare January 30, 2025 22:18
@tcjennings tcjennings force-pushed the tickets/DM-48099/no_templates branch from ddd6efd to 1397c3f Compare January 30, 2025 22:23
@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch from 7116838 to fc2c0e3 Compare January 30, 2025 22:25
@tcjennings tcjennings force-pushed the tickets/DM-48099/no_templates branch from 1397c3f to d36e6d3 Compare January 31, 2025 15:29
@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch from fc2c0e3 to 336a370 Compare January 31, 2025 15:30
@tcjennings tcjennings force-pushed the tickets/DM-48099/no_templates branch 4 times, most recently from e900a60 to 931a0c3 Compare February 4, 2025 14:44
@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch 6 times, most recently from 9a0cc96 to d8a2179 Compare February 5, 2025 17:28
@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch 3 times, most recently from 5275051 to d9e51e5 Compare February 5, 2025 23:39
@tcjennings tcjennings force-pushed the tickets/DM-48099/no_templates branch from 931a0c3 to b9cdf53 Compare February 6, 2025 14:58
@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch from d9e51e5 to 2d3f8c3 Compare February 6, 2025 14:59
Base automatically changed from tickets/DM-48099/no_templates to tickets/DM-48099/release February 6, 2025 18:10
Copy link

@daues daues left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks like the code will submit the Condor jobs for allocateNodes, chnages approved. i had one comment about the current and future use of "batch_name", though i think we all agreed to kick the can down the road on "subsets of jobs int the queue".

),
"environment": f'"{submission_environment}"',
"initialdir": config.htcondor.working_directory,
"batch_name": config.htcondor.batch_name,
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One question here on the 'batch_name'. it seems to be sent here as an attribute for the condor job, and I am not sure how this would be used. I suspect it could just be a placeholder, as the future. possible intention could be to add --constraint batch_name to the allocateNodes invocation. As is not sure what the job attribute will do.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For now it is for potential bookkeeping as a potential future constraint.

@tcjennings tcjennings force-pushed the tickets/DM-48560/resources branch from 2d3f8c3 to de63992 Compare February 12, 2025 15:48
@tcjennings tcjennings merged commit 81ffaf2 into tickets/DM-48099/release Feb 12, 2025
5 checks passed
@tcjennings tcjennings deleted the tickets/DM-48560/resources branch February 12, 2025 15:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants