Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PR #20332: [ds-fusion] Add runtime support for host calculation of offsets in ds fusion #22576

Merged
merged 1 commit into from
Feb 13, 2025

Conversation

copybara-service[bot]
Copy link

PR #20332: [ds-fusion] Add runtime support for host calculation of offsets in ds fusion

Imported from GitHub PR #20332

This patch adds the support for calculating offset on the host at runtime when the offset depends on the loop induction variable. This is done by extracting the offset computation, the induction variable initialization and the induction variable update as independent computations and they are evaluated on the host at runtime. This avoids device-to-host copy for this fusion in these cases.
Copybara import of the project:

--
5c85fe7 by Shraiysh Vaishay [email protected]:

Add runtime support for host calculation of offsets in ds fusion

This patch adds the support for calculating offset on the host at
runtime when the offset depends on the loop induction variable. This is
done by extracting the offset computation, the induction variable
initialization and the induction variable update as independent
computations and they are evaluated on the host at runtime. This avoids
device-to-host copy for this fusion in these cases.

--
b5573b0 by Shraiysh Vaishay [email protected]:

Addressed comments

--
decde73 by Shraiysh Vaishay [email protected]:

Rebase

--
f98d9dc by Shraiysh Vaishay [email protected]:

Rebase

Merging this change closes #20332

FUTURE_COPYBARA_INTEGRATE_REVIEW=#20332 from shraiysh:ds_fusion_3 f98d9dc

@copybara-service copybara-service bot force-pushed the test_725575581 branch 3 times, most recently from 97857af to e27b97d Compare February 13, 2025 12:30
…fsets in ds fusion

Imported from GitHub PR #20332

This patch adds the support for calculating offset on the host at runtime when the offset depends on the loop induction variable. This is done by extracting the offset computation, the induction variable initialization and the induction variable update as independent computations and they are evaluated on the host at runtime. This avoids device-to-host copy for this fusion in these cases.
Copybara import of the project:

--
5c85fe7 by Shraiysh Vaishay <[email protected]>:

Add runtime support for host calculation of offsets in ds fusion

This patch adds the support for calculating offset on the host at
runtime when the offset depends on the loop induction variable. This is
done by extracting the offset computation, the induction variable
initialization and the induction variable update as independent
computations and they are evaluated on the host at runtime. This avoids
device-to-host copy for this fusion in these cases.

--
b5573b0 by Shraiysh Vaishay <[email protected]>:

Addressed comments

--
decde73 by Shraiysh Vaishay <[email protected]>:

Rebase

--
f98d9dc by Shraiysh Vaishay <[email protected]>:

Rebase

Merging this change closes #20332

COPYBARA_INTEGRATE_REVIEW=#20332 from shraiysh:ds_fusion_3 f98d9dc
PiperOrigin-RevId: 726440397
@copybara-service copybara-service bot merged commit 988e55c into main Feb 13, 2025
1 check passed
@copybara-service copybara-service bot deleted the test_725575581 branch February 13, 2025 13:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant