Remap compiler vs non-compiler sources differently (bootstrap side) #141751
+70
−10
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
rustbot
added
the
T-bootstrap
jieyouxu
added
the
A-path-remapping
|
We'll also need in the compiler a different compile-time environment variable, like is currently done for Be aware that both environment variables need to be set when compiling the compiler. |
jieyouxu
changed the title
|
rustbot has assigned @albertlarsan68. Use |
rustbot
added
the
S-waiting-on-review
This comment was marked as resolved.
This comment was marked as resolved.
rustbot
added
S-waiting-on-author
This comment was marked as resolved.
This comment was marked as resolved.
rustbot
added
S-waiting-on-review
- Map compiler sources (corresponding to `rustc-dev` dist component)
with `/rustc-dev/{hash}`.
- Map non-compiler sources (corresponding to `rust-src` dist component
or other non-compiler sources) with `/rustc/{hash}`.
This allows the compiler to have the possibility of opportunistically
reverse the mapping. This is because
- `rust-src` unpacks sources to a path like
`$sysroot/lib/rustlib/src/rust`, whereas
- `rustc-dev` unpacks sources to a path like
`$sysroot/lib/rustlib/rustc-src/rust`
(Notice the `src` vs `rustc-src` difference.)
|
@rustbot ready |
rustbot
added
S-waiting-on-review
|
The changes looks good to me. Thanks you. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See #t-compiler/help > Span pointing to wrong file location (`rustc-dev` component).
The path remapping and unremapping for compiler sources (distributed via
rustc-devdist component) is broken because bootstrap currently remaps all sources unconditionally (if remapping is enabled) to the/rustc/{hash}form. However, therustc-devdist component (compiler sources) andrust-srcdist component (library sources) unpacks differently:rust-srcunpacks sources to a path like$sysroot/lib/rustlib/src/rust, whereasrustc-devunpacks sources to a path like$sysroot/lib/rustlib/rustc-src/rust1,meaning that the compiler need to unremap them differently. But the same remapping means that the compiler has no way to distinguish between compiler and non-compiler (esp. standard library) sources. To remedy this, this PR adopts the approach of:
rustc-devdist component) with/rustc-dev/{hash}(this isRemapScheme::Compiler), andrust-srcdist component or other non-compiler sources) with/rustc/{hash}(this isRemapScheme::NonCompiler).A different remapping allows the compiler to reverse the remapping differently.
This PR implements the bootstrap side. A follow-up compiler-side change is needed to implement the unremapping change to address the reported issue completely.
This PR introduces another env var
CFG_VIRTUAL_RUSTC_DEV_SOURCE_BASE_DIRthat is made available to the compiler when building compiler sources to know what the remap scheme forrustc-dev(RemapScheme::Compiler) is. Compiler sources are built with the compiler remapping scheme.As far as I know, this change should not introduce new regressions, because the compiler source unremapping (through
rustc-dev) is already broken.Footnotes
(Notice the
srcvsrustc-srcdifference.) ↩