Skip to content

Minor: consolidate datafusion_substrait tests into substrait_integration to save builder space and build time #6685 - #6686

Merged
alamb merged 1 commit into
apache:mainfrom
alamb:alamb/consolidate-datafusion-protot
Jun 16, 2023
Merged

alamb merged 1 commit into
apache:mainfrom
alamb:alamb/consolidate-datafusion-protot

Conversation

@alamb

@alamb alamb commented Jun 15, 2023 •

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Part of #6676

Rationale for this change

This is the same pattern applied in #6682

Basically, each test binary has about 125MB of overhead (the size of the datafusion code that is linked in). Thus I estimate this PR to save 2 * ~125 MB of builder space as it reduces the number of test binaries created by 2

What changes are included in this PR?

consolidate repartition test into substrait_integration to save builder space and build time

Are these changes tested?

Yes

Are there any user-facing changes?

no

@github-actions github-actions Bot added the substrait Changes to the substrait crate label Jun 15, 2023
@@ -0,0 +1,697 @@
// Licensed to the Apache Software Foundation (ASF) under one

@alamb alamb Jun 15, 2023 •

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I moved these files and then removed a level of indenting as

#[cfg(test)]
mod tests {

is not necessary for integration tests

. I did not change any of the tests

@waynexia waynexia left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TIL

cargo clean has been my daily job until I bought a new 2T disk 😵‍💫

@alamb
alamb merged commit 31c96a7 into apache:main Jun 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

development-process Related to development process of DataFusion substrait Changes to the substrait crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants