0
0
mirror of https://github.com/mongodb/mongo.git synced 2024-12-01 09:32:32 +01:00
Commit Graph

294 Commits

Author SHA1 Message Date
Mathew Robinson
abcbc1ea9d SERVER-46129 Ignore things that aren't builders when hooking into emitters for the ninja file 2020-02-27 16:47:42 +00:00
Ben Caimano
3aea7a5bc1 Revert "SERVER-45785 Make PREFIX, PREFIX_*DIR, and DESTDIR work more like regular SCons expansions"
This reverts commit eae0b5ee0d.
2020-02-24 22:37:41 +00:00
Andrew Morrow
59454c2b2c SERVER-46210 Ensure archives of dynamic builds include all required dependencies 2020-02-24 21:33:46 +00:00
Mathew Robinson
551ae2747b SERVER-40943 Define a variables file to build with brew llvm and the remote v3 clang 2020-02-24 19:53:44 +00:00
Mathew Robinson
eae0b5ee0d SERVER-45785 Make PREFIX, PREFIX_*DIR, and DESTDIR work more like regular SCons expansions 2020-02-24 19:41:01 +00:00
Mathew Robinson
60aed37d90 SERVER-46129 Make ninja faster and contain all targets all the time 2020-02-22 02:23:40 +00:00
Mathew Robinson
0e079be3b4 SERVER-40943 Support fetching icecream toolchain tarballs from URLs in SCons 2020-02-21 20:41:38 +00:00
Mathew Robinson
9791eb19d2 SERVER-46096 Add NINJA_PREFIX 2020-02-21 19:34:45 +00:00
Mathew Robinson
dbba9fcb5c SERVER-46282 Do A/B releases of Ninja 2020-02-21 19:08:36 +00:00
Henrik Edin
7a91c2823d SERVER-45138 Add MONGO_CONFIG_JSON_LOG_DEFAULT define to use JSON logs by default 2020-02-14 23:22:38 +00:00
Mathew Robinson
1c69f63fe4 SERVER-46136 Ninja should not use environment variables for response file rules on Windows 2020-02-14 15:57:50 +00:00
Mathew Robinson
6df40e01f7 SERVER-46134 SCons does not respect CCACHE settings 2020-02-13 18:01:07 +00:00
Mathew Robinson
12b63497b8 SERVER-45301 Not all expected aliases are present in the ninja generator output 2020-02-13 15:21:41 +00:00
Mathew Robinson
f31bc89f66 SERVER-45048 Use hygienic builds in Evergreen 2020-02-13 15:21:41 +00:00
Ian Boros
f51b997ba1 SERVER-46047 fix compiledb ninja target 2020-02-10 17:45:57 +00:00
Mathew Robinson
6017618f1a SERVER-46035 Disable embedManifest*Check on Windows for Ninja 2020-02-10 16:03:40 +00:00
Andrew Morrow
01074b4518 SERVER-46021 Improve Ninja generator escaping for origin processing 2020-02-07 16:33:45 +00:00
Mathew Robinson
b70432be43 SERVER-40943 Fix typo in ninja rule mappings 2020-02-05 22:17:38 +00:00
Mathew Robinson
ffb5317f9e SERVER-45824 Only allow one output for rspfile ninja rules 2020-02-04 21:08:51 +00:00
Henrik Edin
2b5356ef52 SERVER-45946 Suppress "1 file(s) copied." spam when using ninja on Windows 2020-02-04 18:16:39 +00:00
Mathew Robinson
e69c698233 SERVER-45824 Use Ninja's response files instead of hard coding them into the generated file 2020-02-04 16:54:48 +00:00
Mathew Robinson
fc200fe8df Revert "SERVER-45824 Use Ninja's response files instead of hard coding them into the generated file"
This reverts commit 4dfbe1988c.
2020-01-31 22:37:45 +00:00
Mathew Robinson
e1774c067b Revert "SERVER-45302 Only write Ninja file if the contents have changed"
This reverts commit 66c7d6485f.
2020-01-31 22:37:45 +00:00
Mathew Robinson
66c7d6485f SERVER-45302 Only write Ninja file if the contents have changed 2020-01-31 17:07:09 +00:00
Mathew Robinson
4dfbe1988c SERVER-45824 Use Ninja's response files instead of hard coding them into the generated file 2020-01-31 17:07:09 +00:00
Mathew Robinson
5935ff7832 SERVER-45479 Teach ninja how to build test lists 2020-01-30 15:16:40 +00:00
Mathew Robinson
38aee4fa7d SERVER-45727 Do not discard outputs 2020-01-25 03:21:36 +00:00
Mathew Robinson
e4f034d162 SERVER-45727 Only pass down environment variables that matter to Ninja 2020-01-24 20:36:24 +00:00
Mathew Robinson
d4970df851 SERVER-45724 Make new generator as fast as old module 2020-01-24 16:08:37 +00:00
Mathew Robinson
d1c3869041 SERVER-45682 Correct Ninja compiledb, improve performance 2020-01-22 18:30:42 +00:00
Mathew Robinson
d436c1ef26 SERVER-45041 Remove extraneous calls to env.Entry in libdeps.py 2020-01-17 20:53:55 +00:00
Mathew Robinson
02f3b3a204 SERVER-42702 $PYTHON should not be used in build signature 2020-01-16 23:04:43 +00:00
Mathew Robinson
a46da9f6b3 SERVER-44947 Wire test execution targets into Ninja generator 2020-01-13 23:18:59 +00:00
Mathew Robinson
91b99094e0 SERVER-45134 Generate compile database with Ninja 2020-01-10 17:34:08 +00:00
Mathew Robinson
af8105297a SERVER-44947 Make test lists depend on the tests 2020-01-09 19:46:46 +00:00
Mathew Robinson
16207c4fa7 SERVER-44947 Allow test execution selection by test source file name 2020-01-07 18:48:42 +00:00
Mathew Robinson
ae1bfe7026 SERVER-45379 Add pools in self.pools during generation 2020-01-07 17:05:50 +00:00
Mathew Robinson
d5da349ff1 SERVER-45379 Don't regenerate ninja immediately after generating 2020-01-07 15:50:42 +00:00
Mathew Robinson
77fd09b418 Revert "SERVER-44947 Allow test execution selection by test source file name" 2020-01-06 19:53:40 +00:00
Mathew Robinson
3842544b5e SERVER-45337 Speed up libdeps subst performance 2020-01-06 17:22:37 +00:00
Mathew Robinson
7099b048c2 SERVER-44947 Allow test execution selection by test source file name 2020-01-06 17:03:45 +00:00
Andrew Morrow
00a41363a7 SERVER-45171 Improve handling of transitive dependencies in hygienic 2020-01-03 17:53:50 +00:00
Andrew Morrow
01fc07d7e0 SERVER-44768 Make ccache work right with icecream and Ninja 2019-12-26 20:49:40 +00:00
Mathew Robinson
b1c0455f82 SERVER-45165 Support env['ENV'] in Ninja generator 2019-12-20 14:17:36 +00:00
Andrew Morrow
1cace75040 SERVER-45130 Make icecc tool resilient to ninja tool 2019-12-17 20:09:33 +00:00
Mathew Robinson
5660c43032 SERVER-45197 Ninja builder creates invalid file when SCons split dwarf emitter is enabled 2019-12-17 19:57:47 +00:00
Mathew Robinson
df561affc6 SERVER-45169 Ninja always sees wiredtiger_ext.h as out of date on Windows 2019-12-17 16:53:40 +00:00
Mathew Robinson
3da6513067 SERVER-44729 Remove unnecessary stats during Ninja generation 2019-12-11 21:08:41 +00:00
Mathew Robinson
53de62cc12 SERVER-44970 Remove noop_action from site_scons/site_tools/libtool.py 2019-12-11 20:54:37 +00:00
Mathew Robinson
98c07f8d4c SERVER-45005 Make the ninja tool able to be loaded uncondtionally 2019-12-11 20:04:42 +00:00
Mathew Robinson
577ea7fccd SERVER-44729 Remove unneeded WhereIs IO from ninja generator 2019-12-10 18:26:43 +00:00
Mathew Robinson
b541f873fe SERVER-45005 Correct an indentation bug causing an undefined reference 2019-12-10 18:03:48 +00:00
Mathew Robinson
3dab501342 SERVER-45005 The generated ninja file deletes response files after first use 2019-12-09 20:12:47 +00:00
Mathew Robinson
6b013542da SERVER-44767 Make depfile support more robust and configurable 2019-12-09 19:38:43 +00:00
Mathew Robinson
d8acb38f17 SERVER-44767 Add depfile support to new Ninja generator 2019-12-08 01:59:50 +00:00
Andrew Morrow
7c428b6fba SERVER-44557 Set the default for MSVC_VERSION to VS2017 2019-12-08 01:30:07 +00:00
Mathew Robinson
79c90bc555 SERVER-44728 Improve performance of idl_scanner 2019-12-04 15:00:54 +00:00
Mathew Robinson
a3dc86799f SERVER-44907 NINJA_SUFFIX should prepend a dot if one is not supplied 2019-12-03 16:23:53 +00:00
Mathew Robinson
542479adb8 SERVER-42408 Ensure hygienic builds work with Ninja 2019-11-19 17:19:15 +00:00
Mathew Robinson
ba9a82eab1 SERVER-44364 2019-11-06 17:39:43 +00:00
Andrew Morrow
2f4e03bbca SERVER-43730 Small build system speed improvements
These should speed up all SCons startup tasks for both
vanilla SCons and Ninja generation
2019-10-14 22:46:31 +00:00
Andrew Morrow
0682563bfb SERVER-43368 Revert SCons icecream integration to working state
This reverts the following commits:
- 166a5d78c1
- f659b76958
2019-10-11 20:39:56 +00:00
Andrew Morrow
54d1ab6130 SERVER-42887 Make roles injectible instead 2019-09-16 19:21:02 +00:00
Mathew Robinson
9672002569 SERVER-41972 Integrate mongo_benchmark.py with Hygienic 2019-09-10 14:12:25 +00:00
Mathew Robinson
d4480b9441 SERVER-41973 Integrate mongo_libfuzzer.py with Hygienic 2019-09-10 13:48:09 +00:00
ADAM Martin
6b5aab0f57 SERVER-43047 Make "registered" unit tests also run by @ prefix. 2019-08-29 23:36:23 +00:00
Andrew Morrow
b4c3df15c7 SERVER-42891 Placate SCons configure subsystem regarding status of dSYM nodes 2019-08-28 14:47:30 +00:00
Mathew Robinson
171118e6ac SERVER-42944 Update compilation_db decider to new signature 2019-08-22 15:56:34 -04:00
Andrew Morrow
c2ac6fb3c0 SERVER-42887 Ensure PDBs remain in the runtime component on windows 2019-08-22 19:12:25 +00:00
Mathew Robinson
313c4e1220 SERVER-42656 Add scons targets for building and executing unittests 2019-08-20 15:00:07 -04:00
Mathew Robinson
14c0c00284
Revert "SERVER-42656 Add scons targets for building and executing unittests"
This reverts commit feba925e50.
2019-08-19 08:55:57 -04:00
Mathew Robinson
feba925e50
SERVER-42656 Add scons targets for building and executing unittests 2019-08-19 08:11:13 -04:00
Mathew Robinson
166a5d78c1
SERVER-42664 Correct usage of ICECC_VERSION 2019-08-16 16:05:24 -04:00
Andrew Morrow
0fc03d1fc9 SERVER-41672 Use hygienic to produce dist and distsrc archives in evergreen 2019-08-15 14:08:32 +00:00
Mathew Robinson
b73a7d6ab9
SERVER-42319 Improve performance of Archive Builder 2019-08-14 16:24:55 -04:00
Andrew Morrow
06a2692de5 SERVER-41672 Minor AIB fixes for transitive libraries and debug info directory expansion 2019-08-13 22:05:34 +00:00
Mathew Robinson
780afd77ba
SERVER-41670 Add support for renaming awkward autogenerated package names via an aliasing description 2019-08-12 15:52:46 -04:00
Mathew Robinson
a13bd1716f
SERVER-41669 Add support for package name prefix to apply to generated package names 2019-08-12 15:52:46 -04:00
Mathew Robinson
7a3751d58c
SERVER-42048 Install and package jstests using SCons hygienic builds 2019-08-12 15:52:46 -04:00
Mathew Robinson
d41e5d199d
SERVER-41663 Make hygienic variable names match autoconf 2019-08-12 15:52:46 -04:00
Mathew Robinson
f659b76958
SERVER-42408 Add build.ninja generation to SCons 2019-08-06 18:06:49 -04:00
Jonathan Reams
0f996060bd
SERVER-42263 Only enable fuzzing tests if libfuzzer is supported by the compiler 2019-07-26 10:23:01 -04:00
Mathew Robinson
d9c06a3b01 SERVER-9668 Use SCons install target tags to identify mapping of targets to install packages. 2019-07-02 13:45:15 -04:00
Roxane
333af6c905 SERVER-41689 Adding Scons support for building with libfuzzer 2019-06-24 11:05:54 -04:00
Andrew Morrow
661588a680 SERVER-41548 Restrict dsymutil to single threaded mode 2019-06-05 16:46:03 -04:00
Mathew Robinson
3b2fb3741d SERVER-40694 Make icecream.py site_tool support Python 3.5 2019-04-24 13:35:40 -04:00
Andrew Morrow
2392f37fec SERVER-40782 Allow specifying explicit ICECC_VERSION on command line 2019-04-24 08:55:35 -04:00
Mathew Robinson
3b94354b60 SERVER-40600 Move encoding kwarg to open call 2019-04-12 10:59:55 -04:00
Mathew Robinson
f4feba485b SERVER-40542 Remove references to pip2 2019-04-10 11:42:47 -04:00
Mathew Robinson
8dd6d47557 SERVER-32295 Support Python 3 2019-04-08 14:08:49 -04:00
Mark Benvenuto
115285a443 SERVER-40002 IDL inline dependencies 2019-03-07 19:38:22 -05:00
Henrik Edin
66430d75e3 SERVER-38176 Compile with /permissive- on MSVC to make the compiler strictly standard conformant. 2019-02-01 17:06:10 -05:00
Mark Benvenuto
9af799a2ea SERVER-38446 idlc.py fails to report errors correct during dependency analysis 2018-12-18 12:19:09 -05:00
Andrew Morrow
6d475fdb5a SERVER-37488 SERVER-37596 Manage debug info and symbol maps info for embedded builds 2018-10-30 13:01:30 -04:00
Andrew Morrow
92b9046433 SERVER-37170 Dont let shared archives become reverse edges for programs 2018-09-21 15:45:39 -04:00
Andrew Morrow
47ab234e91 SERVER-33911 Implement collapsed library builds under a new link model 2018-09-12 16:10:41 -04:00
Andrew Morrow
d175ae80e6 SERVER-36147 Add basic support for targeting emscripten 2018-07-17 15:31:15 -04:00
Andrew Morrow
9e1dd9db4b SERVER-35600 Add support for targeting watchos 2018-06-14 17:54:18 -04:00
Gabriel Russell
31fc16ed8b SERVER-34957 remove unused libdeps_exploring tracking from dagger.py 2018-05-11 16:45:32 -04:00
Andrew Morrow
73a74e4ba3 SERVER-33980 Reduce dependencies for embedded commands 2018-03-29 12:15:39 -04:00
Andrew Morrow
b06203cf7b SERVER-34071 SERVER-34071 Don't assume all executors have targets 2018-03-24 10:32:50 -04:00
Andrew Morrow
82b6d9b431 SERVER-34071 Apply install aliases to other binaries when in hygienic mode 2018-03-23 15:14:36 -04:00
Andrew Morrow
0ebab66992 SERVER-32117 Make embedded builds slimmer 2018-03-15 13:47:14 -04:00
Andrew Morrow
5dfa372b25 SERVER-32117 Minimal hygienic build to support mobile dev 2018-03-06 09:57:57 -05:00
Robert Guo
721846a8b4 SERVER-33203 add benchmark canary tests 2018-03-02 15:56:33 -05:00
Gabriel Russell
b778690717 SERVER-32373 building android targets as TARGET_OS=android 2018-02-15 10:44:29 -05:00
Robert Guo
518d8e0d3c SERVER-33200 add entry point for Benchmark tests 2018-02-14 18:07:21 -05:00
Robert Guo
8d9b68094c SERVER-32785 integrate Google Benchmark with SCons 2018-01-27 11:39:46 -05:00
Mark Benvenuto
86afc6ed82 SERVER-32431 IDL generated code seg faults on s390x 2017-12-27 11:54:14 -05:00
Andrew Morrow
263b5b2cb3 SERVER-30815 Library injections via LIBDEPS_DEPENDENTS should be private
But provide a way to force them public when needed
2017-12-19 10:39:25 -05:00
Mathias Stearn
2680f414b5 SERVER-32130 stop printing arguments in code generation tools 2017-12-08 14:07:07 -05:00
Andrew Morrow
f96e0ef10b SERVER-31800 Disable location information in ABI XML 2017-11-02 16:59:48 -04:00
Andrew Morrow
f1884ccb8b SERVER-30278 SCons icecream integration 2017-10-10 16:11:17 -04:00
Jonathan Reams
8e5e2ece95 SERVER-31222 JSFile source member should not be a reference 2017-09-29 12:06:35 -04:00
tycho garen
9b90669185 SERVER-30815: fix string reprepresentation of libdeps library 2017-09-22 13:31:24 -04:00
Andrew Morrow
7b5a6c25c0 SERVER-30661 Ignore non-truthy libdeps entries 2017-08-17 17:46:04 -04:00
Andrew Morrow
8b2dab9bd3 SERVER-30065 Do libdeps dependency types by section, not tuple 2017-07-08 15:08:24 -04:00
William Deegan
0019d153b9 SERVER-29338 Switch to use Value node instead of Node class in compiledb tool
Also use .write() and .read() methods on same to store entry information

Signed-off-by: Gabriel Russell <gabriel.russell@mongodb.com>
2017-06-23 12:45:55 -04:00
Andrew Morrow
41046adf0e SERVER-27380 Revert "Revert "SERVER-27380 Re-enable the thin archive tool""
This reverts commit b4e14a64d7.
2017-05-25 12:12:50 -04:00
Max Hirschhorn
b4e14a64d7 Revert "SERVER-27380 Re-enable the thin archive tool"
This reverts commit 3e1461b80c.
2017-05-25 08:22:58 -04:00
Andrew Morrow
3e1461b80c SERVER-27380 Re-enable the thin archive tool
This refactors the thin_archive tool to use emitters and scanners
to note that when linking to a thin archive, you must also depend on
the children of that thin archive. Failing to do so is an error,
because a changed .o does not necessarily lead to a different .a,
which would subvert the SCons dependency mechanism.

This also includes a refactoring of the ABILINK tool to use a similar
mechanism, to achieve the opposite effect. For ABILINK, we want to
depend not on the actual .so, but on the hash of its abidw result. We
use emitters, actions, and scanners to produce an associated .abidw
file for each .so we build, and then update the scanner to depend on
the .abidw of our libraries, not the library itself. This allows us to
elide needless relinks.
2017-05-24 23:42:49 -04:00
Andrew Morrow
dab9d2681c SERVER-29220 Default to archive based linking 2017-05-24 23:41:24 -04:00
Andrew Morrow
e40ab076f9 SERVER-29042 Propagate DEVELOPER_DIR when set 2017-05-22 19:19:36 -04:00
Andrew Morrow
d920bb9d9d SERVER-29110 Include IDL compiler output in the generated sources alias 2017-05-17 08:49:07 -04:00
Mark Benvenuto
107b0bdf95 SERVER-29081 Add toBSON to IDL generated classes 2017-05-12 10:34:39 -04:00
Andrew Morrow
fff318ff19 SERVER-29036 The IDL compiler invocation must depend on the IDL compiler sources 2017-05-02 10:30:28 -04:00
Andrew Morrow
955faacc40 SERVER-27320 Enable fine grained application of whole archive extraction 2017-05-01 21:59:29 -04:00
Andrew Morrow
ab0fc1ebb4 SERVER-28888 Ensure scanner stability across rebuilds
Also, a quick fix to eliminate a needless sort, since Node.sources
is expected to be stable across rebuilds, unlike Node.sources_set
2017-04-21 13:33:29 -04:00
Mark Benvenuto
37073e44e9 SERVER-28515 Add import support to IDL 2017-04-20 09:48:31 -04:00
Andrew Morrow
7237623f2d SERVER-28583 Split up mongo_scons_utils.py into site_scons/mongo 2017-04-06 14:31:32 -04:00
Andrew Morrow
865b400e4a SERVER-28583 Move some functions down into site_scons modules 2017-04-06 14:31:32 -04:00
Andrew Morrow
190dcaab71 SERVER-27505 Link libraries in topological order 2017-04-04 18:28:56 -04:00
Mark Benvenuto
2981615366 SERVER-28306 IDL Code Generator 2017-03-29 11:37:08 -04:00
Andrew Morrow
21628d6b23 SERVER-28390 Mark targets as Precious during incremental links 2017-03-21 14:01:15 -04:00
Andrew Morrow
39f71f9f17 SERVER-20540 Add an emitter for .dwo generated by -gsplit-dwarf 2017-03-21 14:00:46 -04:00
Mathias Stearn
7ff63b0de1 SERVER-28325 Clean up dependencies around unit and integration test list files
* The integration_tests alias now depends on the individual tests directly
  rather than the whole directory.
* Both list files now just depend on the list of tests rather than the tests
  themselves.
* The string printed during execution is now evaluated at the right time so
  we don't need to print it separately.
* Fix installing tests to the build/unitests/ directory on windows.
2017-03-20 18:38:42 -04:00
Mathias Stearn
e4c62ca157 SERVER-28324 Generate cpp files containing js strings outside of the scons process
This matches how the other python-generated source files work.
2017-03-20 18:38:42 -04:00
Mathias Stearn
1927810547 SERVER-28099 Use key rather than cmp in libdeps.py sorted_by_str
From the python docs: "In general, the key and reverse conversion processes
are much faster than specifying an equivalent cmp function. This is because
cmp is called multiple times for each list element while key and reverse touch
each element only once."
2017-02-28 11:58:12 -05:00
Gabriel Russell
29ee4e817e SERVER-14605 Make SYSLIBDEPS dependency order stable across SCons invocations 2017-02-01 16:00:23 -05:00
Kasper Laudrup
de7e3c74f1 SERVER-27628 Use the overrided environment when generating compile_command.json
When the compilation_db scons emitter saved compilation database
entried it always used the "global" environment which might not match
the compilation command line actually used to build the target.

That meant that using eg.:

env.Library("foo", ["foo.cpp"], CXXFLAGS=["-Dfoo"])

Would not write the extra "-Dfoo" flag actually used to build the foo
library to the compile_commands.json file.

Instead save the environment used to generate the target and use that
when writing the compile_command.json entry.
2017-01-13 13:40:48 -05:00
Andrew Morrow
ef364240d7 SERVER-27577 Only apply thin_archive handling to StaticLibrary
By default on SCons, the Library and StaticLibrary builders are
the same object, so adding the target_factory to StaticLibrary is
sufficient. If they aren't the same, then even more important
to only modify SaticLibrary, since Library may have been re-purposed
to mean something else. In our case it does mean something different
when using --link-model=dynamic, so this oversight inadvertently changed
the signature calculations for dynamic libaries.

Also includes a drive-by fix to add LoadableModule to the builders
affected by the abilink.py tool, since a LoadableModule is also
a shared library on the platforms where abidw is in play.
2017-01-06 21:59:41 -05:00
Matt Cotter
47653843a0 SERVER-26642 use char arrays instead of str literals for js code 2016-11-17 11:44:59 -05:00
Andrew Morrow
53cd93fb9b SERVER-26473 Implement the git based decider 2016-10-21 13:50:22 -04:00
Andrew Morrow
bdb8bfe3b5 SERVER-26276 Enable thin static linking on binutils platforms 2016-10-10 16:38:53 -04:00
Juggls
6db3c739f6 SERVER-25809 Add Executable Dependency Tracking for Dagger Project 2016-08-25 17:45:31 -04:00
Juggls
3a25e6f73c SERVER-24838: add scons tool for capturing dependency graph 2016-07-29 13:43:09 -04:00
Andrew Morrow
84139e7e34 SERVER-24988 Re-license useful SCons utilities as Apache 2016-07-12 11:23:55 -04:00
Austin Steady
737d557b17 SERVER-24555: make compilation_db compatible with scons 2.4
Signed-off-by: Sam Kleinman <samk@10gen.com>
2016-06-17 17:51:41 -04:00
Andrew Morrow
7d78e7c9ae SERVER-23103 Remove the unit test crutch 2016-06-16 17:54:40 -04:00
Jonathan Reams
e729e9caf7 SERVER-16852 Print buildInfo in version output/allow override of buildInfo 2015-09-04 15:27:03 -04:00