Try to fix parallel docs builds with subdirs#1154
Try to fix parallel docs builds with subdirs#1154jimklimov merged 12 commits intonetworkupstools:masterfrom
Conversation
… we can, so parallel runs do not collide
…l times (mentioned in different list variables)
…L of the main docs dir
…t several times (mentioned in different list variables)" This reverts commit 29ae5a8f6e5524d689ebaf2abdf508528288b010.
…l times (mentioned in different list variables)
…ilt several times (mentioned in different list variables)
…omponent docs" This reverts commit 0b9ac2500ddbc7bd11a639805d43cda9259bfb1f.
…rectory (chunked HTML)
…n up the destination if needed and make the workdir removable if needed (a2x can copy system/EXTRA_DIST resources with their attrs)
… documents, not just the target name
|
TODO: If the different |
|
For a rough benchmark, on a laptop this branch passed Master branch passed seq build in 4m5s at the same timeframe. |
Picks up from #1152 to allow actual parallel builds (and distchecks) with each piece of documentation rolling in a dedicated uniquely named directory while it is being generated. This allows to avoid the conflict of requesting same-named targets from different rules, as well as of a2x using same-named helper files to build different docs, ruling it out on the OS/filesystem level. And to gain parallelism instead of safely evading it with earlier trickery attempts.
Subject also touched in #505 and #418 discussions.