Module cache
REQUIREMENTS
Tuist Module cache provides a powerful way to optimize your build times by caching your modules as binaries (.xcframeworks) and sharing them across different environments. This capability allows you to leverage previously generated binaries, reducing the need for repeated compilation and speeding up the development process.
Warming
Tuist efficiently utilizes hashes for each target in the dependency graph to detect changes. Utilizing this data, it builds and assigns unique identifiers to binaries derived from these targets. At the time of graph generation, Tuist then seamlessly substitutes the original targets with their corresponding binary versions.
This operation, known as "warming," produces binaries for local use or for sharing with teammates and CI environments via Tuist. The process of warming the cache is straightforward and can be initiated with a simple command:
tuist cacheThe command re-uses binaries to speed up the process.
Usage
By default, when Tuist commands necessitate project generation, they automatically substitute dependencies with their binary equivalents from the cache, if available. Additionally, if you specify a list of targets to focus on, Tuist will also replace any dependent targets with their cached binaries, provided they are available. For those who prefer a different approach, there is an option to opt out of this behavior entirely by using a specific flag:
tuist generate # Only dependencies
tuist generate Search # Dependencies + Search dependencies
tuist generate Search Settings # Dependencies, and Search and Settings dependencies
tuist generate --no-binary-cache # No cache at alltuist testWARNING
Binary caching is a feature designed for development workflows such as running the app on a simulator or device, or running tests. It is not intended for release builds. When archiving the app, generate a project with the sources by using the --no-binary-cache flag.
Supported products
Only the following target products are cacheable by Tuist:
- Frameworks (static and dynamic) that don't depend on XCTest
- Bundles
- Swift Macros
We are working on supporting libraries and targets that depend on XCTest.
UPSTREAM DEPENDENCIES
When a target is non-cacheable it makes the upstream targets non-cacheable too. For example, if you have the dependency graph A > B, where A depends on B, if B is non-cacheable, A will also be non-cacheable.
Efficiency
The level of efficiency that can be achieved with binary caching depends strongly on the graph structure. To achieve the best results, we recommend the following:
- Avoid very nested dependency graphs. The shallower the graph, the better.
- Define dependencies with protocol/interface targets instead of implementation ones, and dependency-inject implementations from the top-most targets.
- Split frequently-modified targets into smaller ones whose likelihood of change is lower.
The above suggestions are part of the The Modular Architecture, which we propose as a way to structure your projects to maximize the benefits not only of binary caching but also of Xcode's capabilities.
Recommended setup
We recommend having a CI job that runs in every commit in the main branch to warm the cache. This will ensure the cache always contains binaries for the changes in main so local and CI branch build incrementally upon them.
CACHE WARMING USES BINARIES
The tuist cache command also makes use of the binary cache to speed up the warming.
The following are some examples of common workflows:
A developer starts to work on a new feature
- They create a new branch from
main. - They run
tuist generate. - Tuist pulls the most recent binaries from
mainand generates the project with them.
A developer pushes changes upstream
- The CI pipeline will run
tuist buildortuist testto build or test the project. - The workflow will pull the most recent binaries from
mainand generate the project with them. - It will then build or test the project incrementally.
Troubleshooting
It doesn't use binaries for my targets
Ensure that the hashes are deterministic across environments and runs. This might happen if the project has references to the environment, for example through absolute paths. You can use the diff command to compare the projects generated by two consecutive invocations of tuist generate or across environments or runs.
Also make sure that the target doesn't depend either directly or indirectly on a non-cacheable target.
Missing symbols
When using sources, Xcode's build system, through Derived Data, can resolve dependencies that are not declared explicitly. However, when you rely on the binary cache, dependencies must be declared explicitly; otherwise you'll likely see compilation errors when symbols can't be found. To debug this, we recommend using the tuist inspect implicit-imports command and setting it up in CI to prevent regressions in implicit linking.
