2024-11-19
+LocTask.generatedSrcsDir @Internal to avoid depending implicitly on outputs of tasks that sometimes only just make empty dirs with no files.2024-11-15
This repository contains much of Slack\u2019s Android/Kotlin/JVM tooling for Gradle, IntelliJ, CLIs, and more.
This repo is effectively for Slack\u2019s own used but publishes to Maven Central. We develop these in the open to knowledge-share with the community.
As such, we don\u2019t normally accept external PRs, but we welcome your questions in the discussions section of the project!
"},{"location":"#highlights","title":"Highlights","text":""},{"location":"#common-project-configuration","title":"Common project configuration","text":"The foundry.base plugin offers common configuration for all projects implementing it, covering a wide spectrum of Android, Kotlin, and Java configurations.
This includes a whole host of things!
FoundryExtension (see next section).Full docs can be found in the architecture docs.
"},{"location":"#feature-dsl","title":"Feature DSL","text":"To ease use and configuration of common features in projects, we expose a foundry DSL in projects that allows for configuration of these in a semantically easy and boilerplate-free way. This is controlled via FoundryExtension.
foundry {\n features {\n dagger()\n moshi(codegen = true)\n }\n android {\n features {\n robolectric()\n }\n }\n}\nA major benefit of this is that we can intelligently configure features and avoid applying costly plugins like Kapt unless they\u2019re actually needed for a specific feature, such as Java injections in projects using Dagger. Since this is pure code, we can also propagate deprecated behavior by deprecating the corresponding functions in the DSL.
"},{"location":"#platform-plugins","title":"Platform plugins","text":"Platforms.kt contains an implementation that sources a VersionCatalog and applies it to a Gradle platform project. This allows us to effectively treat our versions catalog as a BOM and apply it to all projects in the consuming repo and reduce dependency version stratification.
MacBooks can suffer thermal throttling and result in poor build performance. We built instrumentation for this to capture these and include them in our build scans to better understand their impact. We support both Intel and Apple Silicon macs now and contain this implementation in ThermalsWatcher.kt. This also includes helpful charting APIs for visualizing the data (courtesy of our friends at Square).
Gradle\u2019s built-in property support is limited and has surprising behavior, so we have our own system on top of it that has consistent precedence, local.properties support, project-local gradle.properties, and configuration caching support. Check out PropertyResolver.
DependencyRake.kt contains an extension to the gradle-dependency-analysis-plugin that applies its advice to a project to automatically optimize it and rake dependencies.
As a part of our modularization efforts, we developed a scoring mechanism for modules that we could use as a measure of their \u201cmodularization\u201d. This includes a number of metrics and weighs them in a formula to compute a score. This includes LoC, language mixtures, and build graph centrality. This logic is under the foundry.stats package.
Robolectric uses preinstrumented Android API jars that live on maven central. While it can handle downloading of these automatically, we found this implementation to be brittle and unreliable, so we built our own version of it that handles downloading these into a local .cache directory. This implementation lives in UpdateRobolectricJarsTask.kt and that task is configured to be a dependency of all Test tasks.
We try to simplify and streamline the bootstrap process for both local development and on CI. This involves computing optimized JVM arguments for the Gradle and Kotlin daemons (which differ between CI and local) as well as toe-holds for future customizations. This logic lives in BootstrapTask.kt.
To avoid accidentally checking in any new, unexpected manifest permissions, we have a CheckManifestPermissionsTask that compares the final merged manifest\u2019s permissions to an allow list of known permissions. This is allow list is checked in and expected to be guarded by a CODEOWNERS watch and will fail the build if they differ.
slack {\n android {\n app {\n permissionAllowlist {\n if (name == \"externalRelease\") {\n setAllowlistFile(file(\"permissionsAllowlist.txt\"))\n }\n }\n }\n }\n}\nAGP offers new property-based APIs for computing APK version codes and version names. We use this to compute information from different inputs (CI build number, git state, etc) and control this logic in ApkVersioningPlugin.kt.
Sometimes a dependency update may bring with it a surprise update to a transitive dependency that we also declare. In order to avoid this happening unexpectedly, the CheckDependencyVersionsTask checks that any transitive dependency versions that also correspond to a version declared in our VersionCatalog match the version there. It\u2019s ok if they don\u2019t, but the author just need to update the version in the catalog too to be explicit (or investigate further if it\u2019s an unwanted surprise!).
AGP occasionally contains new or breaking API changes that we want to handle gracefully in early testing. We regularly test against newer preview versions of AGP so we can\u2019t just hardcode in new APIs and expect them to work everywhere. To handle this, we have an AgpHandler interface that can be used to abstract these new APIs in a backward-compatible way. Then we ship implementations of this as different artifacts that are built against different AGP versions. Then, at runtime, we pick the appropriate instance (via service loading) to use for the current AGP version being used in that build.
Detekt is a static analysis tool that we use to check for common issues in our code. We use one global baseline file for baselined issues (when introducing new checks or updates), but Detekt doesn\u2019t currently support this easily. So, we built MergeDetektBaselinesTask to merge all the generated baselines from each subproject into a single global baseline.
There are a ton of miscellaneous tools, utilities, and glue code for Gradle (and various plugins) sprinkled throughout this project.
"},{"location":"#usage-requirements","title":"Usage requirements","text":"SGP expects there to be a libs version catalog.
The following versions are required to be set the above catalog. Their docs can be found in FoundryVersions.kt.
For Android projects, some extra definitions need to be defined
libs.versions.toml librariesgoogle-coreLibraryDesugaring - the core library desugaring libraries to use with L8.gradle.properties propertiesfoundry.compileSdkVersionfoundry.targetSdkVersionfoundry.minSdkVersionThe following plugins are applied by default but can be disabled if you don\u2019t need them.
foundry.auto-apply.test-retryfoundry.test.retry.pluginType property to GE.foundry.auto-apply.spotlessfoundry.auto-apply.detektfoundry.auto-apply.nullawayfoundry.auto-apply.cache-fixThe installCommitHooks task can install commit hooks for formatting kotlin and java files. They expect binaries to be in <root>/config/git/hooks and it\u2019s highly recommended to enable git-lfs for these objects. These binaries can be downloaded via the updateKtfmt, updateGjf, etc tasks.
Copyright 2022 Slack Technologies, LLC\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n2024-11-15
globalCiValidateModuleTopography and ciValidateModuleTopography tasks.mustRunAfter for depending on source gen tasks + add back sqldelight\u2019s schema task as a source-generating task..setContent {.foundry.topography.features.config property.0.65.0.3.18.2.1.32.2.2024-11-13
LocTask depend on source-generating tasks if MODULE_SCORE_INCLUDE_GENERATED is true.2024-11-13
2024-11-12
2024-11-12
moduleTopography task. This is a general task that attempts to validate project configurations by looking for features that are enabled but unused. Currently covers a few core features like kapt, ksp, moshi code gen, dagger/anvil, and viewbinding. Outputs are printed and written to a JSON file. Add --validate-all to make the tasks fail on validation issues.FoundryProperties instance for subproject use.composeRuntimeOnly() DSL feature.Path.walkEachFile().MODULE_SCORE_INCLUDE_GENERATED is false8.11.RakeDependencies task.2.0.0.0.90.3.0.62.2.3.0.1.0.12.2.0.21-1.0.27.2.4.2.1.7.0.2024-10-25
better-gradle-properties artifact, which is our hierarchical Gradle properties solution that better handles properties in Gradle. This is what powers FoundryProperties but is now extracted to be more portable.local.propertiesgradle.propertieslocal.propertiesgradle.propertiesversion-number artifact. This contains a Kotlin, non-deprecated VersionNumber API. This is useful given that Gradle\u2019s is both deprecated and not available in standard JVM projects.foundry.git.hooksPath and foundry.git.ignoreRevsFile properties.SgpArtifact to FoundryArtifact.0.90.2.7.0.0.BETA4.2.0.21-1.0.26.2.2.0.2.1.0.4.1.0.1.7.0.2.0.0-Beta.2024-10-14
2024-10-14
Don\u2019t use this release! We goofed on something.
"},{"location":"changelog/#0200","title":"0.20.0","text":"2024-10-11
"},{"location":"changelog/#project-restructuring","title":"Project Restructuring","text":"We\u2019ve restructured this project! Since its early days as a simple Gradle convention plugin it\u2019s expanded into IntelliJ plugins, CLIs, CI tooling, and more. To better capture this, we\u2019ve renamed the project to Foundry, restructured its artifacts into a more cohesive setup, moved kotlin-cli-util into this repo, and will likely split out some more artifacts down the line.
"},{"location":"changelog/#migration-guide","title":"Migration Guide","text":"slack. or sgp. have now moved to foundry.. slack.gradle. prefix have also removed the gradle. (i.e. slack.gradle.foo would now be foundry.foo).SlackProperties has been renamed to FoundryProperties.There is a helper script you can use to automatically rename all properties in foundry-migration/.
mapping.txtproperty_migration.sh./property_migration.sh mapping.txt <path to target project>.*.kts and *.properties files. This does not cover args passed via CLI or envs.Package names have all aligned to foundry.*. In most cases it should be simple enough to replace import com.slack.* with import foundry.*.
Gradle coordinates group have moved to the com.slack.foundry group name.
The former kotlin-cli-util APIs have moved to the com.slack.foundry:cli artifact.
platforms/ directory.tools/ directory.Slack-prefixed APIs are now prefixed with Foundry.foundry {}, but the previous slack {} entry points are left with deprecation ReplaceWith options.Gradle plugin IDs have migrated to com.slack.foundry.* names.
com.slack.gradle.root com.slack.foundry.root com.slack.gradle.base com.slack.foundry.base com.slack.gradle.apk-versioning com.slack.foundry.apk-versioning Introduce new required foundry.android.defaultNamespacePrefix property for android projects. This is necessary for projects that don\u2019t define an android.namespace explicitly.
FoundryProperties.progressive.5.0.1.6.6.5.4.0.1.2.0.0.0.51.0.3.18.1.2024-09-25
SoftRefLRUPolicyMSPerMB + ReservedCodeCacheSize jvm args to bootstrap3.0.1.33.3.1-jre.8.10.2.2024-09-23
sourceInformation compose options in android projects and default it to true.2024-09-22
slack.allowWarnings property to sgp.kotlin.allowWarnings.sgp.kotlin.allowWarningsInTests property to opt-out.1.9.0.3.9.1.5.0.0.5.15.0.6.6.4.3.0.0.8.6.1.2024-09-12
testFixtures() feature DSL to enableTestFixtures() to disambiguate from Gradle\u2019s methods.sgp.compose.stabilityConfigurationPath property to specify a Compose configuration file path from the root project. It is also now disallowed to specify this via sgp.compose.commonCompilerOptions.2024-09-12
slack { features { testFixtures() } } DSL for enabling test fixtures in a project-agnostic way.slack.location.robolectric-core property optional.KaptGenerateStubsTask.DialectClasspath configurations too.2.0.20-1.0.25.8.6.0.8.10.1.5.1.0.2024-09-03
slack.bootstrap.minGradleXms property to set minimum xms values for daemon memory args.slack.boostrap.minGradleXm* values to kotlin daemon jvm args too.1.0.4.3.7.2.8.6.0.2024-08-27
0.28.0.3.1.9.6.6.3.0.7.2.0.20.1.10.0.2.0.20-1.0.24.8.10.2024-08-12
sgp.kapt.languageVersion property to override the language version used for KAPT.2.0.10.2.0.10-1.0.24.8.5.2.2024-08-04
2024-07-31
0.61.0.6.6.2.1.33.0.2.0.0-1.0.24.2.5.0-beta11.2024-07-19
jvmTarget.0.7.1.1.18.1.5.0.0.0.27.2.8.9.2.0.0-1.0.23.8.5.1.0.7.2024-05-28
sgp.kotlin.languageVersionOverride. Default is null, which will just defer to KGP\u2019s default.sgp.kotlin.optInskotlin.contracts.ExperimentalContracts, kotlin.experimental.ExperimentalTypeInference, kotlin.ExperimentalStdlibApi, kotlin.time.ExperimentalTimesgp.kotlin.freeArgs-Xenhance-type-parameter-types-to-def-not-null, -Xself-upper-bound-inferencesgp.kotlin.jvmFreeArgs-Xjsr305=strict, -Xassertions=jvm, -Xemit-jvm-type-annotations, -Xjvm-default=all, -Xtype-enhancement-improvements-strict-mode, -Xjspecify-annotations=strictsgp.kotlin.progressive. Default is true.8.5.0.1.32.0.1.6.11.0.60.0.33.2.1-jre.0.27.1.2024-05-28
2.0.0.2.0.0-1.0.21.8.4.1.2024-04-30
8.4.0.4.4.0.2024-04-26
retry extension.1.8.1.0.59.0.2024-04-18
2.5.0-beta07.1.12.0.6.6.0.1.31.0.1.6.2.8.3.2.1.9.23-1.0.20.2.0.2.4.9.9.4.3.0.2024-03-28
8.3.1.1.23.6.8.7.2.11.0.0.58.0.4.9.8.33.1.0-jre.2024-03-14
-Xjdk-release on jvm compilations (not android).2024-03-14
2.5.0-beta04.-Xjdk-release option alongside jvmTarget.3.9.0.6.5.0.1.9.23.1.9.23-1.0.19.1.6.1.2024-03-08
2024-03-04
com.android.test in Project.isAndroid checks. This resolves a case where we accidentally set the JavaCompile.options.release property in those projects.2024-02-28
2024-02-28
AnvilMode casing in detection.2024-02-27
6.4.13.sgp.compose.commonCompilerOptions property for common compose compiler options.1.6.0.2024-02-19
-Xproper-ieee754-comparisons arg, as it\u2019s enabled by default and removed entirely in K2.3.8.0.6.4.12.1.8.0.1.30.0.8.3.0-rc01.2024-02-03
TaskCollection.named(Spec) APIs where appropriate.1.15.1.2.6.3.6.4.11.8.2.2.1.9.22.1.9.22-1.0.17.1.23.5.1.5.12.1.29.0.6.25.0.2024-01-11
PropertyResolver to public API.com.slack.gradle:skippy. This also includes a CLI that can be run as an alternative to the gradle task. Note this requires serialized dependency graph and androidTest projects to be pre-computed. THe config must be in a static JSON file. See the docs on ComputeAffectedProjectsCli.Usage: compute-affected-projects-cli [<options>]\n\n Computes affected projects and writes output files to an output directory.\n\nOptions:\n --debug Enable debug logging.\n --merge-outputs Merge outputs from all configs into a single\n /merged dir.\n --config=<path> Path to a config file that contains a mapping of\n tool names to SkippyConfig objects.\n --parallel Compute affected projects in parallel.\n --changed-files=<path> A relative (to the repo root) path to a\n changed_files.txt that contains a\n newline-delimited list of changed files. This is\n usually computed from a GitHub PR's changed files.\n -o, --outputs-dir=<path> Output directory for skippy outputs.\n --root-dir=<path> Root repo directory. Used to compute relative\n paths.\n --dependency-graph=<path> Path to a serialized dependency graph file.\n --android-test-project-paths=<path>\n Path to a file that contains a newline-delimited\n list of project paths that produce androidTest\n APKs.\n -h, --help Show this message and exit\ngenerateDependencyGraph and generateAndroidTestProjects tasks from ComputeAffectedProjectsTask. This allows for more fine-grained caching and parallelization. An example flow of the last two bullets can look like so:
# Generate the dependency graph and androidTest projects\n./gradlew generateDependencyGraph generateAndroidTestProjectPaths\n\n# Run the CLI, such as from a `*.main.kts` file that imports it.\n./skippy-runner.main.kts \\\n --changed-files changed_files.txt \\\n --dependency-graph slack/dependencyGraph/serializedGraph.bin \\\n --android-test-project-paths slack/androidTestProjectPaths/paths.txt \\\n ...\n2024-01-09
2024-01-02
local.properties). Note that this work is ongoing as project isolation is incubating, but the changes in this release should be non-functional in nature.1.9.22.1.9.22-1.0.16.8.2.1.8.3.0-beta01 in AgpHandler83.0.26.0.33.0.0-jre.6.4.10.2.6.0.2023-12-18
compose() DSL function with Action parameter public.2023-12-18
compilerOption() API in Compose DSL for compiler arg configuration.1.28.0 + migrate off deprecated APIs.3.7.0.8.3.0-alpha18.1.9.21-1.0.16.2023-12-12
skippy extension now. These outputs and diagnostics are stored at build/skippy/{tool}/.... Merged outputs can be generated as well to build/skippy/merged. This allows for creating dynamic pipelines based on the outputs of each tool. The global config is always overlaid onto each tool-specific config.skippy {\n debug.set(true)\n mergeOutputs.set(true)\n computeInParallel.set(true)\n global {\n applyDefaults()\n // Glob patterns of files to include in computing\n includePatterns.addAll(\n \"**/*.pro\",\n \"**/src/**/sqldelight/**\",\n )\n excludePatterns.addAll(\".idea/**/*.kt\")\n // Glob patterns of files that, if changed, should result in not skipping anything in the build\n neverSkipPatterns.addAll(\n \".buildkite/**\",\n \".github/actions/**\",\n \"ci/**\",\n \"config/health-score/**\",\n \"tooling/scripts/**\",\n )\n }\n config(\"lint\") {\n includePatterns.addAll(\n // project-local lint.xml files\n // this doesn't fuuuuully work with skippy because these layer like .gitignore does\n \"**/lint.xml\",\n // Lint baselines\n \"**/lint-baseline.xml\",\n )\n neverSkipPatterns.addAll(\n // Global lint config\n \"config/lint/lint.xml\",\n // Houston feature flags, which is an input to our feature flags lints\n \"config/feature-flags/experiments.txt\",\n )\n }\n config(\"detekt\") {\n // Detekt baselines\n includePatterns.add(\"**/detekt-baseline.xml\")\n // Global detekt configs\n neverSkipPatterns.add(\"config/detekt/*\")\n }\n}\n1.9.3.6.06.4.95.14.02.5.48.3.0-alpha17 in AgpHandler 8.3 artifact.1.27.0.2023-12-05
Project.isSyncing public.android.studio.version property for reporting to build scans.4.9.3.3.1.8.1.9.21.1.9.21-1.0.15.0.25.1.8.2.0.2.0.1.1.7.1.1.23.4.0.9.1.2023-11-30
BuildFeatures to build scans as custom values, starting with configuration cache and isolated projects.32.1.3-jre.6.4.8.8.1.4 (main) and 8.3.0-alpha15 (agp handler 8.3).1.5.11.2023-11-21
2023-11-20
SlackExtension.circuit() DSL. This makes it easy to set up Circuit in a project. See the DSL docs for more details. slack {\n features {\n circuit()\n }\n}\nKspTask subtypes of KotlinCompile tasks.autoValue() APIs from SlackExtension.2023-11-10
2023-11-09
Detekt.baseline to null if we don\u2019t specify one, as we don\u2019t want it to fall back to its default location.2023-11-09
8.3.0-alpha13.2023-11-08
slack.detekt.baseline-file-name property to indicate what the simple file name should be. This is evaluated against project.layout.projectDirectory.file(...). This replaces the previous slack.detekt.baseline property.1.9.20.8.1.3.1.5.10.2023-11-02
2023-10-30
null if their property values are blank.2023-10-22
sgp.isTestLibrary property to indicate if a library is a test library. Note that projects that are named test-fixtures are implicitly considered test libraries.VisibleForTests lint on test libraries.2023-10-22
slack.lint.update-baselines property in favor of AGP\u2019s modern updateBaselines task.ImplicitSamInstance lint config.2023-10-19
8.3.0-alpha08.8.4.1.5.3.2023-10-02
slack.gradle.debugVersionCode and defaults to 90009999.slack.gradle.debugUserString and defaults to debug.8.1.0.2023-09-28
allowListFile file property instead.4.9.1.1.5.2.6.4.6.2023-09-22
coreLibraryDesugaring configuration.compilerOptions.moduleName to a dashified version of the Gradle project path.0.24.32.4.8.1.5.1.1.22.0.1.6.1.2023-08-29
2023-08-29
sgp-tracing artifact ID. We use this internally to collect extra build metadata, but it\u2019s generic enough for general use. Not currently used in slack-plugin yet.sgp.android.buildToolsVersionOverride property to override the default build tools version in Android.AndroidPluginVersion API in AgpHandler.8.1.1.6.21.0.1.5.0.1.9.10.1.9.10-1.0.13.3.1.7.2.2.1.6.4.5.4.8.11.21.0.8.3.2023-08-15
com.android.test projects in a few waysProject.buildDir API usages.kotlin-cli-util to 2.1.0.2023-08-10
This streamlines configuration of enabling androidResources and enforces use of a resource prefix to avoid conflicts.
May your avatars never be wrongly sized again.
slack {\n android {\n features {\n resources(\"prefix_\")\n }\n }\n}\n2.0.0.1.15.0.0.4.1.9.0-1.0.13.3.5.0.0.5.0.2023-08-08
32.1.2-jre.2023-08-08
slack.gradle.defaultVersionCode). The default is 90009999, for reasons.2023-08-07
{rootProject}/build/ci/release.version. The default behavior will be to just use the version set in the android DSL.1.23.1.3.14.1.1.4.3.2.0.0.2.4.7.2023-07-25
1.9.0.1.9.0-1.0.12.8.1.0.1.2.3.0.24.0.1.5.0.4.8.0.2023-07-12
slack.dependencyrake.dryRun gradle property flag for dependency rake to enable dry-run. If enabled, the project build files will not be modified and a separate new-build.gradle.kts file will be written to instead.3.4.0.2023-07-07
RakeDependencies task on platform projects../gradlew aggregateMissingIdentifiers -Pslack.gradle.config.enableAnalysisPlugin=true --no-configuration-cache2023-06-30
DependencyRake.32.1.0-jre.2023-06-29
kotlin-cli-util to 1.2.2.2023-06-25
2023-06-24
2023-06-24
2023-06-24
sgp.compose.multiplatform.forceAndroidXComposeCompiler Gradle property flag to force use of the AndroidX compose compiler in Compose Multiplatform projects.sgp.config.jvmVendor.optOut Gradle property flag to disable jvmVendor configuration in toolchains.2023-06-06
2023-06-06
robolectric key in the primary version catalog.sgp.config.jvmVendor property.4.7.0.2.4.6.8.0.2.1.23.0.2023-05-15
slack DSL.2023-05-15
2023-05-09
disallowChanges() on javaCompiler in JavaCompile tasks. It seems that Gradle sets this multiple times.2023-05-09
disallowChanges() where possible on properties SGP controls in order to avoid accidental overwrites.ComputeAffectedProjectsTask also generate a affected_android_test_projects.txt file with a newline-delimited list of affected projects that enable androidTest(). This can be used in CI scripts to statically determine if instrumentation tests need to run.2023-05-06
SlackVersions. See SlackVersions.kt for updated expected naming of aliases.2023-05-05
jdk.compiler/com.sun.tools.javac.model to Bootstrap Gradle JVM args and exec prefixes for binaries for GJF 17.2023-05-05
2023-05-04
Happy May the Fourth!
sgp.config.jvmVendor property to control the JVM vendor used in Kotlin and Java toolchains. This value is used to match a known vendor spec, such as AZUL.afterEvaluate block to avoid https://github.com/Kotlin/kotlinx-kover/issues/362.2023-04-30
OkHttpClient setup in SlackTools.slack.features.dagger DSL controls. There are two new properties to control this:slack.ksp.allow-dagger \u2013 allow use of Dagger in KSP.slack.ksp.allow-anvil \u2013 allow use of Anvil in KSP. Note this is not yet implemented in Anvil, just a toe-hold for the future.SlackToolsExtension instances + fix classloader used for it.SlackToolsExtension extensions that fail to load.2023-04-25
Context to SlackToolsExtension.2023-04-25
SlackTools.findExtension API.SlackTools.SERVICE_NAME for @ServiceReference API.2023-04-25
moshi-kotlin, only use generated adapters now.sgp.ge.apply-common-build-tags property flag to gate applying common build tags to a project.SlackToolsExtension to work as a ServiceLoader instead.2023-04-23
SlackTools because this apparently invalidates configuration cache every time.2023-04-22
class for SAM conversions due to https://github.com/gradle/gradle/issues/24871.2023-04-22
SlackTools and support enabling property at different scopes (local.properties, etc).SlackTools is closed.class for SAM conversions. The minimum supported Gradle version is now 8.1, which introduced support for this.2023-04-22
2023-04-22
SlackTools instances when reporting background data to Gradle Enterprise. These instances would be orphaned because this would happen after Gradle had closed all existing services, and create a memory leak.SlackTools instances.Executor for SlackTools\u2019 thermals heartbeat.2023-04-22
Throwable with multiple instances of SlackTools to help track origin points.2023-04-22
SlackTools to track multiple instances.2023-04-15
ValueSource for Gradle 8.x compatibility.PLATFORM_NATIVE in spotless by default. Its default of looking at .gitattributes is expensive and incompatible with Gradle 8.1+ configuration caching.slack.auto-apply.sort-dependencies boolean Gradle property to gate auto-applying the sort-dependencies plugin.2023-04-01
Happy April Fool\u2019s Day!
2023-03-28
detekt task dependencies for globalDetekt.2023-03-27
slack.detekt.full property to gate whether or to run full detekt (i.e. with type resolution). If disabled, detektRelease/detektMain and associated tasks will be disabled and not used in detektGlobal.2023-03-25
DetektCreateBaselineTask tasks too due to https://github.com/detekt/detekt/issues/5940.2023-03-24
slack.avoidance.build-upon-default-affected-project-configurations flag to make provided configurations build upon defaults.globalDetekt task that runs detekt on all subprojects. This is Skippy-compatible and responds to slack.avoidance.affectedProjectsFile.2023-03-22
androidExtension publicly in SlackExtension to avoid Gradle mismatching number of type arguments in AGP 8.1.0-alpha10+.2023-03-22
Detekt.jdkHome to null to avoid https://github.com/detekt/detekt/issues/5925.String.safeCapitalize() to String.capitalizeUS() to make it more explicit.2023-03-21
-Pslack.compose.android.enableLiveLiterals=true..github/actions/** to default never skip filters.2023-03-20
affected_projects.txt and allow non-existent files as a value. This makes it easy to gracefully fall back in CI.6.4.1.2023-03-17
"},{"location":"changelog/#project-skippy","title":"Project Skippy","text":"This release introduces an experimental new computeAffectedProjects task for computing affected projects based on an input of changed files. The goal of this is to statically detect which unit test, lint, and androidTest checks can be safely skipped in CI on pull requests.
Example usage
./gradlew computeAffectedProjects --changed-files changed_files.txt\nWhere changed_files.txt is resolved against the root repo directory and contains a newline-delimited list of changed files (usually inferred from a PR).
A simple example of how to produce such a file with the gh CLI:
gh pr view ${{ github.event.number }} --json files -q '.files[].path' > changed_files.txt\nOne would run this task first as a preflight task, then run subsequent builds with the slack.avoidance.affectedProjectsFile Gradle property pointing to its output file location (printed at the end of the task).
./gradlew ... -Pslack.avoidance.affectedProjectsFile=/Users/zacsweers/dev/slack/slack-android-ng/build/skippy/affected_projects.txt\nThe globalCiLint, globalCiUnitTest, and aggregateAndroidTestApks tasks all support reading this property and will avoid adding dependencies on tasks in projects that are not present in this set.
The ComputeAffectedProjectsTask task has some sensible defaults, but can be configured further in the root projects like so.
tasks.named<ComputeAffectedProjectsTask>(\"computeAffectedProjects\") {\n // Glob patterns of files to include in computing\n includePatterns.addAll(\n \"**/*.kt\",\n \"**/*.java\",\n )\n // Glob patterns of files that, if changed, should result in not skipping anything in the build\n neverSkipPatterns.addAll(\n \"**/*.versions.toml\",\n \"gradle/wrapper/**\",\n )\n}\nDebug logging can be enabled via the slack.debug=true Gradle property. This will output timings, logs, and diagnostics for the task.
The configurations used to determine the build graph can be customized via comma-separated list to the slack.avoidance.affected-project-configurations property.
2023-03-15
Happy Ted Lasso season 3 premier day!
UseContainerSupport jvm arg from unit tests as this appears to only work on Linux.2023-03-14
Happy Pi day!
Test tasks are now configured more consistently across CI and local, so there should be more cache hits.globalCiUnitTest task to the root project to ease running ciUnitTest tasks across all subprojects.SlackProperties for controlling max parallelism and forkEvery options in Test tasks.ciLint task to every project that depends on all lint tasks in that project. This is intended to be the inverse behavior of the built-in lint task in Android projects, which only runs the default variant\u2019s lint task.globalCiLint task to the root project to ease running ciLint tasks across all subprojects.SlackProperties for controlling which variants should be linted.lint.xml is the right place for this kind of logic.2023-03-07
slack.lint.severity.errorRuleIds Gradle property to specify lint rule IDs that should always be error severity.2023-02-27
2023-02-20
checkDependencies is no longer enabled by default.slack.lint.baseline-file-name property. Defaults to lint-baseline.xml.ImplicitSamInstance lint not being enabled.2023-02-15
MergeFileTask.kt was accidentally removed during a previous release.jna-platform dependency to align with the jna dependency version.2023-02-15
Do not use! Release was accidentally messed up.
"},{"location":"changelog/#055","title":"0.5.5","text":"2023-02-13
LocTask is now compatible with Gradle 8.0 and has the correct task dependencies when Ksp, Kapt, etc are running.LocTask is now compatible with remote build cache.KtfmtDownloadTask, DetektDownloadTask, etc) now have prettier and more reliable download progress indications.UpdateRobolectricJarsTask now uses Gradle workers to parallelize downloads. On gigabit wifi, this takes the task runtime down from ~21sec to ~13sec.SLACK_FORCE_REDOWNLOAD_ROBOLECTRIC_JARS env variable can be used to force UpdateRobolectricJarsTask to redownload jars even if already downloaded. Behavior change: Mod score must now be opted in to via the slack.gradle.config.modscore.enabled=true gradle property.slack.gradle.config.modscore.ignore=true gradle property.2023-02-07
sortDependencies toml version is present, and you can have it download+create executable binaries via ./gradlew downloadDependenciesSorter.compose() DSL is moved to slack.features and offers an optional multiplatform parameter to enable the compose multiplatform plugin. slack {\n features {\n compose(multiplatform = <true|false>)\n }\n}\n1.8.10 and AGP 7.4.1.2023-01-27
MergeFilesTask monkeypatch using env vars instead of system props.2023-01-26
MergeFilesTask monkeypatch plus extra logging. Feel free to skip this update if you\u2019re unaffected.2023-01-23
Optional for google-coreLibraryDesugaring dependency before adding it. The Gradle API\u2019s lack of type safety strikes again.2023-01-23
sgp-monkeypatch-agp artifact. This contains monkeypatches for AGP where we try to fix bugs. This initial version contains a patched MergeFilesTask that sorts files before merging them to ensure deterministic outputs, as we believe this is causing our lint tasks to be non-cacheable across machines. This can be enabled via setting the com.slack.sgp.sort-merge-files system property to true.slack.gradle.config.bugsnag.enabled gradle property to true.slack.gradle.config.bugsnag.enabledBranchPattern gradle property. For example: slack.gradle.config.bugsnag.enabledBranchPattern=main|release_.*.libs.versions.toml instead of assuming the artifact name. Starting with 1.2.0, desugar JDK libs offers multiple artifacts. Point google-coreLibraryDesugaring in [libraries] to whichever artifact should be used.2023-01-13
2023-01-09
Happy new year!
3.3.0.2022-12-29
compilerOptions API now.2022-12-22
2022-12-19
2022-12-15
android.packagingOptions.jniLibs.pickFirst for AGP 8.x compatibility, as the returned type by jniLibs changed from JniLibsPackagingOptions to JniLibsPackaging.2022-12-06
compileCiUnitTest lifecycle task to just compile (but not run!) unit tests that are run by ciUnitTest.2022-12-04
isIncludeAndroidResources in Android unit tests automatically when robolectric() is used.2022-11-11
2022-11-10
AndroidManifest.xml files in androidTest sources + ensure they\u2019re debuggable.2022-10-20
**/build/** from Detekt tasks.2022-10-14
com.android.test projects.org.jetbrains.compose) projects.me.tongfei:progressbar to 0.9.5.2022-10-06
2022-10-03
2022-10-03
--add-opens to Test tasks for Robolectric 4.9+ when it\u2019s enabled.subprojects module stats and allprojects in bootstrap for better project isolation support.2022-09-27
androidTest(allowedVariants = ...) wasn\u2019t running on com.android.application projects.Lint DSL block for com.android.library and org.jetbrains.kotlin.jvm projects too.2022-09-23
slack {\n android {\n features {\n androidTest(allowedVariants = setOf(\"internalDebug\"))\n }\n }\n}\n2022-09-20
2022-09-08
slack.unit-test plugin application.2022-09-07
Instantiatable lint in min SDK 28+ due to lint bug.Diversity and inclusion make our community strong. We encourage participation from the most varied and diverse backgrounds possible and want to be very clear about where we stand.
Our goal is to maintain a safe, helpful and friendly community for everyone, regardless of experience, gender identity and expression, sexual orientation, disability, personal appearance, body size, race, ethnicity, age, religion, nationality, or other defining characteristic.
This code and related procedures also apply to unacceptable behavior occurring outside the scope of community activities, in all community venues (online and in-person) as well as in all one-on-one communications, and anywhere such behavior has the potential to adversely affect the safety and well-being of community members.
For more information on our code of conduct, please visit https://slackhq.github.io/code-of-conduct
"},{"location":"contributing/","title":"Contributors Guide","text":"Note that this project is considered READ-ONLY. You are welcome to discuss or ask questions in the discussions section of the repo, but we do not normally accept external contributions without prior discussion.
"},{"location":"contributing/#development","title":"Development","text":"Check out this repo with Android Studio or IntelliJ. It\u2019s a standard gradle project and conventional to check out.
The primary project is slack-plugin.
Kotlin should be used for more idiomatic use with Gradle/AGP APIs
Code formatting is checked via Spotless. To run the formatter, use the spotlessApply command.
./gradlew spotlessApply\nOptionally, there are commit hooks in the repo you can enable by running the below
git config core.hooksPath config/git/hooks\nFoundry contains three Gradle plugins and some associated helper artifacts.
"},{"location":"platforms/gradle/architecture/#foundryrootplugin","title":"FoundryRootPlugin","text":"This is the root plugin that is applied to the root project of a multi-project build.
plugins {\n id(\"foundry.root\")\n}\nIts responsibilities include:
FoundryTools build service.libs.versions.toml.FoundryBasePlugin","text":"This is the base plugin that is applied to all projects (including the root project).
plugins {\n id(\"foundry.base\")\n}\nIts responsibilities include:
StandardProjectConfigurations.UnitTests. This also includes configuring the Gradle test retry plugin, if enabled.StandardProjectConfigurations","text":"This class warrants special mention as it is responsible for the bulk of the configuration applied to projects SGP manages.
foundry extension DSL.All JVM projects (Android, Java, Kotlin) receive some common configuration for their JVM tasks.
"},{"location":"platforms/gradle/architecture/#common","title":"Common","text":"DependencyRake.StandardProjectConfigurations.configureAnnotationProcessors() and StandardProjectConfigurations.APT_OPTION_CONFIGS, which seeks to apply common configs for known processors like Dagger and Moshi.Java projects are fairly simple. Note that these are applied on all projects that apply the java plugin, which is most of them!
JavaCompile tasks have their options.release property set to this as well.JavaCompile tasks in non-android projects to ensure consistency.JavaCompile tasks have -parameters added to options.compilerArgs for better static analysis and annotation processing support.foundry.epAutoPatch property.compileOptions, defaultConfig, compileSdk/targetSdk/minSdk/ndkVersion, etc.vectorDrawables.useSupportLibrary.testOptions like orchestrator, unitTests, etc.unitTests.isReturnDefaultValues is always enabled for convenience.unitTests.isIncludeAndroidResources is only enabled if robolectric is enabled on the project, as this is expensive to enable.Test tasks to depend on the UpdateRobolectricJarsTask if robolectric is enabled.com.android.library and com.android.application projects. com.android.test is supported but somewhat limited.jniLibs handling.PermissionChecks.android.namespace, if none is manually specified in the buildscript. The namespace is inferred from the project\u2019s Gradle path.release.Kotlin projects are configured with KGP and Detekt in mind. SGP supports configuring Android, JVM, Multiplatform, and Compose Multiplatform projects. Multiplatform for targets other than JVM/android is limited at the moment.
Common configurations include:
jvmToolchain to align with the repo\u2019s JDK target.KotlinCompilation tasks with common configurations.allWarningsAsErrors.freeCompilerArgs.jvmTarget and javaParameters.StandardProjectConfigurations.configureFreeKotlinCompilerArgs(). This is an annoying thing to have to do, but necessary because kotlinc will complain if you add opt-ins that are not recognized by any dependencies on that classpath.DetektTasks.com.android.lint plugin and LintTasks.src/{variant}/kotlin source set in android projects, as these are still not automatically enabled.android.extensions extension.correctErrorTypes is set to true for better error messages.mapDiagnosticLocations is set to false because it\u2019s broken.plugins {\n id(\"com.slack.gradle.apk-versioning\")\n}\nThis plugin is applied in Android application projects and is solely to configure the versionCode and versionName of APKs based on git and Gradle property inputs.
The following properties are sourced
versionMajor=...\nversionMinor=...\nversionPatch=...\nThis also adds a generateVersionProperties task that is more or less only relevant for Slack\u2019s internal CI.
SGP is designed to work with multiple versions of AGP at a time, albeit only for forward compatibility and testing reasons. Generally SGP will only be tested against the latest stable version of AGP. To support multiple beta/canary versions of upcoming AGP versions, SGP has an API called AgpHandler, which is intended to be an AGP-agnostic common interface for configuring AGP projects across breaking API (source or binary) changes. When a new such change is introduced, we create an AgpHandler{version} artifact and implementation with that AGP version as its minimum. At runtime, SGP loads the relevant AgpHandler instance for the AGP version it is running against and relevant APIs use this instance via FoundryTools to interact with them in a version-agnostic way. These aren\u2019t always needed so there may be times when there are no implementations needed for the current suite of AGP versions.
An example handler for AGP 8.0 looks like this.
// AutoService makes it available via ServiceLoader\n// The factory should always be AGP-api agnostic.\nclass AgpHandler80 : AgpHandler {\n @Suppress(\"DEPRECATION\")\n override val agpVersion: String\n get() = com.android.builder.model.Version.ANDROID_GRADLE_PLUGIN_VERSION\n\n @AutoService(AgpHandlerFactory::class)\n class Factory : AgpHandlerFactory {\n override val minVersion: VersionNumber = VersionNumber.parse(\"8.0.0\")\n\n @Suppress(\"DEPRECATION\")\n override fun currentVersion(): String =\n com.android.builder.model.Version.ANDROID_GRADLE_PLUGIN_VERSION\n\n override fun create(): AgpHandler {\n return AgpHandler80()\n }\n }\n}\nBootstrap is a tool for bootstrapping local dev environments. This is usually used in tandem with a bootstrap bash script that runs the ./gradlew bootstrap task and any other repo-specific setups.
The core implementation lives in BootstrapTask.kt.
At a high level, bootstrap is mostly focused on configuring the JDK and daemon environments. Gradle has extremely limited configurability for the Gradle daemon, and we want to optimize the JDK for available space on different developer machines. To support this, we compute optimal daemon jvm arguments in bootstrap and write them to the user\u2019s home ~/.gradle/gradle.properties to override repo-specific settings with client-side properties.
For the JDK, it requests the JDK toolchain from Gradle\u2019s first-party APIs. This includes allowing Gradle to download the JDK if it\u2019s missing, which is useful for getting developers set up and running faster.
Bootstrap is also useful on CI for its ability to scale available memory to the machine it\u2019s running on, so we generally run it as a preflight step for all of our CI jobs too.
Finally, there are some other specific things it does to optimize things:
TODO
"},{"location":"platforms/gradle/dependency-rake/","title":"Dependency Rake","text":"Dependency rake is an tool we develop within foundry (SGP) to automatically clean up Gradle build files.
This tool uses the outputs of the dependency-analysis-gradle-plugin ( DAGP) to infer and apply fixes it recommends.
"},{"location":"platforms/gradle/dependency-rake/#types-of-fixes","title":"Types of Fixes","text":"There are three main categories of fixes that DR applies.
The primary benefit of dependency rake is to improve build times by more or less \u201craking\u201d the build dependency graph. By removing and fixing dependencies, we remove unneeded edges in the build graph. This in turn provides improved build parallelism and better avoidance in Skippy CI pipelines.
A secondary benefit is automatic upkeep of build files. As projects change over time, dependencies become obsolete and out of date. Most developers do not keep up with these changes over time, so automating this affords us extra upkeep that we currently do not do.
"},{"location":"platforms/gradle/dependency-rake/#implementation","title":"Implementation","text":"The core implementation of DR lives in DependencyRake.kt.
To run dependency rake in a project, use the below command
$ ./gradlew rakeDependencies -Pfoundry.config.enableAnalysisPlugin=true --no-configuration-cache\nThis will run all rakeDependencies tasks in the project. This task exists on all subprojects as well, but it works best if all are run together.
Sometimes dependency rake will try to replace identifiers with ones that are not present in any available version catalogs. Sometimes this is acceptable, but often times it can result in \u201cmissing\u201d dependencies from the build after it runs. To help fix these, DR will write all missing identifiers out to a build output file.
For convenience, you can also run ./gradlew aggregateMissingIdentifiers -Pslack.gradle.config.enableAnalysisPlugin=true --no-configuration-cache to run all dependency rake tasks and aggregate these missing identifiers into a root project build output file.
SGP offers a DSL extension for configuring project behavior via the plugin. The idea is that developers don\u2019t really want to think about specific dependency wirings, and instead want to express what features they want and allow SGP to automatically wire these up for them.
Some examples of this include Dagger, Moshi code gen, Robolectric, and more.
The primary entry point is the slack extension in the build file, which is backed by the SlackExtension interface.
foundry {\n features {\n dagger(...)\n moshi(...)\n }\n android {\n features {\n robolectric(...)\n }\n }\n}\nThe Circuit feature automatically sets up Circuit in the project. This includes controls for different Circuit artifacts and code gen. The default circuit() call will just enable Circuit\u2019s runtime + code gen.
The Dagger feature automatically sets up both Dagger and Anvil. This includes optional parameters to control whether or not you want the runtime only, component merging, or other features. This automatically handles applying the Anvil, kapt, or KSP plugins under the hood and any necessary dependencies to run them.
The default dagger() call will just enable Dagger\u2019s runtime + Anvil\u2019s factory generation with no component merging ( to avoid the Kapt cost).
The Moshi feature handles setting up both Moshi and MoshiX. This includes handling applying code gen logic (either KSP or IR) as well as moshi-sealed support if requested.
This enables the redacted-compiler-plugin compiler plugin.
"},{"location":"platforms/gradle/dsl/#compose","title":"Compose","text":"The Compose feature handles setting up Compose in both Android and multiplatform projects. This handles a bunch of boilerplate (see ComposeUtil.kt) for applying the right compose-compiler artifact version as well as enabling the right controls in the Android plugin.
This enables Gradle test fixtures in a project-agnostic fashion. In JVM projects this will apply the java-test-fixtures plugin, in Android projects this will configure the android.testFixtures.enable property.
The Robolectric feature handles setting up Robolectric in an Android project. This entails common Robolectric dependencies (including any bundles or core Robolectric project dependencies). This also sets up Robolectric jar downloads (via UpdateRobolectricJarsTask) for test tasks and enabling resource merging in tests (which Robolectric requires). There are a few other controls that StandardProjectConfigurations use to control or patch Robolectric\u2019s behavior.
By default, SGP disables androidTests in projects. These can be enabled via the androidTest() feature, which will enable the relevant controls in the Android plugin. This can also accept specified variants to enable/disable.
This is important for opting in tests to AndroidTest APK Aggregation.
"},{"location":"platforms/gradle/dsl/#resources","title":"Resources","text":"By default, we disable Android resources (different from Java resources) and libraries have to opt-in to using them.
This can be enabled via the resources() feature, which will enable the relevant BuildFeature in the Android plugin and also takes a required prefix parameter that is used as the required resourcePrefix for that library\u2019s resources to avoid naming conflicts.
This enables checking of a permission allowlist. See PermissionChecks for more details.
SGP supports running a number of formatters and static analysis tools.
Individual tools are usually gated on whether they have a version specified in libs.versions.toml. If they do not have a version specified, they are deemed not enabled.
The core set of formatters are:
The core set of analysis tools supported in SGP are:
SGP ships with a standard set of git hooks (pre-commit, etc) that it can bootstrap in projects by running ./gradlew installCommitHooks. These hooks rely on checking in relevant binaries for each formatter/checker, it\u2019s strongly recommended to use git-lfs for these. These files should be edited as needed to best serve the project they\u2019re running in.
SGP can configure these hooks in the project automatically during bootstrap if you add the foundry.git.hooksPath gradle property and point it at the hooks directory that the above command output to, or wherever the host project opts to store them.
Note that Detekt is not yet supported in git hooks as these require extra parameters for baselines.
"},{"location":"platforms/gradle/formatters-and-analysis/#downloading-binaries","title":"Downloading binaries","text":"Each tool (ktfmt, gjf, etc) has corresponding ./gradlew update<tool name> tasks that you can run to download and install them, by default to config/bin/<tool name>. You should re-run these any time you update a tool to re-run them.
TODO
"},{"location":"platforms/gradle/mod-score/","title":"Mod Score","text":"TODO
"},{"location":"platforms/gradle/properties/","title":"Properties","text":"TODO
"},{"location":"platforms/gradle/testing/","title":"Testing","text":"TODO
"},{"location":"platforms/gradle/thermals-logging/","title":"Thermals Logging","text":"TODO
"},{"location":"platforms/gradle/utilities/","title":"Utilities","text":"There are a bunch of miscellaneous utilities and tools in this project that don\u2019t necessarily warrant their own dedicated docs page.
"},{"location":"platforms/gradle/utilities/#androidsourcesconfigurer","title":"AndroidSourcesConfigurer","text":"When testing new Android SDK betas, the compile SDK version is available months before sources are. Developers want to build against these APIs, but we don\u2019t want to make their experience in the IDE worse than necessary. The problem with using a compile SDK version that doesn\u2019t have sources is that the IDE can\u2019t provide any documentation for the APIs and will just show stub files instead.
To work mitigate this, we will patch the SDK by putting a copy of the previous version\u2019s sources in the location of the new SDK. This allows most sources to still index properly during the beta period. Then, once the new sources are available, the consuming repo needs only to update the foundry.latestCompileSdkWithSources gradle property to that new SDK version and the patcher will clear out that copy and let AGP download the real ones.
This runs automatically in the root plugin.
"},{"location":"platforms/gradle/utilities/#androidtest-apk-aggregation","title":"AndroidTest APK Aggregation","text":"At Slack we use FTL + Fladle for running our instrumentation tests. In order to add more test APKs from modularized instrumentation tests in other subprojects, we have to aggregate a list of their locations and pass them on to Fladle. This is done via AndroidTestApksTask, which is registered in the root project and can be wired to pipe its output file into Fladle\u2019s config input.
Example
val aggregatedApksProvider = rootProject.tasks\n .named<AndroidTestApksTask>(\"aggregateAndroidTestApks\")\n .flatMap { it.outputFile }\n .map { it.asFile.readLines() }\n\ntasks\n .withType<YamlConfigWriterTask>()\n .named { it == \"writeConfigProps${fladleTarget}\" }\n .configureEach { additionalTestApks.value(testInputsProvider) }\nThis task is automatically added to whenever a subproject uses the androidTest() DSL feature.
PermissionChecks","text":"Permissions are an integral part of Android apps, and oversight into what permissions are required in the app is critical to a release pipeline. PermissionChecks is a feature to help with this.
The workflow we use at Slack is like this:
permissionsAllowlist.txt file in the Slack android repo.allowListFile DSL feature in the application project.This way new permissions are not accidentally or secretly added to the app.
"},{"location":"tools/cli/","title":"Foundry CLIs","text":"An artifact containing basic CLI utilities for Kotlin.
"},{"location":"tools/cli/#installation","title":"Installation","text":"
// In Gradle\ndependencies {\n implementation(\"com.slack.foundry:cli:<version>\")\n}\n\n// In kotlin script\n@file:DependsOn(\"com.slack.foundry:cli:{version}\")\nIf consuming these utilities from a kotlin script file, you can test changes like so:
gradle.properties, such as 2.5.0-LOCAL1../gradlew publishToMavenLocal to publish the current version to your local maven repository.@file:Repository(\"file:///Users/{username}/.m2/repository\")\n@file:DependsOn(\"com.slack.foundry:cli:{version you set in gradle.properties}\")\nTODO
"}]} \ No newline at end of file +{"config":{"lang":["en"],"separator":"[\\s\\-]+","pipeline":["stopWordFilter"]},"docs":[{"location":"","title":"foundry","text":"This repository contains much of Slack\u2019s Android/Kotlin/JVM tooling for Gradle, IntelliJ, CLIs, and more.
This repo is effectively for Slack\u2019s own used but publishes to Maven Central. We develop these in the open to knowledge-share with the community.
As such, we don\u2019t normally accept external PRs, but we welcome your questions in the discussions section of the project!
"},{"location":"#highlights","title":"Highlights","text":""},{"location":"#common-project-configuration","title":"Common project configuration","text":"The foundry.base plugin offers common configuration for all projects implementing it, covering a wide spectrum of Android, Kotlin, and Java configurations.
This includes a whole host of things!
FoundryExtension (see next section).Full docs can be found in the architecture docs.
"},{"location":"#feature-dsl","title":"Feature DSL","text":"To ease use and configuration of common features in projects, we expose a foundry DSL in projects that allows for configuration of these in a semantically easy and boilerplate-free way. This is controlled via FoundryExtension.
foundry {\n features {\n dagger()\n moshi(codegen = true)\n }\n android {\n features {\n robolectric()\n }\n }\n}\nA major benefit of this is that we can intelligently configure features and avoid applying costly plugins like Kapt unless they\u2019re actually needed for a specific feature, such as Java injections in projects using Dagger. Since this is pure code, we can also propagate deprecated behavior by deprecating the corresponding functions in the DSL.
"},{"location":"#platform-plugins","title":"Platform plugins","text":"Platforms.kt contains an implementation that sources a VersionCatalog and applies it to a Gradle platform project. This allows us to effectively treat our versions catalog as a BOM and apply it to all projects in the consuming repo and reduce dependency version stratification.
MacBooks can suffer thermal throttling and result in poor build performance. We built instrumentation for this to capture these and include them in our build scans to better understand their impact. We support both Intel and Apple Silicon macs now and contain this implementation in ThermalsWatcher.kt. This also includes helpful charting APIs for visualizing the data (courtesy of our friends at Square).
Gradle\u2019s built-in property support is limited and has surprising behavior, so we have our own system on top of it that has consistent precedence, local.properties support, project-local gradle.properties, and configuration caching support. Check out PropertyResolver.
DependencyRake.kt contains an extension to the gradle-dependency-analysis-plugin that applies its advice to a project to automatically optimize it and rake dependencies.
As a part of our modularization efforts, we developed a scoring mechanism for modules that we could use as a measure of their \u201cmodularization\u201d. This includes a number of metrics and weighs them in a formula to compute a score. This includes LoC, language mixtures, and build graph centrality. This logic is under the foundry.stats package.
Robolectric uses preinstrumented Android API jars that live on maven central. While it can handle downloading of these automatically, we found this implementation to be brittle and unreliable, so we built our own version of it that handles downloading these into a local .cache directory. This implementation lives in UpdateRobolectricJarsTask.kt and that task is configured to be a dependency of all Test tasks.
We try to simplify and streamline the bootstrap process for both local development and on CI. This involves computing optimized JVM arguments for the Gradle and Kotlin daemons (which differ between CI and local) as well as toe-holds for future customizations. This logic lives in BootstrapTask.kt.
To avoid accidentally checking in any new, unexpected manifest permissions, we have a CheckManifestPermissionsTask that compares the final merged manifest\u2019s permissions to an allow list of known permissions. This is allow list is checked in and expected to be guarded by a CODEOWNERS watch and will fail the build if they differ.
slack {\n android {\n app {\n permissionAllowlist {\n if (name == \"externalRelease\") {\n setAllowlistFile(file(\"permissionsAllowlist.txt\"))\n }\n }\n }\n }\n}\nAGP offers new property-based APIs for computing APK version codes and version names. We use this to compute information from different inputs (CI build number, git state, etc) and control this logic in ApkVersioningPlugin.kt.
Sometimes a dependency update may bring with it a surprise update to a transitive dependency that we also declare. In order to avoid this happening unexpectedly, the CheckDependencyVersionsTask checks that any transitive dependency versions that also correspond to a version declared in our VersionCatalog match the version there. It\u2019s ok if they don\u2019t, but the author just need to update the version in the catalog too to be explicit (or investigate further if it\u2019s an unwanted surprise!).
AGP occasionally contains new or breaking API changes that we want to handle gracefully in early testing. We regularly test against newer preview versions of AGP so we can\u2019t just hardcode in new APIs and expect them to work everywhere. To handle this, we have an AgpHandler interface that can be used to abstract these new APIs in a backward-compatible way. Then we ship implementations of this as different artifacts that are built against different AGP versions. Then, at runtime, we pick the appropriate instance (via service loading) to use for the current AGP version being used in that build.
Detekt is a static analysis tool that we use to check for common issues in our code. We use one global baseline file for baselined issues (when introducing new checks or updates), but Detekt doesn\u2019t currently support this easily. So, we built MergeDetektBaselinesTask to merge all the generated baselines from each subproject into a single global baseline.
There are a ton of miscellaneous tools, utilities, and glue code for Gradle (and various plugins) sprinkled throughout this project.
"},{"location":"#usage-requirements","title":"Usage requirements","text":"SGP expects there to be a libs version catalog.
The following versions are required to be set the above catalog. Their docs can be found in FoundryVersions.kt.
For Android projects, some extra definitions need to be defined
libs.versions.toml librariesgoogle-coreLibraryDesugaring - the core library desugaring libraries to use with L8.gradle.properties propertiesfoundry.compileSdkVersionfoundry.targetSdkVersionfoundry.minSdkVersionThe following plugins are applied by default but can be disabled if you don\u2019t need them.
foundry.auto-apply.test-retryfoundry.test.retry.pluginType property to GE.foundry.auto-apply.spotlessfoundry.auto-apply.detektfoundry.auto-apply.nullawayfoundry.auto-apply.cache-fixThe installCommitHooks task can install commit hooks for formatting kotlin and java files. They expect binaries to be in <root>/config/git/hooks and it\u2019s highly recommended to enable git-lfs for these objects. These binaries can be downloaded via the updateKtfmt, updateGjf, etc tasks.
Copyright 2022 Slack Technologies, LLC\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n2024-11-19
LocTask.generatedSrcsDir @Internal to avoid depending implicitly on outputs of tasks that sometimes only just make empty dirs with no files.2024-11-15
globalCiValidateModuleTopography and ciValidateModuleTopography tasks.mustRunAfter for depending on source gen tasks + add back sqldelight\u2019s schema task as a source-generating task..setContent {.foundry.topography.features.config property.0.65.0.3.18.2.1.32.2.2024-11-13
LocTask depend on source-generating tasks if MODULE_SCORE_INCLUDE_GENERATED is true.2024-11-13
2024-11-12
2024-11-12
moduleTopography task. This is a general task that attempts to validate project configurations by looking for features that are enabled but unused. Currently covers a few core features like kapt, ksp, moshi code gen, dagger/anvil, and viewbinding. Outputs are printed and written to a JSON file. Add --validate-all to make the tasks fail on validation issues.FoundryProperties instance for subproject use.composeRuntimeOnly() DSL feature.Path.walkEachFile().MODULE_SCORE_INCLUDE_GENERATED is false8.11.RakeDependencies task.2.0.0.0.90.3.0.62.2.3.0.1.0.12.2.0.21-1.0.27.2.4.2.1.7.0.2024-10-25
better-gradle-properties artifact, which is our hierarchical Gradle properties solution that better handles properties in Gradle. This is what powers FoundryProperties but is now extracted to be more portable.local.propertiesgradle.propertieslocal.propertiesgradle.propertiesversion-number artifact. This contains a Kotlin, non-deprecated VersionNumber API. This is useful given that Gradle\u2019s is both deprecated and not available in standard JVM projects.foundry.git.hooksPath and foundry.git.ignoreRevsFile properties.SgpArtifact to FoundryArtifact.0.90.2.7.0.0.BETA4.2.0.21-1.0.26.2.2.0.2.1.0.4.1.0.1.7.0.2.0.0-Beta.2024-10-14
2024-10-14
Don\u2019t use this release! We goofed on something.
"},{"location":"changelog/#0200","title":"0.20.0","text":"2024-10-11
"},{"location":"changelog/#project-restructuring","title":"Project Restructuring","text":"We\u2019ve restructured this project! Since its early days as a simple Gradle convention plugin it\u2019s expanded into IntelliJ plugins, CLIs, CI tooling, and more. To better capture this, we\u2019ve renamed the project to Foundry, restructured its artifacts into a more cohesive setup, moved kotlin-cli-util into this repo, and will likely split out some more artifacts down the line.
"},{"location":"changelog/#migration-guide","title":"Migration Guide","text":"slack. or sgp. have now moved to foundry.. slack.gradle. prefix have also removed the gradle. (i.e. slack.gradle.foo would now be foundry.foo).SlackProperties has been renamed to FoundryProperties.There is a helper script you can use to automatically rename all properties in foundry-migration/.
mapping.txtproperty_migration.sh./property_migration.sh mapping.txt <path to target project>.*.kts and *.properties files. This does not cover args passed via CLI or envs.Package names have all aligned to foundry.*. In most cases it should be simple enough to replace import com.slack.* with import foundry.*.
Gradle coordinates group have moved to the com.slack.foundry group name.
The former kotlin-cli-util APIs have moved to the com.slack.foundry:cli artifact.
platforms/ directory.tools/ directory.Slack-prefixed APIs are now prefixed with Foundry.foundry {}, but the previous slack {} entry points are left with deprecation ReplaceWith options.Gradle plugin IDs have migrated to com.slack.foundry.* names.
com.slack.gradle.root com.slack.foundry.root com.slack.gradle.base com.slack.foundry.base com.slack.gradle.apk-versioning com.slack.foundry.apk-versioning Introduce new required foundry.android.defaultNamespacePrefix property for android projects. This is necessary for projects that don\u2019t define an android.namespace explicitly.
FoundryProperties.progressive.5.0.1.6.6.5.4.0.1.2.0.0.0.51.0.3.18.1.2024-09-25
SoftRefLRUPolicyMSPerMB + ReservedCodeCacheSize jvm args to bootstrap3.0.1.33.3.1-jre.8.10.2.2024-09-23
sourceInformation compose options in android projects and default it to true.2024-09-22
slack.allowWarnings property to sgp.kotlin.allowWarnings.sgp.kotlin.allowWarningsInTests property to opt-out.1.9.0.3.9.1.5.0.0.5.15.0.6.6.4.3.0.0.8.6.1.2024-09-12
testFixtures() feature DSL to enableTestFixtures() to disambiguate from Gradle\u2019s methods.sgp.compose.stabilityConfigurationPath property to specify a Compose configuration file path from the root project. It is also now disallowed to specify this via sgp.compose.commonCompilerOptions.2024-09-12
slack { features { testFixtures() } } DSL for enabling test fixtures in a project-agnostic way.slack.location.robolectric-core property optional.KaptGenerateStubsTask.DialectClasspath configurations too.2.0.20-1.0.25.8.6.0.8.10.1.5.1.0.2024-09-03
slack.bootstrap.minGradleXms property to set minimum xms values for daemon memory args.slack.boostrap.minGradleXm* values to kotlin daemon jvm args too.1.0.4.3.7.2.8.6.0.2024-08-27
0.28.0.3.1.9.6.6.3.0.7.2.0.20.1.10.0.2.0.20-1.0.24.8.10.2024-08-12
sgp.kapt.languageVersion property to override the language version used for KAPT.2.0.10.2.0.10-1.0.24.8.5.2.2024-08-04
2024-07-31
0.61.0.6.6.2.1.33.0.2.0.0-1.0.24.2.5.0-beta11.2024-07-19
jvmTarget.0.7.1.1.18.1.5.0.0.0.27.2.8.9.2.0.0-1.0.23.8.5.1.0.7.2024-05-28
sgp.kotlin.languageVersionOverride. Default is null, which will just defer to KGP\u2019s default.sgp.kotlin.optInskotlin.contracts.ExperimentalContracts, kotlin.experimental.ExperimentalTypeInference, kotlin.ExperimentalStdlibApi, kotlin.time.ExperimentalTimesgp.kotlin.freeArgs-Xenhance-type-parameter-types-to-def-not-null, -Xself-upper-bound-inferencesgp.kotlin.jvmFreeArgs-Xjsr305=strict, -Xassertions=jvm, -Xemit-jvm-type-annotations, -Xjvm-default=all, -Xtype-enhancement-improvements-strict-mode, -Xjspecify-annotations=strictsgp.kotlin.progressive. Default is true.8.5.0.1.32.0.1.6.11.0.60.0.33.2.1-jre.0.27.1.2024-05-28
2.0.0.2.0.0-1.0.21.8.4.1.2024-04-30
8.4.0.4.4.0.2024-04-26
retry extension.1.8.1.0.59.0.2024-04-18
2.5.0-beta07.1.12.0.6.6.0.1.31.0.1.6.2.8.3.2.1.9.23-1.0.20.2.0.2.4.9.9.4.3.0.2024-03-28
8.3.1.1.23.6.8.7.2.11.0.0.58.0.4.9.8.33.1.0-jre.2024-03-14
-Xjdk-release on jvm compilations (not android).2024-03-14
2.5.0-beta04.-Xjdk-release option alongside jvmTarget.3.9.0.6.5.0.1.9.23.1.9.23-1.0.19.1.6.1.2024-03-08
2024-03-04
com.android.test in Project.isAndroid checks. This resolves a case where we accidentally set the JavaCompile.options.release property in those projects.2024-02-28
2024-02-28
AnvilMode casing in detection.2024-02-27
6.4.13.sgp.compose.commonCompilerOptions property for common compose compiler options.1.6.0.2024-02-19
-Xproper-ieee754-comparisons arg, as it\u2019s enabled by default and removed entirely in K2.3.8.0.6.4.12.1.8.0.1.30.0.8.3.0-rc01.2024-02-03
TaskCollection.named(Spec) APIs where appropriate.1.15.1.2.6.3.6.4.11.8.2.2.1.9.22.1.9.22-1.0.17.1.23.5.1.5.12.1.29.0.6.25.0.2024-01-11
PropertyResolver to public API.com.slack.gradle:skippy. This also includes a CLI that can be run as an alternative to the gradle task. Note this requires serialized dependency graph and androidTest projects to be pre-computed. THe config must be in a static JSON file. See the docs on ComputeAffectedProjectsCli.Usage: compute-affected-projects-cli [<options>]\n\n Computes affected projects and writes output files to an output directory.\n\nOptions:\n --debug Enable debug logging.\n --merge-outputs Merge outputs from all configs into a single\n /merged dir.\n --config=<path> Path to a config file that contains a mapping of\n tool names to SkippyConfig objects.\n --parallel Compute affected projects in parallel.\n --changed-files=<path> A relative (to the repo root) path to a\n changed_files.txt that contains a\n newline-delimited list of changed files. This is\n usually computed from a GitHub PR's changed files.\n -o, --outputs-dir=<path> Output directory for skippy outputs.\n --root-dir=<path> Root repo directory. Used to compute relative\n paths.\n --dependency-graph=<path> Path to a serialized dependency graph file.\n --android-test-project-paths=<path>\n Path to a file that contains a newline-delimited\n list of project paths that produce androidTest\n APKs.\n -h, --help Show this message and exit\ngenerateDependencyGraph and generateAndroidTestProjects tasks from ComputeAffectedProjectsTask. This allows for more fine-grained caching and parallelization. An example flow of the last two bullets can look like so:
# Generate the dependency graph and androidTest projects\n./gradlew generateDependencyGraph generateAndroidTestProjectPaths\n\n# Run the CLI, such as from a `*.main.kts` file that imports it.\n./skippy-runner.main.kts \\\n --changed-files changed_files.txt \\\n --dependency-graph slack/dependencyGraph/serializedGraph.bin \\\n --android-test-project-paths slack/androidTestProjectPaths/paths.txt \\\n ...\n2024-01-09
2024-01-02
local.properties). Note that this work is ongoing as project isolation is incubating, but the changes in this release should be non-functional in nature.1.9.22.1.9.22-1.0.16.8.2.1.8.3.0-beta01 in AgpHandler83.0.26.0.33.0.0-jre.6.4.10.2.6.0.2023-12-18
compose() DSL function with Action parameter public.2023-12-18
compilerOption() API in Compose DSL for compiler arg configuration.1.28.0 + migrate off deprecated APIs.3.7.0.8.3.0-alpha18.1.9.21-1.0.16.2023-12-12
skippy extension now. These outputs and diagnostics are stored at build/skippy/{tool}/.... Merged outputs can be generated as well to build/skippy/merged. This allows for creating dynamic pipelines based on the outputs of each tool. The global config is always overlaid onto each tool-specific config.skippy {\n debug.set(true)\n mergeOutputs.set(true)\n computeInParallel.set(true)\n global {\n applyDefaults()\n // Glob patterns of files to include in computing\n includePatterns.addAll(\n \"**/*.pro\",\n \"**/src/**/sqldelight/**\",\n )\n excludePatterns.addAll(\".idea/**/*.kt\")\n // Glob patterns of files that, if changed, should result in not skipping anything in the build\n neverSkipPatterns.addAll(\n \".buildkite/**\",\n \".github/actions/**\",\n \"ci/**\",\n \"config/health-score/**\",\n \"tooling/scripts/**\",\n )\n }\n config(\"lint\") {\n includePatterns.addAll(\n // project-local lint.xml files\n // this doesn't fuuuuully work with skippy because these layer like .gitignore does\n \"**/lint.xml\",\n // Lint baselines\n \"**/lint-baseline.xml\",\n )\n neverSkipPatterns.addAll(\n // Global lint config\n \"config/lint/lint.xml\",\n // Houston feature flags, which is an input to our feature flags lints\n \"config/feature-flags/experiments.txt\",\n )\n }\n config(\"detekt\") {\n // Detekt baselines\n includePatterns.add(\"**/detekt-baseline.xml\")\n // Global detekt configs\n neverSkipPatterns.add(\"config/detekt/*\")\n }\n}\n1.9.3.6.06.4.95.14.02.5.48.3.0-alpha17 in AgpHandler 8.3 artifact.1.27.0.2023-12-05
Project.isSyncing public.android.studio.version property for reporting to build scans.4.9.3.3.1.8.1.9.21.1.9.21-1.0.15.0.25.1.8.2.0.2.0.1.1.7.1.1.23.4.0.9.1.2023-11-30
BuildFeatures to build scans as custom values, starting with configuration cache and isolated projects.32.1.3-jre.6.4.8.8.1.4 (main) and 8.3.0-alpha15 (agp handler 8.3).1.5.11.2023-11-21
2023-11-20
SlackExtension.circuit() DSL. This makes it easy to set up Circuit in a project. See the DSL docs for more details. slack {\n features {\n circuit()\n }\n}\nKspTask subtypes of KotlinCompile tasks.autoValue() APIs from SlackExtension.2023-11-10
2023-11-09
Detekt.baseline to null if we don\u2019t specify one, as we don\u2019t want it to fall back to its default location.2023-11-09
8.3.0-alpha13.2023-11-08
slack.detekt.baseline-file-name property to indicate what the simple file name should be. This is evaluated against project.layout.projectDirectory.file(...). This replaces the previous slack.detekt.baseline property.1.9.20.8.1.3.1.5.10.2023-11-02
2023-10-30
null if their property values are blank.2023-10-22
sgp.isTestLibrary property to indicate if a library is a test library. Note that projects that are named test-fixtures are implicitly considered test libraries.VisibleForTests lint on test libraries.2023-10-22
slack.lint.update-baselines property in favor of AGP\u2019s modern updateBaselines task.ImplicitSamInstance lint config.2023-10-19
8.3.0-alpha08.8.4.1.5.3.2023-10-02
slack.gradle.debugVersionCode and defaults to 90009999.slack.gradle.debugUserString and defaults to debug.8.1.0.2023-09-28
allowListFile file property instead.4.9.1.1.5.2.6.4.6.2023-09-22
coreLibraryDesugaring configuration.compilerOptions.moduleName to a dashified version of the Gradle project path.0.24.32.4.8.1.5.1.1.22.0.1.6.1.2023-08-29
2023-08-29
sgp-tracing artifact ID. We use this internally to collect extra build metadata, but it\u2019s generic enough for general use. Not currently used in slack-plugin yet.sgp.android.buildToolsVersionOverride property to override the default build tools version in Android.AndroidPluginVersion API in AgpHandler.8.1.1.6.21.0.1.5.0.1.9.10.1.9.10-1.0.13.3.1.7.2.2.1.6.4.5.4.8.11.21.0.8.3.2023-08-15
com.android.test projects in a few waysProject.buildDir API usages.kotlin-cli-util to 2.1.0.2023-08-10
This streamlines configuration of enabling androidResources and enforces use of a resource prefix to avoid conflicts.
May your avatars never be wrongly sized again.
slack {\n android {\n features {\n resources(\"prefix_\")\n }\n }\n}\n2.0.0.1.15.0.0.4.1.9.0-1.0.13.3.5.0.0.5.0.2023-08-08
32.1.2-jre.2023-08-08
slack.gradle.defaultVersionCode). The default is 90009999, for reasons.2023-08-07
{rootProject}/build/ci/release.version. The default behavior will be to just use the version set in the android DSL.1.23.1.3.14.1.1.4.3.2.0.0.2.4.7.2023-07-25
1.9.0.1.9.0-1.0.12.8.1.0.1.2.3.0.24.0.1.5.0.4.8.0.2023-07-12
slack.dependencyrake.dryRun gradle property flag for dependency rake to enable dry-run. If enabled, the project build files will not be modified and a separate new-build.gradle.kts file will be written to instead.3.4.0.2023-07-07
RakeDependencies task on platform projects../gradlew aggregateMissingIdentifiers -Pslack.gradle.config.enableAnalysisPlugin=true --no-configuration-cache2023-06-30
DependencyRake.32.1.0-jre.2023-06-29
kotlin-cli-util to 1.2.2.2023-06-25
2023-06-24
2023-06-24
2023-06-24
sgp.compose.multiplatform.forceAndroidXComposeCompiler Gradle property flag to force use of the AndroidX compose compiler in Compose Multiplatform projects.sgp.config.jvmVendor.optOut Gradle property flag to disable jvmVendor configuration in toolchains.2023-06-06
2023-06-06
robolectric key in the primary version catalog.sgp.config.jvmVendor property.4.7.0.2.4.6.8.0.2.1.23.0.2023-05-15
slack DSL.2023-05-15
2023-05-09
disallowChanges() on javaCompiler in JavaCompile tasks. It seems that Gradle sets this multiple times.2023-05-09
disallowChanges() where possible on properties SGP controls in order to avoid accidental overwrites.ComputeAffectedProjectsTask also generate a affected_android_test_projects.txt file with a newline-delimited list of affected projects that enable androidTest(). This can be used in CI scripts to statically determine if instrumentation tests need to run.2023-05-06
SlackVersions. See SlackVersions.kt for updated expected naming of aliases.2023-05-05
jdk.compiler/com.sun.tools.javac.model to Bootstrap Gradle JVM args and exec prefixes for binaries for GJF 17.2023-05-05
2023-05-04
Happy May the Fourth!
sgp.config.jvmVendor property to control the JVM vendor used in Kotlin and Java toolchains. This value is used to match a known vendor spec, such as AZUL.afterEvaluate block to avoid https://github.com/Kotlin/kotlinx-kover/issues/362.2023-04-30
OkHttpClient setup in SlackTools.slack.features.dagger DSL controls. There are two new properties to control this:slack.ksp.allow-dagger \u2013 allow use of Dagger in KSP.slack.ksp.allow-anvil \u2013 allow use of Anvil in KSP. Note this is not yet implemented in Anvil, just a toe-hold for the future.SlackToolsExtension instances + fix classloader used for it.SlackToolsExtension extensions that fail to load.2023-04-25
Context to SlackToolsExtension.2023-04-25
SlackTools.findExtension API.SlackTools.SERVICE_NAME for @ServiceReference API.2023-04-25
moshi-kotlin, only use generated adapters now.sgp.ge.apply-common-build-tags property flag to gate applying common build tags to a project.SlackToolsExtension to work as a ServiceLoader instead.2023-04-23
SlackTools because this apparently invalidates configuration cache every time.2023-04-22
class for SAM conversions due to https://github.com/gradle/gradle/issues/24871.2023-04-22
SlackTools and support enabling property at different scopes (local.properties, etc).SlackTools is closed.class for SAM conversions. The minimum supported Gradle version is now 8.1, which introduced support for this.2023-04-22
2023-04-22
SlackTools instances when reporting background data to Gradle Enterprise. These instances would be orphaned because this would happen after Gradle had closed all existing services, and create a memory leak.SlackTools instances.Executor for SlackTools\u2019 thermals heartbeat.2023-04-22
Throwable with multiple instances of SlackTools to help track origin points.2023-04-22
SlackTools to track multiple instances.2023-04-15
ValueSource for Gradle 8.x compatibility.PLATFORM_NATIVE in spotless by default. Its default of looking at .gitattributes is expensive and incompatible with Gradle 8.1+ configuration caching.slack.auto-apply.sort-dependencies boolean Gradle property to gate auto-applying the sort-dependencies plugin.2023-04-01
Happy April Fool\u2019s Day!
2023-03-28
detekt task dependencies for globalDetekt.2023-03-27
slack.detekt.full property to gate whether or to run full detekt (i.e. with type resolution). If disabled, detektRelease/detektMain and associated tasks will be disabled and not used in detektGlobal.2023-03-25
DetektCreateBaselineTask tasks too due to https://github.com/detekt/detekt/issues/5940.2023-03-24
slack.avoidance.build-upon-default-affected-project-configurations flag to make provided configurations build upon defaults.globalDetekt task that runs detekt on all subprojects. This is Skippy-compatible and responds to slack.avoidance.affectedProjectsFile.2023-03-22
androidExtension publicly in SlackExtension to avoid Gradle mismatching number of type arguments in AGP 8.1.0-alpha10+.2023-03-22
Detekt.jdkHome to null to avoid https://github.com/detekt/detekt/issues/5925.String.safeCapitalize() to String.capitalizeUS() to make it more explicit.2023-03-21
-Pslack.compose.android.enableLiveLiterals=true..github/actions/** to default never skip filters.2023-03-20
affected_projects.txt and allow non-existent files as a value. This makes it easy to gracefully fall back in CI.6.4.1.2023-03-17
"},{"location":"changelog/#project-skippy","title":"Project Skippy","text":"This release introduces an experimental new computeAffectedProjects task for computing affected projects based on an input of changed files. The goal of this is to statically detect which unit test, lint, and androidTest checks can be safely skipped in CI on pull requests.
Example usage
./gradlew computeAffectedProjects --changed-files changed_files.txt\nWhere changed_files.txt is resolved against the root repo directory and contains a newline-delimited list of changed files (usually inferred from a PR).
A simple example of how to produce such a file with the gh CLI:
gh pr view ${{ github.event.number }} --json files -q '.files[].path' > changed_files.txt\nOne would run this task first as a preflight task, then run subsequent builds with the slack.avoidance.affectedProjectsFile Gradle property pointing to its output file location (printed at the end of the task).
./gradlew ... -Pslack.avoidance.affectedProjectsFile=/Users/zacsweers/dev/slack/slack-android-ng/build/skippy/affected_projects.txt\nThe globalCiLint, globalCiUnitTest, and aggregateAndroidTestApks tasks all support reading this property and will avoid adding dependencies on tasks in projects that are not present in this set.
The ComputeAffectedProjectsTask task has some sensible defaults, but can be configured further in the root projects like so.
tasks.named<ComputeAffectedProjectsTask>(\"computeAffectedProjects\") {\n // Glob patterns of files to include in computing\n includePatterns.addAll(\n \"**/*.kt\",\n \"**/*.java\",\n )\n // Glob patterns of files that, if changed, should result in not skipping anything in the build\n neverSkipPatterns.addAll(\n \"**/*.versions.toml\",\n \"gradle/wrapper/**\",\n )\n}\nDebug logging can be enabled via the slack.debug=true Gradle property. This will output timings, logs, and diagnostics for the task.
The configurations used to determine the build graph can be customized via comma-separated list to the slack.avoidance.affected-project-configurations property.
2023-03-15
Happy Ted Lasso season 3 premier day!
UseContainerSupport jvm arg from unit tests as this appears to only work on Linux.2023-03-14
Happy Pi day!
Test tasks are now configured more consistently across CI and local, so there should be more cache hits.globalCiUnitTest task to the root project to ease running ciUnitTest tasks across all subprojects.SlackProperties for controlling max parallelism and forkEvery options in Test tasks.ciLint task to every project that depends on all lint tasks in that project. This is intended to be the inverse behavior of the built-in lint task in Android projects, which only runs the default variant\u2019s lint task.globalCiLint task to the root project to ease running ciLint tasks across all subprojects.SlackProperties for controlling which variants should be linted.lint.xml is the right place for this kind of logic.2023-03-07
slack.lint.severity.errorRuleIds Gradle property to specify lint rule IDs that should always be error severity.2023-02-27
2023-02-20
checkDependencies is no longer enabled by default.slack.lint.baseline-file-name property. Defaults to lint-baseline.xml.ImplicitSamInstance lint not being enabled.2023-02-15
MergeFileTask.kt was accidentally removed during a previous release.jna-platform dependency to align with the jna dependency version.2023-02-15
Do not use! Release was accidentally messed up.
"},{"location":"changelog/#055","title":"0.5.5","text":"2023-02-13
LocTask is now compatible with Gradle 8.0 and has the correct task dependencies when Ksp, Kapt, etc are running.LocTask is now compatible with remote build cache.KtfmtDownloadTask, DetektDownloadTask, etc) now have prettier and more reliable download progress indications.UpdateRobolectricJarsTask now uses Gradle workers to parallelize downloads. On gigabit wifi, this takes the task runtime down from ~21sec to ~13sec.SLACK_FORCE_REDOWNLOAD_ROBOLECTRIC_JARS env variable can be used to force UpdateRobolectricJarsTask to redownload jars even if already downloaded. Behavior change: Mod score must now be opted in to via the slack.gradle.config.modscore.enabled=true gradle property.slack.gradle.config.modscore.ignore=true gradle property.2023-02-07
sortDependencies toml version is present, and you can have it download+create executable binaries via ./gradlew downloadDependenciesSorter.compose() DSL is moved to slack.features and offers an optional multiplatform parameter to enable the compose multiplatform plugin. slack {\n features {\n compose(multiplatform = <true|false>)\n }\n}\n1.8.10 and AGP 7.4.1.2023-01-27
MergeFilesTask monkeypatch using env vars instead of system props.2023-01-26
MergeFilesTask monkeypatch plus extra logging. Feel free to skip this update if you\u2019re unaffected.2023-01-23
Optional for google-coreLibraryDesugaring dependency before adding it. The Gradle API\u2019s lack of type safety strikes again.2023-01-23
sgp-monkeypatch-agp artifact. This contains monkeypatches for AGP where we try to fix bugs. This initial version contains a patched MergeFilesTask that sorts files before merging them to ensure deterministic outputs, as we believe this is causing our lint tasks to be non-cacheable across machines. This can be enabled via setting the com.slack.sgp.sort-merge-files system property to true.slack.gradle.config.bugsnag.enabled gradle property to true.slack.gradle.config.bugsnag.enabledBranchPattern gradle property. For example: slack.gradle.config.bugsnag.enabledBranchPattern=main|release_.*.libs.versions.toml instead of assuming the artifact name. Starting with 1.2.0, desugar JDK libs offers multiple artifacts. Point google-coreLibraryDesugaring in [libraries] to whichever artifact should be used.2023-01-13
2023-01-09
Happy new year!
3.3.0.2022-12-29
compilerOptions API now.2022-12-22
2022-12-19
2022-12-15
android.packagingOptions.jniLibs.pickFirst for AGP 8.x compatibility, as the returned type by jniLibs changed from JniLibsPackagingOptions to JniLibsPackaging.2022-12-06
compileCiUnitTest lifecycle task to just compile (but not run!) unit tests that are run by ciUnitTest.2022-12-04
isIncludeAndroidResources in Android unit tests automatically when robolectric() is used.2022-11-11
2022-11-10
AndroidManifest.xml files in androidTest sources + ensure they\u2019re debuggable.2022-10-20
**/build/** from Detekt tasks.2022-10-14
com.android.test projects.org.jetbrains.compose) projects.me.tongfei:progressbar to 0.9.5.2022-10-06
2022-10-03
2022-10-03
--add-opens to Test tasks for Robolectric 4.9+ when it\u2019s enabled.subprojects module stats and allprojects in bootstrap for better project isolation support.2022-09-27
androidTest(allowedVariants = ...) wasn\u2019t running on com.android.application projects.Lint DSL block for com.android.library and org.jetbrains.kotlin.jvm projects too.2022-09-23
slack {\n android {\n features {\n androidTest(allowedVariants = setOf(\"internalDebug\"))\n }\n }\n}\n2022-09-20
2022-09-08
slack.unit-test plugin application.2022-09-07
Instantiatable lint in min SDK 28+ due to lint bug.Diversity and inclusion make our community strong. We encourage participation from the most varied and diverse backgrounds possible and want to be very clear about where we stand.
Our goal is to maintain a safe, helpful and friendly community for everyone, regardless of experience, gender identity and expression, sexual orientation, disability, personal appearance, body size, race, ethnicity, age, religion, nationality, or other defining characteristic.
This code and related procedures also apply to unacceptable behavior occurring outside the scope of community activities, in all community venues (online and in-person) as well as in all one-on-one communications, and anywhere such behavior has the potential to adversely affect the safety and well-being of community members.
For more information on our code of conduct, please visit https://slackhq.github.io/code-of-conduct
"},{"location":"contributing/","title":"Contributors Guide","text":"Note that this project is considered READ-ONLY. You are welcome to discuss or ask questions in the discussions section of the repo, but we do not normally accept external contributions without prior discussion.
"},{"location":"contributing/#development","title":"Development","text":"Check out this repo with Android Studio or IntelliJ. It\u2019s a standard gradle project and conventional to check out.
The primary project is slack-plugin.
Kotlin should be used for more idiomatic use with Gradle/AGP APIs
Code formatting is checked via Spotless. To run the formatter, use the spotlessApply command.
./gradlew spotlessApply\nOptionally, there are commit hooks in the repo you can enable by running the below
git config core.hooksPath config/git/hooks\nFoundry contains three Gradle plugins and some associated helper artifacts.
"},{"location":"platforms/gradle/architecture/#foundryrootplugin","title":"FoundryRootPlugin","text":"This is the root plugin that is applied to the root project of a multi-project build.
plugins {\n id(\"foundry.root\")\n}\nIts responsibilities include:
FoundryTools build service.libs.versions.toml.FoundryBasePlugin","text":"This is the base plugin that is applied to all projects (including the root project).
plugins {\n id(\"foundry.base\")\n}\nIts responsibilities include:
StandardProjectConfigurations.UnitTests. This also includes configuring the Gradle test retry plugin, if enabled.StandardProjectConfigurations","text":"This class warrants special mention as it is responsible for the bulk of the configuration applied to projects SGP manages.
foundry extension DSL.All JVM projects (Android, Java, Kotlin) receive some common configuration for their JVM tasks.
"},{"location":"platforms/gradle/architecture/#common","title":"Common","text":"DependencyRake.StandardProjectConfigurations.configureAnnotationProcessors() and StandardProjectConfigurations.APT_OPTION_CONFIGS, which seeks to apply common configs for known processors like Dagger and Moshi.Java projects are fairly simple. Note that these are applied on all projects that apply the java plugin, which is most of them!
JavaCompile tasks have their options.release property set to this as well.JavaCompile tasks in non-android projects to ensure consistency.JavaCompile tasks have -parameters added to options.compilerArgs for better static analysis and annotation processing support.foundry.epAutoPatch property.compileOptions, defaultConfig, compileSdk/targetSdk/minSdk/ndkVersion, etc.vectorDrawables.useSupportLibrary.testOptions like orchestrator, unitTests, etc.unitTests.isReturnDefaultValues is always enabled for convenience.unitTests.isIncludeAndroidResources is only enabled if robolectric is enabled on the project, as this is expensive to enable.Test tasks to depend on the UpdateRobolectricJarsTask if robolectric is enabled.com.android.library and com.android.application projects. com.android.test is supported but somewhat limited.jniLibs handling.PermissionChecks.android.namespace, if none is manually specified in the buildscript. The namespace is inferred from the project\u2019s Gradle path.release.Kotlin projects are configured with KGP and Detekt in mind. SGP supports configuring Android, JVM, Multiplatform, and Compose Multiplatform projects. Multiplatform for targets other than JVM/android is limited at the moment.
Common configurations include:
jvmToolchain to align with the repo\u2019s JDK target.KotlinCompilation tasks with common configurations.allWarningsAsErrors.freeCompilerArgs.jvmTarget and javaParameters.StandardProjectConfigurations.configureFreeKotlinCompilerArgs(). This is an annoying thing to have to do, but necessary because kotlinc will complain if you add opt-ins that are not recognized by any dependencies on that classpath.DetektTasks.com.android.lint plugin and LintTasks.src/{variant}/kotlin source set in android projects, as these are still not automatically enabled.android.extensions extension.correctErrorTypes is set to true for better error messages.mapDiagnosticLocations is set to false because it\u2019s broken.plugins {\n id(\"com.slack.gradle.apk-versioning\")\n}\nThis plugin is applied in Android application projects and is solely to configure the versionCode and versionName of APKs based on git and Gradle property inputs.
The following properties are sourced
versionMajor=...\nversionMinor=...\nversionPatch=...\nThis also adds a generateVersionProperties task that is more or less only relevant for Slack\u2019s internal CI.
SGP is designed to work with multiple versions of AGP at a time, albeit only for forward compatibility and testing reasons. Generally SGP will only be tested against the latest stable version of AGP. To support multiple beta/canary versions of upcoming AGP versions, SGP has an API called AgpHandler, which is intended to be an AGP-agnostic common interface for configuring AGP projects across breaking API (source or binary) changes. When a new such change is introduced, we create an AgpHandler{version} artifact and implementation with that AGP version as its minimum. At runtime, SGP loads the relevant AgpHandler instance for the AGP version it is running against and relevant APIs use this instance via FoundryTools to interact with them in a version-agnostic way. These aren\u2019t always needed so there may be times when there are no implementations needed for the current suite of AGP versions.
An example handler for AGP 8.0 looks like this.
// AutoService makes it available via ServiceLoader\n// The factory should always be AGP-api agnostic.\nclass AgpHandler80 : AgpHandler {\n @Suppress(\"DEPRECATION\")\n override val agpVersion: String\n get() = com.android.builder.model.Version.ANDROID_GRADLE_PLUGIN_VERSION\n\n @AutoService(AgpHandlerFactory::class)\n class Factory : AgpHandlerFactory {\n override val minVersion: VersionNumber = VersionNumber.parse(\"8.0.0\")\n\n @Suppress(\"DEPRECATION\")\n override fun currentVersion(): String =\n com.android.builder.model.Version.ANDROID_GRADLE_PLUGIN_VERSION\n\n override fun create(): AgpHandler {\n return AgpHandler80()\n }\n }\n}\nBootstrap is a tool for bootstrapping local dev environments. This is usually used in tandem with a bootstrap bash script that runs the ./gradlew bootstrap task and any other repo-specific setups.
The core implementation lives in BootstrapTask.kt.
At a high level, bootstrap is mostly focused on configuring the JDK and daemon environments. Gradle has extremely limited configurability for the Gradle daemon, and we want to optimize the JDK for available space on different developer machines. To support this, we compute optimal daemon jvm arguments in bootstrap and write them to the user\u2019s home ~/.gradle/gradle.properties to override repo-specific settings with client-side properties.
For the JDK, it requests the JDK toolchain from Gradle\u2019s first-party APIs. This includes allowing Gradle to download the JDK if it\u2019s missing, which is useful for getting developers set up and running faster.
Bootstrap is also useful on CI for its ability to scale available memory to the machine it\u2019s running on, so we generally run it as a preflight step for all of our CI jobs too.
Finally, there are some other specific things it does to optimize things:
TODO
"},{"location":"platforms/gradle/dependency-rake/","title":"Dependency Rake","text":"Dependency rake is an tool we develop within foundry (SGP) to automatically clean up Gradle build files.
This tool uses the outputs of the dependency-analysis-gradle-plugin ( DAGP) to infer and apply fixes it recommends.
"},{"location":"platforms/gradle/dependency-rake/#types-of-fixes","title":"Types of Fixes","text":"There are three main categories of fixes that DR applies.
The primary benefit of dependency rake is to improve build times by more or less \u201craking\u201d the build dependency graph. By removing and fixing dependencies, we remove unneeded edges in the build graph. This in turn provides improved build parallelism and better avoidance in Skippy CI pipelines.
A secondary benefit is automatic upkeep of build files. As projects change over time, dependencies become obsolete and out of date. Most developers do not keep up with these changes over time, so automating this affords us extra upkeep that we currently do not do.
"},{"location":"platforms/gradle/dependency-rake/#implementation","title":"Implementation","text":"The core implementation of DR lives in DependencyRake.kt.
To run dependency rake in a project, use the below command
$ ./gradlew rakeDependencies -Pfoundry.config.enableAnalysisPlugin=true --no-configuration-cache\nThis will run all rakeDependencies tasks in the project. This task exists on all subprojects as well, but it works best if all are run together.
Sometimes dependency rake will try to replace identifiers with ones that are not present in any available version catalogs. Sometimes this is acceptable, but often times it can result in \u201cmissing\u201d dependencies from the build after it runs. To help fix these, DR will write all missing identifiers out to a build output file.
For convenience, you can also run ./gradlew aggregateMissingIdentifiers -Pslack.gradle.config.enableAnalysisPlugin=true --no-configuration-cache to run all dependency rake tasks and aggregate these missing identifiers into a root project build output file.
SGP offers a DSL extension for configuring project behavior via the plugin. The idea is that developers don\u2019t really want to think about specific dependency wirings, and instead want to express what features they want and allow SGP to automatically wire these up for them.
Some examples of this include Dagger, Moshi code gen, Robolectric, and more.
The primary entry point is the slack extension in the build file, which is backed by the SlackExtension interface.
foundry {\n features {\n dagger(...)\n moshi(...)\n }\n android {\n features {\n robolectric(...)\n }\n }\n}\nThe Circuit feature automatically sets up Circuit in the project. This includes controls for different Circuit artifacts and code gen. The default circuit() call will just enable Circuit\u2019s runtime + code gen.
The Dagger feature automatically sets up both Dagger and Anvil. This includes optional parameters to control whether or not you want the runtime only, component merging, or other features. This automatically handles applying the Anvil, kapt, or KSP plugins under the hood and any necessary dependencies to run them.
The default dagger() call will just enable Dagger\u2019s runtime + Anvil\u2019s factory generation with no component merging ( to avoid the Kapt cost).
The Moshi feature handles setting up both Moshi and MoshiX. This includes handling applying code gen logic (either KSP or IR) as well as moshi-sealed support if requested.
This enables the redacted-compiler-plugin compiler plugin.
"},{"location":"platforms/gradle/dsl/#compose","title":"Compose","text":"The Compose feature handles setting up Compose in both Android and multiplatform projects. This handles a bunch of boilerplate (see ComposeUtil.kt) for applying the right compose-compiler artifact version as well as enabling the right controls in the Android plugin.
This enables Gradle test fixtures in a project-agnostic fashion. In JVM projects this will apply the java-test-fixtures plugin, in Android projects this will configure the android.testFixtures.enable property.
The Robolectric feature handles setting up Robolectric in an Android project. This entails common Robolectric dependencies (including any bundles or core Robolectric project dependencies). This also sets up Robolectric jar downloads (via UpdateRobolectricJarsTask) for test tasks and enabling resource merging in tests (which Robolectric requires). There are a few other controls that StandardProjectConfigurations use to control or patch Robolectric\u2019s behavior.
By default, SGP disables androidTests in projects. These can be enabled via the androidTest() feature, which will enable the relevant controls in the Android plugin. This can also accept specified variants to enable/disable.
This is important for opting in tests to AndroidTest APK Aggregation.
"},{"location":"platforms/gradle/dsl/#resources","title":"Resources","text":"By default, we disable Android resources (different from Java resources) and libraries have to opt-in to using them.
This can be enabled via the resources() feature, which will enable the relevant BuildFeature in the Android plugin and also takes a required prefix parameter that is used as the required resourcePrefix for that library\u2019s resources to avoid naming conflicts.
This enables checking of a permission allowlist. See PermissionChecks for more details.
SGP supports running a number of formatters and static analysis tools.
Individual tools are usually gated on whether they have a version specified in libs.versions.toml. If they do not have a version specified, they are deemed not enabled.
The core set of formatters are:
The core set of analysis tools supported in SGP are:
SGP ships with a standard set of git hooks (pre-commit, etc) that it can bootstrap in projects by running ./gradlew installCommitHooks. These hooks rely on checking in relevant binaries for each formatter/checker, it\u2019s strongly recommended to use git-lfs for these. These files should be edited as needed to best serve the project they\u2019re running in.
SGP can configure these hooks in the project automatically during bootstrap if you add the foundry.git.hooksPath gradle property and point it at the hooks directory that the above command output to, or wherever the host project opts to store them.
Note that Detekt is not yet supported in git hooks as these require extra parameters for baselines.
"},{"location":"platforms/gradle/formatters-and-analysis/#downloading-binaries","title":"Downloading binaries","text":"Each tool (ktfmt, gjf, etc) has corresponding ./gradlew update<tool name> tasks that you can run to download and install them, by default to config/bin/<tool name>. You should re-run these any time you update a tool to re-run them.
TODO
"},{"location":"platforms/gradle/mod-score/","title":"Mod Score","text":"TODO
"},{"location":"platforms/gradle/properties/","title":"Properties","text":"TODO
"},{"location":"platforms/gradle/testing/","title":"Testing","text":"TODO
"},{"location":"platforms/gradle/thermals-logging/","title":"Thermals Logging","text":"TODO
"},{"location":"platforms/gradle/utilities/","title":"Utilities","text":"There are a bunch of miscellaneous utilities and tools in this project that don\u2019t necessarily warrant their own dedicated docs page.
"},{"location":"platforms/gradle/utilities/#androidsourcesconfigurer","title":"AndroidSourcesConfigurer","text":"When testing new Android SDK betas, the compile SDK version is available months before sources are. Developers want to build against these APIs, but we don\u2019t want to make their experience in the IDE worse than necessary. The problem with using a compile SDK version that doesn\u2019t have sources is that the IDE can\u2019t provide any documentation for the APIs and will just show stub files instead.
To work mitigate this, we will patch the SDK by putting a copy of the previous version\u2019s sources in the location of the new SDK. This allows most sources to still index properly during the beta period. Then, once the new sources are available, the consuming repo needs only to update the foundry.latestCompileSdkWithSources gradle property to that new SDK version and the patcher will clear out that copy and let AGP download the real ones.
This runs automatically in the root plugin.
"},{"location":"platforms/gradle/utilities/#androidtest-apk-aggregation","title":"AndroidTest APK Aggregation","text":"At Slack we use FTL + Fladle for running our instrumentation tests. In order to add more test APKs from modularized instrumentation tests in other subprojects, we have to aggregate a list of their locations and pass them on to Fladle. This is done via AndroidTestApksTask, which is registered in the root project and can be wired to pipe its output file into Fladle\u2019s config input.
Example
val aggregatedApksProvider = rootProject.tasks\n .named<AndroidTestApksTask>(\"aggregateAndroidTestApks\")\n .flatMap { it.outputFile }\n .map { it.asFile.readLines() }\n\ntasks\n .withType<YamlConfigWriterTask>()\n .named { it == \"writeConfigProps${fladleTarget}\" }\n .configureEach { additionalTestApks.value(testInputsProvider) }\nThis task is automatically added to whenever a subproject uses the androidTest() DSL feature.
PermissionChecks","text":"Permissions are an integral part of Android apps, and oversight into what permissions are required in the app is critical to a release pipeline. PermissionChecks is a feature to help with this.
The workflow we use at Slack is like this:
permissionsAllowlist.txt file in the Slack android repo.allowListFile DSL feature in the application project.This way new permissions are not accidentally or secretly added to the app.
"},{"location":"tools/cli/","title":"Foundry CLIs","text":"An artifact containing basic CLI utilities for Kotlin.
"},{"location":"tools/cli/#installation","title":"Installation","text":"
// In Gradle\ndependencies {\n implementation(\"com.slack.foundry:cli:<version>\")\n}\n\n// In kotlin script\n@file:DependsOn(\"com.slack.foundry:cli:{version}\")\nIf consuming these utilities from a kotlin script file, you can test changes like so:
gradle.properties, such as 2.5.0-LOCAL1../gradlew publishToMavenLocal to publish the current version to your local maven repository.@file:Repository(\"file:///Users/{username}/.m2/repository\")\n@file:DependsOn(\"com.slack.foundry:cli:{version you set in gradle.properties}\")\nTODO
"}]} \ No newline at end of file diff --git a/sitemap.xml.gz b/sitemap.xml.gz index 8109a5d0c..bd75785e9 100644 Binary files a/sitemap.xml.gz and b/sitemap.xml.gz differ