Skip to content

John98Zakaria/nx-remotecache-gcp

 
 

Repository files navigation

npm package link

nx-remotecache-gcp

A task runner for @nrwl/nx that uses a Google Cloud Storage bucket as a remote cache. This enables all team members and CI servers to share a single cache. The concept and benefits of Cache Task Results are explained in the Nx documentation.

This package was built with nx-remotecache-custom 🙌

Compatability

Nx Remote Cache
>= 16.9.0 >= 2.0.2
< 16.9.0 < 1.2.1

Setup

  1. Add Nx to your workspace guide

  2. Install this package as dev dependency.

    npm install --save-dev nx-remotecache-gcp
  3. Authenticate to Google Cloud The user authenticating must have read/write access to the bucket as well as storage.buckets.get permission

    1. Locally using google cloud CLI using gcloud auth
    2. For Github actions use google-github-actions/auth
    3. You may provide NX_GOOGLE_APPLICATION_CREDENTIALS_PATH and point to your own Google service account credentials.
  4. Create a Google bucket to store the cache in

Creating a service account with the right permissions

To authenticate on CI it is recommended to create a service account that only has the required permissions.

  1. Create a custom role with only the storage.buckets.get permission

  2. Create a service account with the custom Role and limit it only manage the nx-cache bucket using this CEL Expression resource.name.startsWith(\"projects/_/buckets/<nx_cache_bucket.name>\")

  3. Add Object Admin to the bucket from the page of the Bucket

Configuration

Note: Environment variables have precedence over configured variables

Additionally all parameters defined in nx-remotecache-custom are valid here

Parameter Description Environment Variable / .env nx.json
Google Project Project Name in which the Bucket resides NXCACHE_GCP_PROJECT googleProject
Bucket Name Bucket name in which the cache will be stored NXCACHE_GCP_BUCKET_NAME bucketName
Read from Remote Cache Allow reading from the the remote cache NXCACHE_READ read (true/false)
Write to Remote Cache Allow writing to the the remote cache NXCACHE_WRITE write (true/false)
Credentials path (optional) Provide your own google application credentials NX_GOOGLE_APPLICATION_CREDENTIALS_PATH googleApplicationCredentialsPath
{
   "tasksRunnerOptions": {
      "default": {
         "runner": "nx-remotecache-gcp",
         "options": {
            "googleProject": "my-google-project-id",
            "bucketName": "my-nx-cache-bucket",
            "read": true,
            "write": false,
            "cacheableOperations": [
               "build",
               "test",
               "lint",
               "e2e"
            ]
         }
      }
   }
}

Run it 🚀

Running tasks should now show the storage or retrieval from the remote cache:

------------------------------------------------------------------------------
Remote cache hit: Google Cloud Bucket
File: 1fb268062785d739b5a43c1e4032fd7731c6080e2249e87a00e568b3c41acf9c.tar.gz
------------------------------------------------------------------------------

About

Remote caching for @nrwl/nx using Google Cloud Storage

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 100.0%