What do I need to cache in my CI job to avoid ngcc recompiling each time?
Asked Answered
P

3

50

With angular 9 and it's new compilation engine IVY, my CI build times have increased substantially. This is of course is because ngcc is ran on many modules.

e.g.

Compiling @angular/core : es2015 as esm2015

Compiling @angular/common : es2015 as esm2015

...

I thought ngcc cached the compiled libs in node_modules, but my node_modules is cached on my CI job and there is still compilation occuring, so it can't be.

What path should I cache to avoid recompiling all modules with ngcc on each build?

Pompon answered 4/3, 2020 at 22:54 Comment(6)
I'm not experiencing the same problem. When caching node_modules the build time reduces from 360 to 219 seconds for me. You might want to double check that your cache is working properly. Maybe your cache is scoped to the current branch? In this case the first build will regenerate the es2015 modules. Afterwards it's way quicker.Pula
What does the cache line look like exactly in your circle-ci config? The ivy build cache looks like it resides in node_modules/.cache (a hidden directory), so the glob pattern might be off?Indecipherable
In my case, the ngcc cache be removed after yarn install (or npm install).Martijn
Did anyone found answer to this?Tirol
One way of doing this is by using NxDevTools: nx.devCutshall
Note that with Angular 13, ngcc will no longer compile Angular (and any newer libraries) which will drastically speed up CI! No cache needed.Selenodont
H
1

UPDATE 1:

Hard coded Ivy entry points have been Removed from the angular build if you are using latest, it was previously & wrongly hardcoded inside Angular init TS github code link

Now/latest you can just do

ngcc --properties es2015 browser module main



For older versions only, please see Update 1 for newer versions

ngcc --properties es2015 browser module main --first-only --create-ivy-entry-points

Or as par of you build inside package.json

{  
  "scripts": {    
    "postinstall": "ngcc --properties es2015 browser module main --first-only --create-ivy-entry-points"
  }
}

Some ref configure Travis to

# custom caching for .travis.yml
install:
- npm ci
# keep the npm cache around to speed up installs
cache:
  directories:
  - "$HOME/.npm"
# you can add other 

Option 2: Much faster with yarn or pnpm

pnpm install
// or
yarn install
// or
npm install --prefer-offline --no-audit
Herzberg answered 2/2, 2021 at 23:2 Comment(1)
using --create-ivy-entry-points is not recommended.Rubie
G
0

In short, you can't do that. Current version of ngcc doesn't check for any changes and always recompile all packages upon calling ngcc command. This case can be resolved in future with angular linker but it's not certain, for sure it will improve build times.

Goldie answered 5/5, 2021 at 10:41 Comment(0)
P
-1

Retain package-lock.json and folder node_modules/ between each runs. I hope you are NOT running build on brand new image every time.

If package.json or package-lock.json gets updated in next CI build, only the updated ones will be pre-processed and installed. Others will not be installed again and again.

There are various do's and dont's guidelines around package-lock.json and node_modules folder. You will find a lot to read about it on the internet and I am not going to get involved

Thumb rule: Keep package-lock.json and node_modules together

Basically a package gets installed (mentioned in package.json) if

  1. There is no entry in package-lock.json
  2. Updated version is available than the one entered into package-lock.json
  3. Package will be removed if its not referred any more
Parsimony answered 2/8, 2021 at 21:2 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.