Do I have to install packages needed each time when I start Google Colab?

Question

I am using Google colab for one of my projects. I have a list of packages which I need to run the notebook perfectly. So, should I have to install all packages each time I start colab or only installing once I can use them forever?

Ussery

Seems like you can permanently install them now via !pip. See here – Umbilicate

Answer 1

You'll need to install it each time. From the FAQ:

Where is my code executed? What happens to my execution state if I close the browser window? Code is executed in a virtual machine dedicated to your account. Virtual machines are recycled when idle for a while, and have a maximum lifetime enforced by the system.

Periodate

Thanks, Your 'Yes' answer told me the only running way it shows – Klehm

But each time I start a new session and install, it says requirement already met - why? – Excruciation

Answer 2

EDIT: I incorrectly assumed you wanted to install R packages, but I'll leave this here in case it's useful to someone. I'm not familiar enough with Python to know whether a solution like this would be feasible.

The accepted answer is indeed correct, you will need to install your packages to the virtual machine every time you run it. However, you can use the lib and lib.loc arguments of install.packages and library to your advantage.

I've managed to circumvent this issue somewhat by creating a library of packages in my google drive.

I then connect to drive at the beginning of the notebook and load the packages from there. Here's how I did it.

1. Load R into your Python NB

%reload_ext rpy2.ipython

2. Connect your notebook to drive (only available in Python NBs).

from google.colab import drive
drive.mount('/content/mydrive')

3. Install your packages into a folder in your drive.

%%R
lib_loc <- "/content/mydrive/r-lib"
install.packages("data.table", lib = lib_loc)

4. Flush and unmount the drive, just to make sure it works!

drive.flush_and_unmount()

5. Next time you run the notebook, you don't need to install the packages, you just need to do #1, and #2 and then load your packages from your new library.

%%R
lib_loc <- "/content/mydrive/r-lib"
library(data.table, lib.loc = lib_loc)

In case you're wondering, the %%R is a call to the R engine inside a Python notebook.

Hope this helps.

Frances

I get this error when I try step #3: R[write to console]: Warning in install.packages("texreg", lib = lib_loc) : R[write to console]: R[write to console]: 'lib = "/content/mydrive/Intro_R/r-lib"' is not writable Would you like to use a personal library instead? (yes/No/cancel – Palmer

@TobiasP.G. make sure that the path exists /content/mydrive/Intro_R/r-lib , one way to to make sure these folders exist in the same order in google drive. – Viscountcy

there is an automount feature now, which probably wasn't available at the time of this post. The automount mounts the google drive folder under /content/drive/MyDrive, instead of the path above. This may be a source of error for many trying this solution combined with the automount feature. – Driskell

Answer 3

If you connect to a local runtime then you can install once and use forever.

Here is how: https://research.google.com/colaboratory/local-runtimes.html

Lanitalank