How can I see the size of a GitHub repository before cloning it?
Asked Answered
F

15

573

Is there a way to see how big a Git repository is on GitHub before you decide to clone it?

This seems like a really obvious/basic statistic, but I can't find how to see it on GitHub at all.

Fillister answered 27/12, 2011 at 15:50 Comment(4)
possible duplicate of Is it possible to remote count object and size of of git repository?Shoe
@KennyTM very similar question, yes, but this is specific to github rather than any method using only the git protocol.Fillister
FYI, check out this chrome extension which automatically adds repository size to GitHub's repository summary github.com/harshjv/github-repo-size. UPDATE: added this as an answerBendicta
Here's a hint: My absolute largest repository contains only images of various formats, it's an "artwork" repo of icons which I use in various apps. Yet, GitHub reports the size as 0. So I'm assuming it only considers the size of known source files, and doesn't consider unknown file types.Wallis
C
435

There's a way to access this information through the GitHub API.

When retrieving information about a repository, a property named size is valued with the size of the whole repository (including all of its history), in kilobytes.

For instance, the Git repository weights around 124 MB. The size property of the returned JSON payload is valued to 124283.

Update

The size is indeed expressed in kilobytes based on the disk usage of the server-side bare repository. However, in order to avoid wasting too much space with repositories with a large network, GitHub relies on Git Alternates. In this configuration, calculating the disk usage against the bare repository doesn't account for the shared object store and thus returns an "incomplete" value through the API call.

This information has been given by GitHub support.

Confuse answered 30/12, 2011 at 12:47 Comment(12)
@FrançoisBeaune yes its MB.Hluchy
Isn't the size in MB now -> It's not that clear, it looks like it depends on the repo being queried... Small repos expose size in bytes, large ones in megabytes. I've opened an issue at GitHub support. I'll update the answer as soon as the issue is closed.Confuse
This doesn't seem to work for private repos. Am I missing something? Thanks!Kenzie
@Kenzie Try $ curl -u "{:username}" https://api.github.com/repos/{:organization}/{:repository}. See developer.github.com/v3/#authenticationConfuse
@Confuse Any response on the query about kB / MB etc?Henrique
Just forked a repo (September 9th, 2018) and it's kB, not MBIndefeasible
e.g. the php/php-src repo is reported to be "size": 362064,, while my file manager says it's 501 MB. looks like it's KB.Prebo
Came here looking for an answer as to why the GitHub API returns WAY less than the actual downloaded repo. Turns out this file size (which the API doesn't clearly document but appears to be in KB) is not very reliable.Wallis
PS - I guess that also explains why anything which can download a Repo via ZIP is unable to get the header with the file size... It builds the file on the fly...Wallis
Here's a hint: My absolute largest repository contains only images of various formats, it's an "artwork" repo of icons which I use in various apps. Yet, GitHub reports the size as 0. So I'm assuming it only considers the size of known source files, and doesn't consider unknown file types.Wallis
example: api.github.com/repos/date-fns/date-fns look for "size" property, in this case it's 11124 kb, which is 10.86 mb. Or, you can use Chrome extension described below by @Bigwave.Pratte
@Confuse The size is in KB.Musicianship
V
255

If you own the repository, you can find the exact size by opening your Account SettingsRepositories (https://github.com/settings/repositories), and the repository size is displayed next to its designation.

If you do not own the repository, you can fork it and then check the in the same place.

Note: You might be the owner of the organization that hosts multiple repositories and yet not have a role in a specific repository inside the organization. By default, even if you create a repository in the organization you own, you are not added to the repo and hence not see that repo in settings/repositories. So add yourself in the repository Setting(https://github.com/org-name/repo-name/settings) to see it in https://github.com/settings/repositories

Somewhat hacky: use the download as a zip file option, read the file size indicated and then cancel it.

I do not remember if downloading as a zip ever worked, but in any case, doing so now only downloads the currently selected branch with no history.

Vinegarette answered 19/6, 2012 at 2:55 Comment(11)
Shouldn't one take into account the zip compression? Source code and text files can be compressed upto about 60% I think.Aloise
I am unaware of a way to check the compression ratio of the zip without completing the download. Of course you could complete the download and then check the compression ratio. However, at that point, you might as well unzip and check the repo size directly. It really depends on how accurate you need to be. And if you can afford to download the repo to check.Vinegarette
I could not find it in Settings > Repositories, but instead found the repo size under Account Settings > Repositories off of your git home page. Of course, this only works with repos that you own (or fork).Devorahdevore
Organizations' account settings do not appear to show repo size, so it is only if you own a repo as a user and not as an organization?Speakeasy
@BBrown If you can see the repo, you can always fork it and see it that way.Vinegarette
Can't view the size of private repos, grrAlienate
The "download as a zip file" option in GitHub is actually a bit different: seems to me that it only downloads the master branch, while the former method you have indicated measures the (compressed) size of all branches.Fireboard
The size of the zip file is no indication at all of the actual repository size: 1) it only includes a snapshot of the repository at a given revision with no history and 2) Git repositories are stored as pack files which are compressed, do not store duplicates etc.Expect
In addition, the ZIP file is built on-the-fly, so there's no way of getting the size of the repo before-hand. You'd have to wait for the file to finish downloading, then read it. But of course, compressed data is unreliable information.Wallis
This is such an easy method and shows the exact size. Thanks:)Kinsman
How... inconvenientMasterful
O
122

If you use Google Chrome browser you can install the GitHub Repository Size extension.

enter image description here

Repo here: https://github.com/harshjv/github-repo-size

Organogenesis answered 7/2, 2017 at 15:30 Comment(4)
any firefox port?Alton
@BaneeIshaqueK its not the same but it does show you the repo size check it hereWakefield
UPDATE Now, works perfectly even in private repositories as long as you provide the Github token.Sussex
Still not reliable, it uses the GitHub API, which does not report correct size. I have a repository with nothing but images (no code), and the API reports the size as 0, although it's the largest repo I have. This extension doesn't even show me the size of this particular repo (probably because it sees 0).Wallis
F
41

@larowlan great sample code. With the new GitHub API V3, the curl statement needs to be updated. Also, the login is no longer required:

curl https://api.github.com/repos/$2/$3 2> /dev/null | grep size | tr -dc '[:digit:]'

For example:

curl https://api.github.com/repos/dotnet/roslyn 2> /dev/null | grep size | tr -dc '[:digit:]'

returns 931668 (in KB), which is almost a GB.

A private repo requires authentication. One way is with a GitHub Personal Access token:

curl -u myusername:$PERSONAL_ACCESS_TOKEN https://api.github.com/repos/$2/$3 2> /dev/null | grep size | tr -dc '[:digit:]'
Fibril answered 23/9, 2013 at 23:11 Comment(4)
This doesn't seem to work for private repos. Is there something I am missing? Thanks!Kenzie
Can you please include an example of a command that just prints the output instead of writing it to a file?Musicianship
I got "The system cannot find the path specified." I tried URLs to a couple projects including this one.Frizzell
@Frizzell You are doing something wrong with the url, check again for a mistake you've made in it. This works perfectly.Sagitta
B
34

From a browser, with JavaScript, since the Github API is CORS enabled:

fetch('https://api.github.com/repos/webdev23/source_control_sentry')
  .then(v => v.json()).then((v) => {
     console.log(v['size'] + 'KB')
  }
)
Blackberry answered 5/11, 2020 at 9:10 Comment(7)
Love this answer. Only takes seconds to get the size.Privilege
Curl? Browser extensions? NVRM's answer is literally the best one on this thread. Highly underrated. Thanks NVRM!Rehearsal
It says { "message": "Not Found", "documentation_url": "https://docs.github.com/rest/reference/repos#get-a-repository" }Kassel
The best answer!❤️Cross
very very good. Little more readable with MB conversion fetch('api.github.com/repos/aws/aws-toolkit-vscode') .then(v => v.json()).then((v) => { console.log(v['size'] /1000 + 'MB') } )Mamey
how to change the url in order to read my repo ? @BlackberryEke
I'd like to measure in MB: fetch('https://api.github.com/repos/webdev23/source_control_sentry') .then(v => v.json()).then((v) => { console.log(Math.round((v['size'] / 1024)*100)/100 + ' Mb') } ) Failing
D
28

If you're trying to find out the size of your own repositories.

All you have to do is go to GitHub settings repositories and you see all the sizes right there in the browser no extra work needed.

https://github.com/settings/repositories

Dilettante answered 13/2, 2021 at 0:9 Comment(2)
This doesn't appear to display anymore.Wholehearted
As of 05 Feb 2022 this seems to work for the personal profile but not for repositories in organizations.Myriad
A
11

To do this with curl (sudo apt-get curl) and json pretty (sudo gem install jsonpretty json):

curl -u "YOURGITHUBUSERNAME" http://github.com/api/v2/json/repos/show/OWNER/REPOSITORY |
  jsonpretty

Replace YOURGITHUBUSERNAME with your GitHub username (go figure).

Replace OWNER with the repository owner's Git username. Replace REPOSITORY with the repository name.

Or as a nice Bash script (paste this in a file named gitrepo-info):

#!/bin/bash
if [ $# -ne 3 ]
then
  echo "Usage: gitrepo-info <username> <owner> <repo>"
  exit 65
fi
curl -u "$1" http://github.com/api/v2/json/repos/show/$2/$3|jsonpretty

Use it like so:

gitrepo-info larowlan pisi reel

This will give me information on the pisi/reel repository on GitHub.

Alethiaaletta answered 7/3, 2012 at 23:41 Comment(0)
C
10

As shown in other answers, it's possible to get a size via api.github.com. It's in the size property of a JSON object returned.

To get it, just add to your repo URL an additional subdomain api and extend the repo path with /repos:

# For public repos ->
#     Repo example: Axios
#     Repo URL: https://github.com/axios/axios
        
             ⤵              ⤵
curl https://api.github.com/repos/axios/axios

# For private repos ->
#   Repo example: My-repo
#   Repo URL: https://github.com/my-org/my-repo

curl https://{username}:{api-token}@api.github.com/repos/{orgname}/{reponame}

As it's only URL, you can fetch data using any programming language.

The response will be like:

// Much more props inside
{
  "id": 23088740,
  "name": "axios",
  "full_name": "axios/axios",
  "private": false,
  "size": 4396,
  "default_branch": "v1.x",
  "visibility": "public",
  "network_count": 9581,
  "subscribers_count": 1213
}

The most important to us is size. It's in Kb now, but it could be changed in the future (as it was already).

But... I tested it a lot of times, and see that real size of repo and the size shown with the above mechanism are too different.

Let's give the same axios repo:

  • the size shown in api.github.com -> 4396 Kb -> ~4.29 Mb

What if clone a full repo:

  • pull the repo with clone repo.git command
  • get weight with command du -sh ./axios
  • have -> 8.0 Mb
  • remove .git folder from inside
  • have -> 2.6 Mb

not good, as size ~4.29 Mb is not 8 or 2.6 Mb either

What if clone only the latest commit:

  • pull the repo with --depth 1 flag, like clone repo --depth 1
  • get weight with command du -sh ./axios
  • have -> 3.2 Mb (that's close)
  • remove .git folder from inside
  • have -> same 2.6 Mb

not good, as size ~4.29 Mb is not 3.2 or 2.6 Mb either

What if clone only one branch:

  • in the above JSON we have a param, called default_branch. Let's clone
  • pull the repo with -b v1.x --single-branch flags
  • get weight with command du -sh ./axios
  • have -> 7.5 Mb (that's close)
  • remove .git folder from inside gives the same 2.6 Mb

still not good, as size ~4.29 Mb is not 7.5 or 2.6 Mb either

Thus, the size param shows something, that is close to the latest commit, but it's not the strongly right size of the repo.

I have shown above how it works with axios repo, but tests with different repos show the same results.

That's from my experience.

Charin answered 17/6, 2022 at 13:48 Comment(2)
better add your references.Scathe
True. Even I noticed the difference between API response and actual duIcelandic
B
4

If you have the official GitHub CLI installed, you can do the following:

gh api repos/<org>/<repo> --jq '.size'

I think it reports the size in KBs.

Baumgardner answered 14/3, 2022 at 17:50 Comment(0)
R
3

You need to follow the GitHub API. See the documentation here for all the details regarding your repository. It requires you to make a GET request as:

GET /repos/:owner/:repository

You need to replace two things:

  1. :owner - the username of the person who owns the repository
  2. :repository - The name of the repository

E.g., my username maheshmnj, and I own a repository, flutter-ui-nice, so my GET URL will be:

https://api.github.com/repos/maheshmnj/flutter-ui-nice

On making a GET request, you will be flooded with some JSON data and probably on line number 78 you should see a key named size that will return the size of the repository.

Tip: When working with JSON I suggest you to add a plugin that formats the JSON data to make reading JSON easy. Install the plugin.

Rattray answered 4/3, 2019 at 13:14 Comment(3)
A) As many are reporting, this size is not accurate and not reliable. B) Even if it was, your note(s) about visually reading the JSON, the line number, and formatting... all pointless. JSON isn't meant for humans to read, it's meant for computers to read. You should be mentioning to read the size key in the response, not line 78. Not to mention, different formatters will have different line breaks in different places, leaving desired data at a different line number.Wallis
@JerryDodge first thing you should carefully read the answer I have mentioned ``` you should see a key named size ``` and I said you should probablysee it on line no 78,so that indicates you should see the size key somewhere around 78, second thing if the size from the github apis was not accurate,I dont think you will find something more accurate than github apis.Rattray
I have a repository of images. Images are binary data. There are no text files in this repo at all. GitHub reports everywhere that it consumes 0 bytes. Even the website / plugin.Wallis
M
3

You can do it using the Github API

This is the Python example:

import requests


if __name__ == '__main__':
    base_api_url = 'https://api.github.com/repos'
    git_repository_url = 'https://github.com/garysieling/wikipedia-categorization.git'

    github_username, repository_name = git_repository_url[:-4].split('/')[-2:]  # garysieling and wikipedia-categorization
    res = requests.get(f'{base_api_url}/{github_username}/{repository_name}')
    repository_size = res.json().get('size')
    print(repository_size)
Macey answered 11/11, 2020 at 16:0 Comment(0)
P
3

I created a bookmarklet script to do this using the method from NVRM's Answer.

To use it, create a new bookmark, give it name, and paste this script into the URL field. Clicking on this bookmark while browsing a repo pops an alert with that repo's size in both megabytes and kilobytes.

javascript:(()=>{let url=new URL(document.location.href);if(url.origin!="https://github.com"){return}if(url.pathname=="/"){return}let p=url.pathname.slice(1,url.pathname.length);let parts=p.split('/');if(parts.length<2){return}let x=[parts[0],parts[1]].join('/');fetch(`https://api.github.com/repos/${x}`).then(r=>r.json()).then((b)=>alert(`${(b['size']/1000).toFixed(2)}mb (${b['size']}kb)`))})()
Propst answered 10/4, 2022 at 2:41 Comment(0)
I
2

To summarize @larowlan, @VMTrooper, and @vahid chakoshy solutions:

#!/usr/bin/env bash


if [ "$#" -eq 2 ]; then
    echo "$(echo "scale=2; $(curl https://api.github.com/repos/$1/$2 2>/dev/null \
    | grep size | head -1 | tr -dc '[:digit:]') / 1024" | bc)MB"
elif [ "$#" -eq 3 ] && [ "$1" == "-z" ]; then
    # For some reason Content-Length header is returned only on second try
    curl -I https://codeload.github.com/$2/$3/zip/master &>/dev/null  
    echo "$(echo "scale=2; $(curl -I https://codeload.github.com/$2/$3/zip/master \
    2>/dev/null | grep Content-Length | cut -d' ' -f2 | tr -d '\r') / 1024 / 1024" \
    | bc)MB"
else
    printf "Usage: $(basename $0) [-z] OWNER REPO\n\n"
    printf "Get github repository size or, optionally [-z], the size of the zipped\n"
    printf "master branch (`Download ZIP` link on repo page).\n"
    exit 1
fi
Integrand answered 27/5, 2015 at 23:20 Comment(0)
H
2

For a private repository, you will need to obtain a Personal Access Token from https://github.com/settings/tokens.

Then use the following curl command to get the details (substituting in values for [token], [owner] and [name]):

curl -u git:[token] https://api.github.com/repos/[owner]/[name] 2> /dev/null | grep size

As mentioned earlier, size may be in MB or KB.

Heteroecious answered 3/12, 2019 at 16:3 Comment(0)
C
0

Simply type: https://api.github.com/repos/orgname_ifany/repo_name on the browser

It'll provide you with a JSON response and find the rep_size in the size property.

enter image description here

Which is roughly equal to 1.07 GB

Coltson answered 4/10, 2023 at 14:30 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.