在 git 中查找未提交或未跟踪文件的总大小

Question

I have a big horrible pile of code and I am setting it up in version control.

I would like a command I can run on Linux to give me the total size of the files that would be committed and pushed if I ran git add -A && git commit -am 'initial commit'

The total size is needed, also a break down by folder would be handy.

I will then use this to build up my ignores so that I can get the repo to a realistic size before I push it up

Answer 1

I think I have answered my own question:

for f in `git status --porcelain | sed 's#^...##'`; do du -cs $f | head -n 1; done | sort -nr;  echo "TOTAL:"; du -cs .

However I'm open to any better ideas or useful tricks. My current output is 13GB :)

---

The above command is basically there, it gives me the total line by line from git status but doesn't give me the total sum. I'm currently getting the total of all files at the end which is not correct. I tried some use of bc but couldn't get it to work

Answer 2

I adapted the answer of edmondscommerce by adding a simple awk statement which sums the output of the for loop and prints the sum (divided by 1024*1024 to convert to Mb)

for f in `git status --porcelain | sed 's#^...##'`; do du -cs $f | head -n 1; done | sort -nr  | awk ' {tot = tot+$1; print } END{ printf("%.2fMb\n",tot/(1024*1024)) }' 

Note that --porcelain prints pathnames relative to the root of the git repos. So, if you do this in a subdirectory the du statement will not be able to find the files..

(whoppa; my first answer in SoF, may the force be with it)

Answer 3

I've used a modified version of this, because I had files with spaces in them which made it crash. I was also unsure about the size calculations and removed a useless head :

git status --porcelain | sed 's/^...//;s/^"//;s/"$//' | while read path; do
    du -bs "$path" ;
done | sort -n | awk ' {tot = tot+$1; print } END { printf("%.2fMB\n",tot/(1024*1024)) }'

I prefer to use while as it's slightly safer than for : it can still do nasty things with files that have newlines in them so I wish there was a to pass null -separate files yet still be able to grep for the status, but I couldn't find a nice way for that.

Answer 4

Since version 2.11 , git provides a handy "count-objects" command :

git count-objects -H

If this is not enough, I would recommend git-sizer from github : https://github.com/github/git-sizer

git-sizer --verbose

Detailed usage here : https://github.com/github/git-sizer/#usage

Answer 5

Since you're just adding everything, I don't see any reason to go via Git. Just use the ordinary Unix tools: du , find , &c.