Found this when looking at Unity Scene files. They are somewhere between 2-3 mio lines so I use LFS for them.
GitHub Desktop only shows the lfs info, maybe GitFiend tries to compare the actual files?
Anyway, the loading circle won't go away even if I change to small files with minimal changes. Could only solve this by restarting GitFiend.