Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Selfhosted
  3. How to download Google Takeout zips?

How to download Google Takeout zips?

Scheduled Pinned Locked Moved Selfhosted
selfhosted
19 Posts 12 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • paequ2@lemmy.todayP This user is from outside of this forum
    paequ2@lemmy.todayP This user is from outside of this forum
    [email protected]
    wrote last edited by
    #1

    So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

    Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

    Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

    S walden@wetshav.ingW gedaliyah@lemmy.worldG D mhzawadi@lemmy.horwood.cloudM 9 Replies Last reply
    9
    • paequ2@lemmy.todayP [email protected]

      So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

      Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

      Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

      S This user is from outside of this forum
      S This user is from outside of this forum
      [email protected]
      wrote last edited by
      #2

      I have tried to solve this many times as I want to regularly back up my Google content - mostly the images for the same purpose you mention.

      Unfortunately there is no good solution I've ever come up with or found. I even looked into scripting with something like puppeteer. It requires regular confirmation of your authentication and I just haven't found a good way to solve that since there's no API access. It also won't let you use any cli tools like wget. You could probably figure out how to pull some token or cookie to give to the cli but you'd have to do it so often that its more of a pain than just manually downloading.

      My solution currently is to run a firefox browser in a container on my server to download them. It acts as sort of a session manager (like tmux or zellij for command line) so that if the PC I'm using goes to sleep or something, the downloads continue. Then I just check in occasionally through the day. Plus I wanted them on the server anyway, at the end of the day. Downloading them there directly saves me having to then transfer to the server.

      Switching to .tgz will let you make up to 50GB files which at least means fewer iterations and longer time between interactions (so I can actually do something useful in the meantime).

      I sincerely hope someone proves me wrong and has a way to do this but I've searched a lot. I know other people want to solve it but I've never seen anyone with a solution.

      1 Reply Last reply
      4
      • paequ2@lemmy.todayP [email protected]

        So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

        Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

        Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

        walden@wetshav.ingW This user is from outside of this forum
        walden@wetshav.ingW This user is from outside of this forum
        [email protected]
        wrote last edited by
        #3

        Do it again, but select 50GB chunks. This will produce fewer files.

        Use immich-go to do the importing.

        paequ2@lemmy.todayP 1 Reply Last reply
        5
        • walden@wetshav.ingW [email protected]

          Do it again, but select 50GB chunks. This will produce fewer files.

          Use immich-go to do the importing.

          paequ2@lemmy.todayP This user is from outside of this forum
          paequ2@lemmy.todayP This user is from outside of this forum
          [email protected]
          wrote last edited by
          #4

          select 50GB chunks

          That wasn't an option for zip files.

          Looks like for tarballs, I can select 50GB chunks. However, immich-go's best practices say to pick zip.

          Choose the ZIP format when creating your takeout for easier import.

          https://github.com/simulot/immich-go?tab=readme-ov-file#google-photos-best-practices

          What difference does it make to immich-go if I pick zip vs tar?

          30p87@feddit.org3 walden@wetshav.ingW 2 Replies Last reply
          1
          • paequ2@lemmy.todayP [email protected]

            So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

            Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

            Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

            gedaliyah@lemmy.worldG This user is from outside of this forum
            gedaliyah@lemmy.worldG This user is from outside of this forum
            [email protected]
            wrote last edited by
            #5

            Well, you won't like it. If you have very fast internet and a managed downloader, then you may be able to get all of the files. Google seems to throttle the speeds to make large takeouts almost impossible to download in the limited time allowed.

            For this size of download, your best option is to get a subscription to a compatible service (Dropbox, etc.) To transfer the files, which will happen much more quickly than downloading yourself. Then download the files from that service at your leisure, and then cancel the service.

            It's pretty backwards, but it's really the best option for large takeouts (over 5 gigs or so).

            1 Reply Last reply
            0
            • paequ2@lemmy.todayP [email protected]

              So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

              Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

              Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

              gedaliyah@lemmy.worldG This user is from outside of this forum
              gedaliyah@lemmy.worldG This user is from outside of this forum
              [email protected]
              wrote last edited by
              #6

              Also, you will need to do some preprocessing of your files before importing to immich. Something like this to fix the metadata. I can't remember which one I used, because there are a few out there.

              1 Reply Last reply
              2
              • paequ2@lemmy.todayP [email protected]

                select 50GB chunks

                That wasn't an option for zip files.

                Looks like for tarballs, I can select 50GB chunks. However, immich-go's best practices say to pick zip.

                Choose the ZIP format when creating your takeout for easier import.

                https://github.com/simulot/immich-go?tab=readme-ov-file#google-photos-best-practices

                What difference does it make to immich-go if I pick zip vs tar?

                30p87@feddit.org3 This user is from outside of this forum
                30p87@feddit.org3 This user is from outside of this forum
                [email protected]
                wrote last edited by
                #7

                For .tgz files (compressed tar archives), you'll need to decompress all the files into a single folder before importing. Then use the command immich-go upload from-google-photos /path/to/your/files.

                1 Reply Last reply
                2
                • paequ2@lemmy.todayP [email protected]

                  So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

                  Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

                  Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

                  D This user is from outside of this forum
                  D This user is from outside of this forum
                  [email protected]
                  wrote last edited by
                  #8

                  The asinine route I took was to authorise Google to deliver the file(s) to my OneDrive and then use one drive sync to download them.

                  There are benefits, the files are 'backed up' on another cloud; the process it entirely independent of you having a browser session.

                  1 Reply Last reply
                  3
                  • paequ2@lemmy.todayP [email protected]

                    So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

                    Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

                    Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

                    mhzawadi@lemmy.horwood.cloudM This user is from outside of this forum
                    mhzawadi@lemmy.horwood.cloudM This user is from outside of this forum
                    [email protected]
                    wrote last edited by
                    #9

                    Have you looked at rclone?

                    You can plug rclone into your Google drive and then use copy to download all your photos into immich, the setup is also very easy

                    U paequ2@lemmy.todayP 2 Replies Last reply
                    0
                    • paequ2@lemmy.todayP [email protected]

                      select 50GB chunks

                      That wasn't an option for zip files.

                      Looks like for tarballs, I can select 50GB chunks. However, immich-go's best practices say to pick zip.

                      Choose the ZIP format when creating your takeout for easier import.

                      https://github.com/simulot/immich-go?tab=readme-ov-file#google-photos-best-practices

                      What difference does it make to immich-go if I pick zip vs tar?

                      walden@wetshav.ingW This user is from outside of this forum
                      walden@wetshav.ingW This user is from outside of this forum
                      [email protected]
                      wrote last edited by
                      #10

                      Ah, maybe the max was 20GB for zip. I'd just do the max available for zip.

                      flamekebab@piefed.socialF 1 Reply Last reply
                      0
                      • paequ2@lemmy.todayP [email protected]

                        So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

                        Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

                        Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

                        T This user is from outside of this forum
                        T This user is from outside of this forum
                        [email protected]
                        wrote last edited by
                        #11

                        I just clicked download on 3 at a time until I was done. Could it be automated? Sure. But clicking 3 at a time is way faster than figuring it out.

                        I HIGHLY recommend immich-go if you haven't found it yet:
                        https://github.com/simulot/immich-go

                        Enjoy immich!! Great self hosting project.

                        1 Reply Last reply
                        4
                        • mhzawadi@lemmy.horwood.cloudM [email protected]

                          Have you looked at rclone?

                          You can plug rclone into your Google drive and then use copy to download all your photos into immich, the setup is also very easy

                          U This user is from outside of this forum
                          U This user is from outside of this forum
                          [email protected]
                          wrote last edited by
                          #12

                          Negative, full-res photos with EXIF is not possible to access with rclone (due to Photos API limitations).

                          mhzawadi@lemmy.horwood.cloudM 1 Reply Last reply
                          0
                          • U [email protected]

                            Negative, full-res photos with EXIF is not possible to access with rclone (due to Photos API limitations).

                            mhzawadi@lemmy.horwood.cloudM This user is from outside of this forum
                            mhzawadi@lemmy.horwood.cloudM This user is from outside of this forum
                            [email protected]
                            wrote last edited by
                            #13

                            Welp, thanks Google.

                            1 Reply Last reply
                            0
                            • walden@wetshav.ingW [email protected]

                              Ah, maybe the max was 20GB for zip. I'd just do the max available for zip.

                              flamekebab@piefed.socialF This user is from outside of this forum
                              flamekebab@piefed.socialF This user is from outside of this forum
                              [email protected]
                              wrote last edited by
                              #14

                              Unless they've changed it in the last month then it's 50 GB for zip.

                              paequ2@lemmy.todayP 1 Reply Last reply
                              1
                              • paequ2@lemmy.todayP [email protected]

                                So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

                                Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

                                Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

                                T This user is from outside of this forum
                                T This user is from outside of this forum
                                [email protected]
                                wrote last edited by
                                #15

                                This worked pretty well for me, although constructing the cli command took a little elbow grease. This video proved to be very helpful.

                                Here's the commands I ended up using:

                                Testing Upload Process

                                Before performing the actual upload, test the process with this command:

                                immich-go.exe -server http://[server.ip:port} -key [put your apikey here w/o brackets} upload -dry-run -google-photos takout-*.zip
                                

                                Actual Upload

                                Once testing is successful, perform the full upload:

                                immich-go.exe -server http://[server.ip:port} -key [put your apikey here w/o brackets} upload -google-photos takout-*.zip
                                

                                Remove Duplicates

                                If you've previously uploaded photos before syncing your phone, remove duplicates with:

                                immich-go.exe -server http://[server.ip:port} -key [apikey} duplicate -yes
                                
                                paequ2@lemmy.todayP 1 Reply Last reply
                                0
                                • paequ2@lemmy.todayP [email protected]

                                  So I started the Google Takeout process because I want to move my photos from Google Photos to Immich.

                                  Google emailed me saying the archives are ready... uh... I have to download 81 zip files, each 2GB big... 😬

                                  Is there an easy way to download all of these files? Or do I have to click "download" 81 times and hope the downloads don't get interrupted?

                                  S This user is from outside of this forum
                                  S This user is from outside of this forum
                                  [email protected]
                                  wrote last edited by
                                  #16

                                  I recently went through the same process. Luckily only 6 zip files, and all but one (the one with my emails) were pretty much empty.

                                  What really pissed me off: because i didnt log in with my current device to google yet, after i let google create the takeout it came to me like "ehh i dont know this phone yet, better wait a week to download"
                                  A week later: "ohh seems like we only store takeouts for a week, guess you gotta do it again :("
                                  Rinse, repeat, and after 3 weeks, i could finally get the only thing i cared about anyway: my mails

                                  1 Reply Last reply
                                  1
                                  • flamekebab@piefed.socialF [email protected]

                                    Unless they've changed it in the last month then it's 50 GB for zip.

                                    paequ2@lemmy.todayP This user is from outside of this forum
                                    paequ2@lemmy.todayP This user is from outside of this forum
                                    [email protected]
                                    wrote last edited by
                                    #17

                                    OOOOOOOOOOOOHHHHH. omg. I just realized the drop down menu scrolls!!! 😂

                                    1 Reply Last reply
                                    2
                                    • T [email protected]

                                      This worked pretty well for me, although constructing the cli command took a little elbow grease. This video proved to be very helpful.

                                      Here's the commands I ended up using:

                                      Testing Upload Process

                                      Before performing the actual upload, test the process with this command:

                                      immich-go.exe -server http://[server.ip:port} -key [put your apikey here w/o brackets} upload -dry-run -google-photos takout-*.zip
                                      

                                      Actual Upload

                                      Once testing is successful, perform the full upload:

                                      immich-go.exe -server http://[server.ip:port} -key [put your apikey here w/o brackets} upload -google-photos takout-*.zip
                                      

                                      Remove Duplicates

                                      If you've previously uploaded photos before syncing your phone, remove duplicates with:

                                      immich-go.exe -server http://[server.ip:port} -key [apikey} duplicate -yes
                                      
                                      paequ2@lemmy.todayP This user is from outside of this forum
                                      paequ2@lemmy.todayP This user is from outside of this forum
                                      [email protected]
                                      wrote last edited by
                                      #18

                                      Remove Duplicates

                                      Excellent! This is my next question.

                                      I've already partially synced my Google Photos library by installing Immich on my Android phone and enabling Immich backups. But I see that the oldest photo in Google Photos is way older than what Immich has.

                                      So now I'm worried that when I run immich-go with the full takeout archives, I'm going to get a ton of duplicates because half of my library is already on immich.

                                      What's the duplicate command? I can't find it in the CLI...

                                      $ immich-go duplicate --help
                                      Error: unknown command "duplicate" for "immich-go"
                                      Run 'immich-go --help' for usage.
                                      unknown command "duplicate" for "immich-go"
                                      
                                      $ immich-go  --help
                                      An alternative to the immich-CLI command that doesn't depend on nodejs installation. It tries its best for importing google photos takeout archives.
                                      
                                      Usage:
                                        immich-go [command]
                                      
                                      Available Commands:
                                        archive     Archive various sources of photos to a file system
                                        completion  Generate the autocompletion script for the specified shell
                                        help        Help about any command
                                        stack       Update Immich for stacking related photos
                                        upload      Upload photos to an Immich server from various sources
                                        version     Give immich-go version
                                      
                                      Flags:
                                        -h, --help               help for immich-go
                                        -l, --log-file string    Write log messages into the file
                                            --log-level string   Log level (DEBUG|INFO|WARN|ERROR), default INFO (default "INFO")
                                            --log-type string    Log formatted  as text of JSON file (default "text")
                                        -v, --version            version for immich-go
                                      
                                      Use "immich-go [command] --help" for more information about a command.
                                      
                                      $ immich-go version
                                      immich-go version:0.27.0,  commit:64221e90df743148a8795994af51552d9b40604f, date:2025-06-29T06:22:46Z
                                      
                                      1 Reply Last reply
                                      0
                                      • mhzawadi@lemmy.horwood.cloudM [email protected]

                                        Have you looked at rclone?

                                        You can plug rclone into your Google drive and then use copy to download all your photos into immich, the setup is also very easy

                                        paequ2@lemmy.todayP This user is from outside of this forum
                                        paequ2@lemmy.todayP This user is from outside of this forum
                                        [email protected]
                                        wrote last edited by
                                        #19

                                        Also, this assumes you have enough Google Drive storage to hold a copy of your entire photo collection. Definitely not possible in my case.

                                        1 Reply Last reply
                                        0
                                        Reply
                                        • Reply as topic
                                        Log in to reply
                                        • Oldest to Newest
                                        • Newest to Oldest
                                        • Most Votes


                                        • Login

                                        • Login or register to search.
                                        • First post
                                          Last post
                                        0
                                        • Categories
                                        • Recent
                                        • Tags
                                        • Popular
                                        • World
                                        • Users
                                        • Groups