Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Selfhosted
  3. introducing copyparty, the FOSS file server

introducing copyparty, the FOSS file server

Scheduled Pinned Locked Moved Selfhosted
selfhosted
136 Posts 85 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • T [email protected]

    BTRFS and ZFS support real deduplication via copy on write, and would eliminate all current disadvantages of symlink and hardlink deduplication. It just works.

    yeah that's a good point, I'll add an option to take advantage of this if you know you're running on a filesystem where that works as intended.

    Why have it be one huge python source file?

    oh don't worry, it's all separate files during development -- there's a build-stage which bundles everything up into a single file for distribution. But thanks for the concern πŸ˜„

    C This user is from outside of this forum
    C This user is from outside of this forum
    [email protected]
    wrote last edited by
    #56

    Ah, so you have compiled it into one file? Didn't know that was possible for python, what tool do you use for this?

    T 1 Reply Last reply
    1
    • T [email protected]

      I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

      The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

      This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

      P This user is from outside of this forum
      P This user is from outside of this forum
      [email protected]
      wrote last edited by
      #57

      The fact you mention security features, without ever saying it's 'super secure' tells me you know a lot about what you're doing. I'm so sick of apps like this that start with "most secure app on the net" but you know they're delusional. Thank you, going to check this out.

      T 1 Reply Last reply
      9
      • T [email protected]

        I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

        The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

        This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

        sefra1@lemmy.zipS This user is from outside of this forum
        sefra1@lemmy.zipS This user is from outside of this forum
        [email protected]
        wrote last edited by
        #58

        OMG! I've been looking for something like this for quite some time!

        I will try this as soon as I have time. Thank you!

        1 Reply Last reply
        0
        • C [email protected]

          Ah, so you have compiled it into one file? Didn't know that was possible for python, what tool do you use for this?

          T This user is from outside of this forum
          T This user is from outside of this forum
          [email protected]
          wrote last edited by
          #59

          sooo this is one of the things that started with someone saying "wouldn't it be funny if..."

          if you open copyparty-sfx.py in a text editor, you'll see how -- but please make sure to use an editor which is able to handle about 600 KiB of comments which contain invalid utf8 / binary garbage 😁

          I ended up rolling my own packer since I wanted optimal encoding efficiency, and everything I could find would do stuff like base85 or ucs2 tricks, but it turns out python is perfectly happy with binary garbage in comments if you declare that the file is latin-1 so it realizes all hope is lost πŸ˜„

          the only drawback of the sfx.py is that it needs to extract to $TEMP before running, so that's the slight advantage of the zipapp (the .pyz alternative), but that suffers from some performance reduction in return, and is more hermetic (doesn't let you swap out the bundled dependencies with fresh versions as easily if necessary)

          C tatterdemalion@programming.devT 2 Replies Last reply
          6
          • T [email protected]

            I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

            The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

            This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

            cyrano@lemmy.dbzer0.comC This user is from outside of this forum
            cyrano@lemmy.dbzer0.comC This user is from outside of this forum
            [email protected]
            wrote last edited by
            #60

            This is really impressive

            1 Reply Last reply
            0
            • T [email protected]

              I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

              The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

              This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

              H This user is from outside of this forum
              H This user is from outside of this forum
              [email protected]
              wrote last edited by
              #61

              Looks fantastic, I'll actually be trying this. Love how it doesn't lock my files into some obscure format like seafiles.

              1 Reply Last reply
              1
              • C [email protected]

                Hey fellow scener, cool project!

                Just a few thoughts/questions:

                • BTRFS and ZFS support real deduplication via copy on write, and would eliminate all current disadvantages of symlink and hardlink deduplication. It just works.
                • Why have it be one huge python source file? This is a serious code smell imo, and something you really should avoid doing as this can be a major maintenance burden.
                suzune@ani.socialS This user is from outside of this forum
                suzune@ani.socialS This user is from outside of this forum
                [email protected]
                wrote last edited by
                #62

                Just a remark from someone who runs ZFS since the beginning. Many people don't like the deduplication feature because of its memory footprint.

                It's also nice to have this feature without relying on a certain filesystem.

                C 1 Reply Last reply
                0
                • T [email protected]

                  I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                  The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                  This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                  01189998819991197253@infosec.pub0 This user is from outside of this forum
                  01189998819991197253@infosec.pub0 This user is from outside of this forum
                  [email protected]
                  wrote last edited by
                  #63

                  Very sleek project. The language switcher bit was brilliant hahaha. Seriously, good job.

                  1 Reply Last reply
                  1
                  • T [email protected]

                    I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                    The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                    This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                    danhab99@programming.devD This user is from outside of this forum
                    danhab99@programming.devD This user is from outside of this forum
                    [email protected]
                    wrote last edited by
                    #64

                    Oh my gawd what a README!! I'm on my phone and I was trying to scroll back to the top of it from the bottom and I just kept on scrolling... Holy shit I'm going to put this on my kanban board give it proper attention

                    C 1 Reply Last reply
                    1
                    • T [email protected]

                      I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                      The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                      This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                      L This user is from outside of this forum
                      L This user is from outside of this forum
                      [email protected]
                      wrote last edited by
                      #65

                      Haven't looked at the project yet, but that's just the greatest name for a fileserver...

                      1 Reply Last reply
                      1
                      • T [email protected]

                        BTRFS and ZFS support real deduplication via copy on write, and would eliminate all current disadvantages of symlink and hardlink deduplication. It just works.

                        yeah that's a good point, I'll add an option to take advantage of this if you know you're running on a filesystem where that works as intended.

                        Why have it be one huge python source file?

                        oh don't worry, it's all separate files during development -- there's a build-stage which bundles everything up into a single file for distribution. But thanks for the concern πŸ˜„

                        R This user is from outside of this forum
                        R This user is from outside of this forum
                        [email protected]
                        wrote last edited by
                        #66

                        What do you use to bundle into one file?

                        T 1 Reply Last reply
                        0
                        • T [email protected]

                          I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                          The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                          This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                          U This user is from outside of this forum
                          U This user is from outside of this forum
                          [email protected]
                          wrote last edited by
                          #67

                          Look cool! I think you should consider putting a screenshot of the UI somewhere near the top of the README

                          T 1 Reply Last reply
                          2
                          • danhab99@programming.devD [email protected]

                            Oh my gawd what a README!! I'm on my phone and I was trying to scroll back to the top of it from the bottom and I just kept on scrolling... Holy shit I'm going to put this on my kanban board give it proper attention

                            C This user is from outside of this forum
                            C This user is from outside of this forum
                            [email protected]
                            wrote last edited by
                            #68

                            At this rate might be faster to read code than a read me. Or convert to a wiki style if this much details are really needed.

                            1 Reply Last reply
                            1
                            • T [email protected]

                              I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                              The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                              This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                              H This user is from outside of this forum
                              H This user is from outside of this forum
                              [email protected]
                              wrote last edited by
                              #69

                              Can you point me to the WebDAV code? I’m interested to see your implementation. There are some parts of the spec that are ambiguous, and I like to see how those are implemented in different servers.

                              T 1 Reply Last reply
                              0
                              • T [email protected]

                                I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                                The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                                This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                                R This user is from outside of this forum
                                R This user is from outside of this forum
                                [email protected]
                                wrote last edited by
                                #70

                                I have a question, and I want to emphasise thar this is not criticism but a request for dive into technicalities.

                                In the video you mentioned copyparty has an one-way sync tool. Is there a good reason why it's not two-way, or is this just something you weren't motivated to do?

                                T 1 Reply Last reply
                                1
                                • T [email protected]

                                  I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                                  The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                                  This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                                  A This user is from outside of this forum
                                  A This user is from outside of this forum
                                  [email protected]
                                  wrote last edited by
                                  #71

                                  Everyone loves CP. Tell all your friends about CP.

                                  O sxan@midwest.socialS mubelotix@jlai.luM 3 Replies Last reply
                                  9
                                  • T [email protected]

                                    I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                                    The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                                    This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                                    H This user is from outside of this forum
                                    H This user is from outside of this forum
                                    [email protected]
                                    wrote last edited by
                                    #72

                                    Elderly raspberry pi B [βœ“]

                                    Large portable drive gathering dust [βœ“]

                                    Guess I'm setting up a locally hosted file server in the near future.

                                    1 Reply Last reply
                                    3
                                    • T [email protected]

                                      I made a video about copyparty, the selfhosted fileserver I've been making for the past 5 years.

                                      The main focus of the video is the features, but it also touches upon configuration. Was hoping it would be easier to follow than the readme on github... not sure how well that went, but hey πŸ˜„

                                      This video is also available to watch on the copyparty demo server, as a high-quality AV1 file and a lower-quality h264.

                                      T This user is from outside of this forum
                                      T This user is from outside of this forum
                                      [email protected]
                                      wrote last edited by
                                      #73

                                      Now it would be interesting to setup a raspberry pi with harddrives plugged in the USB 3 portsπŸ’‘

                                      1 Reply Last reply
                                      0
                                      • H [email protected]

                                        Can you point me to the WebDAV code? I’m interested to see your implementation. There are some parts of the spec that are ambiguous, and I like to see how those are implemented in different servers.

                                        T This user is from outside of this forum
                                        T This user is from outside of this forum
                                        [email protected]
                                        wrote last edited by
                                        #74

                                        sure! my implementation is really basic, just the stuff that's needed to make the clients i've tested happy, so there's probably still clients that won't be able to connect (And i'll fix those as soon as I hear about them!)

                                        httpcli.py is the http methods handler, and the webdav-specific handlers are all next to eachother, propfind // proppatch // lock // unlock // mkcol // and there's also put for the uploads, but that's not entirely webdav-specific, just webdav-aware.

                                        H 1 Reply Last reply
                                        0
                                        • R [email protected]

                                          What do you use to bundle into one file?

                                          T This user is from outside of this forum
                                          T This user is from outside of this forum
                                          [email protected]
                                          wrote last edited by
                                          #75

                                          copyparty-sfx.py is a custom packer (see this reply) created by make-sfx.sh, and copyparty.pyz is a standard zipapp, created by make-pyz.sh. The zipapp has more disadvantages than the sfx.py, so that's the default/recommended build.

                                          1 Reply Last reply
                                          1
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups