Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

agnos.is Forums

  1. Home
  2. Selfhosted
  3. Do any of you have a buttload of RAM sitting around?

Do any of you have a buttload of RAM sitting around?

Scheduled Pinned Locked Moved Selfhosted
selfhosted
40 Posts 27 Posters 0 Views
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • O [email protected]

    Define buttload

    H This user is from outside of this forum
    H This user is from outside of this forum
    [email protected]
    wrote on last edited by [email protected]
    #5

    put your butt on a scale, convert the result to RAM, duh

    paraphrand@lemmy.worldP 1 Reply Last reply
    3
    • H [email protected]

      Why not get a 0.5 or 1 tb nvme ssd and set it all as swap?

      It will run probably 10 times slower, but it's cheap and doable.

      D This user is from outside of this forum
      D This user is from outside of this forum
      [email protected]
      wrote on last edited by [email protected]
      #6

      This is the way.

      Depending on the nature of the sim, it could probably even be done with ~80 GB or less of existing SSD space using zram w/ zstd.

      1 Reply Last reply
      6
      • souperk@reddthat.comS [email protected]

        Hi,

        I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

        For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

        irmadlad@lemmy.worldI This user is from outside of this forum
        irmadlad@lemmy.worldI This user is from outside of this forum
        [email protected]
        wrote on last edited by
        #7

        The computer I'm typing on has 96 gb ram. Most of my equipment is ancient in terms of PCs. This one I build about 14 years ago, and I fully stocked it with the cutting edge tech of the day. My intent was to build a LTS PC, as it were. LOL Back then, SLI was the thing, but I've upgraded the GPU. I have some old stuff in the parts bin tho, but it's ancient as well.

        1 Reply Last reply
        0
        • souperk@reddthat.comS [email protected]

          Hi,

          I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

          For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

          W This user is from outside of this forum
          W This user is from outside of this forum
          [email protected]
          wrote on last edited by
          #8

          that's probably way too much for any sane Python algorithm. if they can't run it, how do they even know how much is needed?

          Probably they should only make a prototype in Python, and then reimplement it in a compiled language. it should reduce the resource usage massively

          1 Reply Last reply
          2
          • souperk@reddthat.comS [email protected]

            Hi,

            I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

            For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

            C This user is from outside of this forum
            C This user is from outside of this forum
            [email protected]
            wrote on last edited by
            #9

            Needing that much RAM is usually a red flag that the algo is not optimized.

            scrubbles@poptalk.scrubbles.techS D R M 4 Replies Last reply
            6
            • C [email protected]

              Needing that much RAM is usually a red flag that the algo is not optimized.

              scrubbles@poptalk.scrubbles.techS This user is from outside of this forum
              scrubbles@poptalk.scrubbles.techS This user is from outside of this forum
              [email protected]
              wrote on last edited by
              #10

              Researchers always make some of the worst coders unfortunately.

              Scientists, pair up with an engineer to implement your code. You'll thank yourself later.

              1 Reply Last reply
              9
              • souperk@reddthat.comS [email protected]

                Hi,

                I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

                For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

                I This user is from outside of this forum
                I This user is from outside of this forum
                [email protected]
                wrote on last edited by
                #11

                As an economist I can confidentally say that he should go a different route. You/ he can show me/us more if he wants to. Maybe we can tell where the problem is.

                If not, swap as others have stated is the way to go

                1 Reply Last reply
                1
                • C [email protected]

                  Needing that much RAM is usually a red flag that the algo is not optimized.

                  D This user is from outside of this forum
                  D This user is from outside of this forum
                  [email protected]
                  wrote on last edited by
                  #12

                  True, but there are also some legitimate applications for 100s of gigabytes of RAM. I've been working on a thing for processing historical OpenStreetMap data and it is quite a few orders of magnitude faster to fill the database by loading the 300GiB or so of point data into memory, sorting it in memory, and then partitioning and compressing it into pre-sorted table files which RocksDB can ingest directly without additional processing. I had to get 24x16GiB of RAM in order to do that, though.

                  C 1 Reply Last reply
                  5
                  • souperk@reddthat.comS [email protected]

                    Hi,

                    I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

                    For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

                    trk@aussie.zoneT This user is from outside of this forum
                    trk@aussie.zoneT This user is from outside of this forum
                    [email protected]
                    wrote on last edited by
                    #13

                    I've got 512GB of RAM in my server, and 128GB of RAM on my desktop cause you can never have too much.

                    1 Reply Last reply
                    1
                    • souperk@reddthat.comS [email protected]

                      Hi,

                      I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

                      For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

                      T This user is from outside of this forum
                      T This user is from outside of this forum
                      [email protected]
                      wrote on last edited by
                      #14

                      Borrow it from NewEgg, then return it

                      O 1 Reply Last reply
                      2
                      • D [email protected]

                        True, but there are also some legitimate applications for 100s of gigabytes of RAM. I've been working on a thing for processing historical OpenStreetMap data and it is quite a few orders of magnitude faster to fill the database by loading the 300GiB or so of point data into memory, sorting it in memory, and then partitioning and compressing it into pre-sorted table files which RocksDB can ingest directly without additional processing. I had to get 24x16GiB of RAM in order to do that, though.

                        C This user is from outside of this forum
                        C This user is from outside of this forum
                        [email protected]
                        wrote on last edited by
                        #15

                        Yea, that makes sense. You could sort it in chunks, but it would probably be slower. If you are regularly doing that and can afford the ram go for it. Otherwise maybe extract the bits that need to be sorted and zip them back up later.

                        1 Reply Last reply
                        0
                        • souperk@reddthat.comS [email protected]

                          Hi,

                          I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

                          For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

                          kolanaki@pawb.socialK This user is from outside of this forum
                          kolanaki@pawb.socialK This user is from outside of this forum
                          [email protected]
                          wrote on last edited by [email protected]
                          #16

                          Not anymore... Had a box of old/junk parts lying around before I moved but I didn't bring it with me because it was essentially just garbage I never got around to taking to the electronic recycling thing because it was just a once a year thing that cost me money.

                          I'd have no problem giving away stuff like that. I wouldn't take parts out of an active machine to let someone "borrow" tho.

                          1 Reply Last reply
                          0
                          • H [email protected]

                            put your butt on a scale, convert the result to RAM, duh

                            paraphrand@lemmy.worldP This user is from outside of this forum
                            paraphrand@lemmy.worldP This user is from outside of this forum
                            [email protected]
                            wrote on last edited by [email protected]
                            #17

                            Yup, that’s some random ass memory.

                            1 Reply Last reply
                            5
                            • T [email protected]

                              Borrow it from NewEgg, then return it

                              O This user is from outside of this forum
                              O This user is from outside of this forum
                              [email protected]
                              wrote on last edited by
                              #18

                              Newegg isn't so bad. Do a shit corporate like best buy.

                              1 Reply Last reply
                              1
                              • souperk@reddthat.comS [email protected]

                                Hi,

                                I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

                                For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

                                B This user is from outside of this forum
                                B This user is from outside of this forum
                                [email protected]
                                wrote on last edited by
                                #19

                                As a hardware guy there is so little info here

                                DDR2, 3, 4, or 5? Clock speed? ECC? Registered?

                                Yeah I have boxes of older memory. But there needs to be a lot more specifics. Most of my home lab machines have at least 384gb (VMs need a lot of memory).

                                S 1 Reply Last reply
                                1
                                • souperk@reddthat.comS [email protected]

                                  Hi,

                                  I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

                                  For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

                                  T This user is from outside of this forum
                                  T This user is from outside of this forum
                                  [email protected]
                                  wrote on last edited by
                                  #20

                                  First of all, he should drop Python for anything resource intensive as such a simulation. And then think about how to optimize the algorithm.

                                  1 Reply Last reply
                                  3
                                  • souperk@reddthat.comS [email protected]

                                    Hi,

                                    I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

                                    For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

                                    P This user is from outside of this forum
                                    P This user is from outside of this forum
                                    [email protected]
                                    wrote on last edited by [email protected]
                                    #21

                                    I do not have any RAM to share, sorry.

                                    Economics simulation + Python needing 200+GB of RAM sounds preventable.

                                    In your friend's shoes, I might start asking for pointers over on the programming.dev Lemmy.

                                    As others have said, a rewrite in a faster language like C or goLang could help - but my guess is there's also ways to cut that memory need way down, while still using Python.

                                    1 Reply Last reply
                                    2
                                    • B [email protected]

                                      As a hardware guy there is so little info here

                                      DDR2, 3, 4, or 5? Clock speed? ECC? Registered?

                                      Yeah I have boxes of older memory. But there needs to be a lot more specifics. Most of my home lab machines have at least 384gb (VMs need a lot of memory).

                                      S This user is from outside of this forum
                                      S This user is from outside of this forum
                                      [email protected]
                                      wrote on last edited by
                                      #22

                                      I don't think OP wants you to lend them physical RAM modules but asks about letting his friend run random code on your high-RAM machine.

                                      B 1 Reply Last reply
                                      2
                                      • S [email protected]

                                        I don't think OP wants you to lend them physical RAM modules but asks about letting his friend run random code on your high-RAM machine.

                                        B This user is from outside of this forum
                                        B This user is from outside of this forum
                                        [email protected]
                                        wrote on last edited by
                                        #23

                                        Maybe? After rereading it I’m really not sure …

                                        S 1 Reply Last reply
                                        0
                                        • souperk@reddthat.comS [email protected]

                                          Hi,

                                          I have a friend who is looking to run a few simulations he has implemented in python and needs around 256GB of ram. He is estimating it will take a couple of hours, but he is studying economics so take that with a grain of salt 🤣

                                          For this instance, I recommended GCP, but I felt a bit dirty doing that. So, I was wondering if any of you have a buttload of memory he can burrow? Generally, would you lend your RAM for a short amount of time to a stranger over the internet? (assuming internet acccess is limited to a signle ssh port, other necessary safeguards are in place)

                                          S This user is from outside of this forum
                                          S This user is from outside of this forum
                                          [email protected]
                                          wrote on last edited by
                                          #24

                                          First, define what you are asking for.

                                          Do you want someone to send you a cardboard box full of RAM? Then forget it. Nobody would be stupid enough to lend that much expensive hardware to someone on the internet.

                                          Or are you asking for someone to let you run random code on their PC for a few hours? Then forget it. Nobody would be stupid enough to open "a single SSH port" to someone on the internet to run potential malware on their PC.

                                          That's exactly what cloud platforms are there for, and if you don't like google, get any other cloud provider.

                                          scrubbles@poptalk.scrubbles.techS 1 Reply Last reply
                                          13
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups