this post was submitted on 18 Aug 2024
219 points (97.0% liked)

Linux

48328 readers
641 users here now

From Wikipedia, the free encyclopedia

Linux is a family of open source Unix-like operating systems based on the Linux kernel, an operating system kernel first released on September 17, 1991 by Linus Torvalds. Linux is typically packaged in a Linux distribution (or distro for short).

Distributions include the Linux kernel and supporting system software and libraries, many of which are provided by the GNU Project. Many Linux distributions use the word "Linux" in their name, but the Free Software Foundation uses the name GNU/Linux to emphasize the importance of GNU software, causing some controversy.

Rules

Related Communities

Community icon by Alpár-Etele Méder, licensed under CC BY 3.0

founded 5 years ago
MODERATORS
 

I'm writing a program that wraps around dd to try and warn you if you are doing anything stupid. I have thus been giving the man page a good read. While doing this, I noticed that dd supported all the way up to Quettabytes, a unit orders of magnitude larger than all the data on the entire internet.

This has caused me to wonder what the largest storage operation you guys have done. I've taken a couple images of hard drives that were a single terabyte large, but I was wondering if the sysadmins among you have had to do something with e.g a giant RAID 10 array.

(page 3) 42 comments
sorted by: hot top controversial new old
[–] GenderNeutralBro@lemmy.sdf.org 3 points 3 months ago* (last edited 3 months ago)

Probably ~15TB through file-level syncing tools (rsync or similar; I forget exactly what I used), just copying my internal RAID array to an external HDD. I've done this a few times, either for backup purposes or to prepare to reformat my array. I originally used ZFS on the array, but converted it to something with built-in kernel support a while back because it got troublesome when switching distros. Might switch it to bcachefs at some point.

With dd specifically, maybe 1TB? I've used it to temporarily back up my boot drive on occasion, on the assumption that restoring my entire system that way would be simpler in case whatever I was planning blew up in my face. Fortunately never needed to restore it that way.

[–] krazylink@lemmy.world 2 points 3 months ago

I recently copied ~1.6T from my old file server to my new one. I think that may be my largest non-work related transfer.

[–] ipkpjersi@lemmy.ml 2 points 3 months ago* (last edited 3 months ago)

20TB (out of 21TB usable), a second 6x6TB zfs raidz2 server as my send target.

[–] potentiallynotfelix@lemdro.id 1 points 3 months ago

I think it would be my whole broken manjaro install, I just used dd to make a copy so I could work on it later lol. About 500 gigs

[–] possiblylinux127@lemmy.zip 1 points 3 months ago (1 children)

While I haven't personally had to move a data center I imagine that would be a pretty big transfer. Probably not dd though.

[–] CrabAndBroom@lemmy.ml 1 points 3 months ago

I can't imagine how nerve-wracking it would be to run dd on something like that lol. I still don't trust myself to copy a USB stick with my unimportant bullshit on it with dd, let alone a server with anything important on it!

[–] Matriks404@lemmy.world 1 points 3 months ago

Probably some vigeo game on that is ~150-200 GiB. Does that count?

load more comments
view more: ‹ prev next ›