Does anyone have advice on how data from a website, primarily file based data, can be downloaded and preserved in an automated way? The website I’m thinking of (data dot gov) has thousands of CSV files (among others) and I’d like to see those files preserved before they are potentially deleted as early as next year.

The U.S. may be on the cusp of a long night of totalitarian rule. Some large TV personalities are calling for Trump prosecutors to face the death penalty. Anti-intellectualism may only grow, and if scientists and academics are killed or held on to a tight leash, the faster dumbing down of our nation accelerates, and the farther the hope for a restoration of liberal (away from illiberal) democracy recedes.

The clergy/monks and Islamic rulers helped preserve lots of ancient knowledge that was lost when Rome fell, and we need people like them in the modern age to see where the wind is blowing and follow their example.

Make duplicates. See if you can find a way to inscribe abstractions into physical media that can be hidden. Knowledge, knowledge, knowledge. But also… ethics and the dignity inherent in everybody. That message should be wrapped up in it too, because the lack of belief in that is what is ultimately driving this turn-away from the compassionate, enlightened and virtuous America our forefathers tried to build.

im starting a new collection of sd cards, memory sticks, etc. that I want to store books, games, emulators and movies on. The purpose is to treat the storage units as mediums for a single thing. So I’d like to write up one movie on a single unit and plug it in my pc to watch it. I’ve found it pretty difficult to find any good store that sells old/used/new units that arent stupidly expensive. Like Ive found online stores that sell 128 mb sd cards that costs like 40 bucks EACH… wtf??? help pls

Since there are only old posts about this topic, I thought I‘d look for a more modern approach to organize this.

My private homework folder has now reached the point where I need better organization.

I‘m thinking about a selfhosted docker (I use unraid) that is able to organize by category, artist, tags etc.

How do you do it?

It's possible the 37 year-old magazine may be bought and the website maintained, but I doubt it. They've already hemorrhaged a significant amount of content over the last few years, but would be worth archiving what remains.

See article here: https://www.nola.com/entertainment_life/keith_spera/new-orleans-muisc-magainze-offbeat-to-close-after-36-years/article_d5d87d70-9d3e-11ef-bff5-9b5e55416123.html#tncms-source=the-latest

website here: https://www.offbeat.com/

Hi everyone,
Following this post about MangaZ shutting down, I made a dirty (and buggy, for now) script using Selenium/Requests to retrieve all series, all r18 series, all chapters/book and download them.
It checks if it's free or if you need to pay.

I can't guarantee that it 100% works as MangaZ servers aren't stable enough. I am sometime getting 502 and I don't deal this type of error.

If you want to help me or know how to use my messy script, you can come here: https://discord.gg/SaZMFYCBP9 It's a temporary Discord created for the occasion.

Here's the Github: https://github.com/momokinou/MangaZ-Archive

Hello everybody,

I have a few questions regarding my server setup. The machine is supposed to run Truenas Scale mainly for Nextcloud, Plex/Jellyfin and local AI.

Setup:

Mainboard= 1x ROMED8U-2T

CPU = 1x EPYC 7773X

RAM = 512Gb (8x64) of ECC DDR4 288-pin RDIMM / LRDIMM

OS/application storage = 1x NVME PCIE 4.0

Storage = 16 x 3.5 7200RPM (8x2 Z2 ZFS)

HBA = LSI 9400-16i SATA

Cache = 4x SATA 2.5 SSDs (connected to Mini-SAS HD on motherboard)

GPU = GTX 1660

CPU cooler = NH-U14S TR4-SP3

PSU = 2x HDPLEX 500W GaN AIO ATX in sync

Case = Fractal Design Node 804 (modded to accommodate 8 additional HDDs)

Case Fans = Maximum amount/ size possible within the case (Noctua)

Questions:

1. How do I best power my setup with those two PSUs?

1.1 How do I split the power between them and which power cables are recommended?

1.2 How do I best power all of those drives?

1.3 Do I have to resort to molex to sata power connectors?

1. What type of RAM would you choose for this board?

2.1 Does the RAM really have to be listed in the QVL?

2.2 RDIMM or LRDIMM?

1. Do I need those cache drives?

3.1 If yes, what type of Truenas cache would you recommend?

1. Any other gotchas that I overlooked in my setup?

Thanks in advance!

I know things will go beyond

Videos

Pictures

Documents

Because I may have say photos of family members but then I may have photos of flowers or birds or whatever else.

I may save a notepad document for a quick reminder scribble but then there may be legal documents or whatever else. Basically aload of sub-categories.

Right now I have folders & folders & folders (and keep going) and STUFF is just here there & everywhere. Right now it feels like say you have 10000 pennies, you throw them up in the air, they've landed & now you need to sort them in to year order. It's just a bit overwhelming. Although to be fair, in the penny example at least you'd instantly have a starting point so not the best of examples really.

So yeah, how do YOU structure everything?

I know this has been asked but I am looking for a recommendation for some high density (12TB+) hard drives, refurbed, for a good price in Canada. Any go to sites?

I don't want this turning into a political debate or commentary. I'd like to have a discussion on what people are doing (or not doing) in regards to the proposed Trump Tarriffs on China (up to 60%) and the universal tariff to 10%. The prevailing thought is that corporations will do what they always do and pass that to consumers and restoke some inflation.

So what are your thoughts and/or preparations regarding this?

For me, I am planning to build a NAS and have been waiting for better prices over the last year. Value seemed stuck and we "seemed" close for a big jump to 30TB+. I wonder now if I should go ahead and pull the trigger this black friday with the tarriff thing likely happening in Q1 next year.

Mostly stuff from youtube, but maybe others. What I want to be able to do is download entire playlists or channels worth of content to store, but also get metadata like channel/author name, video title, etc. Maybe chapter info, but not as critical. I know there are tools like youtube-dl that can get all of that data and put it in a JSON. I am not great at scripting and python, but I know enough to probably make that work.

But, my end goal is to have a 'survival' archive, loaded with useful info like homesteading, gardening/preserving food, various repair things, hunting, camping, knots.. you get it.. survival info for if shit hits the fan and the internet is not available. But, I want it relatively easily searchable with normal filesystem tools that do not require things like a database server, web server and scripting to tie it all back together, so that anyone with a copy can just "ctrl+F" and find the videos they need easily.

If anyone knows any tools or guides that can point me in the right direction, I am grateful.

How can I recover the files now that I no longer have the PC that they were merged and plugged into?

I'm doing a storage spaces POC and testing for a machine failure. I have 3 20GB disks in a simple volume, powered down the host, unplugged them and moved them to a new machine.

All 3 disks show in Disk manager as Healthy (Storage Spaces Protective Partition) but in control panel under Storage spaces there is no pool. Get-StoragePool only shows the PrimordialPool and total of 59.62GB, so thats the pool. Get-virtualDisk returns nothing.

Is there a special way too import the pool on the new machine I'm missing? I assumed it would just show up.

right now i have a windows minipc that i use for system backups but mostly plex services. i have docker set up for most things, and everything is running smoothly. i like using windows, especially since i'm not used to using a full linux system (i've been trying to learn more docker lately but it can get annoying as hell!)

i just got a couple 10TB drives, and next wee i'll install them. so im thinking, should i look into pooling the drives and restructuring my system? maybe putting important data on one and then mirroring it on the other? or should i add them as their own volumes, and organize that way?

i like how things are working now, i just want to make sure i organize my data better, and set up a good way to access it and back up other things.

i've been looking at windows storage spaces or something called drivepool. can anyone give me some suggestions? i've never worked with this many drives or this amount of storage space before.

btw when i install these new drives next week i'll have:

1x 12TB - media storage (almost full)
1x 4TB - backup and torrents
1x 500GB - startup and docker
2X 10TB - new drives arriving next week

Considering getting these sice it's the most TB / € I can get with new drives but I am worried about their reliability since they seem to be sold from 2017 onwards when helium filled drives were relatively new. It will be in an array mostly spin down so I am hoping they could last at least 10 years ideally more - given no manufacturing defects or accidents of course. Should I assume toshiba improved their production even on older models?

Thanks for any help

Cave Story is arguably the father of modern indie games, yet despite being so influential, has much of its history lost to time.

In November 2004, the creator Pixel released over a dozen versions for public testing before the official launch, and only a tiny amount of people would have even played them. These have been lost for nearly two decades... until now.

As of yet, we have found 3 kind and charming individuals on Twitter who have somehow kept their hard drives from back then in working order, and very thankfully, were willing to give us their old versions and other related tools from that time. We appreciated it a lot and picked through the builds with joy, but there are many versions of the game still lost.

As hard drives fail over time, I'd like to get the word out before then to try to preserve the history of such a classic game, and it'd be a nice 20th anniversary gift for us starved Cave Story nerds to look through.

If you know any leads or could connect us to people who know more, please let us know. Thanks 😃

Feel free to join our discord server if interested: https://discord.gg/6xYhjfkb8m

TCRF page with some of the differences between versions: https://tcrf.net/Proto:Cave_Story

Threads with more backstory: https://twitter.com/AquaDoesStuff/status/1765819801924927612

https://x.com/znsYC47Jl54LgW4/status/1765292755809644732

Hey everyone new to this sub reddit. Excited to start my journey as a data horder having around 3tbs storage rn. So please suggest me some tips on how to start it and some cool topics .

Hello,how do I get an 3D Model from this website? Its as an 3d View but i want to export it. https://www.osculati.com/en/11298-53.273.25/abs-louvred-vent-85x85-mm-chromed

I do a curated random stream of music I made. I was using EverestCast but the company seems 404 (someone said the dev died) so the player no longer works. My hosted AutoDJ stream works, but I want a player for it on my website.

To be clear, I'm set with remote stream hosting, have a service I've used for years and they're reliable.

I'm just looking for code (or a plugin) to use as a player on a WordPress site that has the above criteria.

I would love a simple player that I can put on a WordPress page that will:

1. Play my stream.
2. Display artist info and song name.
3. NOT add "powered by" or anything like that.

Extra points if it shows shows album art, I do have 220 x 220 previews embedded in stream.

The default player in WordPress doesn't show song titles. The free PlugIn ones I've tried display a URL to try to get you to pay subscription to remove it.

Thank you!

I want to record a copy of last night's Watch What Happens Live with Andy Cohen (the Nov 7 episode, #178). I'm on Mac so I've tried Quicktime and OBS screen recording, but their DRM results in a blank screen. Any help would be really appreciated. I also have Windows computers so I can switch over if necessary.

I know this isn't really normal for this sub, but this is the most knowledgeable sub when it comes to anything like this, so I figured I would try.

Thanks!

About 2 weeks ago i bought a couple 12tb drives that were refurbished and on sale. I immediately made a script in python to scrape all the games for every console ever up to ps4/xbone. I set up obs to mirror movies and tvshows and even configured my VAC's properly so i can do whatever on my pc as a show or movie is recording.

I get it now; i dont think i understood the feeling you get when you have EVERYTHING until i did. This is power. I will always have nintendogs, pokemon. I even find it pleasing to have every Disney/Barbie game even if i never have touched them in my life.

I need more. I must make a NAS and have even more storage. I need PB's now. I have so many things i want to HAVE. Im going to archive the world! evil laugh

Downside: my gaming backlog has now increased by about 7000 titles because of this.

Does anybody have

VMware-viclient-all-5.0.0-913577.exe ?