I personally think of a small DIY rack stuffed with commodity HDDs off Ebay with an LVM spanned across a bunch of RAID1s. I don't want any complex architectural solutions since my homelab's scale always equals 1. To my current understanding this has little to no obvious drawbacks. What do you think?
Recipe for my specific case: add fetch() on the page you want to track, supply window.location.pathname and document.referrer to track source, send it to some middleware appending data to SQLite (or any other) DB, add a data source in Grafana, filter out bots by their User-Agent headers, adjust as needed.
BTW, my phone & PDA museum page where the data on picture comes from: https://museum.tiredsysadmin.cc/
To my knowledge not really much is available. You may use an intent to trigger database export and then use SQLite to scrape data.
Also keep in mind that data is kept in device specific tables.
https://codeberg.org/Freeyourgadget/Gadgetbridge/wiki/Intent-API
Gadgetbridge allows automatic SQLite database export to the location you specify.
Navigate to Settings -> Automations -> Auto export database, and from there you can configure the details.
You can put it into a shared Syncthing folder, or something alike, or process it with Termux + Tasker. Personally, I hesitate to send megabytes of data over the wire every couple of minutes, so I rigged up a script that extracts the required metrics (for now its my steps only, the rest does not seem to be accurate) and sends a payload to my queue, where a consumer script later adds it to the DB.
FTR: currently experimenting with scraping Gadgetbridge data into Grafana.
Hello, lemmy.world! First time posting here, hope you'll find it somewhat useful.
In an attempt to protect my personal info from data-hungry cloud-infested madness that comes from app stores of various kinds, I decided to establish a routine of scraping health metrics from... myself. This particular example requires manual input, however it proved to be working reliably and much more precise than any other mood journaling app.
Feel free to ask other details, I can share my termux scripts, Tasker workflows, Grafana dashboard JSONs, and other infrastructure around it.
Well, this path seems to be the most appropriate for what I am for.
And more to that, both mergerfs and snapraid are available out of the box in the latest stable Debian release.
Thanks for pointing me at it!