Feature Request: option to show projected total scrape size and confirm before downloading #81

Open
opened 2025-11-21 13:29:37 +00:00 by Crts · 2 comments

Hello!

I would like to ask/mention a feature idea, where the user gets a notification about how big the scrape size is before downloading.

Admittedly I do not know how the scraping process works in code, so I do not know if it would be implementable or not.

Basically my idea is to have an extra option inside config.conf that if enabled, it would show how big the scrape would be from the selected account(s) and then the user gets a notification about it, then decides to go with it or cancel, lets just say as an example the program asks if you still want to continue with it type Y otherwise N.

Having it as an option inside config.conf would make it so not everyone needs to use this, as I am sure people don't stay at their PCs or they just download overnight and dont want to wait for this extra check but it also would be a good addition for those who would either like to check if they have enough space on their drives and make a decision if they should scrape or change the download location before.

Hello! I would like to ask/mention a feature idea, where the user gets a notification about how big the scrape size is before downloading. Admittedly I do not know how the scraping process works in code, so I do not know if it would be implementable or not. Basically my idea is to have an extra option inside config.conf that if enabled, it would show how big the scrape would be from the selected account(s) and then the user gets a notification about it, then decides to go with it or cancel, lets just say as an example the program asks if you still want to continue with it type Y otherwise N. Having it as an option inside config.conf would make it so not everyone needs to use this, as I am sure people don't stay at their PCs or they just download overnight and dont want to wait for this extra check but it also would be a good addition for those who would either like to check if they have enough space on their drives and make a decision if they should scrape or change the download location before.
melithine added the
feature-request
label 2025-11-29 19:37:48 +00:00
Collaborator

I don't know how useful this would be, since determining the size alone would take a very significant amount oof time, but I leave this for sim0n00ps to decline if he does not want to pursue this.

I don't know how useful this would be, since determining the size alone would take a very significant amount oof time, but I leave this for sim0n00ps to decline if he does not want to pursue this.
melithine changed title from Feature Request: Show scrape size before downloading as an extra option to Feature Request: option to show scrape size and confirm before downloading 2025-11-29 20:55:14 +00:00
Owner

This can be done, my main concern is that the amout of requests that are needed to be made to work these out has always been a problem as essentially you are having to go to each media url invididually and get the file size. This can lead to you getting rate limited before you've even started downloading a piece of media. Obviously this all depends on the account you are scraping.

This can be done, my main concern is that the amout of requests that are needed to be made to work these out has always been a problem as essentially you are having to go to each media url invididually and get the file size. This can lead to you getting rate limited before you've even started downloading a piece of media. Obviously this all depends on the account you are scraping.
melithine changed title from Feature Request: option to show scrape size and confirm before downloading to Feature Request: option to show projected total scrape size and confirm before downloading 2025-12-10 14:52:47 +00:00
whimsical-c4lic0 added this to the Development Board project 2026-02-19 19:06:36 +00:00
Sign in to join this conversation.
3 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: sim0n00ps/OF-DL#81
No description provided.