GetemAll! - Fork of DownthemAll!

Dedicated board for extension releases/support threads

Moderators: FranklinDM, Lootyhoof

Forum rules
Please do not create new topics here unless you are an extension author in need of a dedicated releases&support thread!
User avatar
__NM64__
Lunatic
Lunatic
Posts: 399
Joined: 2013-10-17, 05:29
Location: minus 4 hours UTC

Re: GetemAll! - Fork of DownthemAll!

Post by __NM64__ » 2024-03-31, 01:05

RealityRipple wrote:
2024-03-31, 00:55
I hate to be that guy, but I think the solution is to format your partition as Ext4. :crazy:
I'm not sure if you're joking or just misunderstand, but I'm already using Ext4...?
CPU: Xeon E3-1285L v4 (4c/8t Broadwell/Intel 5th gen) @ 3.7GHz 1.152v (3.4GHz uncore)
GPU: Intel integrated Iris Pro Graphics P6300
RAM: 4x8GB Corsair Vengeance @ DDR3-1600
OS: Linux Mint Xfce + [VM] Win7 SP1 x64 

User avatar
Moonchild
Project founder
Project founder
Posts: 39502
Joined: 2011-08-28, 17:27
Location: Sweden

Re: GetemAll! - Fork of DownthemAll!

Post by Moonchild » 2024-03-31, 01:11

I don't think filesystems in general use finer granularity than seconds for "date", no matter which one is in use. Maybe you want to re-think how you manage your downloads, because you can't have your cake (perfect sorting by time) and eat it too (have fast downloads). Maybe use sequential numbering prefixes on the file names or maybe even make use of alternate data streams to store the index (although ext4 probably doesn't support that, being as old as it is). Or start using a CMS.
"Praise from a narcissistic person is always a poison dart. They don't share the stage, so discernment matters." - Dr. Ramani
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite

User avatar
__NM64__
Lunatic
Lunatic
Posts: 399
Joined: 2013-10-17, 05:29
Location: minus 4 hours UTC

Re: GetemAll! - Fork of DownthemAll!

Post by __NM64__ » 2024-03-31, 01:15

Moonchild wrote:
2024-03-31, 01:11
Maybe use sequential numbering prefixes on the file names
That's actually the idea of what I'm doing, but does Get'emAll support doing that on it's own? The way I've been doing it thus far is via the bulk rename function built into Xfce/Thunar while the files are sorted by date modified.
CPU: Xeon E3-1285L v4 (4c/8t Broadwell/Intel 5th gen) @ 3.7GHz 1.152v (3.4GHz uncore)
GPU: Intel integrated Iris Pro Graphics P6300
RAM: 4x8GB Corsair Vengeance @ DDR3-1600
OS: Linux Mint Xfce + [VM] Win7 SP1 x64 

User avatar
andyprough
Forum staff
Forum staff
Posts: 1511
Joined: 2020-05-31, 04:33

Re: GetemAll! - Fork of DownthemAll!

Post by andyprough » 2024-03-31, 01:18

__NM64__ wrote:
2024-03-31, 01:05
RealityRipple wrote:
2024-03-31, 00:55
I hate to be that guy, but I think the solution is to format your partition as Ext4. :crazy:
I'm not sure if you're joking or just misunderstand, but I'm already using Ext4...?
Wikipedia says: "Improved timestamps
As computers become faster in general, and as Linux becomes used more for mission-critical applications, the granularity of second-based timestamps becomes insufficient. To solve this, ext4 provides timestamps measured in nanoseconds." https://en.wikipedia.org/wiki/Ext4

Could be that the difficulty lies in finding a file manager that will list the files in proper nanosecond timestamp file order. If Nemo or Thunar won't do it, maybe Nautilus or Dolphin or Caja or Krusader or some other file manager will do it?

User avatar
__NM64__
Lunatic
Lunatic
Posts: 399
Joined: 2013-10-17, 05:29
Location: minus 4 hours UTC

Re: GetemAll! - Fork of DownthemAll!

Post by __NM64__ » 2024-03-31, 02:04

I got the idea that the timestamp displayed may simply not be showing anything smaller than full seconds, but I can't seem to figure out the necessary syntax for the likes of milliseconds or nanoseconds?

For example, this is the syntax for a modified ISO-8601 that uses a space between the date and the time but, as mentioned, the smallest unit is seconds:

Code: Select all

%Y-%m-%d %H:%M:%S
CPU: Xeon E3-1285L v4 (4c/8t Broadwell/Intel 5th gen) @ 3.7GHz 1.152v (3.4GHz uncore)
GPU: Intel integrated Iris Pro Graphics P6300
RAM: 4x8GB Corsair Vengeance @ DDR3-1600
OS: Linux Mint Xfce + [VM] Win7 SP1 x64 

User avatar
andyprough
Forum staff
Forum staff
Posts: 1511
Joined: 2020-05-31, 04:33

Re: GetemAll! - Fork of DownthemAll!

Post by andyprough » 2024-03-31, 03:13

__NM64__ wrote:
2024-03-31, 02:04
I got the idea that the timestamp displayed may simply not be showing anything smaller than full seconds, but I can't seem to figure out the necessary syntax for the likes of milliseconds or nanoseconds?

For example, this is the syntax for a modified ISO-8601 that uses a space between the date and the time but, as mentioned, the smallest unit is seconds:

Code: Select all

%Y-%m-%d %H:%M:%S
If you don't mind doing it from the command line, it looks to me like you can list and sort the files in a directory with a command like this using the full timestamp down to nanoseconds:

Code: Select all

ls -A -lt --full-time
It gives me some output like this in my Pictures folder:

Code: Select all

-rw-rw-r-- 1 trisquel trisquel  272636 2024-03-29 19:50:01.969584519 -0500  mmexport1711759669983.jpg
-rw-rw-r-- 1 trisquel trisquel  242128 2024-03-29 19:49:52.433694417 -0500  mmexport1711759662560.jpg
-rw-rw-r-- 1 trisquel trisquel  201318 2024-03-29 19:47:38.463316864 -0500  IMG_20240329_194604_481.jpg
-rw-rw-r-- 1 trisquel trisquel 1615758 2024-03-29 19:44:09.961069729 -0500  IMG_20240326_161723940.jpg
-rw-rw-r-- 1 trisquel trisquel  442850 2024-03-16 14:06:03.635652390 -0500  happy-birthday-gnusance.png
-rw-rw-r-- 1 trisquel trisquel  442925 2024-03-16 13:55:34.552861100 -0500  happy-birthday-gnu.png
-rw-rw-r-- 1 trisquel trisquel  129549 2024-01-20 15:55:05.253900359 -0600 'Babbages_Analytical_Engine,_1834-1871._(9660574685).jpg'
-rw-rw-r-- 1 trisquel trisquel  454070 2023-02-25 18:31:54.000000000 -0600 'Happy 39th Birthday.svg'
More info and options can be found here: https://superuser.com/questions/251421/ ... 431#251431

User avatar
__NM64__
Lunatic
Lunatic
Posts: 399
Joined: 2013-10-17, 05:29
Location: minus 4 hours UTC

Re: GetemAll! - Fork of DownthemAll!

Post by __NM64__ » 2024-03-31, 03:28

andyprough wrote:
2024-03-31, 03:13
If you don't mind doing it from the command line, it looks to me like you can list and sort the files in a directory with a command like this using the full timestamp down to nanoseconds
I kind of do mind using the terminal because I've no idea how subsequently rename the files into a basic numerical naming convention, but your command at least confirmed that the nanoseconds are actually being written to the file but either Thunar and Nemo don't support them or I need to figure out the date/time syntax thing for values less than a second (or for all I know maybe the issue is that one doesn't even exist?).

But the fact that the necessary timestamp information is still present made me think to try a different program, and it turns out that XnView MP, despite not showing timestamps less than a second, does actually seem to silently acknowledge their existence! So for the time being I can just use XnView MP's own batch renamer (which, fun fact, actually should work for any file including those that XnView MP cannot open).
CPU: Xeon E3-1285L v4 (4c/8t Broadwell/Intel 5th gen) @ 3.7GHz 1.152v (3.4GHz uncore)
GPU: Intel integrated Iris Pro Graphics P6300
RAM: 4x8GB Corsair Vengeance @ DDR3-1600
OS: Linux Mint Xfce + [VM] Win7 SP1 x64 

User avatar
billmcct
Board Warrior
Board Warrior
Posts: 1112
Joined: 2012-09-04, 15:19
Location: Union City Georgia USA

Re: GetemAll! - Fork of DownthemAll!

Post by billmcct » 2025-10-28, 13:48

@moonbat, how the hell do I change the download folder in GetEmAll?
It's not in the options and changing it in the download by R click and choose a folder doesn't seem to stick.
Yeah I know, I'm getting old and forgetful.

Never mind, I found it in about:config.
--------------------------------------------------------------------------------------------------------------
Dell Precision 15 7550
Windows 10 Pro. 22H2 19045.5965
Xeon W-10885M Comet Lake
64 GB DDR4 ECC memory (128 GB max)
1 TB Samsung 9100 Pro M2 SSD (Main)
2 TB Samsung 9100 Pro M2 SSD (storage)
500 GB Corsair T500 storage M2 SSD (6 TB max)
Intel UHD onboard GPU 1080p
Quadro RTX 5000 Max-Q GPU 4K

Pale Moon 34.x.x - x64 AVX2 build

The difference between the Impossible and the Possible lies in a man's Determination.
Tommy Lasorda

User avatar
Moonchild
Project founder
Project founder
Posts: 39502
Joined: 2011-08-28, 17:27
Location: Sweden

Re: GetemAll! - Fork of DownthemAll!

Post by Moonchild » 2025-10-28, 14:31

It should be in the GeA download manager window. At least that's where it states it'll save and it remembers that setting
"Praise from a narcissistic person is always a poison dart. They don't share the stage, so discernment matters." - Dr. Ramani
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite

User avatar
billmcct
Board Warrior
Board Warrior
Posts: 1112
Joined: 2012-09-04, 15:19
Location: Union City Georgia USA

Re: GetemAll! - Fork of DownthemAll!

Post by billmcct » 2025-10-28, 15:04

Yeah it's there if you right click the failed download, however changing it there doesn't seem to save it.
It only works for that one download. Should be in the options. I had to reinstall my system and now have a different
user profile and GTA kept wanting to download to a non existent folder. Anyway found it in about:config and it's working fine.
--------------------------------------------------------------------------------------------------------------
Dell Precision 15 7550
Windows 10 Pro. 22H2 19045.5965
Xeon W-10885M Comet Lake
64 GB DDR4 ECC memory (128 GB max)
1 TB Samsung 9100 Pro M2 SSD (Main)
2 TB Samsung 9100 Pro M2 SSD (storage)
500 GB Corsair T500 storage M2 SSD (6 TB max)
Intel UHD onboard GPU 1080p
Quadro RTX 5000 Max-Q GPU 4K

Pale Moon 34.x.x - x64 AVX2 build

The difference between the Impossible and the Possible lies in a man's Determination.
Tommy Lasorda

User avatar
moonbat
Knows the dark side
Knows the dark side
Posts: 5893
Joined: 2015-12-09, 15:45

Re: GetemAll! - Fork of DownthemAll!

Post by moonbat » 2025-10-29, 05:52

billmcct wrote:
2025-10-28, 15:04
GTA kept wanting to download to a non existent folder.
Have you been only using its one-click download mode? Else you can configure the download folder in the download dialog prompt. Whatever you add there gets remembered for next time and you can choose previously selected folders as well.
"One hosts to look them up, one DNS to find them and in the darkness BIND them."

Image
KDE Neon on a Slimbook Excalibur (Ryzen 7 8845HS, 64 GB RAM)
AutoPageColor|PermissionsPlus|PMPlayer|Pure URL|RecordRewind|TextFX
Jabber: moonbat@hot-chili.net

User avatar
billmcct
Board Warrior
Board Warrior
Posts: 1112
Joined: 2012-09-04, 15:19
Location: Union City Georgia USA

Re: GetemAll! - Fork of DownthemAll!

Post by billmcct » 2025-10-29, 07:02

Yeah, I only use the one click. Didn't think to try the other way.
Hell man, I turned 85yo July 28th and my mind is getting very forgetful.
--------------------------------------------------------------------------------------------------------------
Dell Precision 15 7550
Windows 10 Pro. 22H2 19045.5965
Xeon W-10885M Comet Lake
64 GB DDR4 ECC memory (128 GB max)
1 TB Samsung 9100 Pro M2 SSD (Main)
2 TB Samsung 9100 Pro M2 SSD (storage)
500 GB Corsair T500 storage M2 SSD (6 TB max)
Intel UHD onboard GPU 1080p
Quadro RTX 5000 Max-Q GPU 4K

Pale Moon 34.x.x - x64 AVX2 build

The difference between the Impossible and the Possible lies in a man's Determination.
Tommy Lasorda

User avatar
moonbat
Knows the dark side
Knows the dark side
Posts: 5893
Joined: 2015-12-09, 15:45

Re: GetemAll! - Fork of DownthemAll!

Post by moonbat » 2025-10-29, 22:23

The best way to learn about a new software (or what has changed in a new version) is to explore the preferences :)
"One hosts to look them up, one DNS to find them and in the darkness BIND them."

Image
KDE Neon on a Slimbook Excalibur (Ryzen 7 8845HS, 64 GB RAM)
AutoPageColor|PermissionsPlus|PMPlayer|Pure URL|RecordRewind|TextFX
Jabber: moonbat@hot-chili.net

User avatar
SlySven
Apollo supporter
Apollo supporter
Posts: 42
Joined: 2018-07-07, 22:42

Re: GetemAll! - Fork of DownthemAll!

Post by SlySven » 2026-06-06, 01:19

Is there a chance to add a date/time to the columns so that the order in which the downloads were started (or maybe completed) could be used. By default(?) it seemed that new downloads are added at the bottom but as soon as one of the columns is chosen for ordering/sorting it is no longer possible to go back to that (download) order. (Yeah I don't clear the downloads when they are completed - but that's just the way I roll...)
Screenshot 2026-06-06 021532.png
I can see that the date/time added is recorded for each item - but it is not present as a "column".
Screenshot 2026-06-06 021628.png
You do not have the required permissions to view the files attached to this post.

User avatar
moonbat
Knows the dark side
Knows the dark side
Posts: 5893
Joined: 2015-12-09, 15:45

Re: GetemAll! - Fork of DownthemAll!

Post by moonbat » 2026-06-06, 05:41

It's doable but complicated; since I forked this from the last XUL compatible version of DownThemAll and am not the original author. Patches are always welcome.
"One hosts to look them up, one DNS to find them and in the darkness BIND them."

Image
KDE Neon on a Slimbook Excalibur (Ryzen 7 8845HS, 64 GB RAM)
AutoPageColor|PermissionsPlus|PMPlayer|Pure URL|RecordRewind|TextFX
Jabber: moonbat@hot-chili.net

User avatar
RealityRipple
Keeps coming back
Keeps coming back
Posts: 951
Joined: 2018-05-17, 02:34
Location: Los Berros Canyon, California

Re: GetemAll! - Fork of DownthemAll!

Post by RealityRipple » 2026-06-10, 21:11

Here's an initial test of the "Added" column: https://github.com/RealityRipple/DownIt ... 1e2985b626 - still testing the sort and filter parts, which will, of course, take more than one day.

User avatar
RealityRipple
Keeps coming back
Keeps coming back
Posts: 951
Joined: 2018-05-17, 02:34
Location: Los Berros Canyon, California

Re: GetemAll! - Fork of DownthemAll!

Post by RealityRipple » 2026-06-12, 04:23

Initial desired functionality appears successful. However, if there's too many items in the list, the filter by date feature may become annoying to navigate. A future update may be warranted that checks for the total number of filter dates and switch over to months if there's more than, say, 10 different days.

User avatar
therube
Board Warrior
Board Warrior
Posts: 1773
Joined: 2018-06-08, 17:02

Re: GetemAll! - Fork of DownthemAll!

Post by therube » 2026-06-12, 15:52

Off-topic:
I didn't realize the dates... so maybe beating an old horse, but...


@__NM64__

> Sorting. If I'm downloading 1 by 1 individually, it's because I'm trying to have the files retain their original order that they were in on the originating server


If the actual date modified time does not matter, only the order, & if you are downloading in the correct order, 1 file at a time, then would you want to NOT set, 'Set file time to last modified time (server) or time of queuing'.

With that, each file would be dated current, as the download finished, which would coincide with the order in which they were downloaded.

User avatar
moonbat
Knows the dark side
Knows the dark side
Posts: 5893
Joined: 2015-12-09, 15:45

Re: GetemAll! - Fork of DownthemAll!

Post by moonbat » 2026-06-13, 23:35

RealityRipple wrote:
2026-06-10, 21:11
Here's an initial test of the "Added" column: https://github.com/RealityRipple/DownIt ... 1e2985b626 - still testing the sort and filter parts, which will, of course, take more than one day.
Thanks for starting this, please send a merge request to the repo when you're done.
"One hosts to look them up, one DNS to find them and in the darkness BIND them."

Image
KDE Neon on a Slimbook Excalibur (Ryzen 7 8845HS, 64 GB RAM)
AutoPageColor|PermissionsPlus|PMPlayer|Pure URL|RecordRewind|TextFX
Jabber: moonbat@hot-chili.net