How do I download blob audio or video resource using Grabit Topic is solved

Add-ons for Pale Moon and other applications
General discussion, compatibility, contributed extensions, themes, plugins, and more.

Moderators: FranklinDM, Lootyhoof

User avatar
Raava
Fanatic
Fanatic
Posts: 198
Joined: 2014-06-22, 22:23
Location: Europe

How do I download blob audio or video resource using Grabit

Unread post by Raava » 2023-11-14, 07:11

Update:
Changed subject to reflect I had to use grabit v32.0 and not GetEmAll! v1.2.4 to get this done.


I installed GetEmAll! v1.2.4 in the hopes of being able to download blob audio streams and blob video streams.
How do I identify the blob resource in GetEmAll?

via Page Info / Media I can see the blob:https://what.ever blob resource, but that very blob resource doesn't appear in the GetEmAll "Make your selection" window, even when I am currently playing the very audio stream in the tab I ask GetEmAll to download from.
Do I have to enable blobs somehow? Or is GetEmAll! v1.2.4 unable to download blob resources?
The site on GetEmAll is very sparse when it comes to background info, and the original Firefox addon GetEmAll is based upon (downthemall - as in down them all not down the mall) mentions blob e.g. here: https://www.downthemall.org/progress/
Regarding the actual downloading, I am still undecided how to best proceed there. There is things we could do with blob: “files” to support segmented downloads and proper resuming and a ton of other things
Searched the forum for "blob download" but found nothing helpful.


My system: Linux x86-64
Browser: Pale Moon 32.5.0
Last edited by Raava on 2023-11-14, 08:57, edited 2 times in total.
yours truly, Rava

User avatar
Moonchild
Pale Moon guru
Pale Moon guru
Posts: 35650
Joined: 2011-08-28, 17:27
Location: Motala, SE

Re: How do I download blob audio or video resource using GetEmAll! v1.2.4

Unread post by Moonchild » 2023-11-14, 07:20

Streamed media blobs are not downloads.
"Sometimes, the best way to get what you want is to be a good person." -- Louis Rossmann
"Seek wisdom, not knowledge. Knowledge is of the past; wisdom is of the future." -- Native American proverb
"Linux makes everything difficult." -- Lyceus Anubite

User avatar
Pentium4User
Board Warrior
Board Warrior
Posts: 1138
Joined: 2019-04-24, 09:38

Re: How do I download blob audio or video resource using GetEmAll! v1.2.4

Unread post by Pentium4User » 2023-11-14, 07:27

IIRC yt-dlp can download that, I did that for X.
The profile picture shows my Maico EC30 E ceiling fan.

User avatar
moonbat
Knows the dark side
Knows the dark side
Posts: 4984
Joined: 2015-12-09, 15:45

Re: How do I download blob audio or video resource using GetEmAll! v1.2.4

Unread post by moonbat » 2023-11-14, 07:53

I've had better luck with Grabit in conjunction with yt-dlp for streaming downloads.
"One hosts to look them up, one DNS to find them and in the darkness BIND them."

Image
Linux Mint 21 Xfce x64 on HP i5-5200 laptop, 12 GB RAM.
AutoPageColor|PermissionsPlus|PMPlayer|Pure URL|RecordRewind|TextFX

User avatar
Raava
Fanatic
Fanatic
Posts: 198
Joined: 2014-06-22, 22:23
Location: Europe

Re: How do I download blob audio or video resource using GetEmAll! v1.2.4

Unread post by Raava » 2023-11-14, 08:01

Pentium4User wrote:
2023-11-14, 07:27
IIRC yt-dlp can download that, I did that for X.
Unfortunately that doesn't work for the blob I am interested in.
moonbat wrote:
2023-11-14, 07:53
I've had better luck with Grabit in conjunction with yt-dlp for streaming downloads.
I try that instead and report back. I have yt-dlp available anyway, but only yt-dlp by itself doesn't work, unfortunately.

Update
At least by default it did not work. The audio stream as listed as mp4 (but its file is a .m3u8)
wget downloaded the tiny .m3u8 as commanded by Grabit - but not the audio stream. This is the contents of the "mp4" file I got:

Code: Select all

#EXTM3U
#EXT-X-STREAM-INF:PROGRAM-ID=1,BANDWIDTH=125437,CODECS="mp4a.40.2"
index-a1.m3u8
but at least I saw the URL of the .m3u8 and now do a yt-dlp download on that (yt-dlp was not available in the menu as default downloader for Grabit) and by the size it seems to be the correct file.
Currently downloading…
yours truly, Rava

User avatar
moonbat
Knows the dark side
Knows the dark side
Posts: 4984
Joined: 2015-12-09, 15:45

Re: How do I download blob audio or video resource using GetEmAll! v1.2.4

Unread post by moonbat » 2023-11-14, 08:27

Yeah that's how I used it as well, from the .m3u (which is a playlist format)
"One hosts to look them up, one DNS to find them and in the darkness BIND them."

Image
Linux Mint 21 Xfce x64 on HP i5-5200 laptop, 12 GB RAM.
AutoPageColor|PermissionsPlus|PMPlayer|Pure URL|RecordRewind|TextFX

User avatar
Raava
Fanatic
Fanatic
Posts: 198
Joined: 2014-06-22, 22:23
Location: Europe

Re: How do I download blob audio or video resource using GetEmAll! v1.2.4

Unread post by Raava » 2023-11-14, 08:40

moonbat wrote:
2023-11-14, 08:27
Yeah that's how I used it as well, from the .m3u (which is a playlist format)
I presume the website is made that you get chunks of 59:59 when downloading.

Code: Select all

$ ffprobe-hide_banner master\ \[master\].mp4 
ffprobe-hide_banner V0.1
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'master [master].mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2mp41
    encoder         : Lavf58.76.100
  Duration: 00:59:59.92, start: 0.000000, bitrate: 126 kb/s
  Stream #0:0(und): Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 125 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
The live concert I wanted recorded starts at 19:30 on that day, so in this part I only got the first 30 minutes (plus the news broadcast from 19:00 that day plus the 25 minutes with different music prior to the concert).

And the usual trick doesn't work, usual as in this:
Open the browser console (or e.g. "Developer Tools") with Ctrl+Shift+J (PM)
Delete all previous entries in console.
Reload the page where the stream is, start the stream when it is not started by itself.
Go in the console to "network" and look for m3u8


The audio stream starts again by itself. But unfortunately, there is nothing "m3u8" to be found via that trick. :(

I presume I need to find the URL where the next hourly chunk is addressed (hopefully that exists) and do the same as above via Grabit...
On the URL itself when I start playing the stream, it starts right at the beginning of the concert (at approx 19:30 that day) and continues all the two hours this concert lasted, but not that easy to track how it's organized into m3u8's. :(
yours truly, Rava

User avatar
Raava
Fanatic
Fanatic
Posts: 198
Joined: 2014-06-22, 22:23
Location: Europe

Re: How do I download blob audio or video resource using GetEmAll! v1.2.4

Unread post by Raava » 2023-11-14, 08:49

I did not really look into how the URL was made when i wrote the above, in reality it's child's play.

The first chunk is (paraphrased) so:

Code: Select all

http://what.ever/x/y/name_20231112T190000+0100.mp4/master.m3u8
and now I used this URL for the next chunk:

Code: Select all

http://what.ever/x/y/name_20231112T200000+0100.mp4/master.m3u8
I only had to rename "master [master].mp4" first or yt-dlp would have told me that I "already downloaded that file".
And, of course, the last chunk will be this:

Code: Select all

http://what.ever/x/y/name_20231112T210000+0100.mp4/master.m3u8
And I will note down that very example of an URL, hopefully they not change that for a long while so that I can download any radio broadcast up to 7 days later after it was broadcast. :D
yours truly, Rava

User avatar
moonbat
Knows the dark side
Knows the dark side
Posts: 4984
Joined: 2015-12-09, 15:45

Re: How do I download blob audio or video resource using Grabit

Unread post by moonbat » 2023-11-14, 10:02

In Grabit options, media tab, 'show toolbar button' will show a button with headphones on it that will show auto-detected media streams on the current page. May help.
"One hosts to look them up, one DNS to find them and in the darkness BIND them."

Image
Linux Mint 21 Xfce x64 on HP i5-5200 laptop, 12 GB RAM.
AutoPageColor|PermissionsPlus|PMPlayer|Pure URL|RecordRewind|TextFX