download of source code

Talk about code development, features, specific bugzilla bugs, enhancements, patches, and other highly technical things.

Moderator: satrow

Forum rules
Please keep everything here strictly on-topic.
This board is meant for Pale Moon source code development related subjects only like code snippets, patches, specific referenced Bugzilla bugs, mercurial, etc.

This is not for tech support! Please do not post tech support questions in the "Development" board!
Please make sure not to use this board for support questions. Most "bug reports" do not belong in this board and should initially be posted in Community Support or other relevant support boards.

Please keep things on-topic as this forum will be used for reference for Pale Moon development. Expect topics that aren't relevant as such to be moved or deleted.
User avatar
karlkracher
Moon lover
Moon lover
Posts: 87
Joined: 2015-12-05, 17:40
Location: germany

download of source code

Unread post by karlkracher » 2018-09-21, 01:47

I went here https://github.com/MoonchildProductions/UXP/releases, downloaded each of the two files three times and what i've got is this:

Code: Select all

21.09.2018  01:28       245.940.156 UXP-PM28.1.0_Release_1.zip
21.09.2018  02:24       175.990.190 UXP-PM28.1.0_Release_2.zip
21.09.2018  03:07       188.444.675 UXP-PM28.1.0_Release_3.zip

21.09.2018  01:58       270.598.144 UXP-PM28.1.0_Release_1.tar.gz
21.09.2018  02:24       158.279.720 UXP-PM28.1.0_Release_2.tar.gz
21.09.2018  03:07       147.734.528 UXP-PM28.1.0_Release_3.tar.gz
zip says all six files are broken.

User avatar
therube
Board Warrior
Board Warrior
Posts: 1101
Joined: 2018-06-08, 17:02

Re: download of source code

Unread post by therube » 2018-09-21, 02:00

Where are you seeing that?

I see a single file (either zip or tar.gz) with the "source" (text) files/directories within.


UXP-PM28.1.0_Release.zip, 380,567,740, 667c7e17bb4b5f9e8391d80484d7f67e:

Code: Select all

accessible
application
build
caps
chrome
config
db
devtools
docs
docshell
dom
editor
embedding
extensions
gfx
gradle
hal
image
intl
ipc
js
layout
media
memory
mfbt
mobile
modules
mozglue
netwerk
nsprpub
other-licenses
parser
probes
python
rdf
security
services
startupcache
storage
taskcluster
testing
toolkit
tools
uriloader
view
widget
xpcom
xpfe
.clang-format
.clang-format-ignore
.eslintignore
.eslintrc.js
.flake8
.gdbinit
.gdbinit_python
.gitattributes
.gitignore
.lldbinit
.taskcluster.yml
.ycm_extra_conf.py
aclocal.m4
Android.mk
AUTHORS
build.gradle
client.mk
client.py
CLOBBER
configure.in
configure.py
GNUmakefile
gradle.properties
gradlew
LEGAL
LICENSE
mach
Makefile.in
moz.build
moz.configure
mozilla-config.h.in
old-configure.in
README.md
settings.gradle
sourcestamp.txt
test.mozbuild
Last edited by therube on 2018-09-21, 02:05, edited 4 times in total.

User avatar
Moonchild
Pale Moon guru
Pale Moon guru
Posts: 24839
Joined: 2011-08-28, 17:27
Location: 58°2'16"N 14°58'31"E
Contact:

Re: download of source code

Unread post by Moonchild » 2018-09-21, 07:32

therube: maybe you weren't paying attention. The downloads from github are all incomplete for this person (see file sizes).

There's nothing we can do on our end to fix this -- if you are having connectivity issues with github, you have to contact github.
"If you want to build a better world for yourself, you have to be willing to build one for everybody." -- Coyote Osborne
Image

vannilla
Astronaut
Astronaut
Posts: 691
Joined: 2018-05-05, 13:29

Re: download of source code

Unread post by vannilla » 2018-09-21, 11:19

Another alternative is to try "git clone", but then you'd get what is essentially an alpha version instead of a stable release (save for some settings and/or arguments I don't know about).

User avatar
Isengrim
Keeps coming back
Keeps coming back
Posts: 997
Joined: 2015-09-08, 22:54
Location: 127.0.0.1
Contact:

Re: download of source code

Unread post by Isengrim » 2018-09-21, 11:32

vannilla wrote:Another alternative is to try "git clone", but then you'd get what is essentially an alpha version instead of a stable release (save for some settings and/or arguments I don't know about).
You can use "git clone" to download the whole repository, including commit history. You can then use git to checkout branches such as "basilisk-release" or "pale-moon-release" to get the latest release version of the code.
Linux Mint 19.2 Cinnamon (64-bit), Windows 7 (64-bit), Windows 10 build 1803 (64-bit)
"As long as there is someone who will appreciate the work involved in the creation, the effort is time well spent." ~ Tetsuzou Kamadani, Cave Story

User avatar
karlkracher
Moon lover
Moon lover
Posts: 87
Joined: 2015-12-05, 17:40
Location: germany

Re: download of source code

Unread post by karlkracher » 2018-09-23, 09:24

Thanks for the ideas, but no matter what i do in the end i would have to download and this is not working between github and me. I've tried 10 or 15 time the last two days, going on wouldn't be nice to the server.

User avatar
Moonchild
Pale Moon guru
Pale Moon guru
Posts: 24839
Joined: 2011-08-28, 17:27
Location: 58°2'16"N 14°58'31"E
Contact:

Re: download of source code

Unread post by Moonchild » 2018-09-23, 09:49

karlkracher wrote:Thanks for the ideas, but no matter what i do in the end i would have to download and this is not working between github and me. I've tried 10 or 15 time the last two days, going on wouldn't be nice to the server.
I don't think github cares much about bandwidth for failed attempts. It's because of their own setup ("streaming" the downloads instead of having static files) that it causes problems. As said you should ask github for help in solving these problems.
"If you want to build a better world for yourself, you have to be willing to build one for everybody." -- Coyote Osborne
Image

User avatar
therube
Board Warrior
Board Warrior
Posts: 1101
Joined: 2018-06-08, 17:02

Re: download of source code

Unread post by therube » 2018-09-23, 13:00

(Yes, I misunderstood what he was showing.)


How are you downloading, through the browser?
Does PM Download Manager show the files to have completed or failed?

Have you tried a real download manager (external) program, even something like wget?

yami_
Astronaut
Astronaut
Posts: 505
Joined: 2018-04-26, 11:05

Re: download of source code

Unread post by yami_ » 2018-09-23, 13:59

IIRC if the file is streamed the browser will not know its size. This makes detecting an incomplete download impossible.
cat came back from Berkeley waving flags -- rob pike

User avatar
karlkracher
Moon lover
Moon lover
Posts: 87
Joined: 2015-12-05, 17:40
Location: germany

Re: download of source code

Unread post by karlkracher » 2018-09-23, 14:51

I've used
  • the "normal" way in the browser, actually two browsers: pale moon and firefox portable
  • downthemall in pale moon
  • jdownloader
  • wget
At some point the data stream stops (instantly from good speed to zero) and after waiting the program concludes "done". Only wget seems to be a bit more clever because it restarts the download with an error message. And to be honest i do a lot downloading without problems, so i think it is not my computer or internet connection.

But in the meantime i've lost the reason to load the whole package, my point of interest is in the javascript files i can access directly in the browser.

User avatar
Isengrim
Keeps coming back
Keeps coming back
Posts: 997
Joined: 2015-09-08, 22:54
Location: 127.0.0.1
Contact:

Re: download of source code

Unread post by Isengrim » 2018-09-23, 15:06

You can also browse code directly through github, or by using http://xref.palemoon.org/.
Linux Mint 19.2 Cinnamon (64-bit), Windows 7 (64-bit), Windows 10 build 1803 (64-bit)
"As long as there is someone who will appreciate the work involved in the creation, the effort is time well spent." ~ Tetsuzou Kamadani, Cave Story

User avatar
therube
Board Warrior
Board Warrior
Posts: 1101
Joined: 2018-06-08, 17:02

Re: download of source code

Unread post by therube » 2018-09-23, 15:53

Two different browsers, an extension in your browser, a Java based downloader, an external downloader, & none are working, I would think it is on your end &/or your connection &/or github (you didn't piss them off did you ;-)).

The download itself isn't that large, 380M, & I gather you've download larger files, elsewhere?


Even if wget outright failed in a particular attempt, I would think using the -c switch, wget -c, would pick up the pieces in future attempt(s)?

User avatar
Moonchild
Pale Moon guru
Pale Moon guru
Posts: 24839
Joined: 2011-08-28, 17:27
Location: 58°2'16"N 14°58'31"E
Contact:

Re: download of source code

Unread post by Moonchild » 2018-09-23, 22:19

As yami_ already pointed out the way downloads are streamed makes it impossible for any downloading application (browser or otherwise) to know the file size, and won't know if a file is incomplete or not if the remote end stops sending.
"If you want to build a better world for yourself, you have to be willing to build one for everybody." -- Coyote Osborne
Image

Locked