Is Download from Secure (https://) Websites Possible?

erik
01/01/2010 04:16 am
I need to login in to get to my secure user forum (https://.....).
I would like to download one of the sub-forums (messages and attachments) for offline browsing.

Is this possible? How?
Oleg Chernavin
01/02/2010 08:23 am
Yes, all editions of Offline Explorer support HTTPS protocol.

There are two kinds of password-protected Web sites. One type asks for a username and password in a standard Windows-type dialog (BASIC and NTLM authentication,) while the other type requires you to logon directly on a Web page.

1. Web sites that require BASIC and NTLM-authentication.

To download this type of site, either specify the username and password in the Project Properties dialog | Advanced | Password section, or type them directly in the URL, such as:
http://username:password@www.server.com/...

Notice that a colon separates the password from the username and the @ symbol separates them from the server name.

Some sites use NTLM authentication, which looks like the above, but with a third box labeled "DOMAIN" along with the username and password. Enter the domain name along with the username in the same field in the Project Properties dialog | Passwords this way:

DOMAIN\username

The backslash symbol separates the domain name from the username. When you are done with the Project Properties changes, click the OK button to save them.

Note: NTLM authentication is supported only in the Pro and Enterprise editions of Offline Explorer.


2. Authentication in a Web form.

It is easy to download this type of site.
You need to browse to the logon page of the site using the internal Browser of Offline Explorer Pro .

If you need to download the site immediately and only once, you can proceed with the logon and begin downloading the desired pages using Offline Explorer Pro . The program will use the session cookies of the logged on site from the internal browser.

You can also record the logon form contents in a Project, so that Offline Explorer Pro will know how to log itself on whenever you wish to download the site. This is useful when you want to schedule the site download or perform it later, or if you want to update the downloaded site in the future.

Once you have entered your username and password on the logon page in the internal browser, press and hold the Alt + Ctrl keys on your keyboard, click the Logon (or Submit) button in the Web form and release the keyboard buttons. You should get a new Project that contains the Web form information recorded in the URL field.

Adjust the Project settings as you wish (set the Level and other parameters) and click the OK button to save the Project. You may begin downloading at any time.

It is also recommended to make sure that the "Use alternate connection method" box is checked in the Internet tab of the Ribbon.

Note: The form recording method is supported only in the Pro and Enterprise editions of Offline Explorer.

Best regards,
Oleg Chernavin
MP Staff
Rue
06/14/2011 02:43 am
Can you give a sample program of downloading a file from https of secure server..

Thanks in advance....
Oleg Chernavin
06/14/2011 05:40 am
All Offline Explorer editions now support HTTPS downloads without limitations.

Oleg.
Robert
11/12/2014 02:02 pm
Hello,
I have a problem with downloading site that has Authentication in a Web form. I create the project according to the guidelines (Alt + Ctrl + click) after that it start downloading properly but after a few seconds Offline Exporer download pages which includes only redirection to login page. It looks like that the cookie expires.
I bought Pro version.

How can I solve this problem?

Robert
Oleg Chernavin
11/12/2014 02:04 pm
Could it be because it follows some logout link? There is protection against this, but maybe this site has some unusual way to logout. Can you please copy the logout link address and send it here?

Another possibility is that the site detects too fast download and logs you out. If so, you may change the Connections to 1 on the Internet tab and set a few seconds delay between downloads.

Oleg.
Robert
11/13/2014 06:23 am
Hello,
Thank you for the tips. I added the logout page to url filters and set only one connection. Now downloads everything correctly, thank you again.

best regards
Robert
Oleg Chernavin
11/13/2014 08:48 am
This is good.

Can I ask you to post this logout link here? I will add it to Offline Explorer, so it would skip such links in future automatically.

Thank you!

Oleg.
Robert
11/13/2014 12:26 pm
I would prefer to send this link to your email, not on the public forum. Send me your email address and I'll send it to you.

Robert
Oleg Chernavin
11/14/2014 11:19 am
Yes, please send it to support@metaproducts.com for me. Thank you!

Oleg.
Robert
11/18/2014 02:00 am
ok,
But this address is currently not possible to send an email because your mail box has quota exceed:

    ----- Transcript of Session Follows -----
procmail: Quota exceeded while writing "/home/.sites/70/site4/.users/47/support.metaproducts/mbox"
550 5.0.0 \ support.metaproducts ... Can not create output

Robert
Oleg Chernavin
11/18/2014 06:52 am
Thank you very much for reporting this! We will solve shortly and I will post again here.

Oleg.
Oleg Chernavin
11/18/2014 07:04 am
It should be corrected now. Can you please try again?

Thank you!

Oleg.
marc
03/03/2015 06:19 pm
Hello,

I am having an issue on an existing project that is now broken. An internal website recently converted from http to https. A page I download has links to word docs and pdfs. The documents download fine and I can see them in the download folder in windows explorer. However, when the project is exported they do not open. The accounts that download the project can navigate and open the files on the normal website...so should not have to configure log in.

2 different versions of OE.
6.9.4174 sr2 service account on dedicated pc. When project is exported and try to open the files, IE gives a page can not be displayed message.

6.9 my pc my account.. when same project is exported and try to open link to document, nothing happens.

any help appreciated

Thanks
Oleg Chernavin
03/03/2015 07:46 pm
In most cases it depends on MS Internet Explorer security settings. The easiest way to check it is to install FireFox or Chrome browser and try to open the downloaded site there.

Most probably, it would work fine and all links are correct.

Oleg.
marc
03/04/2015 10:15 am
I tried opening the exported project in both firefox (same error when trying to open the file), and Chrome gives me a policy error, and I cant even open the project at all.
Would something in the link configuration be a problem? The exported project seems to be trying to open the document from the wrong location. … The document link in the project points to C:\Export\https@xxxx.xxx.org\folder1\folder2\file.docm when the file is actually at C:\Export\local files\folder1\folder2\file.docm.
The links are coded on the webpage like this <a href="file:///X:/folder1/folder2/file.docm" target="_blank"> file name</a>
Oleg Chernavin
03/04/2015 10:16 am
Can you give me more details to reproduce this problem? Perhaps, there is a bug in Offline Explorer. An address of the site and explanation of which links fail would be great.

If you don't want to make these details public, send me an E-mail to support@metaproducts.com.

Oleg.