New problem with `URL Substitution` feature

Author Message
Geoffrey Spencer 09/07/2004 12:00 pm
I need your help on something else. I am having a problem with a website and with the new feature of wildcards redirection.

The problem centers on the webpage generated by OE is not changing all of the path information for links on the page. I am at a webpage like this:

http://www.server.com/members/folder/load.asp?arg1=img_aaa&arg2=dir_bbb
I sent the URL substitution rule to the following:
URL: */load.asp?arg1=*&arg2=*
Replace: load.asp?arg1=**&arg2=*
With: */**.htm

You can see the webpage is one folder lower in the chain than what is used on the originating website.

But inside the webpage itself are a lot of references to images that are displayed on the page like

1) Src=`images/top_bar.gif`
2) and others like mouse_over=`images/home_over.gif`
3) and some with src=`/secret_members/images/dir_bbb/img_aaa`

The problem is with my new subfolder listed in Replace: and With: above and OE making the downloaded page anywhere in the folder chain, I am off, in this case, by one folder.

Using the above as an example, they should be:
1) src=`.../images/top_bar.gif`
2) mouse_over=`../images/home_over.gif`
3) src=`../../../secret_members/images/dir_bbb/img_aaa`

But OE is off, as I said, by one folder so they are coming up as:
1) src=`images/top_bar.gif`
2) mouse_over=`images/home_over.gif`
3) src=`../../secret_members/images/dir_bbb/img_aaa`

FYI, the images themselves are downloaded to the proper folders. It is the webpage images and some links in the redirected and OE generated webpages that are referenced wrong.

Is there anything you can suggest I can add to the `URL Substitution` rules to fix this? I tried all kind of parameters for URL/Replace/With without success.

Thanks
Oleg Chernavin 09/08/2004 06:37 am
Thank you! I will work on it. I hope to have a solution soon.

Best regards,
Oleg Chernavin
MP Staff
Oleg Chernavin 09/08/2004 07:31 am
I think, I have fixed that. Here is the updated file:

http://www.metaproducts.com/download/betas/oep1794.zip

Does it work well?

Best regards,
Oleg Chernavin
MP Staff
Geoffrey Spencer 09/08/2004 11:32 am
You are the best, Oleg!!!! That fixed it. Thank you

> I think, I have fixed that. Here is the updated file:
> > http://www.metaproducts.com/download/betas/oep1794.zip
> > Does it work well?
> > Best regards,
> Oleg Chernavin
> MP Staff
Geoffrey Spencer 09/08/2004 12:38 pm
I found a new problem with `URL Substitution` rule. I have my rules to work only on the webpage AFTER retrieving the pages from the web. In other words, all rules are unchecked so that the rules are applied AFTER downloading everything first. It works beautifully but I noticed I`m getting a lot of "Could Not Find" errors at the end of the download. It appears the `URL Substitution` rules are being applied at the end of the downloads as desired but then OE starts downloading again with the new "webpages" (re-direction to new folders) and this is causing the "Could Not Find" (or whatever OE returns for webpages it could not find).
Oleg Chernavin 09/10/2004 07:22 am
Can you please explain it with more details?

Oleg.
Geoffrey Spencer 09/18/2004 03:53 pm
Sorry for the delay. I wanted to watch the downloads closely to explain the bug clearly. I think I have it. It definitely involves the "URL Substitution" rule, folder or destination redirection and certain image files.

Say I have this link:

http://www.server.com/members/showpic.php?dir=abc&pic=001

I have this URL Substitution rule:
URL: */showpic.php?dir=*&pic=*
Replace: /showpic.php?dir=**&pic=*
With: /**/*.htm

The URL downloads works fine. The images are downloads fine. The image, after reading the page source, is at: http://www.server.com/members/images/abc/001.jpg. Now at the end of downloading everything successfully, it appears that OE makes another attempt to download images from this location: http://members/private/abc/001.jpg. Obviously this fails because the URL (www.server.com) is missing. This happens everytime with URL Substitution for me. If you are testing, make sure you try a site that is displaying a picture based on a server-side script (php). If you are not watching the downloading of the files, you will think nothing is wrong. I can still export successfully. I only noticed the error because I was watching the download in progress.

I tried the same download without any URL substitution and I do not get this error.

I hope this helps.

> Can you please explain it with more details?
> > Oleg.
Oleg Chernavin 09/19/2004 03:12 am
Could you please tell me a particular site that works this way? I can`t recall right now any of them. Maybe you would better write me by E-mail?

Oleg.
Geoffrey Spencer 09/19/2004 02:47 pm
The sites I was watching were member`s only sites. I`ll look into other sites I download to see if this occurs elsewhere that is free to all.

> Could you please tell me a particular site that works this way? I can`t recall right now any of them. Maybe you would better write me by E-mail?
> > Oleg.
Oleg Chernavin 09/20/2004 05:49 am
OK. Or drop me an E-mail to support@metaproducts.com .

Oleg.