Downloading pages with no extension

Author Message
Len Lydik 10/11/2004 01:09 pm
How would you go about downloading a page without an extension? An example is this:

http://www.imdb.com/name/nm0000129/bio

I cannot get this to work, it downloads a page that is the default page in that directory.
Oleg Chernavin 10/11/2004 01:25 pm
I loaded the above URL in Offline Explorer Pro and I got the page "Biography for Tom Cruise". It is not the default for the directory.

The default URL:
http://www.imdb.com/name/nm0000129/

It loads the general page about Tom Cruise.

Best regards,
Oleg Chernavin
MP Staff
Len Lydik 10/11/2004 06:06 pm
But when I try to crawl, I don`t get that page...

> I loaded the above URL in Offline Explorer Pro and I got the page "Biography for Tom Cruise". It is not the default for the directory.
>
> The default URL:
> http://www.imdb.com/name/nm0000129/
>
> It loads the general page about Tom Cruise.
>
> Best regards,
> Oleg Chernavin
> MP Staff
Len Lydik 10/11/2004 06:09 pm
When I try to download several bio pages like:

http://www.imdb.com/name/nm0000129/bio

using OEP, it actually downloads this page:

http://www.imdb.com/name/nm0000129/
Len Lydik 10/11/2004 06:12 pm
Cancel that. Figured it out.
Oleg Chernavin 10/12/2004 04:09 am
What was wrong?

Oleg.