Couple of quick questions

Peter
04/01/2011 10:28 am
1. Would putting the temporary directory on an SSD speed up parsing large sites?

2. Are there any plans for a 64 bit version to use larger memory that 3GB?

3. How would I download the following:

I want to skip all directories called backup EXECPT files in those directories beginning with the letters 'db'

I've tried using combinations of include and exclude filters but can't seem to get this to work

Thanks


Peter
Oleg Chernavin
04/01/2011 10:40 am
1. I doubt so. Most of downloaded files are kept in memory - it should not increase performance. Also, SSDs have their performance issues.

2. Yes, we are waiting for the Delphi development studio version that supports 64-bit now. Perhaps, it will happen this year.

3. Please let me know a few examples of such URLs you want to exclude.

Best regards,
Oleg Chernavin
MP Staff
Peter
04/01/2011 11:16 am
Oleg,

Thanks for that.

For example I would like to exclude:

exclude - http://intranet/backup/abc.dat
exclude - http://intranet/2010/march/backup/xyz.dat

except that I want to include any file in a */backup directory that begins with 'db'

include - http://intranet/backup/db_123.dat
include - http://intranet/2010/march/backup/db_abc.dat

In other words in any directory called 'backup' I want to exclude every file EXCEPT those that begin with the letters 'db'

SO exclude all files http://intranet/*/backup/*

EXCEPT FILES http://intranet/*/backup/db*


Peter
Oleg Chernavin
04/01/2011 11:27 am
What about to specify in URL Filters - Filename - Included list:

/*backup*/db*

Everything else will be skipped.

Oleg.
Peter
04/01/2011 12:04 pm
Thanks I will try that.

I was using the following 2 filters:

exclude - */backup/*
include - */backup/db*

I wasn't sure how the include/exclude filters worked together, but that didn't work.
Peter
04/01/2011 12:15 pm
No that doesn't work, now it excludes all the other directories e.g.

http://intranet/2010/live/db_abc.dat doesn't download. When I test this URL I get "The URL is rejected: reason URL Filters : filename : included file keywords.

There are lots of other directories which I want to download complete but I only want the restriction applied to any directory called backup.

So

http://intranet/...........any directory except 'backup' ......./* - all downloaded

http://intranet/*/backup/db* - downloaded also.


Any other URL containing */backup/* - not downloaded.


Is this possible
Oleg Chernavin
04/01/2011 12:15 pm
The rule is simple. If anything disallows some URL, all other rules will not allow it back.

Oleg.
Oleg Chernavin
04/01/2011 01:03 pm
OK. Here is the updated oe.exe file:

http://www.metaproducts.com/download/betas/OEP3341.ZIP

It will support the following keyword:

/*backup/#db*

Use it in the Excluded list.

Oleg.
Peter
04/04/2011 04:58 am
Thanks Oleg.

Much appreciated
Oleg Chernavin
04/04/2011 06:08 am
You are welcome!

Oleg.