Niche Spider Updates

Update date: 19 Oct 2007

VERY IMPORTANT UPDATE!!

Link attribute rel="nofollow" added to each link! What does that do? It preserves your own PR (Page Rank)! It tells any spiders coming across the links on the pages created NOT to follow those links - and NOT to pass on any 'votes' from your page to the pages the links point to.

So please, uninstall Niche Spider on your computer first, then download the latest version via Freewarefiles.com and then reinstall.

This is really worth doing - so do it now! This latest update also fixes several minor bugs, too.

 

Update date: 18 Oct 2007

Bug fixed in the page creation process! Please uninstall Niche Spider first, download the latest version via Freewarefiles.com and then reinstall.

 

Update date: 04 Aug 2007

Two improvements added, the first being the ability to add a CSV file to the clipboard. This is initiated by checking the box marked csv before clicking the Add to clipboard button.

Why is that useful? It means that if you have a database, you can now paste the data from the clipboard into a text editor (Notepad), save the file as a .csv file, and then import into your database (e.g. MySQL).

 

NOTE: some database setups can cause problems. Sometimes it is better to just save as a .txt text file (with the raw data in CSV format)instead of .csv, then upload to MySQL, or import into Excel etc.. Experiment if you don't succeed at first (but it DOES work - I've successfully imported into both MySQL and Excel).

Of course, use this after the 'dry run' has been completed, NOT after the create pages process. You're interested in uploading raw data to your database, not data with HTML added.

The second improvement concerns the Title must/must not contain textbox. Now you can stipulate the keywords each page title MUST have, AND the keywords it MUST NOT contain.

Separate the MUST and MUST NOT keywords with a space, then a '-', and individual keywords within the must and must not groups with a comma. Here's the sort of example you can input.

loan, car, mortgage -auto,taxi

The above means the title must contain the word 'loan' AND 'car' AND 'mortgage but NOT 'auto' OR 'taxi'.

Notice the or checkbox above the textbox? Checking it changes the above, so now the title must contain 'loan' OR 'car' OR 'mortgage but NOT 'auto' OR 'taxi'.

Remember, always separate the must and must not groups with a space, then a dash ('-'). Separate keywords in each group with a comma. You can enter as many comma-separated keywords as you want.

Of course, you can simply enter a single keyword as before, or a single must keyword with a single must not. It's up to you. However, the more you enter the greater the filtering effect, and the fewer the results returned.

 

Update date: 02 Aug 2007

Consolidate URL list button added.

Niche Spider occasionally hits on a site which causes it to 'hang'. That can be a real hassle if you've just successfully spidered 1,349 sites!

By clicking the Consolidate URL list button, the current URL list is cleared, then the successfully spidered urls to date are added to the listbox, plus the urls yet to be spidered. The offending url is not added.

Now SAVE this new list immediately (overwriting the previously saved file).

You'll probably still have to press Ctrl Alt + Delete to get out of Niche Spider.

Reload the newly saved list. Because the list contains the successfully spidered urls first, Niche Spider should fly through them before getting to the urls not yet spidered. So, if you respider the list again, any lost time should be minimal.