memory when Indexing? (was Indexing a file with 3, 000, 000 records FAST ?)

[Mike Fedkiw]

> system
> filePro 5.0.09
> windows 2000 advances server
> P4 2.4 GHz
> 2 gig of ram


Server also has the following
Dual processor machine
Ultra ata hard drive (don't know the exact speed but it's about 36 gigs)
All Terminals Running Remote Desktop.
I can use any terminal, or even logon from home, and go just as fast as
being at the server.

Last night I tried the following.
I set PFBIXBUILD=2 and PFNUMIXBUILD=10000.
Now I built A-P indexes in about 1.5 hrs. I guess thats fast enough, Better
than 15 hrs!


I ran into another problem with indexing a large file a while back. I have a
menu option setup like this"/fp/dxmaint - -ra -e". When I try running this
on a very larger file I get an error about half way through. I think it said
something about memory. Now that I have reindexed my file, I dont want to
try this to get the exact error message. When using the menu option above,
filepro seems like is keeps using memory on top of memory for each index,
until it gets to the last one. There is something different about manually
selecting each index and building it. This seems to be the only way I can
build the indexes on this large file. I don't get it?


Mike Fedko



>
> BTW, I don't want to upgrade to 5.0.14. I am waiting for next ver.
> Ray said
> that the bug slowing browse window scrolling and flickering when
> using lots
> of show commands would be fixed in ver 5.0.15 and above.
>
> I have a file with about three million records. Recently I deleted
> some
> records out of this file. Now I am getting node errors on a
> particular
> Index. I rebuilt one index this morning and it took over an hour.
> now add up
> (a-p times 1 hour). That's 16 hours. There has to be a faster/better
> way. I
> did try setting PFNUMIXBUF=15000 and that helped a little. What
> about
> PFNUMIXBUILD.
>
> Any help will be greatly appreciated. I am not looking forward to
> fifteen
> hours of indexing for one file.
>
> Thanks in Advance, Mike Fedko
>
> Mike,
>
> Just a "dumb" question, are you rebuilding these indexes from a
workstation
> or directly on the server?
>
> Most of the responses I have read look like they are considering a *nix
> system.
>
> If you are building from a workstation, create a local server start up
> script and rebuild from there.  No network contention.
>
> Now, if there is a workstation with a very fast processor and fast drives,
> you might consider using that machine.  But, I would try Ken's suggestion
> and run it from your server directly.
>
> Richard Kreiss
> GCC Consulting
>
>
>
> _______________________________________________
> Filepro-list mailing list
> Filepro-list at lists.celestial.com
> http://mailman.celestial.com/mailman/listinfo/filepro-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.celestial.com/pipermail/filepro-list/attachments/20060314/b19638e1/attachment.html