parsing key file

[Jose Lerebours]

On 5/26/21 5:23 PM, Fairlight via Filepro-list wrote:
> The part where you said create an array in memory and store the data
> there for later operations implied to me that you would just read the
> records in wholesale and operate on them quickly...which is the only way
> to do it, since you don't have index access.
>
> Also, you wouldn't use an array.  You should use a hash/dict.  Arrays
> are going to be far slower to use.

Ah, agree, if one construct an array to build up as data is 
selected/read, yes,
it could get pretty bloated but the array would primarily be for parsing 
the data
block as you read it, take the record block into an array and parse the 
array.

Today, one could use NoSQL for dumping data deal with it as needed - 
like the
age old say goes: more than a 1000 ways to skin the cat.

That said, yeah, you are right, if one attempts to load into arrays a 
couple of GIGs
worth of data you can find yourself bringing your system to a halt - Not 
that it cannot
be done, but if you are negligible, it can turn bad really fast.

In the other hand, if you are only talking about processing a couple Ks 
of rows and
staying within the 5MB to 10MB,  properly worked arrays could do wonders.


-- 

https://www.asisuites.com
https://www.helpsuites.com