Determining what records changed

[Mike Fedkiw]

I'm running  win2003 server at the moment and I really have no idea what 
the website is running. I am not hosting the website, its on 
IXwebhosting. I tried looking up to see what they are using but couldn't 
find anything.

I sorta laid out a few scenarios to the web developer and this was the 
response I got from him.

As far as the ETL (the file import mechanism), we can account for missed 
file dates easily, because it logs the last time it ran, so it knows 
where to pick up, in terms of the date stamp in the file. As far as the 
on hand decrements, we'll work out the ideal scenario, in terms of 
calculations, updates and gaps - this is typically a part of the next 
step, which is the full detail scoping of that process.  For deleted 
items, are they in the file but not flagged, or are they simply gone?  
If so, we can run an additional step in the ETL process, once the 
adds/updates are complete, and check products on the web against those 
in the file - anything missing from the file would get deactivated on 
the web.  That's just a comparison of id's, so won't take as long.  
Again, we'll flesh that out in the detailed scoping.



Mike



On 10/23/2014 2:48 AM, Ken Cole wrote:
> Mike,
>
> Can you explain your network typology?
>
> Is the web server hosted somewhere different to your filePro server or in
> the same location?
>
> What OS on the web server, on the filePro server, what web server Apache,
> IIS, etc.
>
> Ken
>
> On Thursday, 23 October 2014, Mike Fedkiw <mfedkiwfp at gmail.com> wrote:
>
>> Okay, I've been thinking about this for a while now and what I come up
>> with is pretty much nothing.
>>
>> I have a website with my inventory displayed on it and I want to update
>> the on hand, add new items and remove any deleted items every hour
>> throughout the day. The web developers say that's not an issue to automate
>> that process but they also said that it's really not feasible to update the
>> entire inventory file containing roughly 20k records in it on an hourly
>> basis.
>>
>> I don't know if it's possible for the website to save the last uploaded
>> file and compare it to the new file being uploaded and compare them to see
>> what changed...but if it was that easy, hell, just compare the qty on hand
>> to see what changed.
>>
>> What I've been thinking about is somehow using the last updated date to
>> determine which items may need updating, but still, it's pretty easy to
>> find a flaw there. What if after the last update of the day, something is
>> sold before the date changes to the next day? Well now it's a new day and
>> that item's qty changed the night before and has the previous days date so
>> it's possible it could think it's not necessary to update it. Hell Idk, I
>> think I confuse myself more every time I think about this.
>>
>> I also thought about adding some additional fields in the inventory file
>> and copying the on hand, price, description, etc to those fields so I could
>> compare the next time the file is generated and I can catch any changes and
>> tag records needing updated. Yea, well what if for some reason that
>> particular file doesn't make it to the website for whatever reason and
>> another one gets generated an hour later. Now there's a ton of records that
>> probably need to be updated but won't because the fields I added were
>> updated with the file that ran before this one that never made it to the
>> website.
>>
>> Now that I don't even know what I'm writing about anymore, someone must
>> have had to do something similar this before, I hope.
>>
>> Adding fields to inventory so I can catch the actual time of any updates
>> is not really an option. There's so many processes that have access to and
>> change the on hand, I'm not even sure I could find all of them at this
>> point.
>>
>> Mike's head hurts now, Lol
>> _______________________________________________
>> Filepro-list mailing list
>> Filepro-list at lists.celestial.com <javascript:;>
>> Subscribe/Unsubscribe/Subscription Changes
>> http://mailman.celestial.com/mailman/listinfo/filepro-list
>>
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <http://mailman.celestial.com/pipermail/filepro-list/attachments/20141023/3a74004e/attachment.html>
> _______________________________________________
> Filepro-list mailing list
> Filepro-list at lists.celestial.com
> Subscribe/Unsubscribe/Subscription Changes
> http://mailman.celestial.com/mailman/listinfo/filepro-list