see comments below …
Data can be processed very quickly now (millions of records in seconds),
update only runs should be avoided (look at twitter, you can crate and delete
but no update - KIS)
Think new … use BI tech
Moving files around manually is as much out of date as spreadsheets are (the
less duplication of data and files moving around the system the better)
Really a set of questions (so please bear with me) and I think the answer is
a set of open source infrastructure projects. Also is this the right place for
questions like this??
A problem I have at the moment is updating a list of GP’s and Practices on a
Document Management System. The normal solution is to provide updates via
traditional HL7 but our PAS system doesn’t support this.
So what I’m planning to do is a system where:
* A member of staff (or computer) downloads the relevant files either
quarterly. (possibly from TRUD but possibly from this link
free months out of date, typical NHS, this is 2016, not 1916, there can be no
excuses for having info which is 3 months out of date
* Unzips the files and load the files data into a database (probably
the HAPI HL7 FHIR Server I mentioned in another thread)
so long winded, typical NHS, use BI to remove any manual tasks (this 2016 …)
* When this is done again I would be able to detect changes in GP's
or Practices and possibly generate traditional HL7 messages.
why do you need to know what the changes are, what is your requirement?
* Can I get this list elsewhere via an API? [SDS does provide an API
(LDAP) for these but I need a list]
an API is to integrate systems, you are trying to integarte data, think outside
the box and use business intelligence tech
* Could I just process a list of changes from somewhere?
best to avoid, see above, updating is pain (to “reload” the entire lot should
take no mre than a few seconds using BI)
* If not would the solution above be useful for others? (The HAPI
FHIR Server would provide an API which most modern systems would prefer rather
than file uploads and traditional HL7)
share the good stuff