Imported UW Data

We import several types of UW information into our database from other sources. This page describes the common framework adopted to manage this import process.

Specific sources handled through this system are:

Once the raw data have been obtained, processing is required in order to put the data in a useful form for importing into the database. This is done in a uniform manner according to the following steps:

  • Check raw data
  • Create temporary directory
  • Pre-process raw data into form suitable for version control
  • Update version control with pre-processed raw data
  • Process version controlled raw data into database-ready form
  • Update version control with processed data
  • Run database input process on processed data

-- IsaacMorland - 02 Jan 2008

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2008-01-07 - IsaacMorland
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright © 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback