Data Mining, Management, and Migration

Sometimes moving millions of data fields from ten different databases to another seems like trying to get a thousand birds to leave the branches of one tree and land on just the right branches of another.

Data mining, management, and migration

Data Migrator facilitates a data mining work process for:

  • Setting up asset specific electronic data files including U-1 forms and/or fabrication drawings. In other words, a methodology for expeditiously converting your asset information from a docu-centric environment to a data-centric environment allows you to look at your asset data from anywhere in the world.
  • Once the scanning process is completed, the electronic files are organized by equipment type (columns, towers, air coolers, heat exchangers, etc) and piping equipment files, including the systemized and circuitized P&IDs as well as specific files for each piping circuit. An example of the electronic data files include but are not limited to:

    • As-built drawing
    • P&IDs
    • Manufacturer's drawings
    • Installation drawings
    • Arrangement, tube layout, and logic drawings
    • Basic equipment design information
    • Original specification sheet
    • Calculations for sizing the relief device
    • Shop testing or calibration record (for relief valves and conservation vents)
    • Fabrication data
    • Acceptance test results
    • Manufacturer's operating and maintenance instructions
    • Parts list
    • Operating information
    • Operating certificate when required

A facility with, say, 400 pieces of fixed equipment, 800 piping circuits and 400 PRDs takes less than three months to complete.

In many cases, owners are initially happy to have their asset data available electronically; however, converting this data to knowledge is a much easier next step as can be seen from the following case study. A southern California refiner was transitioning from one IDMS (inspection data management system) to a corporate RBI program. Over twenty million data fields had to be moved from one data base to another. The total number of assets being converted was as follows:

Process Units22015
Relief Valves38715387
Inspection History1448600
Piping - Systemized15206 -
Piping - NOt Systemized4022 -
Piping Out of Service1303 -
Piping Inactive - 2669

Another major concern of the owner was the cost of renewing the older IDMS license which was considerable and in excess of several million USD. Given a time frame of less than six months to complete the transition and successfully complete UAT (User Acceptance Testing) of the target RBI database, AOC consultants utilized the data migrator tool from StarThrower Software, to expedite the data mining process and cleanse the data prior to exporting to the target IDMS SQL database. The project was completed in five months saving the owner millions in renewed licensing costs. For additional information on this case study please contact us.

AOC Data Collection Work Process and Import Utility

Case Study Inquiry

Related Services

Master Data Management and Data Conversion

Innovative technology that allows quick, efficient extraction of data into a knowledge-centric world

Risk Based Inspection (RBI) Implementation and Planning

AOC has delivered thousands of sustainable Risk Based Inspection (RBI) programs earning the trust of owner operators.

Operational Readiness and Maintenance Strategy Development

Development of maintenance strategies, recommendations, and plans to implement best practices and increase asset life

Related Training

GE APM Mechanical Integrity Work Process Training

How do I use GE APM to perform MI/RBI tasks?

Risk Analyst Training for GE APM RBI

How does GE APM RBI software estimate risk?

RBI Work Process Using RBMI

How do I use RBMI to perform MI/RBI tasks?

Risk Analyst Training for RBMI

How does RBMI software estimate risk?

Managing and Sustaining an RBI program using RBMI

How do I manage and sustain my MI/RBI program using RBMI software?

Related Knowledge

Risk Analysis: Good In, Good Out - A Risk Analyst's View

Reflections on the importance of ensuring your data is accurate and on the impact that having poor data can have on your risk analysis.

Plant Management 101: Common Work Processes

A dysfunctionality found in many refineries, chemical plants, and other production facilities, is a lack of common asset management work processes.

Proposed API 581 Inspection Plan Optimization

A proposal for a risk analysis option that allows for individual damage mechanism risk calculation in API 581

Asset Value Management vs Asset Performance Management

A look at how the financial sector's concept of Asset Value Management can be applied to the petrochemical industry.

Proposed API 581 Inspection Plan Optimization Example

An example to compliment our earlier proposal for a risk analysis option that allows for individual damage mechanism risk calculation in API 581

RBI Value: Both Transitioning And From The Start

A look at how RBI adds value whether you are just starting out or transitioning from a traditional methodology.

PHMSA vs OSHA Jurisdiction

PHMSA has out for comment, draft document information, that clarifies its jurisdiction in relation to OSHA for Midstream Processing Facilities.

Other Benefits of Risk Based Inspection Implementation

A look at several of the secondary benefits of Risk Based Inspection

Guidelines for Providing Process Conditions for RBI: Cracking

Additional process data may be needed when environment, stress, and metallurgy are so alligned so as to indicate susceptibility to environmental cracking.

Guidelines for Providing Process Conditions for RBI: HTHA

A simple screening to determine HTHA susceptibility and factors to consider when more data is required.