Automated Testing Framework for ETL

Automated Testing Framework for ETL

Posted by: Informatica Professional Services

This automated testing framework is a generic framework which can be used for both system testing & regression testing.

Overview

In a data integration project the QA process involves multiple steps which includes
  • Setting up the source and target systems
  • Populating source and target test data
  • Running of the PowerCenter & other dependent jobs
  • Validating the results
  • Logging the test results
In a typical project these are done manually and repeated multiple times throughout the project lifecycle. The automated framework presented here provides a way of automating these steps. The components of this framework are:An excel interface to capture the steps described above. The test steps that can be configures are:
  • Connect and execute database Queries
  • Run Informatica jobs.
  • Define variables.
  • Execute OS Command.
  • Define the Success conditions.
  • Create & Append file contents.
  • Attachment¬† of Log files (if any).
An engine that processes the excel input and generates and executes the test steps. (Built using the Informatica Platform).Automatic Logging & Email notification of Test Results. The Major features include:
  • Repeatability of Test case Execution.
  • Ease of use.
  • Provides high degree of Flexibility /Scalability
  • Can work with both Windows & UNIX environment.
  • Complete Logging & Email functionality.
  • Can perform a wide variety of tasks.
  • Converts the Test case into an OS script, hence better performance.
  • Excel Utility helps to quickly generate test cases.

Features

System Requirements

  • Informatica PowerCenter 9.1 and above
  • Microsoft Excel
  • Any Database

Resources

Support

Kannapiran is a Senior Consultant with Informatica's Professional Services group He has good amount of experience in implementing large scale end to end Data Integration projects. He has extensive experience in architecting/designing Data Integration solutions for BFSI Clients which includes Investment Banks, Insurance, Mortgage ,Wealth Management clients.

Comments (5) Comment can only be posted by Signed/Logged in user

Sort: Newest | Oldest
  • Hi Team,

    I'm unable to download the document. could you please help me in it..

    thanks,

  • Hi Team,

    I'm unable to download the document. could you please help me in it..

    thanks,

  • Hi Team,Facing some problem with date formats and I find no date information is given as an input and in java code also I am unable to find out where and why the date is getting used. Can you please help me out to resolve the below issues.Severity Timestamp Node Thread Message Code MessageERROR 26/01/2016 10:56:39 dwhdas12 TRANSF_1_2_1 JAVA PLUGIN_1762 [ERROR] at com.informatica.powercenter.server.jtx.JTXPartitionDriverImplGen.gtime(JTXPartitionDriverImplGen.java:231)ERROR 26/01/2016 10:56:39 dwhdas12 TRANSF_1_2_1 JAVA PLUGIN_1762 [ERROR] at java.text.SimpleDateFormat.<init>(SimpleDateFormat.java:500)ERROR 26/01/2016 10:56:39 dwhdas12 TRANSF_1_2_1 JAVA PLUGIN_1762 [ERROR] java.lang.IllegalArgumentException: Illegal pattern character 'Y'ERROR 26/01/2016 10:56:39 dwhdas12 TRANSF_1_2_1 JAVA PLUGIN_1762 [ERROR] at java.text.SimpleDateFormat.compile(SimpleDateFormat.java:768)ERROR 26/01/2016 10:56:39 dwhdas12 TRANSF_1_2_1 JAVA PLUGIN_1762 [ERROR] at java.text.SimpleDateFormat.initialize(SimpleDateFormat.java:575)ERROR 26/01/2016 10:56:39 dwhdas12 TRANSF_1_2_1 JAVA PLUGIN_1762 [ERROR] at java.text.SimpleDateFormat.<init>(SimpleDateFormat.java:475)
     |   2
     Load replies
  • Hi Team,I tried to implement the same in version 9.1 but I am getting the errors JAVA_PLUGIN_1762 . I kept my jar files in local and gave the same path , tired to keep inserver and gave same path, tired to pull rest of jars and place, tried to compile the code and it is compiling successfully. use high precision in java transformations and session level as well, tried to check null pointer exception handling. Tried all but in vain. Can any one please help me out here.
  • In the Specification Tab of this page it says it works with "Any Database" but in the User Guide PDF It says it supports only "Oracle Database." Which is it?
     |   1
     Load replies
Recommended Products