1 ETL Informatica

Published on February 2017 | Categories: Documents | Downloads: 33 | Comments: 0 | Views: 158
of 48
Download PDF   Embed   Report

Comments

Content

DATA WAREHOUSE

Cognos PPES

1

Informatica PowerCenter

2

New Concept Training Center

1

DATA WAREHOUSE

Cognos PPES

Connectivity Overview

3

Informatica’s Architecture
Designer
Workflow Manager
Workflow Monitor

Repository Manager

Data Models

Targets 1-n

Sources 1-n
PowerPlugs
Repository

Server

4

New Concept Training Center

2

DATA WAREHOUSE

Cognos PPES

Connectivity Overview

5

Informatica Design Process

1.
2.

Source Def
5.
3.

Target Def
Sessions
Mapping

4.

1. Create Repository
2. Import Source Definitions
3. Import/Create Target
Schema
4. Create Mappings
5. Load Data

6

New Concept Training Center

3

DATA WAREHOUSE

Cognos PPES

Repository

7

Metadata Repository
‰ Information about the target system
‰ Catalogs the repository
‰ Directs the server
‰ Contains record of user access
‰ Can be shared
‰ Can be searched and reported
‰ Bridged through Metadata Exchange

8

New Concept Training Center

4

DATA WAREHOUSE

Cognos PPES

Repository Manager

9

Repository Manager Navigator

10

New Concept Training Center

5

DATA WAREHOUSE

Cognos PPES

Create Repository
Š Launch the Repository Manager
Š Repository – Connect to Repository Server

11

1. Create the configuration
Š In Manage Repository window
Š Configuration - Create

12

New Concept Training Center

6

DATA WAREHOUSE

Cognos PPES

2. Create Repository
Š In Manage Repository window
Š Repository – Create

13

Informatica Server can not start up without repository

Š NO REPOSITORY

14

New Concept Training Center

7

DATA WAREHOUSE

Cognos PPES

Create a group
Š Connect to the repository using repository manager
Š SecurityÆManage Groups

15

Assign Privileges to a Group

16

New Concept Training Center

8

DATA WAREHOUSE

Cognos PPES

Creating a new user

17

User Management

Privileges
(issued per login ID and/or group)
Use Designer *
Browse Repository *
Create Sessions and Batches *
Session Operator
Administer Repository
Administer Server
Super User

Permissions

Object Locking

(issued at folder level)

(applied at object level)

Read
Write
Execute

Lock - automatic
Unlock - automatic, manual

* Default privileges to each new user and group

New Concept Training Center

18

9

DATA WAREHOUSE

Cognos PPES

Groups and Privileges

Š Create users
Š Create groups
Š Assign privileges to
groups

Š Move users into groups
Š Assign additional privileges to
users

19

Folder Permissions

Š

Assign one user as the folder
permissions
owner for first tier

Š

Select one of the owner’s groups
for second tier
permissions

Š

All users and groups in the
repository will be assigned the
third tier permissions

20

New Concept Training Center

10

DATA WAREHOUSE

Cognos PPES

Designer Tools

21

Designer Windows

22

New Concept Training Center

11

DATA WAREHOUSE

Cognos PPES

Working with Sources
Š Relational Source
ŠOracle
ŠSybase
ŠInformix
ŠSQL Server
ŠDB2
Š MS Excel Source
Š Cobol Source
Š Flat files
Š XML sources

23

Working with Relational source

24

New Concept Training Center

12

DATA WAREHOUSE

Cognos PPES

Analyze Sources

Š
Š

Import from Database
Import from Files
ŠFlat File
ŠExcel file
ŠXML file

Š
Š
Š

Import from Cobol File

Repository

Create manually
Transfer from data modeling
tools via PowerPlugs

Relational

Diff Type
Of files

COBOL file

Data Model

25

Relational Source Analysis

Source Analyzer

Relational Source
OD

BC
Table
View

O
D
B
C

Synonym
DEF

DEF

Repository
26

New Concept Training Center

13

DATA WAREHOUSE

Cognos PPES

Import from relational database

27

Import from relational database
Š After import, chose Repository Æ Save

28

New Concept Training Center

14

DATA WAREHOUSE

Cognos PPES

Updating a relational source definition

Edit existing source definition
Re-import source definition

29

Flat File Analysis

Source Analyzer

Map
NFS ped D
r
Loc Moun ive
al D
t
irec
tory

Flat File
DEF

Š Fixed Width
Š Delimited

O
D
B
C

DEF

Repository
30

New Concept Training Center

15

DATA WAREHOUSE

Cognos PPES

Flat File Wizard

Š

Three-step wizard

Š

Can rename columns
within wizard

Š

Only datatypes allowed
are text or numeric

Š

Wizard ‘guesses’ datatype

31

Flat File Analysis

Edit Source Definition

32

New Concept Training Center

16

DATA WAREHOUSE

Cognos PPES

Import source from MS Excel
Š To import source from MS Excel
Š Install the MS Excel ODBC driver

Š Create a MS Excel ODBC Data Source for each
source file

ŠPrepare MS spreadsheet by definition ranges
and formatting columns of numeric data

Š import source definitions to the designer

33

Import source from XML

34

New Concept Training Center

17

DATA WAREHOUSE

Cognos PPES

COBOL File Analysis

Source Analyzer

Map
NFS ped D
Loc Mou rive
al D ntin
irec g
tory

.CBL File
DEF

O
D
B
C
DATA

DEF

Repository

Supported Numeric Storage Options

35

Cobol File Analysis

Edit Source Definition

36

New Concept Training Center

18

DATA WAREHOUSE

Cognos PPES

Working with Target – Warehouse Designer

37

Importing a relational target definitions

38

New Concept Training Center

19

DATA WAREHOUSE

Cognos PPES

Import from Database
Reverse engineer existing object definitions from a
database into Informatica repository
Warehouse Designer
Database
OD
O
D
B
C

BC

Table
View
Synonym
DEF

Repository

39

Import target from a relational database

40

New Concept Training Center

20

DATA WAREHOUSE

Cognos PPES

Import target from a flat file

41

Import target from XML

42

New Concept Training Center

21

DATA WAREHOUSE

Cognos PPES

Manual Target Definition
1. Create empty definition

2. Add desired columns

3. Finished target definition

43

Target Table Definitions

44

New Concept Training Center

22

DATA WAREHOUSE

Cognos PPES

Create Physical Tables

DEF
DEF

DEF

Execute SQL
via
Designer

Informatica
Repository
logical
target table definitions

Target
Databases
physical
tables

45

Create Physical Tables
Š

Create tables that do not already exist in target database

ŠConnect - connect to the target database
ŠGenerate SQL file - create DDL in a script file
ŠEdit SQL file - modify DDL script as needed
ŠExecute SQL file - create the physical tables in target database

Connect

46

New Concept Training Center

23

DATA WAREHOUSE

Cognos PPES

Mappings and Mapplets

47

Sample Mapping

48

New Concept Training Center

24

DATA WAREHOUSE

Cognos PPES

Steps to develop a mapping
Š Verify that all source, target, and reusable objects are
created

Š Create the mapping (Open the Mapping Designer, chose
MappingÆCreate or drag a repository object into the
workspace, enter a name for the new mapping e.g.
m_PromotionItems)

Š
Š
Š
Š
Š

Add sources and targets
Add transformations and transformation logic
Connect the mapping
Validate the mapping
Save the mapping

49

Mapping Object Edit View

50

New Concept Training Center

25

DATA WAREHOUSE

Cognos PPES

Connecting mapping objects

51

Working with source in a mapping

52

New Concept Training Center

26

DATA WAREHOUSE

Cognos PPES

Working with transformation in a mapping

53

Working with Mapplets in a mapping

54

New Concept Training Center

27

DATA WAREHOUSE

Cognos PPES

Working with Targets in a mapping

55

Working with Targets in a mapping

56

New Concept Training Center

28

DATA WAREHOUSE

Cognos PPES

Relational Target

57

Mapping Validation

58

New Concept Training Center

29

DATA WAREHOUSE

Cognos PPES

Mapplets Overview

59

Sample Mapplet

60

New Concept Training Center

30

DATA WAREHOUSE

Cognos PPES

Sample Mapplet in a mapping

61

Expanded Mapplet in a mapping

62

New Concept Training Center

31

DATA WAREHOUSE

Cognos PPES

Transformation

63

Transformation Type -1

64

New Concept Training Center

32

DATA WAREHOUSE

Cognos PPES

Transformation Type -2

65

Creating a transformation

66

New Concept Training Center

33

DATA WAREHOUSE

Cognos PPES

Configuring a transformation

67

Working with Expression

68

New Concept Training Center

34

DATA WAREHOUSE

Cognos PPES

Using Local Variables

69

Using Local Variables sample

70

New Concept Training Center

35

DATA WAREHOUSE

Cognos PPES

Using Default Value

71

Configuring Tracing levels – Session log

72

New Concept Training Center

36

DATA WAREHOUSE

Cognos PPES

Linking Port

73

Auto-Link by position

74

New Concept Training Center

37

DATA WAREHOUSE

Cognos PPES

Auto-Link by Name

75

Auto-Link by Prefix/Suffix
Š

Layout Æ Autolink

76

New Concept Training Center

38

DATA WAREHOUSE

Cognos PPES

Link one to many / many to one

77

Create a reusable transformation

78

New Concept Training Center

39

DATA WAREHOUSE

Cognos PPES

Source Qualifier Transformation
Represents the source record set queried by the server.
Mandatory in mappings using relational or flat file sources.

Active Transformation
Connected
Ports
† All input/output
Usage
† Modify SQL statement*
† Sorted ports*
† Select DISTINCT*
† Convert datatypes

79

*relational sources only

Source Qualifier Transformation
For relational sources
SQL Query replaces the default query
User Defined Join replaces the WHERE clause of the default query
Source Filter is added to the WHERE clause of the default query
Number of Sorted Ports adds an ORDER BY to the default query
Select Distinct adds a DISTINCT to the default query

80

New Concept Training Center

40

DATA WAREHOUSE

Cognos PPES

Expression Transformation
Perform calculations using non-aggregate Informatica
functions.
Passive Transformation
Connected
Ports
† Mixed
† Variables allowed
Create expression in an
output port
Usage
† Perform majority of
data manipulation

81

Aggregator Transformation
Performs aggregate functions.

Active Transformation
Connected
Ports
† Mixed
† Variables allowed
† Group By allowed
Create expression in an
output port
Usage
† Standard
aggregations
† Group By

82

New Concept Training Center

41

DATA WAREHOUSE

Cognos PPES

Sorted Ports
Š

Source Qualifier

ŠNumber of Sorted Ports property - will create an ORDER BY
statement in the SQL

ŠIncreases performance Š

for rank, joiner, and aggregator

Aggregator

ŠThe Sorted Ports property ONLY works if data has been sorted
ŠGroup By ports
ŠMUST be pre-sorted in SQL
ŠMUST be in same order as in SQL
ŠServer will store data for a group into memory, and when it
reaches the first record of the next group, it can release data from
the cache

83

Working with Transformations

Aggregation Mapping

84

New Concept Training Center

42

DATA WAREHOUSE

Cognos PPES

Rank Transformation
Filters the top or bottom range of records.

Active Transformation
Connected
Ports
† Mixed
† One predefined output
port RANKINDEX
† Variables allowed
† Group By allowed
Specify the column to be
ranked
Usage
† Select top/bottom
number of records

85

Update Strategy Transformation
Used to specify how each individual row will be used to
update target tables (insert, update, delete, reject).
Active Transformation
Connected
Ports
† All input/output
Specify the Update
Strategy Expression
Usage
† Slowly changing
dimension tables
† IIF or DECODE logic
determine how to
handle the record

86

New Concept Training Center

43

DATA WAREHOUSE

Cognos PPES

Lookup Transformation
Looks up values from database objects and provides to
other components in a mapping.
Passive Transformation
Connected/Unconnected
Ports
† Mixed
† L denotes Lookup port
† R denotes port used as
a return value in
unconnected lookup
Specify the Lookup
condition
Usage
† Get related values
† Update tables

87

Working with Transformations
Update Strategy Mapping

SOURCE

SOURCE
QUALIFIER

LOOKUP
Look up
source
Job_IDs
in target
T_JOBS

UPDATE
STRATEGY
Based upon
match of
Job_IDs,
update the
target
T_JOBS table

TARGET

88

New Concept Training Center

44

DATA WAREHOUSE

Cognos PPES

Filter Transformation
Limits rows sent to targets or other transformations.

Active Transformation
Connected
Ports
† All input/output
Specify a Filter condition
Usage
† Filter rows from flat
file sources
† Single pass source(s)
into multiple targets

89

Stored Procedure Transformation
Calls a database stored procedure.

Passive Transformation
Connected/Unconnected
Ports
† Mixed
† R denotes port used as
a return value (from a
stored function)
Usage
† Perform transformation
logic outside Informatica

90

New Concept Training Center

45

DATA WAREHOUSE

Cognos PPES

Stored Function vs.
Stored Procedure Transformations
ORACLE
STORED FUNCTION

ORACLE
STORED PROCEDURE

Can only return one value
(connected or unconnected
mode)

Can return multiple values (in
connected mode)

Must use the Return (R) port
option for the output port that
provides the return value,
regardless of whether the
transformation is unconnected
or connected.

In a connected mode, use links to
designate return values. In
unconnected mode, use
PROC_RESULT in the parameter list
of the stored procedure call to
designate the return value.

91

Sequence Generator Transformation
Generates unique keys for records.

Passive Transformation
Connected
Ports
† Two predefined output
ports, NEXTVAL and
CURRVAL
† No input ports allowed
Usage
† Generate sequence
numbers
† Shareable across
mappings

92

New Concept Training Center

46

DATA WAREHOUSE

Cognos PPES

Working with Transformations
Star Schema Mapping
Filter
filters out
discontinued items
Stored Procedure
calls stored procedure
to calculate the
number of times an
item has been ordered

Sequence Generator
generates unique
ID numbers

93

Workflow Manager

94

New Concept Training Center

47

DATA WAREHOUSE

Cognos PPES

Workflow Monitor

95

New Concept Training Center

48

Sponsor Documents

Or use your account on DocShare.tips

Hide

Forgot your password?

Or register your new account on DocShare.tips

Hide

Lost your password? Please enter your email address. You will receive a link to create a new password.

Back to log-in

Close