Job Documentation
Generated by Talend Open Studio


PROJECT NAME London GENERATION DATE 24-mar-2010 1:11:36
AUTHOR respinosa@terramiticapark.comT.O.S VERSION 4.0.0.M1_r33789

Summary

Project Description
Job Description
Job Preview Picture
Job Settings
Context List
Component List
Components Description


Project Description


Properties Values
NameLondon
Languagejava
Description
Proyecto BI de Analisis de Datos Públicos


Job Description


Properties Values
NameP_grupo_etnico
Authorrespinosa@terramiticapark.com
Version0.1
PurposeCenso Historico desde 1801
Status
Description
Creation11-mar-2010 23:09:55
Modification 21-mar-2010 19:08:56

Job Preview Picture


No image available
tFileInputXML_3tFilterRow_1tFlowToIterate_1tJava_1tLogRow_1tLoop_1tMap_1tMysqlRow_2

Job settings

Extra settings

Name Value
COMP_DEFAULT_FILE_DIRC:/Talend/TOS-Win32-r33789-V4.0.0M1/workspace
Multi thread executionfalse
Implicit tContextLoadfalse


Stats & Logs

Name Value
Use statistics (tStatCatcher)false
Use logs (tLogCatcher)false
Use volumetrics (tFlowMeterCatcher)false
On Consolefalse
On Filesfalse
On Databasesfalse
Catch components statisticsfalse
Catch runtime errorstrue
Catch user errorstrue
Catch user warningstrue


Context List

Context : Default

Name Prompt Need Prompt? Type Value Source
censo_historico_XmlFilePathcenso_historico_XmlFilePath?falseid_FileD:/BI/Info BI/BLog/Entrada 14.11/Datos/Censo Historico.xml
censo_historico_XPathQuerycenso_historico_XPathQuery?falseid_String/ROWSET/ROW
censo_historico_Encodingcenso_historico_Encoding?falseid_StringUTF-8




Component List

Component Name Component Type
tFileInputXML_3tFileInputXML
tFilterRow_1tFilterRow
tFlowToIterate_1tFlowToIterate
tJava_1tJava
tLogRow_1tLogRow
tLoop_1tLoop
tMap_1tMap
tMysqlRow_2tMysqlRow

Components Description

Component:   tFileInputXML

      UNIQUE NAME tFileInputXML_3 INPUT(S) none
LABEL grupo_etnico OUTPUT(S) tLogRow_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Filename/InputStream"D:/BI/Info BI/BLog/Entrada 14.11/Datos/Censo 2001 - Grupo Etnico.xml"
Loop XPath query"/ROWSET/ROW"
Mapping[{QUERY="Area_Code", NODECHECK=, SCHEMA_COLUMN=Area_Code}, {QUERY="All_people", NODECHECK=, SCHEMA_COLUMN=All_people}, {QUERY="People_in_ethnic_groups_-_White_-_British", NODECHECK=, SCHEMA_COLUMN=British}, {QUERY="People_in_ethnic_groups_-_White_-_Irish", NODECHECK=, SCHEMA_COLUMN=Irish}, {QUERY="People_in_ethnic_groups_-_White_-_Other_White", NODECHECK=, SCHEMA_COLUMN=Other_White}, {QUERY="People_in_ethnic_groups_-_Mixed_-_White_and_Black_Caribbean", NODECHECK=, SCHEMA_COLUMN=Mestizo_White_and_Black_Caribbean}, {QUERY="People_in_ethnic_groups_-_Mixed_-_White_and_Black_African", NODECHECK=, SCHEMA_COLUMN=Mestizo_White_and_Black_African}, {QUERY="People_in_ethnic_groups_-_Mixed_-_White_and_Asian", NODECHECK=, SCHEMA_COLUMN=Mestizo_White_and_Asian}, {QUERY="People_in_ethnic_groups_-_Mixed_-_Other_Mixed", NODECHECK=, SCHEMA_COLUMN=Mestizo_Other_Mixed}, {QUERY="People_in_ethnic_groups_-_Asian_or_Asian_British_-_Indian", NODECHECK=, SCHEMA_COLUMN=Indian}, {QUERY="People_in_ethnic_groups_-_Asian_or_Asian_British_-_Pakistani", NODECHECK=, SCHEMA_COLUMN=Pakistani}, {QUERY="People_in_ethnic_groups_-_Asian_or_Asian_British_-_Bangladeshi", NODECHECK=, SCHEMA_COLUMN=Bangladeshi}, {QUERY="People_in_ethnic_groups_-_Asian_or_Asian_British_-_Other_Asian", NODECHECK=, SCHEMA_COLUMN=Other_Asian}, {QUERY="People_in_ethnic_groups_-_Black_or_Black_British_-_Caribbean", NODECHECK=, SCHEMA_COLUMN=Negro_Caribbean}, {QUERY="People_in_ethnic_groups_-_Black_or_Black_British_-_African", NODECHECK=, SCHEMA_COLUMN=Negro_African}, {QUERY="People_in_ethnic_groups_-_Black_or_Black_British_-_Other_Black", NODECHECK=, SCHEMA_COLUMN=Negro_Other_Black}, {QUERY="People_in_ethnic_groups_-_Chinese_or_other_ethnic_group_-_Chinese", NODECHECK=, SCHEMA_COLUMN=Chinese}, {QUERY="People_in_ethnic_groups_-_Chinese_or_other_ethnic_group_-_Other_Ethnic_Group", NODECHECK=, SCHEMA_COLUMN=Other_Ethnic_Group}]
Limit50
Die on errorfalse
Advanced separator(for number)false
Ignore the namespacesfalse
Use Separator for mode Xercesfalse
Generation modeDom4j
Codificación"UTF-8"
Show Informationfalse
Comentario

Schema for tFileInputXML_3 :
Column Key Type Length Precision Nullable Comment
Area_CodefalseString4true
All_peoplefalseInteger8true
BritishfalseInteger8true
IrishfalseInteger6true
Other_WhitefalseInteger7true
Mestizo_White_and_Black_CaribbeanfalseInteger6true
Mestizo_White_and_Black_AfricanfalseInteger5true
Mestizo_White_and_AsianfalseInteger6true
Mestizo_Other_MixedfalseInteger6true
IndianfalseInteger7true
PakistanifalseInteger6true
BangladeshifalseInteger6true
Other_AsianfalseInteger6true
Negro_CaribbeanfalseInteger6true
Negro_AfricanfalseInteger6true
Negro_Other_BlackfalseInteger5true
ChinesefalseInteger6true
Other_Ethnic_GroupfalseInteger6true

Original Function Parameters:
Component:   tFilterRow

      UNIQUE NAME tFilterRow_1 INPUT(S) tLogRow_1
LABEL eliminar_no_londres OUTPUT(S) tMap_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Logical operator used to combine conditions&&
Conditions[]
Use advanced modetrue
Avanzado// code sample : use input_row to define the condition. // input_row.columnName1.equals("foo") ||!(input_row.columnName2.equals("bar")) // replace the following expression by your own filter condition StringHandling.LEFT(input_row.Area_Code,2).equals("00")
Show Informationfalse
Comentario

Schema for tFilterRow_1 :
Column Key Type Length Precision Nullable Comment
Area_CodefalseString4true
All_peoplefalseInteger8true
BritishfalseInteger8true
IrishfalseInteger6true
Other_WhitefalseInteger7true
Mestizo_White_and_Black_CaribbeanfalseInteger6true
Mestizo_White_and_Black_AfricanfalseInteger5true
Mestizo_White_and_AsianfalseInteger6true
Mestizo_Other_MixedfalseInteger6true
IndianfalseInteger7true
PakistanifalseInteger6true
BangladeshifalseInteger6true
Other_AsianfalseInteger6true
Negro_CaribbeanfalseInteger6true
Negro_AfricanfalseInteger6true
Negro_Other_BlackfalseInteger5true
ChinesefalseInteger6true
Other_Ethnic_GroupfalseInteger6true

Original Function Parameters:
Component:   tFlowToIterate

      UNIQUE NAME tFlowToIterate_1 INPUT(S) tMap_1
LABEL __UNIQUE_NAME__ OUTPUT(S) tLoop_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use the default (key, value) in global variables.true
Show Informationfalse
Comentario

Schema for tFlowToIterate_1 :
Column Key Type Length Precision Nullable Comment

Original Function Parameters:
Component:   tJava

      UNIQUE NAME tJava_1 INPUT(S) tLoop_1
LABEL __UNIQUE_NAME__ OUTPUT(S) tMysqlRow_2

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Codigorow3.Sentencia_SQL = ((String)globalMap.get("Censo.Registro"+((Integer)globalMap.get("tLoop_1_CURRENT_VALUE"))));
Import//import java.util.List;
Show Informationfalse
Comentario

Schema for tJava_1 :
Column Key Type Length Precision Nullable Comment
Sentencia_SQLfalseStringtrue

Original Function Parameters:
Component:   tLogRow

      UNIQUE NAME tLogRow_1 INPUT(S) tFileInputXML_3
LABEL __UNIQUE_NAME__ OUTPUT(S) tFilterRow_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Basictrue
Table (print values in cells of a table)false
Vertical (each row is a key/value list)false
Field Separator"|"
Print headerfalse
Print component unique name in front of each output rowfalse
Print schema column name in front of each valuefalse
Use fixed length for valuesfalse
Show Informationfalse
Comentario

Schema for tLogRow_1 :
Column Key Type Length Precision Nullable Comment
Area_CodefalseString4true
All_peoplefalseInteger8true
BritishfalseInteger8true
IrishfalseInteger6true
Other_WhitefalseInteger7true
Mestizo_White_and_Black_CaribbeanfalseInteger6true
Mestizo_White_and_Black_AfricanfalseInteger5true
Mestizo_White_and_AsianfalseInteger6true
Mestizo_Other_MixedfalseInteger6true
IndianfalseInteger7true
PakistanifalseInteger6true
BangladeshifalseInteger6true
Other_AsianfalseInteger6true
Negro_CaribbeanfalseInteger6true
Negro_AfricanfalseInteger6true
Negro_Other_BlackfalseInteger5true
ChinesefalseInteger6true
Other_Ethnic_GroupfalseInteger6true

Original Function Parameters:
Component:   tLoop

      UNIQUE NAME tLoop_1 INPUT(S) tFlowToIterate_1
LABEL __UNIQUE_NAME__ OUTPUT(S) tJava_1

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Fortrue
Whilefalse
From1
To17
Step1
Values are increasingtrue
Show Informationfalse
Comentario


Original Function Parameters:
Component:   tMysqlRow

      UNIQUE NAME tMysqlRow_2 INPUT(S) tJava_1
LABEL __UNIQUE_NAME__ OUTPUT(S) none

Component Parameters:
Properties Values
Activatetrue
tStatCatcher Statisticsfalse
Use an existing connectionfalse
Host"pcserver7"
Port"3306"
Base de Datos"london"
Username"root"
Password******
Schema
Table Name"ds_estadisticas"
Queryrow3.Sentencia_SQL
Die on errortrue
Additional JDBC Parameters"noDatetimeStringSync=true"
Propagate QUERY's recordsetfalse
Codificación"ISO-8859-15"
Commit every10000
Show Informationfalse
Comentario

Schema for tMysqlRow_2 :
Column Key Type Length Precision Nullable Comment
Sentencia_SQLfalseStringtrue

Original Function Parameters:
Component:   tMap

      UNIQUE NAME tMap_1 INPUT(S) tFilterRow_1
LABEL __UNIQUE_NAME__ OUTPUT(S) tFlowToIterate_1

No image available



Component Parameters:
Properties Values
tStatCatcher Statistics
false
Mapping links display as:
AUTO
Temp data directory path:
Max buffer size (nb of rows):
2000000
Show Information
false
Comentario

Mapper table for tMap_1 ( input ):
Mapper table Properties( row2 ):
Properties Values
Name row2
Matching-mode UNIQUE_MATCH
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( row2 ):
Name Type Expression isNullable
Area_CodeStringtrue
All_peopleIntegertrue
BritishIntegertrue
IrishIntegertrue
Other_WhiteIntegertrue
Mestizo_White_and_Black_CaribbeanIntegertrue
Mestizo_White_and_Black_AfricanIntegertrue
Mestizo_White_and_AsianIntegertrue
Mestizo_Other_MixedIntegertrue
IndianIntegertrue
PakistaniIntegertrue
BangladeshiIntegertrue
Other_AsianIntegertrue
Negro_CaribbeanIntegertrue
Negro_AfricanIntegertrue
Negro_Other_BlackIntegertrue
ChineseIntegertrue
Other_Ethnic_GroupIntegertrue

Constraint Table Entries( row2 ):
Name Type Expression isNullable

Mapper table for tMap_1 ( output ):
Mapper table Properties( Censo ):
Properties Values
Name Censo
Matching-mode
isMinimized false
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( Censo ):
Name Type Expression isNullable
Registro1String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_todas_razas'," + row2.All_people.toString() + ");" true
Registro2String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_britanicos'," + row2.British.toString() + ");" true
Registro3String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_irlandeses'," + row2.Irish.toString() + ");" true
Registro4String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_resto_blancos'," + row2.Other_White.toString() + ");" true
Registro5String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_mestizo_caribe'," + row2.Mestizo_White_and_Black_Caribbean.toString() + ");" true
Registro6String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_mestizo_africa'," + row2.Mestizo_White_and_Black_African.toString() + ");" true
Registro7String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_mestizo_asia'," + row2.Mestizo_White_and_Asian.toString() + ");" true
Registro8String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_mestizo_otros'," + row2.Mestizo_Other_Mixed.toString() + ");" true
Registro9String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_asiatico_indio'," + row2.Indian.toString() + ");" true
Registro10String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_asiatico_pakistani'," + row2.Pakistani.toString() + ");" true
Registro11String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_asiatico_bangladesh'," + row2.Bangladeshi.toString() + ");" true
Registro12String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_asiatico_otros'," + row2.Other_Asian.toString() + ");" true
Registro13String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_negro_caribe'," + row2.Negro_Caribbean.toString() + ");" true
Registro14String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_negro_africa'," + row2.Negro_African.toString() + ");" true
Registro15String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_negro_otros'," + row2.Negro_Other_Black.toString() + ");" true
Registro16String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_chino'," + row2.Chinese.toString() + ");" true
Registro17String"INSERT INTO ds_estadisticas(Area_id,Anyo,estadistica,variable,valor ) VALUES ('" + row2.Area_Code + "','2001','P_grupo_etnico','N_otras_etnias'," + row2.Other_Ethnic_Group.toString() + ");" true

Constraint Table Entries( Censo ):
Name Type Expression isNullable

Mapper table for tMap_1 ( var ):
Mapper table Properties( Var ):
Properties Values
Name Var
Matching-mode
isMinimized true
isReject false
isRejectInnerJoin false
isInnerJoin false

Metadata Table Entries( Var ):
Name Type Expression isNullable

Constraint Table Entries( Var ):
Name Type Expression isNullable