Professional Documents
Culture Documents
Access: Welcome To Talend Help Center
Access: Welcome To Talend Help Center
Access
2022-03-17
1. Access
1. Access components
1. tAccessBulkExec
1. tAccessBulkExec Standard properties
2. tAccessClose
1. tAccessClose Standard properties
3. tAccessCommit
1. tAccessCommit Standard properties
4. tAccessConnection
1. tAccessConnection Standard properties
5. tAccessInput
1. tAccessInput Standard properties
6. tAccessOutput
1. tAccessOutput Standard properties
7. tAccessOutputBulk
1. tAccessOutputBulk Standard properties
8. tAccessOutputBulkExec
1. tAccessOutputBulkExec Standard properties
9. tAccessRollback
1. tAccessRollback Standard properties
10. tAccessRow
1. tAccessRow Standard properties
2. Access scenario
1. Inserting data in parent/child tables
Access
Access components
tAccessBulkExec
Offers gains in performance when carrying out Insert operations in an Access database.
The tAccessOutputBulk and tAccessBulkExec components are generally used together to output data to a delimited file and then to
perform various actions on the file in an Access database, in a two step process. These two steps are fused together in the
tAccessOutputBulkExec component, detailed in a separate section. The advantage of using a two step process is that it makes it
possible to carry out transformations on the data before loading it in the database.
These properties are used to configure tAccessBulkExec running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
File Name Browse to the delimited file to be loaded into your database.
Append
Select this check box to append the data to the file.
Schema and Edit Schema A schema is a row description. It defines the number of fields
(columns) to be processed and passed on to the next
component. When you create a Spark Job, avoid the reserved
word line when naming the fields.
Advanced settings
Include header Select this check box to include the column header.
Encoding Select the encoding from the list or select Custom and define
it manually. This field is compulsory for DB data handling.
tStatCatcher Statistics Select this check box to collect log data at the component
level.
Usage
Usage rule This component is to be used along with tAccessOutputBulk
component. Used together, they can offer gains in
performance while feeding an Access database.
Dynamic settings Click the [+] button to add a row in the table and fill the Code
field with a context variable to choose your database
connection dynamically from multiple connections planned
in your Job. This feature is useful when you need to access
database tables having the same data structure but in
different databases, especially when you are working in an
environment where you cannot change your Job settings, for
example, when your Job has to be deployed and executed
independent of Talend Studio.
Limitation If you are using an ODBC driver, make sure that your JVM and
ODBC versions match up: both 64-bit or 32-bit.
tAccessClose
These properties are used to configure tAccessClose running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
Advanced settings
tStat Catcher Statistics Select this check box to gather the Job processing metadata
at the Job level as well as at each component level.
Usage
Dynamic settings Click the [+] button to add a row in the table and fill the Code
field with a context variable to choose your database
connection dynamically from multiple connections planned
in your Job. This feature is useful when you need to access
database tables having the same data structure but in
different databases, especially when you are working in an
environment where you cannot change your Job settings, for
example, when your Job has to be deployed and executed
independent of Talend Studio.
Limitation If you are using an ODBC driver, you need to work with Java 7,
and make sure that your JVM and ODBC versions match up:
both 64-bit or 32-bit.
tAccessCommit
Commits in one go a global transaction instead of doing that on every row or every batch, and provides gain in performance, using a
unique connection.
tAccessCommit validates the data processed through the Job into the connected database.
For more technologies supported by Talend, see Talend components.
These properties are used to configure tAccessCommit running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
Close Connection This check box is selected by default. It allows you to close the
database connection once the commit is done. Clear this
check box to continue to use the selected connection once
the component has performed its task.
Warning:
Advanced settings
tStat Catcher Statistics Select this check box to collect log data at the component
level.
Usage
Usage rule This component is more commonly used with other tAccess*
components, especially with the tAccessConnection and
tAccessRollback components.
Dynamic settings Click the [+] button to add a row in the table and fill the Code
field with a context variable to choose your database
connection dynamically from multiple connections planned
in your Job. This feature is useful when you need to access
database tables having the same data structure but in
different databases, especially when you are working in an
environment where you cannot change your Job settings, for
example, when your Job has to be deployed and executed
independent of Talend Studio.
Limitation If you are using an ODBC driver, you need to work with Java 7,
and make sure that your JVM and ODBC versions match up:
both 64-bit or 32-bit.
tAccessConnection
Opens a connection to the specified database that can then be reused in the subsequent subJob or subJobs.
These properties are used to configure tAccessConnection running in the Standard Job framework.
The Standard tAccessConnection component belongs to the Databases and the ELT families.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
Property type Either Built-in or Repository .
Use or register a shared DB Connection Select this check box to share your database connection or
fetch a database connection shared by a parent or child Job,
and in the Shared DB Connection Name field displayed, enter
the name for the shared database connection. This allows you
to share one single database connection (except the database
schema setting) among several database connection
components from different Job levels that can be either
parent or child.
Advanced settings
Usage
Usage rule This component is more commonly used with other tAccess*
components, especially with the tAccessCommit and
tAccessRollback components.
Limitation If you are using an ODBC driver, you need to work with Java 7,
and make sure that your JVM and ODBC versions match up:
both 64-bit or 32-bit.
tAccessInput
tAccessInput executes a DB query with a strictly defined statement which must correspond to the schema definition. Then it passes
on the field list to the next component via a Row > Main connection.
These properties are used to configure tAccessInput running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
Note: When a Job contains the parent Job and the child
Job, if you need to share an existing connection between
the two levels, for example, to share the connection
created by the parent Job with the child Job, you have to:
Table Name
Enter the name of the table to retrieve data from.
Query type and Query Enter your DB query paying particularly attention to properly
sequence the fields in order to match the schema definition.
Advanced settings
Additional JDBC parameters Specify additional connection properties for the DB
connection you are creating. This option is not available if you
have selected the Use an existing connection check box in the
Basic settings.
tStat Catcher Statistics Select this check box to collect log data at the component
level.
Trim all the String/Char columns Select this check box to remove leading and trailing
whitespace from all the String/Char columns.
Global Variables
Usage
Usage rule This component offers the flexibility benefit of the DB query
and covers all possible SQL queries.
Dynamic settings Click the [+] button to add a row in the table and fill the Code
field with a context variable to choose your database
connection dynamically from multiple connections planned
in your Job. This feature is useful when you need to access
database tables having the same data structure but in
different databases, especially when you are working in an
environment where you cannot change your Job settings, for
example, when your Job has to be deployed and executed
independent of Talend Studio.
Limitation If you are using an ODBC driver, you need to work with Java 7,
and make sure that your JVM and ODBC versions match up:
both 64-bit or 32-bit.
tAccessOutput
tAccessOutput executes the action defined on the table and/or on the data contained in the table, based on the flow incoming from
the preceding component in the Job.
These properties are used to configure tAccessOutput running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
Use an existing connection Select this check box and in the Component List drop-down
list, select the desired connection component to reuse the
connection details you already defined.
Note: When a Job contains the parent Job and the child
Job, if you need to share an existing connection between
the two levels, for example, to share the connection
created by the parent Job with the child Job, you have to:
Action on table On the table defined, you can perform one of the following
operations:
Create table: The table does not exist and gets created.
Warning:
Built-In: You create and store the schema locally for this
component only.
Die on error This check box is selected by default. Clear the check box to
skip the row on error and complete the process for error-free
rows. If needed, you can retrieve the rows on error via a Row >
Rejects link.
Advanced settings
Additional JDBC parameters Specify additional connection properties for the DB
connection you are creating. This option is not available if you
have selected the Use an existing connection check box in the
Basic settings.
Note:
Additional Columns This option is not offered if you create (with or without drop)
the DB table. This option allows you to call SQL functions to
perform actions on columns, which are not insert, nor update
or delete actions, or action that require particular
preprocessing.
tStat Catcher Statistics Select this check box to collect log data at the component
level.
Select this check box to perform high-speed data processing,
Enable parallel execution
by treating multiple data flows simultaneously. Note that this
feature depends on the database or the application ability to
handle multiple inserts in parallel as well as the number of
CPU affected. In the Number of parallel executions field,
either:
Warning:
Use field options Select this check box to customize a request, especially when
there is double action on data.
Debug query mode Select this check box to display each step during processing
entries in a database.
Support null in "SQL WHERE" statement Select this check box if you want to deal with the Null values
contained in a DB table.
Note:
Global Variables
Global Variables NB_LINE: the number of rows processed. This is an After
variable and it returns an integer.
Usage
Usage rule This component offers the flexibility benefit of the DB query
and covers all of the SQL queries possible.
Limitation If you are using an ODBC driver, you need to work with Java 7,
and make sure that your JVM and ODBC versions match up:
both 64-bit or 32-bit.
tAccessOutputBulk
Prepares the file which contains the data used to feed the Access database.
The tAccessOutputBulk and tAccessBulkExec components are generally used together to output data to a delimited file and then to
perform various actions on the file in an Access database, in a two step process. These two steps are fused together in the
tAccessOutputBulkExec component, detailed in a separate section. The advantage of using a two step process is that it makes it
possible to carry out transformations on the data before loading it in the database.
These properties are used to configure tAccessOutputBulk running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
File Name Name and path to the file to be created and/or the variable to
be used.
Create directory if does not exist Select this check box to create the as yet non-existant file
directory that specified in the File Name field.
Append Select this check box to add any new rows to the end of the
file.
Schema and Edit schema A schema is a row description. It defines the number of fields
(columns) to be processed and passed on to the next
component. When you create a Spark Job, avoid the reserved
word line when naming the fields.
Built-In: You create and store the schema locally for this
component only.
Advanced settings
Include header Select this check box to include the column header in the file.
Encoding Select the encoding from the list or select Custom and define
it manually. This field is compulsory for DB data handling.
tStat Catcher Statistics Select this check box to collect log data at the component
level.
Global Variables
Usage
Limitation If you are using an ODBC driver, you need to work with Java 7,
and make sure that your JVM and ODBC versions match up:
both 64-bit or 32-bit.
tAccessOutputBulkExec
The tAccessOutputBulk and tAccessBulkExec components are generally used together to output data to a delimited file and then to
perform various actions on the file in an Access database, in a two step process. These two steps are fused together in
tAccessOutputBulkExec.
As a dedicated component, tAccessOutputBulkExec improves performance during Insert operations in an Access database.
For more technologies supported by Talend, see Talend components.
These properties are used to configure tAccessOutputBulkExec running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
Built-In: You create and store the schema locally for this
component only.
Create directory if does not exist Select this check box to create the as yet non existant file
directory specified in the File Name field.
Append Select this check box to append new rows to the end of the
file.
Advanced settings
Include header Select this check box to include the column header to the file.
Use text enclosure
Select this check box to enclose the text with characters. You
can specify the character used to enclose the text in the Field
enclosure field.
Encoding Select the encoding from the list or select Custom and define
it manually. This field is compulsory for DB data handling.
tStatCatcher Statistics Select this check box to collect the log data at the component
level.
Usage
Dynamic settings Click the [+] button to add a row in the table and fill the Code
field with a context variable to choose your database
connection dynamically from multiple connections planned
in your Job. This feature is useful when you need to access
database tables having the same data structure but in
different databases, especially when you are working in an
environment where you cannot change your Job settings, for
example, when your Job has to be deployed and executed
independent of Talend Studio.
Limitation If you are using an ODBC driver, make sure that your JVM and
ODBC versions match up: both 64-bit or 32-bit.
tAccessRollback
Cancels the transaction commit in the connected database and avoids to commit part of a transaction involuntarily.
These properties are used to configure tAccessRollback running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
Close Connection Clear this check box to continue to use the selected
connection once the component has performed its task.
Advanced settings
tStat Catcher Statistics Select this check box to collect log data at the component
level.
Usage
Usage rule This component is more commonly used with other tAccess*
components, especially with the tAccessConnection and
tAccessCommit components.
Dynamic settings Click the [+] button to add a row in the table and fill the Code
field with a context variable to choose your database
connection dynamically from multiple connections planned
in your Job. This feature is useful when you need to access
database tables having the same data structure but in
different databases, especially when you are working in an
environment where you cannot change your Job settings, for
example, when your Job has to be deployed and executed
independent of Talend Studio.
Limitation If you are using an ODBC driver, you need to work with Java 7,
and make sure that your JVM and ODBC versions match up:
both 64-bit or 32-bit.
tAccessRow
Depending on the nature of the query and the database, tAccessRow acts on the actual DB structure or on the data (although
without handling data). The SQLBuilder tool helps you write easily your SQL statements. tAccessRow is the specific component for
this database query. The row suffix means the component implements a flow in the Job design although it does not provide output.
These properties are used to configure tAccessRow running in the Standard Job framework.
Note: This component is a specific version of a dynamic database connector. The properties related to database settings vary
depending on your database type selection. For more information about dynamic database connectors, see Dynamic database
components.
Basic settings
Database
Select a type of database from the list and click Apply.
Property type Either Built-in or Repository .
Use an existing connection Select this check box and in the Component List drop-down
list, select the desired connection component to reuse the
connection details you already defined.
Note: When a Job contains the parent Job and the child
Job, if you need to share an existing connection between
the two levels, for example, to share the connection
created by the parent Job with the child Job, you have to:
Table Name Name of the source table where changes made to data should
be captured.
Query type The query can be Built-in for a particular Job, or for
commonly used query, it can be stored in the Repository to
ease the query reuse.
Die on error This check box is selected by default. Clear the check box to
skip the row on error and complete the process for error-free
rows. If needed, you can retrieve the rows on error via a Row >
Rejects link.
Advanced settings
Propagate QUERY's recordset Select this check box to insert the result of the query into a
COLUMN of the current flow. Select this column from the use
column list.
Use PreparedStatement Select this check box if you want to query the database using
a PreparedStatement. In the Set PreparedStatement
Parameter table, define the parameters represented by "?" in
the SQL instruction of the Query field in the Basic Settings
tab.
tStat Catcher Statistics Select this check box to collect log data at the component
level.
Global Variables
Global Variables QUERY: the query statement being processed. This is a Flow
variable and it returns a string.
Usage
Usage rule This component offers the flexibility of the DB query and
covers all possible SQL queries.
Dynamic settings Click the [+] button to add a row in the table and fill the Code
field with a context variable to choose your database
connection dynamically from multiple connections planned
in your Job. This feature is useful when you need to access
database tables having the same data structure but in
different databases, especially when you are working in an
environment where you cannot change your Job settings, for
example, when your Job has to be deployed and executed
independent of Talend Studio.
Access scenario
Inserting data in parent/child tables
The following Job is dedicated to advanced database users, who want to carry out multiple table insertions using a parent table
Table1 to generate two child tables: Name and Birthday .
Once the Access database is created, create a table named Table1 with two column headings: Name and Birthday .
Back into the Integration perspective of Talend Studio , the Job requires twelve components including tAccessConnection,
tAccessCommit, tAccessInput, tAccessOutput and tAccessClose.
Drop the following components from the Palette to the design workspace: tFileList, tFileInputDelimited, tMap, tAccessOutput
(two), tAccessInput (two), tAccessCommit, tAccessClose and tLogRow (x2).
Connect the tFileList component to the input file component using an Iterate link. Thus, the name of the file to be processed
will be dynamically filled in from the tFileList directory using a global variable.
Connect the tFileInputDelimited component to the tMap component and dispatch the flow between the two output Access
components. Use a Row link for each of these connections representing the main data flow.
Set the tFileList component properties, such as the directory where files will be fetched from.
Add a tAccessConnection component and connect it to the starter component of this Job. In this example, the tFileList
component uses an OnComponentOk link to define the execution order.
In the tAccessConnection Component view, set the connection details manually or fetch them from the Repository if you
centrally store them as a Metadata DB connection entry. For more information about Metadata, see Talend Studio User Guide
.
In the tFileInputDelimited component's Basic settings view, press Ctrl+Space bar to access the variable list. Set the File Name
field to the global variable: tFileList_1.CURRENT_FILEPATH . For more information about using variables, see Talend Studio
User Guide .
Set the rest of the fields as usual, defining the row and field separators according to your file structure.
Then set the schema manually through the Edit schema dialog box or select the schema from the Repository . Make sure the
data type is correctly set, in accordance with the nature of the data processed.
In the tMap Output area, add two output tables, one called Name for the Name table, the second called Birthday , for the
Birthday table. For more information about the tMap component, see Talend Studio User Guide .
Drag the Name column from the Input area, and drop it to the Name table.
Drag the Birthday column from the Input area, and drop it to the Birthday table.
Then connect the output row links to distribute the flow correctly to the relevant DB output components.
In each of the tAccessOutput components' Basic settings view, select the Use an existing connection check box to retrieve the
tAccessConnection details.
Set the Table name making sure it corresponds to the correct table, in this example either Name or Birthday .
Select Default from the Action on table drop-down list. This is because the tables already exist and no operation is needed for
the tables.
Then connect the first tAccessOutput component to the first tAccessInput component using an OnComponentOk link.
In each of the tAccessInput components' Basic settings view, select the Use an existing connection check box to retrieve the
distributed data flow. Then set the schema manually through Edit schema dialog box.
Then set the Table Name accordingly. In tAccessInput_1, this will be Name .
Connect each tAccessInput component to tLogRow component with a Row > Main link. In each of the tLogRow components'
basic settings view, select Table in the Mode field.
Add the tAccessCommit component below the tFileList component in the design workspace and connect them together
using an OnComponentOk link in order to terminate the Job with the transaction commit.
In the basic settings view of tAccessCommit component and from the Component list, select the connection to be used,
tAccessConnection_1 in this scenario.
The parent table Table1 is reused to generate the Name table and Birthday table.
tAccessInput tFileList
tAccessConnectiontMap
tAccessCommit tFileInputDelimited
tAccessOutput tLogRow
tAccessClose