IC Spring2017 FileProcessorConnectorGuide en
IC Spring2017 FileProcessorConnectorGuide en
Spring 2017
This software and documentation are provided only under a separate license agreement containing restrictions on use and disclosure. No part of this document may be
reproduced or transmitted in any form, by any means (electronic, photocopying, recording or otherwise) without prior consent of Informatica LLC.
U.S. GOVERNMENT RIGHTS Programs, software, databases, and related documentation and technical data delivered to U.S. Government customers are "commercial
computer software" or "commercial technical data" pursuant to the applicable Federal Acquisition Regulation and agency-specific supplemental regulations. As such,
the use, duplication, disclosure, modification, and adaptation is subject to the restrictions and license terms set forth in the applicable Government contract, and, to the
extent applicable by the terms of the Government contract, the additional rights set forth in FAR 52.227-19, Commercial Computer Software License.
Informatica, the Informatica logo, Informatica Cloud, and PowerCenter are trademarks or registered trademarks of Informatica LLC in the United States and many
jurisdictions throughout the world. A current list of Informatica trademarks is available on the web at https://www.informatica.com/trademarks.html. Other company
and product names may be trade names or trademarks of their respective owners.
Portions of this software and/or documentation are subject to copyright held by third parties. Required third party notices are included with the product.
DISCLAIMER: Informatica LLC provides this documentation "as is" without warranty of any kind, either express or implied, including, but not limited to, the implied
warranties of noninfringement, merchantability, or use for a particular purpose. Informatica LLC does not warrant that this software or documentation is error free. The
information provided in this software or documentation may include technical inaccuracies or typographical errors. The information in this software and documentation
is subject to change at any time without notice.
NOTICES
This Informatica product (the "Software") includes certain drivers (the "DataDirect Drivers") from DataDirect Technologies, an operating company of Progress Software
Corporation ("DataDirect") which are subject to the following terms and conditions:
1. THE DATADIRECT DRIVERS ARE PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO,
THE IMPLIED WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NON-INFRINGEMENT.
2. IN NO EVENT WILL DATADIRECT OR ITS THIRD PARTY SUPPLIERS BE LIABLE TO THE END-USER CUSTOMER FOR ANY DIRECT, INDIRECT, INCIDENTAL,
SPECIAL, CONSEQUENTIAL OR OTHER DAMAGES ARISING OUT OF THE USE OF THE ODBC DRIVERS, WHETHER OR NOT INFORMED OF THE POSSIBILITIES
OF DAMAGES IN ADVANCE. THESE LIMITATIONS APPLY TO ALL CAUSES OF ACTION, INCLUDING, WITHOUT LIMITATION, BREACH OF CONTRACT, BREACH
OF WARRANTY, NEGLIGENCE, STRICT LIABILITY, MISREPRESENTATION AND OTHER TORTS.
The information in this documentation is subject to change without notice. If you find any problems in this documentation, report them to us at
infa_documentation@informatica.com.
Informatica products are warranted according to the terms and conditions of the agreements under which they are provided. INFORMATICA PROVIDES THE
INFORMATION IN THIS DOCUMENT "AS IS" WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING WITHOUT ANY WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND ANY WARRANTY OR CONDITION OF NON-INFRINGEMENT.
Table of Contents 3
Renaming Files Example. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Index. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
4 Table of Contents
Preface
The Informatica Cloud File Processor Connector Guide contains information about how to set up and use File
Processor Connector. The guide explains how organization administrators and business users can use File
Processor Connector to transfer files.
Informatica Resources
Informatica Documentation
To get the latest documentation for your product, browse the Informatica Knowledge Base at
https://kb.informatica.com/_layouts/ProductDocumentation/Page/ProductDocumentSearch.aspx.
If you have questions, comments, or ideas about this documentation, contact the Informatica Documentation
team through email at infa_documentation@informatica.com.
https://network.informatica.com/community/informatica-network/products/cloud-integration
To find resources on using Application Integration (the Informatica Cloud Real Time service), access the
community at:
https://network.informatica.com/community/informatica-network/products/cloud-integration/cloud-
application-integration/content
Developers can learn more and share tips at the Cloud Developer community:
https://network.informatica.com/community/informatica-network/products/cloud-integration/cloud-
developers
5
Informatica Cloud Marketplace
Visit the Informatica Marketplace to try and buy Informatica Cloud Connectors, templates, and mapplets:
https://marketplace.informatica.com/community/collections/cloud_integration
To access the Knowledge Base, visit https://kb.informatica.com. If you have questions, comments, or ideas
about the Knowledge Base, contact the Informatica Knowledge Base team at
KB_Feedback@informatica.com.
Status.Informatica.com displays the production status of all the Informatica cloud products. All maintenance
updates are posted to this status page, and during an outage, it will have the most current information. To
ensure you are notified of updates and outages, you can subscribe to a single component, a single incident,
or the site as a whole. Subscribing to the site as a whole is the best way to be certain you never miss an
update. To subscribe, go to http://status.informatica.com and click SUBSCRIBE TO UPDATES. You can then
choose to receive notifications sent as emails, SMS text messages, webhooks, RSS feeds, or any
combination of the four.
For online support, click Submit Support Request in Informatica Cloud. You can also use Online Support to
log a case. Online Support requires a login. You can request a login at
https://network.informatica.com/welcome.
The telephone numbers for Informatica Global Customer Support are available from the Informatica web site
at https://www.informatica.com/services-and-training/support-services/contact-us.html.
6 Preface
Chapter 1
For example, you are a system administrator and need to perform file transfer between a local and remote
server. Create a connection to connect to the FTP or SFTP server where the files reside. Configure a Data
Synchronization task to download files from FTP or SFTP server to a local file system.
The following are the File Processor source objects that you can use to perform file operations:
• SFTP_PUT
7
• SFTP_GET
• FTP_GET
• FTP_PUT
• FTP_DELETE
• SFTP_DELETE
• FileMove
• FileCopy
• FileArchive
• FileUnarchive
• FileCompress
• FileDecompress
• FileEncrypt
• FileDecrypt
The following are the File Processor target objects that you can use to perform file operations:
• FileRename
• FlatFile
Flat file contains the status information. You can view the status to get information on the number of files
that are successfully transferred and files failed to transfer.
You can specify proxy server details for FTP or SFTP to connect to File Processor.
You can configure a connection on the Connections page or when you configure a Data Synchronization task.
9
The following image shows the New Connection page details:
Connection Description
Property
Runtime The name of the runtime environment where you want to run the tasks.
Environment
Source File The location that contains files you want to transfer.
Directory
Target File The location where you want to place the transferred files.
Directory
Select File The files that you want to transfer. You can select files based on the fields.
File Pattern The pattern of the files that you want to transfer. For Example, if you want to select file
based on a date pattern, you can specify the date format as DD/MM/YYYY in the file pattern
field.
Note: File Pattern field is not applicable when you select all from Select File connection
property.
Days Calculation Use days calculation to select files that are created or modified before the specified date or
after the specified date. Select files based on Contains Date Pattern, specify the days
calculation value so that you can select files that are modified before or after the specified
date. Specify the value in terms of days. You cannot specify the value in terms of month and
year.
For example, if you select file based on Contains Date Pattern, use the data filters to specify
LastModDate as 02/02/2016 in DD/MM/YYYY format, and specify days calculation as -1.
Files that are modified till 01/02/2016 are selected.
PassKey The credentials to connect to FTP or SFTP server. For example, you can specify the
password and passphrase of the FTP or SFTP server as passkey1 and passkey2 values.
Fields Description
Equals Selects the files that are equal to the specified name in the file pattern property. For
Example, if you specify sample.docx, the sample.docx file is selected.
Notequals Selects all the files other than the file pattern that you specify. For example, if you specify,
the file pattern as sample.txt, the sample.txt file is not selected.
Startswith Selects files that start with the pattern that you specify. For example, if you specify the
StartsWith value as sample, all the files that start with name sample are selected.
Endswith Selects files that end with the pattern that you specify. For example, if you specify EndsWith
pattern as .txt, all the files that end with .txt are selected.
FileExtension Selects the files that contain the specified file name extension. For example, if you specify
the values as .txt in the file pattern, all the .txt files are selected.
Contains Selects files that contains the specified pattern. For example, if you specify the contains
pattern as sample, all the files that contain sample in the file name are selected.
FileSizeGreaterThan Selects files greater than the size specified in the file pattern. Specify the file size in KB. For
example, if you specify the file size as 30KB, all the files greater than 30KB size are
selected.
FileSizeLessThan Selects files that are less than the specified size. Specify the file size in KB.
For example, if you specify file size as 30KB, all the files less than 30KB size are selected.
FileSizeEqualsto Selects files equal to the specified size. Specify the file size in KB.
For example, if you specify file size as 30KB, all the files with 30KB size are selected.
FileSizeNotEqualsto Selects files not equal to the specified size. Specify the file size in KB.
For example, if you specify file size as 30KB, all the files with size that is not equal to 30KB
size are selected.
Starts with DatePattern Selects files that start with the specified date pattern. For Example, if you specify the file
pattern as DD/MM/YYYY, all the files that start with DD/MM/YYYY date pattern are selected.
EndsWithDatePattern Selects file that end with specified date pattern. If you specify the file pattern as DD/MM/
YYYY, all the files that end with DD/MM/YYYY date pattern are selected.
Contains Date Pattern Selects files that contain the specified date pattern. For example, if you specify the file
pattern as DD/MM/YYYY, all the files that contain DD/MM/YYYY date pattern are selected.
The following table displays formats that you can use to specify Date Pattern:
Year Number y
For example, if you want to mention year as 2001, you can specify the
value in yyyy:2001 or yy:01 format.
Millisecond Number S
For example, if you want to specify the value as 450, you can specify
the value in sss:450 format.
Perform the following steps to enable proxy server through the Secure Agent Manager:
1. Click Start > All Programs > Informatica Cloud Secure Agent > Informatica Cloud Secure Agent to
launch the Secure Agent Manager.
You can also click the Informatica Cloud icon in the Windows taskbar notification area to open the
Secure Agent Manager.
The Secure Agent Manager displays the Secure Agent status.
2. Click Proxy in the Secure Agent Manager page.
3. Click Use a Proxy Server to enter proxy server settings.
4. Configure the following proxy server details:
Field Description
Proxy Host Required. Host name of the outgoing proxy server that the Secure Agent uses.
5. Click OK.
The Secure Agent Manager restarts the Secure Agent to apply the settings.
6. Perform the following steps to enable the proxy server flag in the ProxySettings.ini file:
Note: The Secure Agent creates the ProxySettings.ini file when you test the connection.
a. Copy the ProxySettings.ini file from the following directory:
<Secure Agent installation directory>\downloads\<latest connector package>\package
\plugins\FileProcessor\
b. Paste the ProxySettings.ini file to the following directory:
<Secure Agent installation directory>\apps\Data_Integration_Server\ext\deploy_to_main
\bin\rdtm-extra\FileProcessor\
Note: If the deploy_to_main\bin\rdtm-extra\FileProcessor\ directory does not already exist,
create the directory. The folder name is case sensitive on Linux.
c. Restart the Secure Agent.
To perform a File Processor Connector operation, you can perform the following steps:
16
local system to an FTP or SFTP server. Use the FTP_GET and SFTP_GET objects to download files from an
FTP or SFTP location to a local file system.
Perform the following steps to create a Data Synchronization task to upload files from a local file system to
an SFTP server:
Field Description
Task Name Name of the Data Synchronization task. For example: File_Process_SFTP_PUT
Description Description of the Data Synchronization task. Maximum length is 255 characters.
4. Click Next.
The Source tab appears.
5. Configure the following fields on the Source tab:
Field Description
6. Click Next.
The Target tab appears.
7. Configure the following fields on the Target tab:
Field Description
Note: The target file display the status of the files that are transferred.
Transferring Files between a Local File System and an FTP or SFTP Server 17
8. Click Next.
The Data Filters tab appears.
9. Select the filter object, filter field, and filter operator to create a data filter on the Data Filters page.
The following image shows the Data Filters page:
Note: When you perform an SFTP_GET, SFTP_PUT, FTP_GET, and FTP_PUT operation, you must specify
values to the hostname, password, and userID filter fields to connect to the FTP or SFTP server.
10. Click Next.
The Field Mapping tab appears.
11. Click Automatch on the Field Mapping tab to map source fields to target fields accordingly.
12. Click Validate Mapping to validate the mapping.
13. Click Save and Run the task if you do not want to schedule the task.
After you run the task, the Monitor Log page appears where you can monitor the status of Data
Synchronization tasks.
Perform the following steps to create a Data Synchronization task to download files from an IBM AS/400 or
an IBM z/OS FTP server to a local file system:
Field Description
Description Description of the Data Synchronization task. Maximum length is 255 characters.
4. Click Next.
The Source tab appears.
Field Description
Display source fields in When selected, displays source fields in alphabetic order. By default, fields
alphabetical order appear in the order returned by the source system.
6. Click Next.
The Target tab appears.
7. Configure the following fields on the Target tab:
Field Description
Display technical names instead of Displays technical names instead of business names.
labels
Display target fields in alphabetical order Displays source fields in alphabetical order instead of the order
returned by the source system.
8. Click Next.
The Data Filters tab appears.
9. Click New. Select the source object, filter field, and define a filter expression on the Data Filters page.
The following image shows the Data Filters page:
Note: To connect to an IBM AS/400 or an IBM z/OS FTP server, you must specify the value of the
Is_IBM_AS400 field as 1.
10. Click Automatch on the Field Mapping tab to map source fields to target fields automatically.
11. Click Validate Mapping to validate the mapping.
Transferring Files between a Local File System and an FTP or SFTP Server 19
12. Click Save and Run the task if you do not want to schedule the task.
After you run the task, the Monitor Log page appears where you can monitor the status of Data
Synchronization tasks.
Perform the following steps to create a Data Synchronization task to move files within a local file system:
Field Description
Task Name Name of the Data Synchronization task. For example: Flat_File_Process_124_move_local
Description Description of the Data Synchronization task. Maximum length is 255 characters.
4. Click Next.
The Source tab appears.
5. Configure the following fields on the Source tab:
Field Description
6. Click Next.
The Target tab appears.
Field Description
8. Click Next.
The Data Filters tab appears.
9. Select the filter object, filter field, and filter operator to create a data filter on the Data Filters page.
The following image shows the Data Filters page:
Perform the following steps to create a Data Synchronization task to delete files from the FTP server:
Field Description
Task Name Name of the Data Synchronization task. For example, FTP_DELETE_01.
Description Description of the Data Synchronization task. Maximum length is 255 characters.
4. Click Next.
The Source tab appears.
5. Configure the following fields on the Source tab:
Field Description
6. Click Next.
The Target tab appears.
7. Configure the following fields on the Target tab:
Field Description
8. Click Next.
The Data Filters tab appears.
9. Create a new filter and filter by the LastModDate or File_Path field on the Data Filters page.
Note: If you do not filter by the LastModDate or File_Path field, the Secure Agent deletes all the files in
the source file directory.
• If you filter by File_Path, specify the FTP_Hostname, FTP_User_ID, FTP_Password, and File_Path
fields as shown in the following image:
Note: You must specify the Source File Directory, and the FTP_Password value as the PassKey1 in the
connection.
10. Click Next.
The Field Mapping tab appears.
11. Click Automatch on the Field Mapping tab to map source fields to target fields accordingly.
12. Click Validate Mapping to validate the mapping.
13. Click Save and Run the task if you do not want to schedule the task.
After you run the task, the Monitor Log page appears where you can monitor the status of Data
Synchronization tasks.
File Processor Connector supports public and private key based authentication for an FTP server (FTP over
SSH). File Processor Connector supports FTP over SSL. Set the IS_SSL_Enabled filter field to 1 to enable FTP
over SSL.
When you transfer or upload files from a local system to an SFTP server, or download files from an SFTP
server to a local file system, you can use private or public key based authentication. In this example, you
Field Description
Task Name Name of the Data Synchronization task. For example: File_Process_SFTP_GET.
Description Description of the Data Synchronization task. Maximum length is 255 characters.
4. Click Next.
The Source tab appears.
5. Configure the following fields on the Source tab:
Field Description
6. Click Next.
The Target tab appears.
7. Configure the following fields on the Target tab:
Field Description
8. Click Next.
The Data Filters tab appears.
9. Create a new filter and filter by the SFTP_User_ID, SFTP_Hostname, FileName, and SFTP_SSH2_KeyFile
fields on the Data Filters page.
You must enter the complete private key file path as the data filter in the SFTP_SSH2_KeyFile field. In
this example, the private key file path is C:\a_IOD\Files\FileProcessor\ICS-9902\test_private.ppk.
Note: If you use a pass phrase during the key generation, you must enter it as the data filter in the
SFTP_PassPhrase field. Before you enter the pass phrase as a data filter in a Data Synchronization task,
specify the pass phrase value as one of the passkey fields in the SFTP connection properties.
10. Click Next.
The Field Mapping tab appears.
11. Click Automatch on the Field Mapping tab to map source fields to target fields accordingly.
12. Click Validate Mapping to validate the mapping.
13. Click Save and Run the task if you do not want to schedule the task.
After you run the task, the Monitor Log page appears where you can monitor the status of Data
Synchronization tasks.
You can use the FileCompress object to compress and the FileDecompress object to decompress local files.
File Processor Connector supports the zip, gzip, and 7zip file formats to compress and decompress the local
files.
Perform the following steps to create a Data Synchronization task to compress files present in the local file
system:
Field Description
Task Name Name of the Data Synchronization task. For example: File_Process_Compression
Description Description of the Data Synchronization task. Maximum length is 255 characters.
4. Click Next.
The Source tab appears.
5. Configure the following fields on the Source tab:
Field Description
6. Click Next.
The Target tab appears.
7. Configure the following fields on the Target tab:
Field Description
8. Click Next.
The Data Filters tab appears.
9. Create a new filter, and filter by based on the FileName, CompressionType, lastModDate, or
CompressAllFiles filter fields on the Data Filters page. You can use the CompressAllFiles filter field to
zip files to a single zip or .7z file.
10. Click Next.
The Field Mapping tab appears.
11. Click Automatch on the Field Mapping tab to map source fields to target fields accordingly.
12. Click Validate Mapping to validate the mapping.
13. Click Save and Run the task if you do not want to schedule the task.
After you run the task, the Monitor Log page appears where you can monitor the status of Data
Synchronization tasks.
Perform the following steps to create a Data Synchronization task to encrypt files present in local file system:
Field Description
Task Name Name of the Data Synchronization task. For example: File_Process_Encryption
Description Description of the Data Synchronization task. Maximum length is 255 characters.
4. Click Next.
The Source tab appears.
5. Configure the following fields on the Source tab:
Field Description
6. Click Next.
The Target tab appears.
7. Configure the following fields on the Target tab:
Field Description
8. Click Next.
Perform the following steps to create a Data Synchronization task to archive files present in local file system:
Field Description
Task Name Name of the Data Synchronization task. For example: File_Process_TAR_Archive_LRT
Description Description of the Data Synchronization task. Maximum length is 255 characters.
Field Description
6. Click Next.
The Target tab appears.
7. Configure the following fields on the Target tab:
Field Description
8. Click Next.
The Data Filters tab appears.
9. Select the filter object, filter field, and filter operator to create a data filter on the Data Filters page.
The following image shows the Data Filters page:
Renaming files
You can use File Processor Connector to rename the local files. Use the FileRename object to rename the
local files.
Renaming files 29
Renaming Files Example
You are a system administrator and want to rename files present in the local file system.
Perform the following steps to create a Data Synchronization task to rename files present in local file system:
Field Description
Task Name Name of the Data Synchronization task. For example: FileProcessor_Rename
Description Description of the Data Synchronization task. Maximum length is 255 characters.
4. Click Next.
The Source tab appears.
5. Configure the following fields on the Source tab:
Field Description
Connection Select the flat file connection you created. For example: Conn_filerename_src
Source Object Select the file that contains the details of file to be renamed. The source file should contain
actual file name column and new file name column. In both the columns specify the file name
with the directory. For Example, E:\a_IOD\Files\File Processor\Source\Rename
\sample_ren2.txt.
6. Click Next.
The Target tab appears.
7. Configure the following fields on the Target tab:
Field Description
8. Click Next.
The Field Mapping tab appears.
9. Click Automatch on the Field Mapping tab to map source fields to target fields accordingly.
10. Click Validate Mapping to validate the mapping.
Renaming files 31
Index
C M
Cloud Application Integration community maintenance outages 6
URL 5
Cloud Developer community
URL 5
Connection
P
Creating a Connection 9 proxy settings
Connection Properties 9 configuring on Windows 14
connections
File Processor 9
S
D Select Files
Files to Transfer 11, 12
Data Integration community Source Object 7
URL 5 status
data synchronization tasks Informatica cloud services 6
File Processor Objects 7 system status 6
F T
File Processor Targets
Sources in data synchronization tasks 16 File Processor Target in data synchronization tasks 16
File Processor Connector Transfer Files 7
overview 7, 9 trust site
File Processor Operations 16, 20 description 6
FTP or SFTP Transfer 16
U
I upgrades 6
Informatica Cloud web site
URL 5
Informatica Global Customer Support
contact information 6
W
Windows
configuring proxy settings 14
L
Local File Transfer 20
32