Mainframe, Windows, UNIX and Linux
|
File Convert & Share Mainframe, Windows, UNIX and Linux |
|
| The SimoTime Home Page |
Introduction
There are many options available when moving and converting data between an IBM Mainframe System and a Windows, Linux or UNIX System. This document will discuss the cycle of how to convert a VSAM, KSDS to a flat Sequential file on the mainframe, download the flat sequential file from the Mainframe System to a Windows, UNIX or Linux System and create an Indexed file of ASCII content using Micro Focus.
A general guideline to follow is, "The scope of effort for converting a mainframe legacy file from EBCDIC to ASCII is directly proportional to the size of the file, the age of the file and the number and type of numeric fields." Estimating the time for conversion between EBCDIC and ASCII can be done with a high degree of accuracy. Estimating the time for "scrubbing the data" may be a challenging task.
Additional programs are included for converting ASCII, Text files to Indexed files. These examples also show how to manage Packed-Decimal and BINARY or COMP fields.
In the world of programming there are many ways to solve a problem. This suite of programs is provided as an example of one of the possible solutions to the problems of file conversion. The intent is to keep the programming effort simple and do the conversion as quickly as possible.
The programs have been tested on an IBM mainframe, Mainframe Express from Micro Focus and Net Express from Micro Focus. Sample projects may be obtain for Mainframe Express and Net Express by sending an e-mail to: helpdesk@simotime.com
Note: The source code and documentation for this suite of examples is available from the SimoTime Library under Download Directory at www.simotime.com
This is an example of how a COBOL program can read a VSAM Keyed Sequential Data Set (KSDS) with EBCDIC content and create a sequential file with EBCDIC content. The example then describes how to translate the EBCDIC content to ASCII and write an ASCII file. At first glance the conversion between EBCDIC and ASCII appears to be a simple and practical task. Typically the EBCDIC files reside on a mainframe legacy system. These files may be very large and may have been updated over a period on many years. In addition to containing displayable EBCDIC characters the records may contain binary and packed decimal fields that cannot simply be converted using an EBCDIC/ASCII table. Also, some of the fields in a record may contains low-values (i.e. x'00') that are being handle as a space characters on the mainframe. The low-values remain low-values when converted to ASCII and when downloaded or ported to the PC these low-values may be treated as null characters and this could present a problem if not addressed in the initial conversion process.
Explore How to Generate a Data File Convert Program using simple specification statements in a Process Control File (PCF). This link to the User Guide includes the information necessary to create a Process Control File and generate the COBOL programs that will do the actual data file conversion. The User Guide contains a list of the PCF statements that are used for the data file convert process.
Explore How to Generate a Data File Compare, Validate or Hex-Dump Program using simple specification statements in a Process Control File (PCF). This link to the User Guide includes the information necessary to create a Process Control File and generate the COBOL programs that will do a data file compare, accumulate summary totals with a record count or produce a Hex-Dump of records in a VSAM, KSDS based on a list of user-defined keys. The User Guide contains a list of the PCF statements that are used for the data file compare, validate or dump process.
We have made a significant effort to ensure the documents and software technologies are correct and accurate. We reserve the right to make changes without notice at any time. The function delivered in this version is based upon the enhancement requests from a specific group of users. The intent is to provide changes as the need arises and in a timeframe that is dependent upon the availability of resources.
Copyright © 1987-2023
SimoTime Technologies and Services
All Rights Reserved
Naming Convention
The following provides a list of terms or abbreviations used when referring to the various file types and record structures.
| Term | Description of File Format |
|---|---|
| KSDS | File Format for a Key Sequencd Data Set or Indexedl File. The record structure contains a data area for the user records and an index area that contains a user defined key that is used to access the file in a sequential or randowm methodology. The record content may include text strings that conform to the ASCII or EBCDIC encoding schema. Numeric values may use a Zoned-Decimal, Packed-Decimal or Binary format.. |
| LSEQ | File Format for a Line Sequential File or ASCII/Text File. By default the record content should conform to the ASCII encoding schema. |
| RSEQ | File Format for a Record Sequential File. The record content may include text strings that conform to the ASCII or EBCDIC encoding schema. Numeric values may use a Zoned-Decimal, Packed-Decimal or Binary format. |
| Term | Description of Record Structure and Content |
| CSV | Comma Separated Values is a record structure containing variable length fields of text characters. Each field is separated by a delimiter character that is typically a comma. |
| FFL | Fixed Field Length is a record structure that contains fixed length fields. Each field may contain text or binary data. |
| Term | Description is a hybrid of the File Format and Record Structure |
| LCSV | Line Sequential file with a CSV Record Structure. |
| RFFL | Record Sequential file with a Fixed Field Length record structure. |
The preceding provides a list of terms or abbreviations used when referring to the various file types and record structures.
The programs and data files used in this example use a file naming format that is eight (8) characters long with a three (3) character extension.
Naming Convention for Programs
The member names used in this suite of examples are eight (8) characters long with a three (3) character extension.
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Naming Convention for Programs |
Naming Convention for Data Files
The data files used in this example are eight (8) characters long with a three (3) character extension.
| ||||||||||||||||||||||||||||||||
| Naming Convention for Data Files |
Flowchart, the File Convert Cycles
The following shows the file conversion cycle or process when transferring files between the host system (in this example the host system is an IBM mainframe) and the PC/Windows environment. This illustration also shows the process for converting between ASCII/Text files and Indexed files using Micro Focus Enterprise Server.
|
Color Associations: The
Prepare, Data Convert Environment
This section contains a number of programs to do data conversion. This includes File-Format Conversion and Record-Content conversion. An example of file format conversion would be reading a VSAM, KSDS and writing the records to a sequential file. An example of record content conversion would be changing the information or structure of a record such as converting between the EBCDIC and ASCII encoding schemas.
This suite of programs is dependent on other SimoTime Technologies to perform certain tasks. Therefore, it will be necessary to install the SimoTime Enterprise Technology and configure the environment prior to attempting to execute this suite of programs.
This link provides information about Configuring an Enterprise System to execute mainframe-oriented applications and manage the traditional data file structures.
The following four sub-sections of this document will describe the process for setting the environment, using the predefined command files, generating the conversion programs, compiling the programs and creating a VSAM, KSDS to be used as a starting point and baseline reference.
Common Environment Variables
This section provides information about the tools used to prepare the environment that will support an application migration and the associated data conversion processes. Explore Setting the Environment and the Shared Program Members for additional details.
Generate COBOL Source Code
The following member (DXCONVW1.cmd) is the Windows command file that is used for generating the COBOL source code.
@echo OFF
set CmdName=DXCONVW1
rem * *******************************************************************
rem * DXCONVW1.CMD - a Windows Command File *
rem * This Job Script is provided by SimoTime Enterprises *
rem * (C) Copyright 1987-2019 All Rights Reserved *
rem * Web Site URL: http://www.simotime.com *
rem * e-mail: helpdesk@simotime.com *
rem * *******************************************************************
rem * This procedure calls the following Windows Command Files.
rem * 1. Env1Base.CMD - this provides a single point for setting
rem * commonly used environment variables.
rem * 2. USERCONV.CMD - this provides a single point for setting
rem * conversion-oriented environment variables.
rem * 3. SimoNOTE.CMD - this provides a consistent process for
rem * displaying messages to the screen and writing
rem * to a journal or log file.
rem * 4. SIMOCONV.CMD - this will do the actual genertion of the
rem * specified programs based on the content of
rem * the Process Control File.
rem * *******************************************************************
call ..\ENV1BASE
call USERCONV
rem *
call SimoNOTE "********************************************************************%CmdName%.CMD"
call SimoNOTE "Starting JobName %CmdName%.CMD"
rem *
rem * Set the environment variable to use the default directives file.
set AOK_Count=0
set NOK_Count=0
set SIMOGENS=BATCH
set SIMODROP=Y
rem * Generate the COBOL source code for Mainframe Conversions Programs
CALL SIMOCONV KSXSQX01
CALL SIMOCONV SQXKSX01
CALL SIMOCONV SQXKSX02
rem * Generate the COBOL source code for Server Conversions Programs
CALL SIMOCONV SQEKSA01
CALL SIMOCONV KSASQE01
rem * Generate the COBOL source code for User Conversions Programs
CALL SIMOCONV CUMKTX05
CALL SIMOCONV CUTKTX05
CALL SIMOCONV CUSEXT05
CALL SIMOCONV CUSIMPL5
CALL SIMOCONV CUSIMPU5
rem *
call SimoNOTE "AOKcount Compile Count for AOK is %AOK_Count% "
call SimoNOTE "NOKcount Compile Count for NOK is %NOK_Count% "
call SimoNOTE "Finished JobName %CmdName%.CMD "
pause
Compile the COBOL Programs
The following member (DXBLDLW8.cmd) is the Windows command file that is used for compiling the COBOL source code.
@echo off
echo *********************************************************************
echo * DXBLDLW8.CMD - a Windows Command File *
echo * This program is provided by SimoTime Technologies *
echo * (C) Copyright 1987-2015 All Rights Reserved *
echo * Web Site URL: http://www.simotime.com *
echo * e-mail: helpdesk@simotime.com *
echo *********************************************************************
rem *
rem * This command will read a file that contains a list of COBOL batch
rem * programs without SQL and call ZCBL2GNT to compile each member.
rem *
rem * This procedure calls the following Windows Command Files.
rem * 1. Env1Base.CMD - this provides a single point for setting commonly
rem * used environment variables.
rem * 2. SimoNOTE.CMD - this provides a consistent process for displaying
rem * messages to the screen and writing to a journal
rem * or log file.
rem *********************************************************************
setlocal
set CmdName=DXBLDLW8
call ..\Env1Base
rem *
call SimoNOTE "*******************************************%CmdName%.CMD"
call SimoNOTE "Starting JobName %CmdName%.CMD"
set AOK_Count=0
set NOK_Count=0
rem *
rem *-------------------------------------------------------------------*
rem * Mainframe Programs
call SimoNOTE "Continue JobName %CmdName%.CMD - Compile Mainframe Programs"
set SLIB=%BASELIB1%\COBOLUT1
set TLIB=%BASELIB1%\HOLD\UT1A
set CompileOptions=%BASELIB1%\DIRS\ASC1\OS390AscCBLBAT.DIR
rem *
call :COMPILE KSXSQXC1
call :COMPILE SQXKSXC1
call :COMPILE SQXKSXC2
rem *
rem *-------------------------------------------------------------------*
rem * Server Programs
call SimoNOTE "Continue JobName %CmdName%.CMD - Compile Server Programs"
set SLIB=%BASELIB1%\COBOLUT1
set TLIB=%BASELIB1%\HOLD\UT1A
rem *
call :COMPILE KSASQEC1
call :COMPILE KSASQER1
call :COMPILE SQEKSAC1
call :COMPILE SQEKSAR1
rem *
rem *-------------------------------------------------------------------*
rem * Workstation Programs
call SimoNOTE "Continue JobName %CmdName%.CMD - Compile Workstation Programs"
set SLIB=%BASELIB1%\COBOLUT2
set TLIB=%BASELIB1%\HOLD\UT2A
set CompileOptions=%BASELIB1%\DIRS\MiFoAscIBMcomp.DIR
rem *
call :COMPILE CUMKTXC5
call :COMPILE CUMKTXR1
call :COMPILE CUTKTXC5
call :COMPILE CUTKTXR1
call :COMPILE CUSEXTC5
call :COMPILE CUSEXTR5
call :COMPILE CUSIMPU5
call :COMPILE CUSIMPR1
rem *
call SimoNOTE "Finished JobName %CmdName%.CMD"
call SimoNOTE "AOKcount Compile Count for AOK is %AOK_Count% "
call SimoNOTE "NOKcount Compile Count for NOK is %NOK_Count% "
if not %NOK_Count% == 0 pause
endlocal
pause
goto :END
rem *
rem *-------------------------------------------------------------------*
:COMPILE
echo * %0 %1 COBOL Compile is STARTING...
if exist %COBIDY%\%1.idy erase %COBIDY%\%1.idy
if exist %TLIB%\%1.gnt erase %TLIB%\%1.gnt
if exist %BaseLib1%\LIST\%1.lst erase %BaseLib1%\LIST\%1.lst
rem *
cobol %SLIB%\%1.CBL OMF(GNT),%TLIB%\ USE(%CompileOptions%) LISTPATH(%BaseLib1%\LIST);
if exist %TLIB%\%1.GNT call SimoNOTE "* %0 %1 compiled with %CompileOptions%..."
if exist %TLIB%\%1.GNT set /A AOK_Count=%AOK_Count% + 1
if exist %TLIB%\%1.GNT goto :END
echo %1 - Compile Failure>%BASELIB1%\LOGS\%1.ERR
set /A NOK_Count=%NOK_Count% + 1
call SimoNOTE "ABENDING JobName %CmdName%.CMD %1 failure with %CompileOptions%..."
call SimoNOTE "ABENDING JobName %CmdName%.CMD"
:END
Create an EBCDIC-VSAM-KSDS
The following is the command line syntax to schedule the job to be executed by Micro Focus Enterprise Server.
C:\SIMOSAM1\DEVL\LOADLIB> ezschedule SIMOBATA DXGENRJ1
The following JCL member (DXGENRJ1.jcl) is used to create and populate the baseline VSAM cluster that is as the starting point for this suite of programs. The VSAM cluster is a Key-Sequenced-Data-Set (KSDS) with customer-oriented data and the records are EBCDIC encoded with packed and binary data.
//DXGENRJ1 JOB SIMOTIME,ACCOUNT,CLASS=1,MSGCLASS=0,NOTIFY=&SYSUID
//* *******************************************************************
//* DXGENRJ1.JCL - a JCL Member for Batch Job Processing *
//* This JCL Member is provided by SimoTime Technologies *
//* (C) Copyright 1987-2019 All Rights Reserved *
//* Web Site URL: http://www.simotime.com *
//* e-mail: helpdesk@simotime.com *
//* *******************************************************************
//*
//* Text - Execute a COBOL program to populate a Customer File.
//* Author - SimoTime Technologies
//* Date - January 01, 1997
//*
//* This COBOL program will read a control file and access the various
//* name files to populate or update a customer master file.
//*
//* This program uses a Sequential ADD methodology. Therefore,
//* the records being added to the file need to be in sequence
//* by the record key. Since this does an OPEN for OUTPUT it is used
//* to create a new file.
//*
//* ************
//* * DXGENRJ1 *
//* ********jcl*
//* *
//* *
//* ************ ************ ************
//* * OBFCTL80 *--*--* DXGENRC1 *----* DXKSE512 *
//* *******rseq* * ********cbl* *******ksds*
//* * *
//* ************ * * ************
//* * LASTNAME *--* *--call----* OBFDATR1 *
//* *******rseq* * * ********cbl*
//* * *
//* ************ * * ************
//* * FNAMEF01 *--* *--call----* CUSA2EC1 *
//* *******rseq* * * ********cbl*
//* * *
//* ************ * *
//* * FNAMEM01 *--* *
//* *******rseq* * *
//* * *
//* ************ * *
//* * POSTCODE *--* *
//* *******rseq* * *
//* *
//* ************
//* * EOJ *
//* ************
//*
//* *******************************************************************
//* Step 1 of 4, Delete any previously created file...
//*
//CLEANOUT EXEC PGM=IEFBR14
//OBFCTL80 DD DSN=SIMOTIME.DATA.OBFCTL80,DISP=(MOD,DELETE,DELETE),
// STORCLAS=MFI,
// SPACE=(TRK,5),
// DCB=(RECFM=FB,LRECL=80,BLKSIZE=800,DSORG=PS)
//*
//* *******************************************************************
//* Step 2 of 4, Delete/Define a New VSAM Cluster for DXKSE512
//*
//DELDEFX1 EXEC PGM=IDCAMS
//SYSPRINT DD SYSOUT=*
//SYSIN DD *
DELETE DXSERIES.DATA.DXKSE512
SET MAXCC = 0
DEFINE CLUSTER (NAME(DXSERIES.DATA.DXKSE512) -
KEYS(12,0) -
RECORDSIZE(512,512) -
REUSE -
TRACKS(45,15)) -
DATA (NAME(DXSERIES.DATA.DXKSE512.DAT) -
FREESPACE(10,15) -
CISZ(8192)) -
INDEX (NAME(DXSERIES.DATA.DXKSE512.IDX))
/*
//SYSOUT DD SYSOUT=*
//*
//* *******************************************************************
//* Step 3 of 4, Create and populate a new Control file...
//*
//MAKECNTL EXEC PGM=IEBGENER
//SYSPRINT DD SYSOUT=*
//SYSIN DD DUMMY
//* :....1....:....2....:....3....:....4....:....5....:....6....:....7....:....8
//SYSUT1 DD *
* A comment is identified by an asterisk (*) in position one (1)
* ..:....1....:....2....:....3....:....4....:....5....:....6....
/CTL FLAGS=FFFF0100
/CTL RECORDS=25000
/*
//SYSUT2 DD DSN=SIMOTIME.DATA.OBFCTL80,
// DISP=(NEW,CATLG,DELETE),
// STORCLAS=MFI,
// SPACE=(TRK,5),
// DCB=(RECFM=FB,LRECL=80,BLKSIZE=800,DSORG=PS)
//*
//* *******************************************************************
//* Step 4 of 4, Populate a new DXKSE512 file with Customer Information
//*
//DXGENRX1 EXEC PGM=OBFDATC2
//STEPLIB DD DISP=OLD,DSN=MFI01.SIMOPROD.LOADLIB1
//OBFCTL80 DD DISP=OLD,DSN=SIMOTIME.DATA.OBFCTL80
//FNAMEF01 DD DISP=OLD,DSN=SIMOTIME.DATA.FNAMEF01
//FNAMEM01 DD DISP=OLD,DSN=SIMOTIME.DATA.FNAMEM01
//LASTNAME DD DISP=OLD,DSN=SIMOTIME.DATA.LASTNAME
//POSTCODE DD DISP=OLD,DSN=SIMOTIME.DATA.POSTCODE
//STREET01 DD DISP=OLD,DSN=SIMOTIME.DATA.STREET01
//OBF1CUST DD DISP=OLD,DSN=DXSERIES.DATA.DXKSE512
//SYSOUT DD SYSOUT=*
//*
Execute, ZOS & LUW Tasks
The following tasks (Task-01 through Task-06) are intended to run on an IBM Mainframe System (ZOS) or a Linux, UNIX or Windows System (LUW) with Micro Focus Enterprise Server.
1. Get KSDS-EBC, Put QSAM-EBC
The following is the command line syntax to schedule the job to be executed by Micro Focus Enterprise Server. This job would normally be executed on the Mainframe System to copy the VSAM, KSDS to a sequential file that will be transferred from the Mainframe System to a Linux, UNIX or Windows (LUW) System using FTP.
C:\SIMOSAM1\DEVL\LOADLIB> ezschedule SIMOBATA DXTK01J1
The following shows the logic flow and data relationships.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Copy a VSAM, KSDS with a File Convert to a Record Sequential File |
Note: The data conversion process for Task-01 is a file-format conversion only. It does not do a record-content conversion. The records that are written to the output file (record sequential) are a mirror image of the records read from the Input file (VSAM, KSDS). The preceding job uses a COBOL program to do the file-format conversion. The REPRO function of the IDCAMS Utility program could do the same file-format conversion. A second JCL Member (DXTK01J2.jcl) that uses IDCAMS has been included.
The following job (DXTK01J1.jcl) uses a COBOL program to do the File-Format conversion from a VSAM, KSDS to a Sequential file. The Record-Content is not converted, the output records are a mirror image of the input records.
//DXTK01J1 JOB SIMOTIME,ACCOUNT,CLASS=1,MSGCLASS=0,NOTIFY=&SYSUID //* ******************************************************************* //* DXTK01J1.JCL - a JCL Member for Batch Job Processing * //* This JCL Member is provided by SimoTime Technologies * //* (C) Copyright 1987-2019 All Rights Reserved * //* Web Site URL: http://www.simotime.com * //* e-mail: helpdesk@simotime.com * //* ******************************************************************* //* //* TEXT - Copy a KSDS to a Sequential File using a COBOL Program //* AUTHOR - SIMOTIME TECHNOLOGIES //* DATE - JANUARY 01, 1989 //* ******************************************************************* //* Step 1 of 2, Delete any previously created file... //* //GETREADY EXEC PGM=IEFBR14 //DX512SEQ DD DSN=DXSERIES.DATA.DXSQE512,DISP=(MOD,DELETE,DELETE), // STORCLAS=MFI, // SPACE=(TRK,5), // DCB=(RECFM=FB,LRECL=512,DSORG=PS) //* //* ******************************************************************* //* Step 2 of 2, Copy with File Format Convert... //* // EXEC PGM=KSXSQXC1 //SYSPRINT DD SYSOUT=A //DX512KSD DD DSN=DXSERIES.DATA.DXKSE512,DISP=(SHR) //DX512SEQ DD DSN=DXSERIES.DATA.DXSQE512, // SPACE=(TRK,(10,1),RLSE), // DISP=(NEW,CATLG,DELETE), // DCB=(RECFM=FB,LRECL=512,DSORG=PS) //SYSOUT DD SYSOUT=* //*
The following job (DXTK01J2.jcl) uses the REPRO function of IDCAMS to do the File-Format conversion from a VSAM, KSDS to a Sequential file. The Record-Content is not converted, the output records are a mirror image of the input records.
Note: This job performs the same function as the preceding member (DXST01J1.jcl) but uses IDCAMS instead of a COBOL program.
//DXTK01J2 JOB SIMOTIME,ACCOUNT,CLASS=1,MSGCLASS=0,NOTIFY=CSIP1 //* ******************************************************************* //* DXTK01J2.JCL - a JCL Member for Batch Job Processing * //* This JCL Member is provided by SimoTime Technologies * //* (C) Copyright 1987-2019 All Rights Reserved * //* Web Site URL: http://www.simotime.com * //* e-mail: helpdesk@simotime.com * //* ******************************************************************* //* //* TEXT - COPY (OR REPRO) A KSDS TO A SEQUENTIAL FILE //* AUTHOR - SIMOTIME TECHNOLOGIES //* DATE - JANUARY 01, 1989 //* //* ******************************************************************* //* Step 1 of 2, Delete any previously created file... //* //GETREADY EXEC PGM=IEFBR14 //DXSEQ512 DD DSN=DXSERIES.RSEQ.DXSEQ512,DISP=(MOD,DELETE,DELETE), // STORCLAS=MFI, // SPACE=(TRK,5), // DCB=(RECFM=FB,LRECL=512,DSORG=PS) //* //* ******************************************************************* //* Step 2 of 2, Copy with File Format Convert... //* // EXEC PGM=IDCAMS //SYSPRINT DD SYSOUT=A //DXKSX512 DD DSN=DXSERIES.DATA.DXKSE512,DISP=OLD //DXSQX512 DD DSN=DXSERIES.DATA.DXSEQ512,UNIT=SYSDA, // SPACE=(TRK,(10,10)), // DISP=(NEW,CATLG), // DCB=(LRECL=512,BLKSIZE=0,RECFM=FB) //SYSIN DD * REPRO - INFILE(DXKSX512) - OUTFILE(DXSQX512) /*
2. Download QSAM to LUW System
Download the sequential file from the Mainframe System to a Windows System using FTP (File Transfer Protocol). Since the file contains EBCDIC characters, decimal-packed and COMP data it will be necessary to download in a BINARY format.
Note: Micro Focus provides a Mainframe Access (MFA) option with their Mainframe Express product. The MFA option may be used to download a sequential or VSAM file from the mainframe to the PC with a simple point-and-click or command line procedure. MFA provides for File Format conversion but does not provide record content (i.e. EBCDIC-ASCII) conversion for data files with packed or binary data.
Explore the alternatives for transferring data files between systems. This link provides access to a repository of information that includes the transferring and/or sharing of data between Mainframe (ZOS or VSE), Linux, UNIX and Windows Systems.
3. Get QSAM-EBC, Put KSDS-ASC
The following is the command line syntax to schedule the job to be executed by Micro Focus Enterprise Server.
C:\SIMOSAM1\DEVL\LOADLIB> ezschedule SIMOBATA DXTK03J1
The following shows the logic flow and data relationships.
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Copy with Conversion of an EBCDIC-encoded Record Sequential File to an ASCII-encoded VSAM, KSDS |
Note: The data conversion process for Step-03 is a file-format conversion with record content conversion. This job uses a mainline (or primary) COBOL program to do the file-format conversion and calls a COBOL sub-routine (or secondary program) to do the EBCDIC to ASCII conversion. This secondary program was generated to do the conversion based on the record definition that is defined in a COBOL copy file.
The following job (DXTK03J1.jcl) uses a set of COBOL programs to do the File-Format and Record-Content conversion from an EBCDIC-encoded Sequential file to an ASCII-encoded VSAM, KSDS.
//DXTK03J1 JOB SIMOTIME,ACCOUNT,CLASS=1,MSGCLASS=0,NOTIFY=&SYSUID
//* *******************************************************************
//* DXTK03J1.JCL - a JCL Member for Batch Job Processing *
//* This JCL Member is provided by SimoTime Technologies *
//* (C) Copyright 1987-2019 All Rights Reserved *
//* Web Site URL: http://www.simotime.com *
//* e-mail: helpdesk@simotime.com *
//* *******************************************************************
//*
//* Text - Execute a COBOL program to read RSEQ and write KSDS.
//* Author - SimoTime Technologies
//* Date - January 01, 1997
//*
//* This COBOL program will read an EBCDIC-encoded, Record Sequential
//* file with fixed length records of 512-bytes and write to an
//* ASCII-encoded, VSAM Key-Sequenced-Data-Set.
//*
//* ************
//* * DXST03J1 *
//* ********jcl*
//* *
//* *
//* ************ ************
//* * IDCAMS *-----* DELT/DEF *
//* ************ ************
//* *
//* *
//* ************ ************ ************
//* * CUSGRSEQ *-----* CUSEKAC1 *-----* CUSPKSDS *
//* *******rseq* ********cbl* *******ksds*
//* *
//* *
//* ************
//* * EOJ *
//* ************
//*
//* *******************************************************************
//* Step 1 of 2, Delete and Define a VSAM Cluster.
//*
//CUCRTS01 EXEC PGM=IDCAMS
//SYSPRINT DD SYSOUT=*
//SYSIN DD *
DELETE DXSERIES.DATA.DXKSA512 -
FILE (CUSKA512) -
PURGE -
ERASE -
CLUSTER
SET MAXCC = 0
DEFINE CLUSTER (NAME(DXSERIES.DATA.DXKSA512) -
TRACKS(45,15) -
INDEXED) -
DATA (NAME(DXSERIES.DATA.DXKSA512.DAT) -
KEYS(12,0) -
RECORDSIZE(512,512) -
FREESPACE(10,15) -
CISZ(8192)) -
INDEX (NAME(DXSERIES.DATA.DXKSA512.IDX))
//* *******************************************************************
//* Step 2 of 2, Read Record Sequential file and write a VSAM, KSDS.
//*
//CUSEKAS1 EXEC PGM=CUSEKAC1
//STEPLIB DD DISP=SHR,DSN=SIMOTIME.DEMO.LOADLIB1
//CUSGRSEQ DD DISP=SHR,DSN=DXSERIES.DATA.DXSQE512
//CUSPKSDS DD DISP=SHR,DSN=DXSERIES.DATA.DXKSA512
//SYSOUT DD SYSOUT=*
//*
4. Get KSDS-ASC, Put QSAM- EBC
The following is the command line syntax to schedule the job to be executed by Micro Focus Enterprise Server.
C:\SIMOSAM1\DEVL\LOADLIB> ezschedule SIMOBATA DXTK04J1
The following shows the logic flow and data relationships.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Copy with conversion from an ASCII-encoded VSAM, KSDS to an EBCDIC-encoded Record Sequential File |
The following (DXTK04J1.jcl) shows the JCL member that uses a set of COBOL programs to do the File-Format and Record-Content conversion from a ASCII-encoded VSAM, KSDS to a EBCDIC-encoded Sequential file.
//DXTK04J1 JOB SIMOTIME,ACCOUNT,CLASS=1,MSGCLASS=0,NOTIFY=&SYSUID //* ******************************************************************* //* DXTK04J1.JCL - a JCL Member for Batch Job Processing * //* This JCL Member is provided by SimoTime Technologies * //* (C) Copyright 1987-2019 All Rights Reserved * //* Web Site URL: http://www.simotime.com * //* e-mail: helpdesk@simotime.com * //* ******************************************************************* //* //* Text - Execute a COBOL program to read KSDS and write RSEQ. //* Author - SimoTime Technologies //* Date - January 01, 1997 //* //* This COBOL program will read an ASCII-encoded, VSAM-KSDS //* (Key-Sequenced-Data-Set) and write to an EBCDIC-encoded, Record //* Sequential file with fixed length records of 512-bytes. //* . //* //* ************ //* * DXST04J1 * //* ********jcl* //* * //* * //* ************ ************ //* * IEFBR14 *-----* DELT/DEF * //* ************ ************ //* * //* * //* ************ ************ ************ //* * CUSKA512 *-----* CUKAREC1 *-----* CUSRE512* //* *******ksds* ********cbl* *******rseq* //* * //* * //* ************ //* * EOJ * //* ************ //* //* ******************************************************************* //* Step 1 of 2, Delete any previously created file... //* //GETREADY EXEC PGM=IEFBR14 //CUSRE512 DD DSN=DXSERIES.COPY.DXSQE512,DISP=(MOD,DELETE,DELETE), // STORCLAS=MFI, // SPACE=(TRK,5), // DCB=(RECFM=FB,LRECL=512,DSORG=PS) //* ******************************************************************* //* Step 2 of 2, Read Record Sequential file and write a VSAM, KSDS. //* //CUSEKAS1 EXEC PGM=CUKAREC1 //STEPLIB DD DISP=SHR,DSN=SIMOTIME.DEMO.LOADLIB1 //CUSKA512 DD DISP=SHR,DSN=DXSERIES.DATA.DXKSA512 //CUSRE512 DD DSN=DXSERIES.COPY.DXSQE512, // SPACE=(TRK,(10,1),RLSE), // DISP=(NEW,CATLG,DELETE), // DCB=(RECFM=FB,LRECL=512,DSORG=PS) //SYSOUT DD SYSOUT=* //*
5. Upload QSAM-EBC to ZOS
Upload the sequential file from the Windows System to a Mainframe System using FTP (File Transfer Protocol). Since the file contains EBCDIC characters, decimal-packed and COMP data it will be necessary to transfer in a BINARY format.
Explore the alternatives for transferring data files between systems. This link provides access to a repository of information that includes the transferring and/or sharing of data between Mainframe (ZOS or VSE), Linux, UNIX and Windows Systems.
6. Get QSAM-EBC, Update KSDS-EBC
The following is the command line syntax to schedule the job to be executed by Micro Focus Enterprise Server. This job will update and existing Customer Data Set.
C:\SIMOSAM1\DEVL\LOADLIB> ezschedule SIMOBATA DXTK06J2
The following is the command line syntax to schedule the job to be executed by Micro Focus Enterprise Server. This job will create and populate a new Customer Data Set.
C:\SIMOSAM1\DEVL\LOADLIB> ezschedule SIMOBATA DXTK06J1
The following shows the logic flow and data relationships.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Update an EBCDIC-encoded VSAM, KSDS with information from an EBCDIC-encoded Record Sequential File |
The following (DXTK06J1.jcl) shows the JCL member that uses a COBOL program to do the File-Format conversion. The Record-Content is not converted, the output records are a mirror image of the input records.
//DXTK06J1 JOB SIMOTIME,ACCOUNT,CLASS=1,MSGCLASS=0,NOTIFY=&SYSUID
//* *******************************************************************
//* DXTK06J1.JCL - a JCL Member for Batch Job Processing *
//* This JCL Member is provided by SimoTime Technologies *
//* (C) Copyright 1987-2019 All Rights Reserved *
//* Web Site URL: http://www.simotime.com *
//* e-mail: helpdesk@simotime.com *
//* *******************************************************************
//*
//* Text - Execute a COBOL program to update a Customer File.
//* Author - SimoTime Technologie
//* Date - January 01, 1997
//*
//* This program uses a Random/Update methodology. Since this does an
//* OPEN for I/O it is used to Update existing records and/or add new
//* records.
//*
//* ************
//* * DXST06J1 *
//* ********jcl*
//* *
//* *
//* ************ ************ ************
//* * DXRSE515 *--*--* CUREKEC1 *----* DXKSE512 *
//* *******rseq* * ********cbl* *******ksds*
//* *
//* ************
//* * EOJ *
//* ************
//*
//* *******************************************************************
//* Step 1 of 2, Delete/Define a New VSAM Cluster for DXKSE512
//*
//DELDEFX1 EXEC PGM=IDCAMS
//SYSPRINT DD SYSOUT=*
//SYSIN DD *
DELETE DXSERIES.COPY.DXKSE512
SET MAXCC = 0
DEFINE CLUSTER (NAME(DXSERIES.COPY.DXKSE512) -
KEYS(12,0) -
RECORDSIZE(512,512) -
REUSE -
TRACKS(45,15)) -
DATA (NAME(DXSERIES.COPY.DXKSE512.DAT) -
FREESPACE(10,15) -
CISZ(8192)) -
INDEX (NAME(DXSERIES.COPY.DXKSE512.IDX))
/*
//SYSOUT DD SYSOUT=*
//*
//* *******************************************************************
//* Step 2 of 2, Populate a new DXKSE512 file with Customer Information
//*
//DXGENRX1 EXEC PGM=SQXKSXC2
//STEPLIB DD DISP=OLD,DSN=MFI01.SIMOPROD.LOADLIB1
//DXSEQ512 DD DISP=OLD,DSN=DXSERIES.COPY.DXSQE512
//DXKSD512 DD DISP=OLD,DSN=DXSERIES.COPY.DXKSE512
//SYSOUT DD SYSOUT=*
//*
Execute, LUW Environment
The following examples show how to convert between Indexed files and ASCII/Text files. Since the COBOL programs contain the file definition of "ORGANIZATION IS LINE SEQUENTIAL" on the "SELECT" statement this program will not compile on the mainframe. The programs have been compiled and executed on a Windows System using Micro Focus technologies.
1. Get ASC-KSDS, Convert ASCII/Text
The following is the command line syntax to execute a file conversion that uses a set of COBOL programs to do the File-Format and Record Content conversion from an ASCII-encoded Indexed file with a fixed-length-field record structure with COMP and COMP-3 numeric formats to an ASCII/Text file with a record structure that contains fixed-length-fields of all text (numeric fields of COMP and COMP-3 are expanded to text with a trailing sign byte).
C:\SIMOSAM1\DEVL\LOADLIB> DXTKA1W5
The following (DXTKA1W5.cmd) is a listing of the Windows Command file that executes the data file conversion program.
@echo OFF
rem * *******************************************************************
rem * DXTKA1W5.CMD - a Windows Command File *
rem * This program is provided by SimoTime Technologies *
rem * (C) Copyright 1987-2019 All Rights Reserved *
rem * Web Site URL: http://www.simotime.com *
rem * e-mail: helpdesk@simotime.com *
rem * *******************************************************************
rem *
rem * Text - Read CUSTMAST and write to ASCII/Text using FFL format.
rem * Author - SimoTime Technologies
rem * Date - January 24, 1996
rem * Note - FFL = Fixed-Field-Length
rem *
rem * The job will read a customer master file (a VSAM, KSDS with a
rem * maximum record length of 512 bytes and a key position/length
rem * of 1/12).
rem *
rem * User defined fields within a record will be extracted and copied
rem * (with conversion) to a line sequential (or ASCII/Text) file with
rem * a Fixed-Field-Length (or FFL) the record structure. The packed
rem * and binary (COMP-3 and COMP) numeric fields will be expanded to
rem * a text format. This will increase the size of the individual
rem * records. The new record length will be 524 bytes.
rem *
rem * ************
rem * * DXTKA1W5 *
rem * ********cmd*
rem * *
rem * *
rem * ************ ************ ************
rem * * DXKSA512 * * CUMKTXC5 ******* DXTXT524 *
rem * ************ ********cbl* ********cbl*
rem * *
rem * *
rem * ************
rem * * EOJ *
rem * ************
rem *
rem * *******************************************************************
rem * Step 1 Delete any previously created file...
rem *
set CmdName=DXTKA1W5
call ..\Env1BASE %CmdName%
if "%SYSLOG%" == "" set syslog=c:\SimoLIBR\LOGS\SimoTime.LOG
rem *
call SimoNOTE "*******************************************************%CmdName%"
call SimoNOTE "Starting CmdName %CmdName%"
call SimoNOTE "StepInfo Delete previously created file"
set CUSTMAST=%BaseLib1%\DATA\APPL\DXSERIES.DATA.DXKSA512.DAT
set CUSTLTXT=%BaseLib1%\DATA\TXT1\DXSERIES.DATA.DXTXT524.TXT
if exist %CUSTLTXT% del %CUSTLTXT%
rem *
rem * *******************************************************************
rem * Step 2 Edit input, create a new output file...
rem *
call SimoNOTE "StepInfo Execute the Justify Program"
run CUMKTXC5
if not ERRORLEVEL = 0 set JobStatus=0010
if not %JobStatus% == 0000 goto :EojNok
call SimoNOTE "DataTake %CUSTMAST%"
call SimoNOTE "DataMake %CUSTLTXT%"
rem *
if exist %CUSTLTXT% goto :EojAok
set JobStatus=0020
goto :EojNok
:EojAok
call SimoNOTE "Finished JobName %CmdName%, Job Status is %JobStatus%"
goto :End
:EojNok
call SimoNOTE "ABENDING JobName %CmdName%, Job Status is %JobStatus%"
:End
if not "%1" == "nopause" pause
WIP2
2. Edit ASCII/Text File using NotePAD
This step acknowledges that the ASCII/Text file may be viewed or updated using a standard editor program such as NotePAD.
WIP2
3. Get ASCII/Text, Convert ASC-KSDS
The following is the command line syntax to execute a file conversion that uses a set of COBOL programs to do the File-Format and Record Content conversion from an ASCII/Text file with a record structure that contains fixed-length-fields of all text (numeric fields of COMP and COMP-3 are expanded)to an ASCII-encoded Indexed file with a fixed-length-field record structure with COMP and COMP-3 numeric formats.
C:\SIMOSAM1\DEVL\LOADLIB> DXTKA3W5
The following (DXTKA3W5.cmd) is a listing of the Windows Command file that executes the data file conversion program.
@echo OFF
rem * *******************************************************************
rem * DXTKA3W5.CMD - a Windows Command File *
rem * This program is provided by SimoTime Technologies *
rem * (C) Copyright 1987-2019 All Rights Reserved *
rem * Web Site URL: http://www.simotime.com *
rem * e-mail: helpdesk@simotime.com *
rem * *******************************************************************
rem *
rem * Text - Read ASCII/Text using FFL format and write to CUSTMAST.
rem * Author - SimoTime Technologies
rem * Date - January 24, 1996
rem *
rem * The job will read a line sequential (or ASCII/Text) file with
rem * a Fixed-Field-Length (or FFL) record structure and a fixed record
rem * length of 524 bytes.
rem *
rem * User defined fields within a record will be extracted and copied
rem * (with conversion) to a customer master file (a VSAM, KSDS with a
rem * maximum record length of 512 bytes and a key position/length
rem * of 1/12).
rem *
rem * ************
rem * * DXTKA3W5 *
rem * ********cmd*
rem * *
rem * *
rem * ************ ************ ************
rem * * DXTXT524 * * CUTKTXC5 ******* DXKSA512 *
rem * *******lseq* ********cbl* *******ksds*
rem * *
rem * *
rem * ************
rem * * EOJ *
rem * ************
rem *
rem * *******************************************************************
rem * Step 1 Delete any previously created file...
rem *
set CmdName=DXTKA3W5
call ..\Env1BASE %CmdName%
if "%SYSLOG%" == "" set syslog=c:\SimoLIBR\LOGS\SimoTime.LOG
rem *
call SimoNOTE "*******************************************************%CmdName%"
call SimoNOTE "Starting CmdName %CmdName%"
call SimoNOTE "StepInfo Delete previously created file"
set CUSTMAST=%BaseLib1%\DATA\APPL\DXSERIES.COPY.DXKSA512.DAT
set CUSTLTXT=%BaseLib1%\DATA\TXT1\DXSERIES.DATA.DXTXT524.TXT
rem *
rem * *******************************************************************
rem * Step 2 Edit input, create a new output file...
rem *
call SimoNOTE "StepInfo Execute the Justify Program"
run CUTKTXC5
if not ERRORLEVEL = 0 set JobStatus=0010
if not %JobStatus% == 0000 goto :EojNok
call SimoNOTE "DataTake %CUSTLTXT%"
call SimoNOTE "DataMake %CUSTMAST%"
rem *
if exist %CUSTMAST% goto :EojAok
set JobStatus=0020
goto :EojNok
:EojAok
call SimoNOTE "Finished JobName %CmdName%, Job Status is %JobStatus%"
goto :End
:EojNok
call SimoNOTE "ABENDING JobName %CmdName%, Job Status is %JobStatus%"
:End
if not "%1" == "nopause" pause
WIP2
4. Get ASC-KSDS, Put Text-CSV
The following is the command line syntax to execute a file conversion that uses a set of COBOL programs to do the File-Format and Record Content conversion from an ASCII-encoded Indexed file with a fixed-length-field record structure to an ASCII/Text file with a Comma-Separated-Values (or CSV) record structure.
C:\SIMOSAM1\DEVL\LOADLIB> DXTKA4W5
The following (DXTKA4W5.cmd) is a listing of the Windows Command file that executes the data file conversion program.
@echo OFF
rem * *******************************************************************
rem * DXTKA4W5.CMD - a Windows Command File *
rem * This program is provided by SimoTime Technologies *
rem * (C) Copyright 1987-2019 All Rights Reserved *
rem * Web Site URL: http://www.simotime.com *
rem * e-mail: helpdesk@simotime.com *
rem * *******************************************************************
rem *
rem * Text - Read CUSTMAST and write to ASCII/Text using CSV format.
rem * Author - SimoTime Technologies
rem * Date - January 24, 1996
rem *
rem * The job will read a customer master file (a VSAM, KSDS with a
rem * maximum record length of 512 bytes and a key position/length
rem * of 1/12).
rem *
rem * User defined fields within a record will be extracted and copied
rem * (with conversion) to a line sequential (or ASCII/Text) file with
rem * a Comma-Separated-Values (or CSV) the record structure.
rem *
rem * ************
rem * * DXTKA4W5 *
rem * ********cmd*
rem * *
rem * *
rem * ************ ************ ************
rem * * DXKSA512 * * CUSEXTC5 ******* DXCSV256 *
rem * ************ ********cbl* ********cbl*
rem * *
rem * *
rem * ************
rem * * EOJ *
rem * ************
rem *
rem * *******************************************************************
rem * Step 1 Delete any previously created file...
rem *
set CmdName=DXSTA4W5
call ..\Env1BASE %CmdName%
if "%SYSLOG%" == "" set syslog=c:\SimoLIBR\LOGS\SimoTime.LOG
rem *
call SimoNOTE "*******************************************************%CmdName%"
call SimoNOTE "Starting CmdName %CmdName%"
call SimoNOTE "StepInfo Delete previously created file"
set CUSTMAST=%BaseLib1%\DATA\APPL\DXSERIES.DATA.DXKSA512.DAT
set CUSTLCSV=%BaseLib1%\DATA\XLSS\DXSERIES.DATA.DXCSV256.CSV
if exist %CUSTLCSV% del %CUSTLCSV%
rem *
rem * *******************************************************************
rem * Step 2 Edit input, create a new output file...
rem *
call SimoNOTE "StepInfo Execute the Justify Program"
run CUSEXTC5
if not ERRORLEVEL = 0 set JobStatus=0010
if not %JobStatus% == 0000 goto :EojNok
call SimoNOTE "DataTake %CUSTMAST%"
call SimoNOTE "DataMake %CUSTLCSV%"
rem *
if exist %CUSTLCSV% goto :EojAok
set JobStatus=0020
goto :EojNok
:EojAok
call SimoNOTE "Finished JobName %CmdName%, Job Status is %JobStatus%"
goto :End
:EojNok
call SimoNOTE "ABENDING JobName %CmdName%, Job Status is %JobStatus%"
:End
if not "%1" == "nopause" pause
5. Edit the CSV File using Excel
This step acknowledges that the CSV file may be viewed or updated using Excel.
WIP2
6. Get Text-CSV, Put ASCII-KSDS
The following is the command line syntax to execute a file conversion that uses a set of COBOL programs to do the File-Format and Record Content conversion from an ASCII/Text file with a Comma-Separated-Values (or CSV) record structure to an ASCII-encoded Indexed file with a fixed-length-field record structure.
C:\SIMOSAM1\DEVL\LOADLIB> DXTKA6W5
This step will read an ASCII/Text file with a CSV format for the record structure (or record content).
The following (DXTKA6W5.cmd) is a listing of the Windows Command file that executes the data file conversion program.
@echo OFF
rem * *******************************************************************
rem * DXTKA6W5.CMD - a Windows Command File *
rem * This program is provided by SimoTime Technologies *
rem * (C) Copyright 1987-2019 All Rights Reserved *
rem * Web Site URL: http://www.simotime.com *
rem * e-mail: helpdesk@simotime.com *
rem * *******************************************************************
rem *
rem * Text - Read ASCII/RCSV and write to CUSTMAST using KSDS format.
rem * Author - SimoTime Technologies
rem * Date - January 24, 1996
rem *
rem *
rem * ************
rem * * DXTKA4W5 *
rem * ********cmd*
rem * *
rem * *
rem * ************ ************ ************
rem * * DXCSV512 * * CUSIMPU5 ******* DXKSA256 *
rem * *******rcsv* ********cbl* *******ksds*
rem * *
rem * *
rem * ************
rem * * EOJ *
rem * ************
rem *
rem * *******************************************************************
rem * Step 1 Delete any previously created file...
rem *
set CmdName=DXSTA6W5
call ..\Env1BASE %CmdName%
if "%SYSLOG%" == "" set syslog=c:\SimoLIBR\LOGS\SimoTime.LOG
rem *
call SimoNOTE "*******************************************************%CmdName%"
call SimoNOTE "Starting CmdName %CmdName%"
call SimoNOTE "StepInfo Delete previously created file"
set CUSTMAST=%BaseLib1%\DATA\APPL\DXSERIES.DATA.DXKSA512.DAT
set CUSTLCSV=%BaseLib1%\DATA\XLSS\DXSERIES.DATA.DXCSV256.CSV
rem *
rem * *******************************************************************
rem * Step 2 Edit input, create a new output file...
rem *
call SimoNOTE "StepInfo Execute the Justify Program"
run CUSIMPU5
if not ERRORLEVEL = 0 set JobStatus=0010
if not %JobStatus% == 0000 goto :EojNok
call SimoNOTE "DataTake %CUSTLCSV%"
call SimoNOTE "DataVary %CUSTMAST%"
rem *
if exist %CUSTLCSV% goto :EojAok
set JobStatus=0020
goto :EojNok
:EojAok
call SimoNOTE "Finished JobName %CmdName%, Job Status is %JobStatus%"
goto :End
:EojNok
call SimoNOTE "ABENDING JobName %CmdName%, Job Status is %JobStatus%"
:End
if not "%1" == "nopause" pause
WIP2
Review the Results
The following is the command line syntax to schedule the data file comparison job to be executed by Micro Focus Enterprise Server.
C:\SIMOSAM1\DEVL\LOADLIB> EZSCHEDULE SIMOBATA DXDUOXJ1
WIP
Review, The JCL Member
The following member (DXDUOXJ1.jcl) shows the JCL scripting that is used to execute the compare program.
//DXDUOXJ1 JOB (SIMOTIME),'VSAM KSDS COMPARE',CLASS=1,MSGCLASS=0, // NOTIFY=CSIP1 //* ******************************************************************* //* DXDUOXJ1.JCL - a JCL Member for Batch Job Processing * //* This JCL Member is provided by SimoTime Technologies * //* (C) Copyright 1987-2019 All Rights Reserved * //* Web Site URL: http://www.simotime.com * //* e-mail: helpdesk@simotime.com * //* ******************************************************************* //* //* Text - Compare two VSAM Key-Sequenced-Data-Sets (KSDS). //* Author - SimoTime Technologies //* Date - January 24, 1996 //* //* This example will do a compare of part of the records in the //* data set. The actual record length is 512 bytes but the compare //* will only compare the first 348 positions of a record. //* //* Since the files are in sequence by the key-field the program //* will explicity identify deleted or added records. //* //* This set of programs will run on a Mainframe System with MVS or //* on a Windows System with Micro Focus Technologies. //* //* ************ //* * DXDUOXJ1 * //* ********jcl* //* * //* ************ ************ ************ //* * CUEXPECT *--*--* CUDUOXC1 *-----* SYSLOG * //* *******ksds* * ********cbl* ************ //* * * //* ************ * * //* * CUACTUAL *--* * //* *******ksds* * * //* * * //* ************ * * //* * SYSUT3 *--* * //* *******rseq* * //* * //* ************ //* * EOJ * //* ************ //* //* ******************************************************************* //* STEP 1 of 3, Delete the previously created SYSLOG file. //* //SYSLOGDT EXEC PGM=IEFBR14 //SYSLOG DD DSN=DXSERIES.DATA.SYSLOGDX,DISP=(MOD,DELETE,DELETE), // STORCLAS=MFI, // SPACE=(TRK,5), // DCB=(RECFM=V,LRECL=1055,DSORG=PS) //* //* ******************************************************************* //* STEP 2 of 3, Allocate a new SYSLOG file. //* //* Note: The LRECL is four (4) bytes bigger than the logical record //* that is defined in the program that writes to SYSLOG. This //* allows for the four (4) byte Record Descriptor Word (RDW) //* that is appended to the front of each record. The program //* defines the records as varying in size from 64 to 1,051. //* Note: It is necessary to pre-allocate the SYSLOG file. The program //* that does the actual file compare will do an "OPEN EXTEND". //* If the file is not pre-allocated, an open error will be //* posted and the program will execute but will only display //* truncated information to SYSOUT. //* //SYSLOGCT EXEC PGM=IEFBR14 //SYSLOG DD DSN=DXSERIES.DATA.SYSLOGDX,DISP=(NEW,CATLG,DELETE), // STORCLAS=MFI, // SPACE=(TRK,5), // DCB=(RECFM=V,LRECL=1055,DSORG=PS) //* //* ******************************************************************* //* STEP 3 of 3, Execute the compare program. //* //* Note: when a difference occurs the information will be written to //* the SYSLOG file //* ******************************************************************* //* Compare two VSAM KSDS's or Customer Master Files... //* The positions within the records to be compared are determined by //* the COMPARE statements in the SYSUT3 file. This is done when the //* compare program is executed. //* //* The results of the compare processing is posted to the SYSLOG File. //* The results file must exist and new information is appended to the //* end of the file. For more information about how to create an empty //* log file (SYSLOG) refer to the SYSLOGJ8.JCL Member. //* //CUSTCOMP EXEC PGM=CUDUOXC1 //STEPLIB DD DSN=SIMOTIME.DEMO.LOADLIB1,DISP=SHR //CUEXPECT DD DSN=DXSERIES.DATA.DXKSE512,DISP=SHR //CUACTUAL DD DSN=DXSERIES.COPY.DXKSE512,DISP=SHR //SYSUT3 DD DSN=SIMOTIME.PDS.PARMLIB(CUDUOXT1),DISP=SHR //SYSLOG DD DSN=DXSERIES.DATA.SYSLOGDX,DISP=SHR //SYSOUT DD SYSOUT=* //
Review, The Parameter File
The following member (CUDUOXT1.ctl) contains the parameters (or control information) that affect the behavior of the compare program at execution time. This control file will cause the program to compare 348 positions within a record starting at position 1. The information for an unequal condition will be written to the SYSLOG device.
* ******************************************************************* * CUDUOXT1.ctl - Program Behavior Statements for Compare * * Processed at Execution Time by Generated Compare Program * * This Member is provided by SimoTime Technologies * * (C) Copyright 1987-2016 All Rights Reserved * * Web Site URL: http://www.simotime.com * * e-mail: helpdesk@simotime.com * * ******************************************************************* * This parameter file is used to define the positions to be * compared within the records of the customer master file. * Also, it will override the settings for the SYSLOG and DISPLAY * functions for the SYSOUT or Operator console. * *...:....1....:....2....:....3....:....4....:....5....:....6 /COMPARE SYSUT1 pos 1 len 348 SYSUT2 pos 1 len 348 /SYSLOG ENABLE /DISPLAY NONE
Technical Details
The preceding sections of this document focused on an overview of the data conversion and comparison process and the primary task methodologies. This section will provide the technical detail about the data structures and programs and discuss alternatives task methodologies.
The ASCII and EBCDIC Tables
The following COBOL copy file (ASCEBCB1.cpy) contains the ASCII and EBCDIC tables. The tables may also be used to do case conversion.
*****************************************************************
* AE9437B1.cpy - a COBOL Copy File *
* Copyright (C) 1987-2018 SimoTime Technologies *
* All Rights Reserved *
* Provided by SimoTime Technologies *
* Our e-mail address is: helpdesk@simotime.com *
* Also, visit our Web Site at http://www.simotime.com *
*****************************************************************
* The following tables are used by the INSPECT statement to do *
* the conversion between EBCDIC and ASCII. *
* *
* inspect FIELD-NAME converting EBCDIC-INFO to ASCII-INFO *
* inspect FIELD-NAME converting ASCII-INFO to EBCDIC-INFO *
* *
* The tables include the alphabet for upper and lower case, the *
* digits 0-9, the special characters (US) and the alternate *
* codes for A, E, I, O, and U with the appropriate acute, *
* grave, umlaut, circumflex and tilde. *
* To display the alternate codes the Courier New (Fixed) or *
* Times New Roman (Proportional) font should be used. *
* *
* SimoZAPS contains four tables that may be used for various *
* Upper/Lower Case or EBCDIC/ASCII conversion requirements. *
* ASCEBCB1.CPY - includes a full character set for the alphabet *
* (upper/lower case), digit, special characters *
* and alternate codes for characters with the *
* acute, grave, umlaut, tilde and circumflex. *
* Caution: this table does not convert the Y *
* characters with an umlat. *
* ASCEBCB2.CPY - includes the character set for the translation *
* between EBCDIC/ASCII of signed/unsigned, *
* zoned-decimal, numeric fields. *
* ASCEBCB3.CPY - includes the character set for the alternate *
* codes with the acute, grave, umlaut, tilde and *
* circumflex. This is primarily used for case *
* conversion. *
* Note: this table converts the Y characters *
* with an umlat, this will convert high-values *
* X'FF' to X'DF' *
* ASCEBCB4.CPY - includes the character set for the alphabet *
* (upper/lower case), digit, special characters. *
* This is primarily used in the US where the *
* alternate codes may not be required. *
* ASCEBCB5.CPY - includes a full character set for the alphabet *
* (upper/lower case), digit, special characters *
* and alternate codes for characters with the *
* acute, grave, umlaut, tilde and circumflex. *
* Caution: this table will convert the Y *
* characters with an umlat. *
*****************************************************************
*
* ------------------------------------------------------------
01 EBCDIC-DATA.
05 FILLER pic X(16)
value X'000102030405060708090A0B0C0D0E0F'. 000-015
05 FILLER pic X(16)
value X'101112131415161718191A1B1C1D1E1F'. 016-031
05 FILLER pic X(16)
value X'202122232425262728292A2B2C2D2E2F'. 032-047
05 FILLER pic X(16)
value X'303132333435363738393A3B3C3D3E3F'. 048-063
05 FILLER pic X(16)
value X'404142434445464748494A4B4C4D4E4F'. 064-079
05 FILLER pic X(16)
value X'505152535455565758595A5B5C5D5E5F'. 080=095
05 FILLER pic X(16)
value X'606162636465666768696A6B6C6D6E6F'. 096-111
05 FILLER pic X(16)
value X'707172737475767778797A7B7C7D7E7F'. 112-127
05 FILLER pic X(16)
value X'808182838485868788898A8B8C8D8E8F'. 128-143
05 FILLER pic X(16)
value X'909192939495969798999A9B9C9D9E9F'. 144-159
05 FILLER pic X(16)
value X'A0A1A2A3A4A5A6A7A8A9AAABACADAEAF'. 160-175
05 FILLER pic X(16)
value X'B0B1B2B3B4B5B6B7B8B9BABBBCBDBEBF'. 176-191
05 FILLER pic X(16)
value X'C0C1C2C3C4C5C6C7C8C9CACBCCCDCECF'. 192-207
05 FILLER pic X(16)
value X'D0D1D2D3D4D5D6D7D8D9DADBDCDDDEDF'. 208-223
05 FILLER pic X(16)
value X'E0E1E2E3E4E5E6E7E8E9EAEBECEDEEEF'. 224-239
05 FILLER pic X(16)
value X'F0F1F2F3F4F5F6F7F8F9FAFBFCFDFEFF'. 240-255
01 E-INFO redefines EBCDIC-DATA pic X(256).
01 EBCDIC-TABLE redefines EBCDIC-DATA.
05 EBCDIC-BYTE pic X occurs 256 times.
*
* ------------------------------------------------------------
01 ASCII-DATA.
05 FILLER pic X(16)
value X'000102039C09867F978D8E0B0C0D0E0F'. 000-015
05 FILLER pic X(16)
value X'101112139D8508871819928F1C1D1E1F'. 016-031
05 FILLER pic X(16)
value X'80818283840A171B88898A8B8C050607'. 032-047
05 FILLER pic X(16)
value X'909116939495960498999A9B14159E1A'. 048-063
05 FILLER pic X(16)
value X'20A0E2E4E0E1E3E5E7F1A22E3C282B7C'. 064-079
05 FILLER pic X(16)
value X'26E9EAEBE8EDEEEFECDF21242A293BAC'. 080=095
05 FILLER pic X(16)
value X'2D2FC2C4C0C1C3C5C7D1A62C255F3E3F'. 096-111
05 FILLER pic X(16)
value X'F8C9CACBC8CDCECFCC603A2340273D22'. 112-127
05 FILLER pic X(16)
value X'D8616263646566676869ABBBF0FDFEB1'. 128-143
05 FILLER pic X(16)
value X'B06A6B6C6D6E6F707172AABAE6B8C6A4'. 144-159
05 FILLER pic X(16)
value X'B57E737475767778797AA1BFD0DDDEAE'. 160-175
05 FILLER pic X(16)
value X'5EA3A5B7A9A7B6BCBDBE5B5DAFA8B4D7'. 176-191
05 FILLER pic X(16)
value X'7B414243444546474849ADF4F6F2F3F5'. 192-207
05 FILLER pic X(16)
value X'7D4A4B4C4D4E4F505152B9FBFCF9FAFF'. 208-223
05 FILLER pic X(16)
value X'5CF7535455565758595AB2D4D6D2D3D5'. 224-239
05 FILLER pic X(16)
value X'30313233343536373839B3DBDCD9DAFF'. 240-255
01 A-INFO redefines ASCII-DATA pic X(256).
01 ASCII-TABLE redefines ASCII-DATA.
05 ASCII-BYTE pic X occurs 256 times.
*
*** AE0437B1 - End-of-Copy File - - - - - - - - - - - AE0437B1 *
*****************************************************************
*
Record Structures, COBOL Copy Files
This suite of programs uses COBOL Copy File to define standard record structure with some numeric formats that are a packed or binary format. The signed numbers may have the sign embedded in the numeric format. A second COBOL Copy File is included that is used to demonstrate an approach that will convert all the numeric values for use in an ASCII/Text environment. The packed and binary numbers will be expanded and the sign will be a separate trailing byte.
With Packed, Binary & Embedded Sign
The following member (CUSTCB01.cpy) is the COBOL Copy File that defines the record structure for the Customer Master File. The numeric fields in this record structure contain COMP or COMP-3 and have the sign embedded.
*****************************************************************
* CUSTCB01.cpy - a COBOL Copy Member *
* Customer Master File used for Quality Assurance Testing *
* This is a VSAM Keyed-Sequential-Data-Set or KSDS *
* Copyright (C) 1987-2020 SimoTime Technologies *
* All Rights Reserved *
* Provided by SimoTime Technologies *
* Our e-mail address is: helpdesk@simotime.com *
* Also, visit our Web Site at http://www.simotime.com *
*****************************************************************
* CUST-RECORD size is 512 bytes.
* RMIN is 512 RMAX is 512
* KPOS is 1 KLEN is 012
*
....:.*..1....:....2....:....3....:....4....:....5....:....6....:....7....:....8
01 CUST-RECORD.
05 CUST-NUMBER PIC X(12). col A
05 CUST-DATA.
10 CUST-STATUS PIC X. col B
10 CUST-NAME.
15 CUST-LAST-NAME PIC X(28). col C
15 CUST-FIRST-NAME PIC X(20). col D
15 CUST-MID-NAME PIC X(20). col E
10 CUST-ADDRESS-1 PIC X(48). col F
10 CUST-ADDRESS-2 PIC X(48). col G
10 CUST-CITY PIC X(28). col H
10 CUST-STATE PIC X(28). col I
10 CUST-POSTAL-CODE PIC X(12). col J
10 CUST-PHONE-HOME PIC X(18). col K
10 CUST-PHONE-WORK PIC X(18). col L
10 CUST-PHONE-CELL PIC X(18). col M
10 CUST-CREDIT-LIMIT PIC 9(7) COMP-3. col N
10 CUST-DISCOUNT OCCURS 3 TIMES.
15 CUST-DISCOUNT-CODE PIC S9(3) COMP. col ORU
15 CUST-DISCOUNT-RATE PIC S9(2)V999. col PSV
15 CUST-DISCOUNT-DATE PIC X(8). col QTW
10 CUST-LADATE PIC X(8). col X
10 CUST-LATIME PIC X(8). col Y
10 CUST-TOKEN PIC 9(3). col Z
10 FILLER PIC X(145).
*
*** CUSTCB01 - End-of-Copy File - - - - - - - - - - - CUSTCB01 *
*****************************************************************
*
Without Packed, Binary & Embedded Sign
The following member (CUSTCB02.cpy) is the COBOL Copy File that defines the record structure for the Customer Master File. The numeric fields in this record structure do not use COMP or COMP-3 and have a Sign Trailing Separate.
*****************************************************************
* CUSTCB02.CPY - a COBOL Copy File *
* Customer Master File used for Quality Assurance Testing *
* This is a VSAM Keyed-Sequential-Data-Set or KSDS *
* Copyright (C) 1987-2020 SimoTime Technologies *
* All Rights Reserved *
* Provided by SimoTime Technologies *
* Our e-mail address is: helpdesk@simotime.com *
* Also, visit our Web Site at http://www.simotime.com *
*****************************************************************
* This record structure definition has changed the numeric
* field definitions for COMP and COMP-3 fields to default to
* a "USAGE IS DISPLAY" format. If the numeric field is a
* signed value then the "SIGN TRAILING SEPARATE" is added to
* the new numeric field definition.
*
* Note: Columns 73-80 are used to tag the statements that
* were modified or added.
*
* The length of this data structure is 527 bytes.
*
....:.*..1....:....2....:....3....:....4....:....5....:....6....:....7....:....8
01 CUST-RECORD-02.
05 CUST-NUMBER PIC X(12). col A
05 CUST-DATA.
10 CUST-STATUS PIC X. col B
10 CUST-NAME.
15 CUST-LAST-NAME PIC X(28). col C
15 CUST-FIRST-NAME PIC X(20). col D
15 CUST-MID-NAME PIC X(20). col E
10 CUST-ADDRESS-1 PIC X(48). col F
10 CUST-ADDRESS-2 PIC X(48). col G
10 CUST-CITY PIC X(28). col H
10 CUST-STATE PIC X(28). col I
10 CUST-POSTAL-CODE PIC X(12). col J
10 CUST-PHONE-HOME PIC X(18). col K
10 CUST-PHONE-WORK PIC X(18). col L
10 CUST-PHONE-CELL PIC X(18). col M
10 CUST-CREDIT-LIMIT PIC 9(7). col N
10 CUST-DISCOUNT OCCURS 3 TIMES.
15 CUST-DISCOUNT-CODE PIC S9(3)
SIGN TRAILING SEPARATE. col ORU
15 CUST-DISCOUNT-RATE PIC S9(2)V999
SIGN TRAILING SEPARATE. col PSV
15 CUST-DISCOUNT-DATE PIC X(8). col QTW
10 CUST-LADATE PIC X(8). col X
10 CUST-LATIME PIC X(8). col Y
10 CUST-TOKEN PIC 9(3). col Z
10 FILLER PIC X(145).
....:.*..1....:....2....:....3....:....4....:....5....:....6....:....7....:....8
*
*** CUSTCB02 - End-of-Copy File - - - - - - - - - - - CUSTCB02 *
*****************************************************************
*
Mainframe & LUW Systems
The following tasks (Task-01 through Task-06) are intended to run on an IBM Mainframe System or a Linux, UNIX or Windows (LUW) System with Micro Focus Enterprise Server.
Details and Function, Task-01
WIP
Details and Function, Task-03
WIP
User Workstations and Laptops
The following tasks (Task-A1 through Task-A6) are intended to run on a Windows System with Micro Focus Enterprise Server.
WIP
Details and Function, Task-A1
WIP
This link provides information about the generated COBOL programs that do the actual conversion. Explore the COBOL Source Code for additional details.
Details and Function, Task-A3
WIP
Summary
There are many options available when moving and converting data between an IBM Mainframe System and a Windows, Linux or UNIX System. This document will discuss the cycle of how to convert a VSAM, KSDS to a flat Sequential file on the mainframe, download the flat sequential file from the Mainframe System to a Windows, UNIX or Linux System and create an Indexed file of ASCII content using Micro Focus. This document may be used as a tutorial for new programmers or as a quick reference for experienced programmers.
In the world of programming there are many ways to solve a problem. This documentation and software were developed and tested on systems that are configured for a SIMOTIME environment based on the hardware, operating systems, user requirements and security requirements. Therefore, adjustments may be needed to execute the jobs and programs when transferred to a system of a different architecture or configuration.
SIMOTIME Services has experience in moving or sharing data or application processing across a variety of systems. For additional information about SIMOTIME Services or Technologies please contact us using the information in the Contact, Comment or Feedback section of this document.
Software Agreement and Disclaimer
Permission to use, copy, modify and distribute this software, documentation or training material for any purpose requires a fee to be paid to SimoTime Technologies. Once the fee is received by SimoTime the latest version of the software, documentation or training material will be delivered and a license will be granted for use within an enterprise, provided the SimoTime copyright notice appear on all copies of the software. The SimoTime name or Logo may not be used in any advertising or publicity pertaining to the use of the software without the written permission of SimoTime Technologies.
SimoTime Technologies makes no warranty or representations about the suitability of the software, documentation or learning material for any purpose. It is provided "AS IS" without any expressed or implied warranty, including the implied warranties of merchantability, fitness for a particular purpose and non-infringement. SimoTime Technologies shall not be liable for any direct, indirect, special or consequential damages resulting from the loss of use, data or projects, whether in an action of contract or tort, arising out of or in connection with the use or performance of this software, documentation or training material.
Downloads and Links
This section includes links to documents with additional information that are beyond the scope and purpose of this document. The first group of documents may be available from a local system or via an internet connection, the second group of documents will require an internet connection.
Note: A SimoTime License is required for the items to be made available on a local system or server.
Current Server or Internet Access
The following links may be to the current server or to the Internet.
Note: The latest versions of the SimoTime Documents and Program Suites are available on the Internet and may be accessed using the icon. If a user has a SimoTime Enterprise License the Documents and Program Suites may be available on a local server and accessed using the icon.
Explore the non-Relational Data Connection for more examples of accessing methodologies and coding techniques for Data Files and VSAM Data Sets.
Explore the COBOL Connection for more examples of COBOL programming techniques and sample code.
Explore How to Generate a Data File Convert Program using simple specification statements in a Process Control File (PCF). This link to the User Guide includes the information necessary to create a Process Control File and generate the COBOL programs that will do the actual data file conversion. The User Guide contains a list of the PCF statements that are used for the data file convert process.
Explore How to Generate a Data File Compare, Validate or Hex-Dump Program using simple specification statements in a Process Control File (PCF). This link to the User Guide includes the information necessary to create a Process Control File and generate the COBOL programs that will do a data file compare, accumulate summary totals with a record count or produce a Hex-Dump of records in a VSAM, KSDS based on a list of user-defined keys. The User Guide contains a list of the PCF statements that are used for the data file compare, validate or dump process.
Explore An Enterprise System Model that describes and demonstrates how Applications that were running on a Mainframe System and non-relational data that was located on the Mainframe System were copied and deployed in a Microsoft Windows environment with Micro Focus Enterprise Server.
Explore The ASCII and EBCDIC Translation Tables. These tables are provided for individuals that need to better understand the bit structures and differences of the encoding formats.
Explore The File Status Return Codes that are used to interpret the results of accessing VSAM data sets and/or QSAM files.
Internet Access Required
The following links will require an internet connect.
This suite of programs and documentation is available for download. Link to an Evaluation zPAK Option that includes the program members, documentation and control files.
A good place to start is The SimoTime Home Page for access to white papers, program examples and product information. This link requires an Internet Connection
Explore The Micro Focus Web Site for more information about products (including Micro Focus COBOL) and services available from Micro Focus. This link requires an Internet Connection.
Glossary of Terms
Explore the Glossary of Terms for a list of terms and definitions used in this suite of documents and white papers.
Comments or Feedback
This document was created and is maintained by SimoTime Technologies. If you have any questions, suggestions, comments or feedback please use the following contact information.
| 1. | Send an e-mail to our helpdesk. |
| 1.1. | helpdesk@simotime.com. |
| 2. | Our telephone numbers are as follows. |
| 2.1. | 1 415 763-9430 office-helpdesk |
| 2.2. | 1 415 827-7045 mobile |
We appreciate hearing from you.
Company Overview
SimoTime Technologies was founded in 1987 and is a privately owned company. We specialize in the creation and deployment of business applications using new or existing technologies and services. We have a team of individuals that understand the broad range of technologies being used in today's environments. Our customers include small businesses using Internet technologies to corporations using very large mainframe systems.
Quite often, to reach larger markets or provide a higher level of service to existing customers it requires the newer Internet technologies to work in a complementary manner with existing corporate mainframe systems. We specialize in preparing applications and the associated data that are currently residing on a single platform to be distributed across a variety of platforms.
Preparing the application programs will require the transfer of source members that will be compiled and deployed on the target platform. The data will need to be transferred between the systems and may need to be converted and validated at various stages within the process. SimoTime has the technology, services and experience to assist in the application and data management tasks involved with doing business in a multi-system environment.
Whether you want to use the Internet to expand into new market segments or as a delivery vehicle for existing business functions simply give us a call or check the web site at http://www.simotime.com
| Return-to-Top |
| File Convert, Format and Share |
| Copyright © 1987-2023 SimoTime Technologies and Services All Rights Reserved |
| When technology complements business |
| http://www.simotime.com |