Compare Two Data Files Test Case 03, Track Inserts & Deletes |
The SimoTime Home Page |
The primary objective of this test case is to describe and demonstrate how to compare (on a record-by-record basis) the content of two non-relational data structures such as a sequential file and/or a VSAM Data Set. The process for comparing two data structures should be executable on an IBM/ZOS Mainframe System or on a Linux, UNIX or Windows (LUW) System using Micro Focus Server. Also, the process should be supported in a development, test or production environment. Any system changes to the mainframe or the installation of additional software on the mainframe should be avoided. The creation of batch jobs using JCL and the creation of additional COBOL programs is acceptable. These items will need to be documented and should be kept to a minimum.
In addition to the record-by-record compare a secondary objective is to describe and demonstrate how to track record inserts and deletes.
Note: |
It is important to note the intent of Test Case 03 is not simply to do a one-time data file validation (or compare) during an application and data migration. The intent is to describe and demonstrate a low-cost, repeatable process that may be used as a model for doing data validation as part of the ongoing unit, application and system testing processes. |
Test Case 03 is a series of tasks that are categorized a into a Prepare group and an Execute group. The items in the Prepare group are one-time tasks to define and create the processes for doing the data file compares. The items in the Execute group are the ongoing, repeatable tasks that will be executed many times.
We have made a significant effort to ensure the documents and software technologies are correct and accurate. We reserve the right to make changes without notice at any time. The function delivered in this version is based upon the enhancement requests from a specific group of users. The intent is to provide changes as the need arises and in a timeframe that is dependent upon the availability of resources.
Copyright © 1987-2025
SimoTime Technologies and Services
All Rights Reserved
Test Case 03 (TC03) includes a suite of job scripts and programs that will create data files to be used in the data file compare process.
1. | Application and/or Utilitarian Assets |
1.1. | A COBOL copy file that defines the record structure for the Record Sequential files (RSEQ). |
1.2. | A program to convert Line Sequential files (LSEQ) to Record Sequential files (RSEQ). |
2. | Non-Relational Data Structures |
2.1. | A Record Sequential File (TESTCASE.TC03.TC03BASE.dat) with 128 byte, fixed-length records. This file is used as the baseline (or expected results) file. |
2.2. | A Record Sequential File (TESTCASE.TC03.TC03SAME.dat) that is a copy of the baseline file and is used to describe and demonstrate a compare process that produces an "EQUAL" result. |
2.3. | A Record Sequential File (TESTCASE.TC03.TC03DIFF.dat) that is used to describe and demonstrate a compare process that produces a "NOT EQUAL" result. |
A "Prepare" process (or System Configuration) must be performed to set environment variables, create a directory structure, configure a Micro Focus Server Instance and create the utility programs that will do various data file converts and compares. The following is a list of the tasks.
1. | System Preparation |
1.1. | Create a process to set the necessary Environment Variables. |
1.2. | Create a directory structure to support a development environment. |
1.3. | Configure a Micro Focus batch server instance that will run Test Case 03 using ASCII-encoded, non-relational data structures. Describe and demonstrate how this is accomplished. |
2. | Utility Programs and Processes |
2.1. | Create a set of Windows Command Files to be used as a repeatable data file compare process for the non-relational data structures included in Test Case 03. This repeatable process should serve as a model for comparing other non-relational data structures. The comparison process should run in a development, test and production environment on a Windows System using Micro Focus Enterprise Server. Describe and demonstrate how this is accomplished. |
2.1.1. | Create a batch job using a Windows command file that will compare two ASCII-encoded Record Sequential Files. The compare process should be done on a record-by-record basis and have the capability to track record inserts and deletes. The compare process should have the capability of comparing parts of a record (positions within a record). The positions within a record to be compared should be defined during the preparation phase. |
2.1.2. | Create a batch job using a Windows command file that will compare two ASCII-encoded Record Sequential Files. The compare process should be done on a record-by-record basis and have the capability to track record inserts and deletes. The compare process should have the capability of comparing parts of a record (positions within a record). The positions within a record to be compared should be defined during the execution phase. |
2.2. | Create a set of JCL Members to be used as a repeatable data file compare process for the non-relational data structures included in Test Case 03. This repeatable process should serve as a model for comparing other non-relational data structures. The comparison process should run in a development, test and production environment on a ZOS Mainframe or a Linux, UNIX or Windows System using Micro Focus Enterprise Server. Describe and demonstrate how this is accomplished. |
2.2.1. | Create a batch job using a JCL Member that will compare two ASCII-encoded Record Sequential Files. The compare process should be done on a record-by-record basis and have the capability to track record inserts and deletes. The compare process should have the capability of comparing parts of a record (positions within a record). The positions within a record to be compared should be defined during the preparation phase. |
2.2.2. | Create a batch job using a JCL Member that will compare two ASCII-encoded Record Sequential Files. The compare process should be done on a record-by-record basis and have the capability to track record inserts and deletes. The compare process should have the capability of comparing parts of a record (positions within a record). The positions within a record to be compared should be defined during the execution phase. |
3. | Documentation |
3.1. | Create documentation for the preceding items. |
3.2. | The documentation should be easily viewed from devices that have browser capability. |
Test Case 03 (TC03) was created on a Windows/7 System with Micro Focus Enterprise Server (this includes both Enterprise Studio and Enterprise Developer). The COBOL programs were compiled in the new environment and the JCL was submitted to the Micro Focus Server and executed as expected.
1. CMD, Compare with EQ ResultsThe following Windows command (TC03CPW1.cmd) will set the environment and execute a generated COBOL program that will compare two record sequential files. The compare process will result in an "EQUAL" condition (or ZERO return code). @echo OFF rem * ************************************************************************ rem * TC03CPW1.cmd - a Windows Command File * rem * This program is provided by SimoTime Technologies * rem * (C) Copyright 1987-2019 All Rights Reserved * rem * Web Site URL: http://www.simotime.com * rem * e-mail: helpdesk@simotime.com * rem * ************************************************************************ rem * rem * Text - Compare two Data Files and track record inserts and deletes. rem * Author - SimoTime Technologies rem * Date - January 24, 1996 rem * rem * ******************************************************************* rem * Step 1, Delete any previously created file... rem * set CmdName=TC03CPW1 call ..\Env1BASE set SYSLOG=%BaseLib1%\LOGS\TESTCASE.TC03.TC03LOGS.dat run SYSLOGC8 set SYSOUT=%BaseLib1%\DATA\SPOOL\TESTCASE.TC03.TC03SP09.txt if exist %SYSOUT% erase %SYSOUT% rem * call SimoNOTE "*******************************************************%CmdName%" call SimoNOTE "Starting JobName %CmdName%" call SimoNOTE "Identify JobStep DeleteLSEQ" set TC03ACTL=%BaseLib1%\DATA\APPL\TESTCASE.TC03.TC03SAME.dat set TC03EXPT=%BaseLib1%\DATA\ASC1\TESTCASE.TC03.TC03BASE.dat rem * rem * ******************************************************************* rem * Step 2, Compare two non-relational Record Sequential File (RSEQ) rem * with 128-byte, ASCII-encoded records. rem * call SimoNOTE "Identify JobStep Do the File Compare" run TC03CPC1 if not "%ERRORLEVEL%" == "0" set JobStatus=0010 if not "%JobStatus%" == "0000" goto EojNok rem * rem * ******************************************************************* rem * :EojAok call SimoNOTE "Finished JobName %CmdName%, Job Status is %JobStatus%" goto :End :EojNok call SimoNOTE "ABENDING JobName %CmdName%, Job Status is %JobStatus%" :End set SYSLOGVR=%SYSLOG% set SYSLOGLS=%BASELIB1%\LOGS\TESTCASE.TC03.TC03LOGS.txt if exist %SYSLOGLS% erase %SYSLOGLS% run SYSLOGC1 call SimoNOTE "Conclude SysOut is %SYSOUT%" call SimoNOTE "Conclude SysLog is %SYSLOG%" call SimoNOTE "Conclude TxtLog is %SYSLOGLS%" if not "%1" == "nopause" pause The results are posted in the SYSLOG file. To Review the Results refer to the "Review" section of this document. 2. CMD, Compare with NE ResultsThe following Windows Command file (TC03CPW2.cmd) will set the environment and execute a generated COBOL program that will compare two record sequential files. The compare process will result in a "NOT EQUAL" condition (or 16 return code). @echo OFF rem * ************************************************************************ rem * TC03CPW2.cmd - a Windows Command File * rem * This program is provided by SimoTime Technologies * rem * (C) Copyright 1987-2019 All Rights Reserved * rem * Web Site URL: http://www.simotime.com * rem * e-mail: helpdesk@simotime.com * rem * ************************************************************************ rem * rem * Text - Compare two Data Files, track record inserts and deletes. rem * Author - SimoTime Technologies rem * Date - January 24, 1996 rem * rem * ******************************************************************* rem * Step 1, Delete any previously created file... rem * set CmdName=TC03CPW2 call ..\Env1BASE set SYSLOG=%BaseLib1%\LOGS\TESTCASE.TC03.TC03LOGS.dat run SYSLOGC8 set SYSOUT=%BaseLib1%\DATA\SPOOL\TESTCASE.TC03.TC03SP09.txt if exist %SYSOUT% erase %SYSOUT% rem * call SimoNOTE "*******************************************************%CmdName%" call SimoNOTE "Starting JobName %CmdName%" call SimoNOTE "Identify JobStep DeleteLSEQ" set TC03ACTL=%BaseLib1%\DATA\APPL\TESTCASE.TC03.TC03DIFF.dat set TC03EXPT=%BaseLib1%\DATA\ASC1\TESTCASE.TC03.TC03BASE.dat rem * rem * ******************************************************************* rem * Step 2, Compare two non-relational Record Sequential File (RSEQ) rem * with 128-byte, ASCII-encoded records. rem * call SimoNOTE "Identify JobStep Do the File Compare" run TC03CPC1 if not "%ERRORLEVEL%" == "0" set JobStatus=0010 if not "%JobStatus%" == "0000" goto EojNok rem * rem * ******************************************************************* rem * :EojAok call SimoNOTE "Finished JobName %CmdName%, Job Status is %JobStatus%" goto :End :EojNok call SimoNOTE "ABENDING JobName %CmdName%, Job Status is %JobStatus%" :End set SYSLOGVR=%SYSLOG% set SYSLOGLS=%BASELIB1%\LOGS\TESTCASE.TC03.TC03LOGS.txt if exist %SYSLOGLS% erase %SYSLOGLS% run SYSLOGC1 call SimoNOTE "Conclude SysOut is %SYSOUT%" call SimoNOTE "Conclude SysLog is %SYSLOG%" call SimoNOTE "Conclude TxtLog is %SYSLOGLS%" if not "%1" == "nopause" pause The results are posted in the SYSLOG file. To Review the Results refer to the "Review" section of this document. 3. JCL, Compare with EQ ResultsThe following JCL Member (TC03CPJ1.jcl) will housekeeping functions and execute a generated COBOL program that will compare two record sequential files. The compare process will result in an "EQUAL" condition (or ZERO return code) //TC03CPJ1 JOB (SIMOTIME),'DATA FILE COMPARE',CLASS=1,MSGCLASS=0, // NOTIFY=CSIP1 //* ******************************************************************* //* TC03CPJ1.JCL - a JCL Member for Batch Job Processing * //* This JCL Member is provided by SimoTime Technologies * //* (C) Copyright 1987-2019 All Rights Reserved * //* Web Site URL: http://www.simotime.com * //* e-mail: helpdesk@simotime.com * //* ******************************************************************* //* //* Text - Compare two data files. //* Author - SimoTime Technologies //* Date - January 24, 1996 //* //* This set of programs will run on a mainframe under MVS or on a //* Personal Computer with Windows and Micro Focus Technologies. //* //* ************ //* * TC03CPJ1 * //* ********jcl* //* * //* ************ //* * IEFBR14 * //* ********utl* //* * //* ************ ************ ************ //* * TC03BASE *-----* TC03CPC1 *-----* SYSOUT * //* ********dat* * ********cbl* * ************ //* * * * //* ************ * * * ************ //* * TC03SAME *--* * *--* SYSLOG * //* ********dat* * *******vseq* //* * //* ************ //* * EOJ * //* ************ //* //* ******************************************************************* //* Step 1 of 2, Delete and Define a New SYSLOG file... //* // SET DDSYSLOG=TESTCASE.TC03.SYSLOGJ1 //CRTLOGS1 EXEC SYSLOGP8 //* ******************************************************************* //* Step 2 of 2, Compare two data files, expect an EQUAL result... //* //COMPARE1 EXEC PGM=TC03CPC1 //STEPLIB DD DSN=SIMOTIME.DEMO.LOADLIB1,DISP=SHR //TC03ACTL DD DSN=TESTCASE.TC03.TC03SAME,DISP=SHR //TC03EXPT DD DSN=TESTCASE.TC03.TC03BASE,DISP=SHR //SYSLOG DD DSN=&DDSYSLOG,DISP=SHR //SYSOUT DD SYSOUT=* // 4. JCL, Compare with NE ResultsThe following JCL Member (TC03CPJ2.jcl) will housekeeping functions and execute a generated COBOL program that will compare two record sequential files. The compare process will result in a "NOT EQUAL" condition (or 16 return code) //TC03CPJ2 JOB (SIMOTIME),'DATA FILE COMPARE',CLASS=1,MSGCLASS=0, // NOTIFY=CSIP1 //* ******************************************************************* //* TC03CPJ2.JCL - a JCL Member for Batch Job Processing * //* This JCL Member is provided by SimoTime Technologies * //* (C) Copyright 1987-2019 All Rights Reserved * //* Web Site URL: http://www.simotime.com * //* e-mail: helpdesk@simotime.com * //* ******************************************************************* //* //* Text - Compare two data files. //* Author - SimoTime Technologies //* Date - January 24, 1996 //* //* This set of programs will run on a mainframe under MVS or on a //* Personal Computer with Windows and Micro Focus Technologies. //* //* ************ //* * TC03CPJ1 * //* ********jcl* //* * //* ************ //* * IEFBR14 * //* ********utl* //* * //* ************ ************ ************ //* * TC03BASE *-----* TC03CPC1 *-----* SYSOUT * //* ********dat* * ********cbl* * ************ //* * * * //* ************ * * * ************ //* * TC03DIFF *--* * *--* SYSLOG * //* ********dat* * *******vseq* //* * //* ************ //* * EOJ * //* ************ //* //* ******************************************************************* //* Step 1 of 2, Delete and Define a New SYSLOG file... //* // SET DDSYSLOG=TESTCASE.TC03.SYSLOGJ2 //CRTLOGS1 EXEC SYSLOGP8 //* ******************************************************************* //* Step 2 of 2, Compare two data files, expect an EQUAL result... //* //COMPARE1 EXEC PGM=TC03CPC1 //STEPLIB DD DSN=SIMOTIME.DEMO.LOADLIB1,DISP=SHR //TC03ACTL DD DSN=TESTCASE.TC03.TC03DIFF,DISP=SHR //TC03EXPT DD DSN=TESTCASE.TC03.TC03BASE,DISP=SHR //SYSLOG DD DSN=&DDSYSLOG,DISP=SHR //SYSOUT DD SYSOUT=* // ReviewThis section will show the contents of two SYSLOG files. The first example is produced as a result from an "EQUAL" compare. The second example is produced as a result of a "NOT EQUAL" compare. Compare with "EQUAL" ResultsThe following shows the content of the SYSLOG file that is created when the file compare process resulted in an "Equal" condition. *** 2013/09/10 22:45:28:87 ******************************************************************************* *** 2013/09/10 22:45:28:87 * TC03CPC1 Key Field 1-6, 128-Byte Comparison v13.09.10 helpdesk@simotime.com *** 2013/09/10 22:45:28:87 * TC03CPC1 This Data File Compare Member was generated by SimoTime Technologies *** 2013/09/10 22:45:28:87 ******************************************************************************* *** 2013/09/10 22:45:28:87 Starting - Key Field 1-6, 128-Byte Comparison http://www.SimoTime.com *** 2013/09/10 22:45:28:87 *****************************************************************************QT *** 2013/09/10 22:45:28:87 Conclude - Key Field 1-6, 128-Byte Comparison *** 2013/09/10 22:45:28:87 000000026 - Record count for TC03ACTL *** 2013/09/10 22:45:28:87 000000026 - Record count for TC03EXPT *** 2013/09/10 22:45:28:89 000000000 - NOT Equal count for compare is ZERO *** 2013/09/10 22:45:28:89 000000026 - Number of matching record pairs for Compare Task *** 2013/09/10 22:45:28:89 Finished - Key Field 1-6, 128-Byte Comparison http://www.SimoTime.com Compare with "NOT EQUAL" ResultsThe following shows the content of the SYSLOG file that is created when the file compare process resulted in a "Not Equal" condition. *** 2013/09/13 16:37:42:04 ******************************************************************************* *** 2013/09/13 16:37:42:04 * TC03CPC1 Key Field 1-6, 128-Byte Comparison v13.09.12 helpdesk@simotime.com *** 2013/09/13 16:37:42:04 * TC03CPC1 This Data File Compare Member was generated by SimoTime Technologies *** 2013/09/13 16:37:42:04 ******************************************************************************* *** 2013/09/13 16:37:42:04 Starting - Key Field 1-6, 128-Byte Comparison http://www.SimoTime.com *** 2013/09/13 16:37:42:04 ******************************************************************************* Refer to Note-01 *** 2013/09/13 16:37:42:04 This record is MISSING from TC03ACTL - the record is PRESENT in TC03EXPT *** 2013/09/13 16:37:42:05 KEYFIELD..000000011(00001:00006) COMPARISON PHYSICAL *** 2013/09/13 16:37:42:05 ....:. *** 2013/09/13 16:37:42:05 001100 *** 2013/09/13 16:37:42:05 333333 *** 2013/09/13 16:37:42:05 001100 *** 2013/09/13 16:37:42:05 ###### *** 2013/09/13 16:37:42:05 * *** 2013/09/13 16:37:42:05 KEYRECID..000000011(00001:00032) COMPARISON PHYSICAL *** 2013/09/13 16:37:42:05 ....:...10....:...20....:...30.. *** 2013/09/13 16:37:42:05 001100 Kemper Kelly *** 2013/09/13 16:37:42:07 33333324667672222222224666722222 *** 2013/09/13 16:37:42:07 0011000B5D052000000000B5CC900000 *** 2013/09/13 16:37:42:07 ******************************************************************************* Refer to Note-02 *** 2013/09/13 16:37:42:07 This record is PRESENT in TC03ACTL - the record is MISSING from TC03EXPT *** 2013/09/13 16:37:42:07 KEYFIELD..000000011(00001:00006) COMPARISON PHYSICAL *** 2013/09/13 16:37:42:07 ....:. *** 2013/09/13 16:37:42:07 001150 *** 2013/09/13 16:37:42:07 333333 *** 2013/09/13 16:37:42:07 001150 *** 2013/09/13 16:37:42:07 ###### *** 2013/09/13 16:37:42:07 * *** 2013/09/13 16:37:42:07 KEYRECID..000000011(00001:00032) COMPARISON PHYSICAL *** 2013/09/13 16:37:42:08 ....:...10....:...20....:...30.. *** 2013/09/13 16:37:42:08 001150 Kemper Kelly *** 2013/09/13 16:37:42:08 33333324667672222222224666722222 *** 2013/09/13 16:37:42:08 0011500B5D052000000000B5CC900000 *** 2013/09/13 16:37:42:08 ******************************************************************************* Refer to Note-03 *** 2013/09/13 16:37:42:08 This record is PRESENT in TC03ACTL - the record is MISSING from TC03EXPT *** 2013/09/13 16:37:42:08 KEYFIELD..000000018(00001:00006) COMPARISON PHYSICAL *** 2013/09/13 16:37:42:08 ....:. *** 2013/09/13 16:37:42:08 001744 *** 2013/09/13 16:37:42:08 333333 *** 2013/09/13 16:37:42:08 001744 *** 2013/09/13 16:37:42:08 ###### *** 2013/09/13 16:37:42:10 * *** 2013/09/13 16:37:42:10 KEYRECID..000000018(00001:00032) COMPARISON PHYSICAL *** 2013/09/13 16:37:42:10 ....:...10....:...20....:...30.. *** 2013/09/13 16:37:42:10 001744 Newton Nancy *** 2013/09/13 16:37:42:10 33333324677662222222224666722222 *** 2013/09/13 16:37:42:10 0017440E574FE000000000E1E3900000 *** 2013/09/13 16:37:42:10 ******************************************************************************* Refer to Note-04 *** 2013/09/13 16:37:42:10 TC03ACTL..000000025(00007:00122) COMPARISON PHYSICAL *** 2013/09/13 16:37:42:10 ..10....:...20....:...30....:...40....:...50....:...60....:...70....:...80....:...90....:..100....:..110....:..120....:..1 *** 2013/09/13 16:37:42:10 Xray Xavier 2424 24th Avenue Nashville TN 44190 +000175000 441-207-1135 *** 2013/09/13 16:37:42:10 25767222222222225676672222333323376247667622222222467676666222222542333332223333333332333233323333222222222222222222222222 *** 2013/09/13 16:37:42:10 082190000000000081695200002424024480165E5500000000E13869CC50000004E04419000B0001750000441D207D1135000000000000000000000000 *** 2013/09/13 16:37:42:11 TC03EXPT..000000024(00007:00122) COMPARISON PHYSICAL *** 2013/09/13 16:37:42:11 ..10....:...20....:...30....:...40....:...50....:...60....:...70....:...80....:...90....:..100....:..110....:..120....:..1 *** 2013/09/13 16:37:42:11 Xray Xavier 2424 24TH Street Nashville TN 44190 +000175000 441-207-1135 *** 2013/09/13 16:37:42:11 25767222222222225676672222333323354257766722222222467676666222222542333332223333333332333233323333222222222222222222222222 *** 2013/09/13 16:37:42:11 08219000000000008169520000242402448034255400000000E13869CC50000004E04419000B0001750000441D207D1135000000000000000000000000 *** 2013/09/13 16:37:42:11 =================================##=######================================================================================ *** 2013/09/13 16:37:42:11 * *** 2013/09/13 16:37:42:11 ******************************************************************************* Refer to Note-05 *** 2013/09/13 16:37:42:11 Conclude - Key Field 1-6, 128-Byte Comparison *** 2013/09/13 16:37:42:11 000000027 - Record count for TC03ACTL *** 2013/09/13 16:37:42:11 000000026 - Record count for TC03EXPT *** 2013/09/13 16:37:42:11 WARNING! - Record counts are not equal *** 2013/09/13 16:37:42:13 000000004 - NOT Equal count for compare of existing records *** 2013/09/13 16:37:42:13 000000024 - Number of matching record pairs for Compare Task *** 2013/09/13 16:37:42:13 ABENDING - Key Field 1-6, 128-Byte Comparison http://www.SimoTime.com Note-01: This group of line items was produced when a record was present in the Expected Results file (TC03EXPT) but was missing from the Actual Results file (TC03ACTL). Note-02: This group of line items was produced when a record was present in the Actual Results file (TC03ACTL) but was missing from the Expected Results file (TC03EXPT). Note-03: This group of line items was produced when a record was present in the Actual Results file (TC03ACTL) but was missing from the Expected Results file (TC03EXPT). Note-04: This group of line items was produced when two records were compared and the record content was not equal. Note-05: This group of line items was produced when the compare program performed the End-of-Job processing.
Preparation TasksA Data Migration effort presents a user with a number of choices. For non-relational data structures the decision process will leverage a variety of skills and a broad knowledge base that may be acquired through training, experience, research and assistance. Create a Directory StructureTest Case 01 will focus on the development environment. Explore a Directory Structure for a Development Environment that supports the execution of business applications using Micro Focus Enterprise Server. Configure a Batch Server InstanceThe purpose of this section is to describe how to configure a JES sub-system (or Server Instance) that will run under Micro Focus Enterprise Server. To run all the jobs in Test Case 01 it will be necessary to populate the catalog with a minimum number of Partitioned Data Sets (or PDS's). Explore how to Configure a Batch JES sub-system (or Server Instance) that will run under Micro Focus Enterprise Server and execute batch jobs using JCL.
Technical DetailsThis section contains information about items that are used by the mainline Job Scripts and/or Programs. JCL to Delete/Define TC01KS01The following JCL member (TC01DDJ1.jcl) is a job that uses IDCAMS to do a DELETE/DEFINE of the VSAM/KSDS used in this Test Case. //TC01DDJ1 JOB SIMOTIME,CLASS=1,MSGCLASS=0,NOTIFY=CSIP1 //* ******************************************************************* //* TC01DDJ1.JCL - a JCL Member for Batch Job Processing * //* This JCL Member is provided by SimoTime Technologies * //* (C) Copyright 1987-2019 All Rights Reserved * //* Web Site URL: http://www.simotime.com * //* e-mail: helpdesk@simotime.com * //* ******************************************************************* //* //* Text - Create an empty VSAM, KSDS data set using IDCAMS. //* Author - SimoTime Technologies //* Date - January 24, 1996 //* //* This job will create a VSAM, KSDS data set. The key is six (6) //* characters starting at the first position in the record. //* The record length is 128 characters. //* //* This set of programs will run on a mainframe under MVS or on a //* Personal Computer with Windows and Micro Focus Mainframe Express. //* //* ******************************************************************* //* Step 1 This is a single step job. //* //KSDSMAKE EXEC PGM=IDCAMS //SYSPRINT DD SYSOUT=* //SYSIN DD * DEFINE CLUSTER (NAME(TESTCASE.TC01.TC01KS10) - TRACKS(45,15) - INDEXED) - DATA (NAME(TESTCASE.TC01.TC01KS10.DAT) - KEYS(6,0) - RECORDSIZE(512,512) - FREESPACE(10,15) - CISZ(8192)) - INDEX (NAME(TESTCASE.TC01.TC01KS10.IDX)) /* //* Note: The DELETE/DEFINE will replace an existing data set FTP SpecificationsThe following member (TC02GET3.ctl) contains the FTP specifications to download a sequential file from the Mainframe System to a Windows System. UserID Password CD .. PWD ASCII GET MFI01.SIMOTIME.RSEQ81.JCL D:\TC02\DATA\FTP1\MFI01.SIMOTIME.RSEQ81.JCL.txt QUIT Note: The Specifications or control information is stored in the PARMLIB Partitioned-Data-Set (PDS). Directives Files for Program CompileThis section will describe the directives files that are used when compiling the COBOL programs that are used in Test Case 01. Compile using Mainframe DialectThe following member (OS390AscCBLBAT.dir) is the directives file that is used to compile the COBOL programs that conform to the OS390 dialect. The compiled programs may be executed using JCL or a Windows Command line. DIALECT"OS390" CHARSET"ASCII" ASSIGN"EXTERNAL" IDXFORMAT"8" IBMCOMP NOTRUNC HOSTNUMMOVE HOSTNUMCOMPARE NOSIGN-FIXUP HOSTARITHMETIC CHECKNUM NOOPTIONAL-FILE NOHOSTFD NOQUERY SSRANGE COBIDY ANIM outdd"SYSOUT 121 L" SHARE-OUTDD DATE TIME DATAMAP settings list() noform Compile using Micro Focus DialectThe following member (MiFoAscIBMcomp.dir) is the directives file that is used to compile the COBOL programs that conform to the Micro Focus dialect. The compiled programs are typically executed using a Windows Command line. DIALECT"MF" CHARSET"ASCII" ASSIGN"EXTERNAL" IDXFORMAT"8" IBMCOMP NOTRUNC RTNCODE-SIZE"2" NOOPTIONAL-FILE NOHOSTFD NOQUERY COBIDY NOANIM outdd"SYSOUT 121 L" SHARE-OUTDD DATAMAP settings list() noform Set Environment VariablesThe following is a Windows CMD File (ENV1BASE.cmd) that is called to set the common or shared environment variables for a development environment that will support the execution of Test Case 01. @echo OFF rem * ******************************************************************* rem * ENV1BASE.cmd - a Windows Command File * rem * This program is provided by SimoTime Technologies * rem * (C) Copyright 1987-2021 All Rights Reserved * rem * Web Site URL: http://www.simotime.com * rem * e-mail: helpdesk@simotime.com * rem * ******************************************************************* rem * rem * Text - Provide a single point to set common environment variables. rem * Author - SimoTime Technologies rem * Date - January 24, 1996 rem * rem * Set the commonly used environment variables. This is used to provide rem * a single point for managing the commonly used environment variables. rem * set SimoLIBR=c:\SimoLIBR set BASELIB1=c:\SIMOSAM1\DEVL set BASELIB8=c:\SimoSAM8 set BaseWIP1=c:\SimoSAM1\WIP1 set DATAZERO=c:\SIMODATA\DEVL\DATA\ZERO set BASEAPP=%BaseLib1% set BASESYS=%BaseLib1%\SYS1 set BASECAT=%BaseLib1%\DATA set UMAPALIB=%BASECAT%\ASC1 set UMAPELIB=%BASECAT%\EBC1 set SYSLOG=%BASESYS%\LOGS\SYSLOG_USER.DAT set SYSOUT=%BASEAPP%\LOGS\SYSOUT_SIMSAM01.txt set SLZMSG=%BASEAPP%\LOGS\SLZMSG_USER.TXT set PostNOTE=%BASEAPP%\LOGS\JOBLOG_SIMONOTE.TXT set SIMONOTE=%BASEAPP%\LOGS\JOBLOG_SIMONOTE.txt set USERPOST=%BASEAPP%\LOGS\ASSIGNED_USER_POST_FILE.txt if [%1]==[] goto NO_POST set SYSOUT=%BaseLib1%\LOGS\SYSOUT_%1.txt call SIMONOTE "+ ENV1BASE *" call SIMONOTE "+ ENV1BASE ********************************************************************%1" call SIMONOTE "+ ENV1BASE is preparing the System Environment..." call SIMONOTE "+ SIMOLIBR is %SIMOLIBR%" call SIMONOTE "+ MIFOSYS1 is %MIFOSYS1%" call SIMONOTE "+ BASELIB1 is %BASELIB1%" :NO_POST call SIMONOTE "+ SIMONOTE Job Log File is %SIMONOTE% " rem * set MQBASE=C:\Program Files\IBM\WebSphere MQ rem * rem * Set the location for the Apache-Tomcat Server... set CATALINA_HOME=C:\APACHETC\apache-tomcat-7.0.52 rem set CATALINA_HOME=C:\Program Files (x86)\Java\jdk1.8.0_112 rem * rem * Set the Environment for the Java Environment... rem set JAVABASE=C:\APACHETC\apache-tomcat-7.0.52 set JAVABASE=C:\Program Files (x86)\Java\jdk1.8.0_112 set JAVASDK="%JAVABASE%\bin" set JAVA_HOME=%JAVABASE% set JRE_HOME=%JAVABASE% set SIMOTCAT=%CATALINA_HOME%\webapps\simotcat set SIMPACKS=%CATALINA_HOME%\webapps\simotcat\WEB-INF\classes\simpacks rem * rem * Set the environment for the Micro Focus technology... set MIFOEDEV=C:\Program Files (x86)\Micro Focus\Enterprise Developer set MIFOVCBL=C:\Program Files (x86)\Micro Focus\Visual COBOL Build Tools set MIFOESTU=C:\Program Files (x86)\Micro Focus\Studio Enterprise Edition 6.0 set MIFOEMFE="C:\Program Files (x86)\Micro Focus\Mainframe Express" rem * rem * Large file support, performance tuning and record locking of the File Handler set EXTFH=%BASESYS%\CONFIG\EXTFHBIG.CFG rem * rem * For IMS Support set ES_IMSLIB=%BASEAPP%\IMSLIB set ES_ACBLIB=%BASEAPP%\IMSLIB rem * rem * EZASOKETS Check EZASOKETS Enabled box or set ES_EZASOKET_SUPPORT=YES set EZACONFG=BASESYS1\CONFIG\EZACONFG.dat rem * rem * Resource Allocation and Performance for SORT and non-Relational Data rem set MFJSENGINE=SYNCSORT set SORTSCHEME=1 set SORTSPACE=750000000 set TMP=C:\SORTWORK rem * set ES_ALLOC_OVERRIDE=%BASESYS%\CONFIG\CATMAPA1.cfg rem * For CORE_ON_ERROR function, ABEND Dump rem * set COBCONFIG_=%BASESYS%\CONFIG\diagnose.cfg rem * rem * Consolidated Trace Facility (CTF) rem * set MFTRACE_CONFIG=%BASESYS%\CONFIG\ctf.cfg rem * set MFTRACE_LOGS=c:\ctflogs rem * rem * For Job Restart, ABEND Recovery set MF_UCC11=Y set ES_JES_RESTART=Y rem * rem * Set environment for MFBSI (Micro Focus Batch Scheduling Interface) set ES_EMP_EXIT_1=mfbsiemx set MFBSI_DIR=%BASESYS%\LOGS\%JESSERVERNAME% set MFBSIEOP_CMD=ENABLE set MFBSIEOP_CSV=ENABLE set MFBSIEOP_HTM=ENABLE set MFBSIEOP_XML=ENABLE rem * rem * Set Behavior and Trace Flags for GETJOBDD rem * Position=12345678/12345678 set JDDFLAGS=nnnWnnnn/YYnnnnnn rem * rem * If not already set then set the PATH for Micro Focus Directories if "%SIMOPATH%" == "Y" goto JUMPPATH if "%MIFOSYS1%" == "EDEV" goto JUMPEDEV if "%MIFOSYS1%" == "VCBL" goto JUMPVCBL if "%MIFOSYS1%" == "ESTU" goto JUMPESTU if "%MIFOSYS1%" == "EMFE" goto JUMPEMFE :JUMPEDEV set path=%BASESYS%\LOADLIB;%MIFOEDEV%\bin;%JAVASDK%;%BASEAPP%\JAVA;%PATH%; set CobCpy=%BASEAPP%\CobCpy1;%BASEAPP%\CobCpy2;%BASEAPP%\CobCpy6;%SimoLIBR%;%MIFOEDEV%\CPYLIB set MIFOBASE=%MIFOEDEV% goto JUMPPATH :JUMPVCBL set path=%MIFOVCBL%\bin;%MIFOVCBL%;%JAVASDK%;%BASEAPP%\JAVA;%PATH%; set MIFOBASE=%MIFOVCBL% goto JUMPPATH :JUMPESTU set MIFOBASE=%MIFOESTU%\Base set MIFOBIN=%MIFOBASE%\bin set path=%BASESYS%\LOADLIB;%MIFOBASE%;%MIFOBIN%;%JAVASDK%;%BASEAPP%\JAVA;%PATH%; set CobCpy=%BASEAPP%\CobCpy1;%BASEAPP%\CobCpy2;%BASEAPP%\CobCpy6;%SimoLIBR%;%MIFOBASE%\SOURCE goto JUMPPATH :JUMPEMFE set MIFOBASE=%MIFOEMFE%\Base set MIFOBIN=%MIFOBASE%\bin set path=%BASESYS%\LOADLIB;%MIFOBASE%;%MIFOBIN%;%JAVASDK%;%BASEAPP%\JAVA;%PATH%; set CobCpy=%BASEAPP%\CobCpy1;%BASEAPP%\CobCpy2;%BASEAPP%\CobCpy6;%SimoLIBR%;%MIFOBASE%\SOURCE goto JUMPPATH rem * :JUMPPATH set SIMOPATH=Y rem * set MAINFRAME_FLOATING_POINT=true set COBIDY=%BASEAPP%\COBIDY set COBPATH=.;%BASEAPP%\LOADLIB;%BASEAPP%\LOADLIB\GNTS;%BASESYS%\LOADLIB;%SimoLIBR% set LIBPATH=.;%BASEAPP%\LOADLIB;%BASEAPP%\LOADLIB\GNTS;%BASESYS%\LOADLIB;%SimoLIBR% set TXDIR=%BASESYS%\LOADLIB;%MIFOBASE% set CobCpy=%BASEAPP%\CobCpy1;%BASEAPP%\CobCpy2;%BASEAPP%\CobCpy6;%SimoLIBR% rem * set USERCLASS=%BASELIB1%\LOADLIB set CLASSPATH=. set CLASSPATH=%CLASSPATH%;%JAVABASE% set CLASSPATH=%CLASSPATH%;%JAVABASE%\lib set CLASSPATH=%CLASSPATH%;\%USERCLASS%\simpacks set CLASSPATH=%CLASSPATH%;C:\APACHETC\apache-tomcat-7.0.52\webapps\simotcat\WEB-INF\classes set CLASSPATH=%CLASSPATH%;C:\APACHETC\apache-tomcat-7.0.52\webapps\simotcat\WEB-INF\classes\simpacks rem * if "%MIFOSYS1%" == "ESTU" set CLASSPATH=%CLASSPATH%;%MIFOBIN% if "%MIFOSYS1%" == "EDEV" set CLASSPATH=%CLASSPATH%;%MIFOEDEV% if "%MIFOSYS1%" == "VCBL" set CLASSPATH=%CLASSPATH%;%MIFOVCBL% if "%MIFOSYS1%" == "VCBL" set CLASSPATH=%CLASSPATH%;%MIFOVCBL%\bin\mfcobol.jar rem * set JobStatus=0000 call SIMONOTE "+ ENV1BASE is returning to caller" Display and Log MessagesThe following is a Windows CMD File (SIMONOTE.cmd) that is called to display a user message to the screen and post the message to a log file. This provides a consistent method for viewing a jobs progress during execution or reviewing the job results some time after the job has been executed. @echo OFF rem * ******************************************************************* rem * SIMONOTE.cmd - a Windows Command File * rem * This program is provided by SimoTime Technologies * rem * (C) Copyright 1987-2019 All Rights Reserved * rem * Web Site URL: http://www.simotime.com * rem * e-mail: helpdesk@simotime.com * rem * ******************************************************************* rem * rem * Text - Display message on screen and write to a log file. rem * Author - SimoTime Technologies rem * rem * This script may be called from other scripts and expects a single rem * parameter enclosed in double quotes. The double quotes will be rem * removed. Before writing to the log file a date and time stamp rem * will be inserted in front of the message text. rem * rem * Note: The tilde (~) removes leading/trailing double-quotes. rem * if "%SimoNOTE%" == "" set SimoNOTE=c:\SimoLIBR\LOGS\SimoTime.LOG echo %date% %time% %~1>> %SimoNOTE% echo %~1
SummaryThe primary objective of this test case is to describe and demonstrate how to compare (on a record-by-record basis) the content of two non-relational data structures such as a sequential file and/or a VSAM Data Set. This document may be used as a tutorial for new programmers or as a quick reference for experienced programmers. In the world of programming there are many ways to solve a problem. This documentation and software were developed and tested on systems that are configured for a SIMOTIME environment based on the hardware, operating systems, user requirements and security requirements. Therefore, adjustments may be needed to execute the jobs and programs when transferred to a system of a different architecture or configuration. SIMOTIME Services has experience in moving or sharing data or application processing across a variety of systems. For additional information about SIMOTIME Services or Technologies please contact us using the information in the Contact or Feedback section of this document.
Permission to use, copy, modify and distribute this software, documentation or training material for any purpose requires a fee to be paid to SimoTime Technologies. Once the fee is received by SimoTime the latest version of the software, documentation or training material will be delivered and a license will be granted for use within an enterprise, provided the SimoTime copyright notice appear on all copies of the software. The SimoTime name or Logo may not be used in any advertising or publicity pertaining to the use of the software without the written permission of SimoTime Technologies. SimoTime Technologies makes no warranty or representations about the suitability of the software, documentation or learning material for any purpose. It is provided "AS IS" without any expressed or implied warranty, including the implied warranties of merchantability, fitness for a particular purpose and non-infringement. SimoTime Technologies shall not be liable for any direct, indirect, special or consequential damages resulting from the loss of use, data or projects, whether in an action of contract or tort, arising out of or in connection with the use or performance of this software, documentation or training material. Downloads and LinksThis section includes links to documents with additional information that are beyond the scope and purpose of this document. The first group of documents may be available from a local system or via an internet connection, the second group of documents will require an internet connection. Note: A SimoTime License is required for the items to be made available on a local system or server. Current Server or Internet AccessThe following links may be to the current server or to the Internet. Note: The latest versions of the SimoTime Documents and Program Suites are available on the Internet and may be accessed using the icon. If a user has a SimoTime Enterprise License the Documents and Program Suites may be available on a local server and accessed using the icon. Explore How to Generate a Data File Convert Program using simple specification statements in a Process Control File (PCF). This link to the User Guide includes the information necessary to create a Process Control File and generate the COBOL programs that will do the actual data file conversion. The User Guide contains a list of the PCF statements that are used for the data file convert process. Explore How to Generate a Data File Compare, Validate or Hex-Dump Program using simple specification statements in a Process Control File (PCF). This link to the User Guide includes the information necessary to create a Process Control File and generate the COBOL programs that will do a data file compare, accumulate summary totals with a record count or produce a Hex-Dump of records in a VSAM, KSDS based on a list of user-defined keys. The User Guide contains a list of the PCF statements that are used for the data file compare, validate or dump process. Explore An Enterprise System Model that describes and demonstrates how Applications that were running on a Mainframe System and non-relational data that was located on the Mainframe System were copied and deployed in a Microsoft Windows environment with Micro Focus Enterprise Server. Explore the evolution of application software from conception to retirement. This document includes an overview of how to setup a Development, Test and Production environment on a Windows System using Micro Focus Enterprise Server. Explore the COBOL Connection for more examples of COBOL programming techniques and sample code. Explore The ASCII and EBCDIC Translation Tables. These tables are provided for individuals that need to better understand the bit structures and differences of the encoding formats. Explore The File Status Return Codes that are used to interpret the results of accessing VSAM data sets and/or QSAM files. Internet Access RequiredThe following links will require an internet connection. This suite of programs and documentation is available for download. Link to an Evaluation zPAK Option that includes the program members, documentation and control files. A good place to start is The SimoTime Home Page for access to white papers, program examples and product information. This link requires an Internet Connection Explore The Micro Focus Web Site for more information about products (including Micro Focus COBOL) and services available from Micro Focus. This link requires an Internet Connection. Glossary of TermsExplore the Glossary of Terms for a list of terms and definitions used in this suite of documents and white papers. Comments or FeedbackThis document was created and is maintained by SimoTime Technologies. If you have any questions, suggestions, comments or feedback please use the following contact information.
We appreciate hearing from you. Company OverviewSimoTime Technologies was founded in 1987 and is a privately owned company. We specialize in the creation and deployment of business applications using new or existing technologies and services. We have a team of individuals that understand the broad range of technologies being used in today's environments. Our customers include small businesses using Internet technologies to corporations using very large mainframe systems. Quite often, to reach larger markets or provide a higher level of service to existing customers it requires the newer Internet technologies to work in a complementary manner with existing corporate mainframe systems. We specialize in preparing applications and the associated data that are currently residing on a single platform to be distributed across a variety of platforms. Preparing the application programs will require the transfer of source members that will be compiled and deployed on the target platform. The data will need to be transferred between the systems and may need to be converted and validated at various stages within the process. SimoTime has the technology, services and experience to assist in the application and data management tasks involved with doing business in a multi-system environment. Whether you want to use the Internet to expand into new market segments or as a delivery vehicle for existing business functions simply give us a call or check the web site at http://www.simotime.com
|