The document outlines testing protocols for changes made to the RPR6320 Assurant transmission program. It describes testing at various levels, from unit testing using small test data to full regression testing against all production data. Key tests include: comparing output files from the new and current versions line by line; comparing system logs and comment table entries; and superc comparisons of source code and output files. Any differences found must be justified based on the intended program changes. The goal is to ensure the transmission accuracy is maintained before the new version is moved to production.
1 of 9
Download to read offline
More Related Content
Test Proofing Protocol - RPR6320 Assurant Xmit-a
1. Test Proofing Protocol
Batch Process: RPR6320 Assurant Daily SVP Sales/Refunds
DEVELOPED BY APPROVED BY
NAME Jon Fortman Tim Reagan
ROLE SME/Developer Asst. Dir.
2. Test Proofing Protocol RPR6320 Assurant Xmit
Jon Fortman audit for
RSPP New Program Launch [Recur Bill Email Sourcing]
Page 2 of 9
Abstract
For makingany change to thisprogram, itis imperativethatfull,non-compromisedtestingbe
performed. Inadditiontoproject-specifictestingscenarios,the followingtests scenarios mustalways
be performedwhenachange has occurredto thissource code unlessthe change isof a dire emergency.
To thislatterpoint,thisisnot a likelyscenario. The timingof thistransmissionisnotnearlyascritical as
that of the accuracy needed;itisimperativethatthisdatagoingto Assurantbe maintainedwith
precision. Beinglate butcorrectisa LOT lessexpensive,inthiscase, incontrasttobeingon timebut
withdamageddata. Fixingtransmissionsanddoingresendscanbe verycostly. The outputfile we send
to Assurantisthe only static datarecord of any kind thatrepresentsthis transmission. The DB2 sourcing
database isnot an official recordof thistransmissionbecause itisa living database. Side note:the
official database of recordresideswithAssurant.
3. Test Proofing Protocol RPR6320 Assurant Xmit
Jon Fortman audit for
RSPP New Program Launch [Recur Bill Email Sourcing]
Page 3 of 9
Duringdevelopmentandunittesting,youwill wanttouse small datafortestingspecificproject-related
testcases. Youwill needtocontrol thisbyfirstupdatingSVP_ITM_XMIT_DT in SVP_ITEMtosomething
otherthan NULL. Then goback and update the fieldwithNULLfor onlythose tktsyouwant to testwith.
A source code superc comparison listingmustbe performedbetweenthe currentproductionversion
of the source code and the newversion of the source code. The resultingdataset:
YOURACID.SUPERC.LISTshouldbe downloadedtoapropernetworkdirectory[probablythe project
folder] asa textfile. Thisshouldbe utilizedaspart of the code review.
RPR6320.JFORTM1.SUPERC.LIST placedinprojectfolder
Once you have completedproject-relatedtestscenarios,youthenmustdolargerA/Btype testing.
An A/B comparisonbetweenthe output of the current prod versionof the program and the output
of the newversionof the program must be performed. For thisbroadertesting,youwill utilizeall of
the tkts inthe Z db2 table environment. Typicallyinthe Zdb2 table environmentthere isagood
representationof differenttypesof transactions.
Compile andbindthe prodversionof the program. Run thisagainstall Z db2 data andcapture
the outputfile inan appropriate name.
CSVDQ.RS.RPR6320.CURRPROD.SEP13
Compile andbindthe new versionof the program. Runthisagainstall Z db2 data and capture
the outputfile inan appropriate name differentfromthatof the prod versionfile name.
CSVDQ.RS.RPR6320.ESC
OpentwosessionsinTSO. On one sessionbrowse the prodfileandonthe othersessionbrowse
the testfile.
PASS-The physical reccounts should be identical unlessyourchangesare intended to
eliminateoraddrecords to the output. If your changesare not intended toreduce or
add recordsto the outputthenyou mustfindoutwhythe rec countsare different.
According to the requirementsof the project,no addition to or reduction of the rec count
wasexpected.
TEST:
-IPT- BROWSE CSVDQ.RS.RPR6320.ESC Line 00043493
Command ===> Scrol
TRL00000434930060067720O0003346342A0018344666{0001182893E0000120802G
** Bottom of Data
PROD:
-IPT- BROWSE CSVDQ.RS.RPR6320.CURRPROD.SEP13 Line 00043493
Command ===> Scrol
TRL00000434930060067720O0003346342A0018344666{0001182893E0000120837I
4. Test Proofing Protocol RPR6320 Assurant Xmit
Jon Fortman audit for
RSPP New Program Launch [Recur Bill Email Sourcing]
Page 4 of 9
Failed- The totals in the fieldsinthe TRL rec shouldbe identicalunlessyourchanges
are intended toresultinthe totalsbeingreducedorincreased. If yourchangesare not
intended toincrease orreduce these totals,thenyoumustfindoutwhythere isa
difference.
Service plansalestax total amountsdonot match.
Test:
-IPT- BROWSE CSVDQ.RS.RPR6320.ESC Line
00043493
Command ===> Scrol
RL00000434930060067720O0003346342A0018344666{0001182893E0000120802G
DDFFFFFFFFFFFFFFFFFFFFDFFFFFFFFFFCFFFFFFFFFFCFFFFFFFFFFCFFFFFFFFFFC
9300000434930060067720600033463421001834466600001182893500001208027
Prod:
-IPT- BROWSE CSVDQ.RS.RPR6320.CURRPROD.SEP13 Line
00043493
Command ===>
Scrol
TRL00000434930060067720O0003346342A0018344666{0001182893E0000120837I
EDDFFFFFFFFFFFFFFFFFFFFDFFFFFFFFFFCFFFFFFFFFFCFFFFFFFFFFCFFFFFFFFFFC
39300000434930060067720600033463421001834466600001182893500001208379
FAILED - An output superc compare listingshould be runbetweenthe outputfile
producedbythe current versionof the programand the outputfile producedbyyour
newversionof the program.
The superc shouldonlyfindthe HDRrecs beingdifferent due tothe systemdate and
timestamps. If otherrecsare founddifferentthenyoumustfindoutwhyandjustifythe
difference. The resultingdataset: YOURACID.SUPERC.LISTshouldbe downloadedtoa
propernetworkdirectory[probablythe projectfolder] asa textfile. Thisshouldbe
utilizedaspartof the code review.
531 TOTAL CHANGES
Newprogramis outputtinghex zeroesforsome email fieldswhere the email isnot
available. Itneedstoalwaysoutputspacesformissingemailaddresses tobe consistent
withthe way all otheralphanumericfieldsare beingoutputonthe file.
New:
5. Test Proofing Protocol RPR6320 Assurant Xmit
Jon Fortman audit for
RSPP New Program Launch [Recur Bill Email Sourcing]
Page 5 of 9
Curr:
Differencesfoundinthe name/addrIbelieveare because Deborahnoticedthatthe
cust_addnl cursor wasonlyfetchingthe firstrow inthe curr prodversionof the
program. She changedthat topick onlythe MDSE row. We needto be sure thisis the
cause of the differences. However,dowe know forsure in prod that the MDSE row is
the one that will alwayshave the bestinfo?
6. Test Proofing Protocol RPR6320 Assurant Xmit
Jon Fortman audit for
RSPP New Program Launch [Recur Bill Email Sourcing]
Page 6 of 9
FAILED-The sysoutlogs fromthe prod and new versionsare tobe capturedand stored
inthe projectfolderandshouldbe identical betweenthe tworunsunlessyourchanges
are intended toalterthe totaling. If yourchangesare not intended toalterthe totaling,
thenyouneedto investigatethe differencesandmake appropriate changestothe
program.
PROD:
**
* R P R 6 3 2 0 *
**
==================
PARM INPUT VALUES:
==================
DATEBACK=CURDATERUN
WS-TARGET-DATE SET AS: 09/13/2013
EXTRACTING SALES/REFUNDS WITH SLTKT_DT < 09/13/2013
****
* R P R 6 3 2 0 *
****
42790 TOTAL CURSOR FETCHES
121 CONTRACTS MARKED FOR HOLDUP AND REVIEW (QUERIED AND FETCHED BUT
NO REC
DTL REC TYPE *
42103 TOTAL NON-VALUE-DEAL NON-RECUR-BILL-EXTENSION DTL RECS WRITTEN
566 TOTAL VALUE-DEAL-RVH DTL RECS WRITTEN
5 TOTAL RECUR BILL CONTRACT EXTENSIONS WRITTEN
-------
42674 SUBTOTAL DTL RECS (SHOULD MATCH RPR6321 PROCESSING)
817 TOTAL VALUE-DEAL-RVD DTL RECS WRITTEN
MISCELLANEOUS INFO
7. Test Proofing Protocol RPR6320 Assurant Xmit
Jon Fortman audit for
RSPP New Program Launch [Recur Bill Email Sourcing]
Page 7 of 9
745 TOTAL STAND-ALONE RSSPS FOUND
42045 TOTAL NON-STAND-ALONE RSSPS FOUND
19282 TOTAL CUST_ADDNL RETRIEVALS DONE
443 TOTAL RECURRING BILLING SALES FOUND
139 TOTAL RECURRING BILLING REFUNDS FOUND
17 WIRELESS PREMIUM PROTECTION PLANS (SALES AND REFUNDS)
191 IPHONE TRADE GUARANTEE PLANS (SALES AND REFUNDS)
** HDR+DTL+TRL REC TYPES TOTAL
1 HDR REC TYPE WRITTEN
1 TRL REC TYPE WRITTEN
43493 TOTAL RECS WRITTEN
NEW:
**
* R P R 6 3 2 0 *
**
==================
PARM INPUT VALUES:
==================
DATEBACK=CURDATERUN
WS-TARGET-DATE SET AS: 09/13/2013
EXTRACTING SALES/REFUNDS WITH SLTKT_DT < 09/13/2013
****
* R P R 6 3 2 0 *
****
42790 TOTAL CURSOR FETCHES
121 CONTRACTS MARKED FOR HOLDUP AND REVIEW (QUERIED AND FETCHED BUT
NO REC
DTL REC TYPE *
42103 TOTAL NON-VALUE-DEAL NON-RECUR-BILL-EXTENSION DTL RECS WRITTEN
566 TOTAL VALUE-DEAL-RVH DTL RECS WRITTEN
5 TOTAL RECUR BILL CONTRACT EXTENSIONS WRITTEN
-------
42674 SUBTOTAL DTL RECS (SHOULD MATCH RPR6321 PROCESSING)
817 TOTAL VALUE-DEAL-RVD DTL RECS WRITTEN
MISCELLANEOUS INFO
745 TOTAL STAND-ALONE RSSPS FOUND
42045 TOTAL NON-STAND-ALONE RSSPS FOUND
19275 TOTAL CUST_ADDNL RETRIEVALS DONE
443 TOTAL RECURRING BILLING SALES FOUND
139 TOTAL RECURRING BILLING REFUNDS FOUND
17 WIRELESS PREMIUM PROTECTION PLANS (SALES AND REFUNDS)
191 IPHONE TRADE GUARANTEE PLANS (SALES AND REFUNDS)
** HDR+DTL+TRL REC TYPES TOTAL
1 HDR REC TYPE WRITTEN
1 TRL REC TYPE WRITTEN
43493 TOTAL RECS WRITTEN
8. Test Proofing Protocol RPR6320 Assurant Xmit
Jon Fortman audit for
RSPP New Program Launch [Recur Bill Email Sourcing]
Page 8 of 9
PASS-Markedforholdup/review: thisprogramwill markcontracts forholdup/review
by populatingSVP_ITM_XMIT_DTinSVP_ITEMwithspecial dates. i.e.12/31/5555 or
12/31/6666. You will needtoverifythatthe currentprodversionof the program and
your newversionare insyncinterms of what eachversionmarksforreview ordoesnot
mark for review. If there are differencesinthisactivity,thenyoumustfindoutwhyand
justifythe differences.
Newandoldversions: 121 CONTRACTS MARKED FOR HOLDUP AND REVIEW
PASS-<F11>Notes:thisprogramwill insertrowsintodb2table CSP.CMNT_LINEfor
certainactivitiesperformedwithinthe programsprocessingsuchasmarkingcontracts
for holdup/review. These rowscanbe viewedinthe service planCICS screenswhen
viewingservice plantktsbyaccessingthe <F11>Notespanel. Youwill needtoverifythat
the current prodversionof the program andyour new versionare insyncin termsof
whateach versioninsertsintothistable. If thisactivityisnotidentical,youmustfind
out whyand justifythe difference.
Prod:
SELECT
SVP_CNTL_ID ,-- =' '
SVP_DROP_ID ,-- =' '
ROW_LAST_MAINT_TMS ,-- ='
ROW_LST_MAINT_INTL ,-- =' '
SVP_CMNT_DESC -- ='
FROM CSZ.CMNT_LINE
WHERE
ROW_LAST_MAINT_TMS BETWEEN '2013-09-13-00.00.00.000000'
AND '2013-12-31-23.59.59.000000'
ORDER BY
ROW_LAST_MAINT_TMS
NUMBER OF ROWS SELECTED 330
Test:
SELECT
SVP_CNTL_ID ,-- =' '
SVP_DROP_ID ,-- =' '
ROW_LAST_MAINT_TMS ,-- ='
ROW_LST_MAINT_INTL ,-- =' '
SVP_CMNT_DESC -- ='
FROM CSZ.CMNT_LINE
WHERE
ROW_LAST_MAINT_TMS BETWEEN '2013-09-13-00.00.00.000000'
AND '2013-12-31-23.59.59.000000'
ORDER BY
ROW_LAST_MAINT_TMS
9. Test Proofing Protocol RPR6320 Assurant Xmit
Jon Fortman audit for
RSPP New Program Launch [Recur Bill Email Sourcing]
Page 9 of 9
NUMBER OF ROWS SELECTED 330