ISRSTM Summit - User Training ISRS TM P roduct Cent entre re
Agenda
Agenda
Introduction
The The purpose ose of this cou course is to provid ovide e User Users with ith the knowle owled dge and and skil skills ls to use the ISRS Summit software. ISRS Summit uses the new Summit 2.0 platform which is built on Microsoft .NET internet technology. ISRS Summit
ISRS IS RS Summ Summit Web application (online only)
ISRS IS RS Summ Summit Recording ecording Tool (online or offline)
ISR IS R S Summ ummit has two two parts. parts. The web web application is used used to to create new organisations, new assess ass essm ments, and for analysis and reporting reporting of results. The “Recording Tool” Tool” is used used during during an audit for capturing capturing scores scores and comm comments. ents. The web web application must must be used online. The Recording Tool can be used offline for example when at the client’s premises. All the data from internal and external audits is stored and continuously backed up on a secure data data centre centre in DNV Oslo. Os lo. In the fut future ure this this will be used used for new benchmarking benchmarking services services..
Work Process Overview Web Application: 1.Create Project 2.Create Assessment 3.Scope, language, aspects, level 4.Prepare for checkout
Recor ding Tool : 5.Check out 6. Detailed scoping 7.Check in
8. Print protocol report 9.Assign project assessors 10.Split Assessment
12. Check out
11.Prepare fro Checkout
13.Enter Scores and Notes 14.Upload Assessment
16. Analyse Results 17. Generate Report
15.Check-In Assessment
ISRS Training & Production Database
The difference between the Summit Training Database and Production Database:
Summit Training Database is used for training courses or marketing. Please click the following link: https://summittraining.dnv.com
Summit production database is the real assessment. Please click the following link: https://summit.dnv.com (Note: Use database carefully!)
Logging in to ISRS Summit
Enter the web address for ISRS Summit (see above) into your internet browser and add to your ‘Favourites’ list. Your ISRS Summit super user will have provided you with your ‘’Login ID’ and password, enter these details on the ‘Log In’ page.
ISRS Summit – Home page 1.Home page tab
2. Assessment tool tab
8. ISRS Licence Agreement hyperlink
3. Organisations tab
9. ISRS Book of Knowledge hyperlink
4. User profile tab
10. Email us hyperlink
5. Select language
6. Logout ‘button’
7. Help ‘button’
Create Assessment – New Project
Log in to ISRS Summit.
Click the Assessment Tool tab.
Complete the New Project Fields with values of your choice.
Click Add.
The new project will be displayed under the projects tab, from where the assessments can be created.
Create Assessment – New Assessments
Your Assessment Project appears in the list on the left, click its title.
Assessment projects contain one or more Assessments.
Complete the New Assessment field on the right with an assessment name of your choice, click Add Assessment.
Your new assessment will appear in the list of assessments on the left. Click its title to continue its creation.
Create Assessment – Scoping Assessments
If you chose Level Scoring, pick your desired level from the drop down list:
If you chose Custom Scoring, assign property constraints you can proceed and have free selection over Process and Sub process content of assessment. Or you can choose to Select Question Properties’ constraints:
Create Assessment – Checkout and Launch
Now that your assessment is scoped, click the Prepare For Checkout button.
To perform the assessment and record findings electronically, click the Launch Recording Tool button.
…clicking Launch Recording Tool begins the installation of the Summit recording tool, or if the tool is already installed, the tool will simply launch after the system first checks for updates to the software.
No admin rights are required to install the recording tool.
Once the installation / launch is complete, you are asked to log in to the Recording Tool. Enter your ISRS Summit login details
Team Assessments in ISRS Summit
Add the team members as assessors for a specific project by using the New Assessor section on Project Assessors. The Project Responsible assigns control of assessments to the Project Assessor. A Project Assessor can only have control of the assessment if this has been designated by the Project Responsible.
To assign control of the assessment the Project Responsible must Ensure whoever has control of the assessment has checked it in. Select the particular assessment to be reassigned. Select Scoping / Assign to, and from the drop down menu select the name of the desired Project Assessor. Select “Prepare for checkout."
The designated Project Assessor is now able to check out the assessment to continue working on it.
Split Assessment
In order to enable multiple assessors to carryout different sections of the assessment simultaneously, ISRS Summit has an inbuilt “Split Assessment” functionality. The entire assessment can be split by assigning the scoped processes and subprocesses to the available assessors.
Sub-Assessments can be created after selecting the split assessment button.
Each sub-assessment can be assigned. to different assessors based on requirement.
Split Assessment – Scoping
The scoping of the assessment cannot be modified or altered once it is split for the assessors. So scoping should be completed before the assessment is split.
To ensure that the user is aware of this, a warning message is displayed when the split assessment is selected.
New sub-assessments can be created once splitting the assessment.
Split Assessment – Sub-assessments
Press the Edit button to assign a sub-assessment to an assessor in the project team. Only the processes and sub-processes that are part of the selected scope are available for assigning to different assessors. The Project Responsible can assign different processes / sub-processes to be part of a sub-assessment. Once one or more of the sub-assessments are checked-in, the reporting system of ISRS Summit automatically picks up the score and consolidates a single report for the whole assessment.
Recording tool – Checkout assessments
Once logged in, the Summit recording tool offers you the Manage Assessments window.
Find your Assessment in the list and click the Check Out link. Clicking this link downloads the scoped question set from the central Summit server to your local laptop / machine.
Once checked out, the assessment is available on your PC, so that it can be worked on offline.
Click the Assessment’s name to open your assessment for scoring.
Recording tool – Scoring assessments
A new screen will appear with your assessment ready to score.
You are now working offline, until you “check in” back to the server.
You may now add Scores, Suggestions for Improvement, Noteworthy Efforts, and Evidence for each question.
You may now flag certain Noteworthy efforts or verifications to highlight them in the report.
It is always a good practice to save the assessment regularly by selecting “Save.”
Recording tool – Scoring options
Edit the Process and Sub-process scope of the assessment using the tree. - Note the locked sub process for Level scoped assessments are marked with “padlocks.” - Note how Possible Points changes as sub processes are added and removed from scope.
Scoring the 5 question types: - Yes No (XO) e.g., question 1.1.1 in ISRS 8th Ed. - Professional J udgement (PJ ) e.g., question 1.1.2 in ISRS 8 th Ed. - Part Whole List (P/W) e.g., question 1.2.1 in ISRS 8th Ed. - Frequency (F) e.g., question 7.5.2 in ISRS 8 th Ed. - Percentage (%) e.g., question 2.3.5 in ISRS 8 th Ed.
Score multiple entry question with MAX or ZERO fields for speed.
Marking questions N/A. Possible points remains the same, Available points are reduced.
Recording tool – Scoring assistance
While scoring, the assessor can Review Guidelines tab at the bottom of the screen. Enter Evidence in the tab at the bottom of the screen. Enter Suggestion and flag as Key Suggestion. Enter a Noteworthy Effort and flag as a Key Noteworthy Effort. - Enter Verification Note and flag as Verified. - Apply Filters to assist the work process, e.g., Have all questions been answered? - Use the Find Tool to search all fields in the assessment and notes you have entered. -
At any time, when you are online you use the Manage Assessments tool to Upload your assessment to the ISRS Summit central server.
EXTREME CAUTION – In Manage Assessments you may use Undo Changes to delete all scores and notes since the last checkout. There is a warning message that must be confirmed before it deletes all your scores!
To complete the process of entering scores and notes, click the Check In link in the Manage Assessments tool. When Check In is complete, you can close the Summit Recording Tool.
Manage Assessment There are 3 ways to manage / save assessment data in the ISRS Summit Recording Tool 1. Press “Save” button. Users are encouraged to press this periodically to save data within their local Recording tool application.
2. “Check in” or “Upload” assessment in Manage Assessments. If connected to the internet, users are encouraged to do this periodically to save data on the DNV server. If successful, a message appears in the Manage Assessments window confirming upload / check in has been successful.
3. Backup data using “File” / “Backup.” Users are encouraged to do this periodically if they are not able to “upload” data or if they are concerned about data loss. This procedure creates a zip file of assessment on a local drive which the user can “Restore” later if required or can be used by DNV for trouble shooting. See help files for more information.
Analysis – Summary
Return to ISRS Summit web appl icatio n - https://summittraining.dnv.com - Click the Assessment Tool tab Note: ISRS Summit will send you an email to notify you that your assessment has been check in. You can click the link in this notification email to browse directly to the assessment, via the log in screen.
Summary Section - This provides you with a summary graph of your assessment scores. It gives you a very
quick overview of your assessment. - This section shows you a histogram of the % scores achieved (awarded / available x 100) at the process level.
Analysis – Detailed
Expand the Analysis area of the Assessment’s page. The analysis tool allows you to build your own graphs by dragging and dropping objects onto the graphs axes such as Aspects, Question Properties and Sub-Processes.
Click the properties button to change graph type, colours legends etc.
Advanced reporting features described in the online help files.
Analysis – Reporting
Expand the Reporting area of the Assessment’s page.
Verify the email address to which the report needs to be sent.
Select required type of report and then “Generate Report.”
The report will now be emailed.
Analysis – Types of reports
You can create the following reports, which will be emailed to you by ISRS Summit:
Assessment Report
An executive report of summary scores, graphs and notes of the completed assessment.
Workbook Report
A fully detailed report of all scores and notes on every question in your assessment.
Protocol Report
A detailed .pdf report resembling the ISRS protocol with all the guidance, evidences.
Benchmarking – Assessments
ISRS Summit allows the user to compare and contrast the performance of its units based on the various assessments carried out at their units.
Benchmarking places a certain assessment among the range of the other assessments to be compared against.
In order to select a project for benchmarking, the “Benchmark” option has to be selected in the Assessment page.
The benchmarking process is carried out under the “Benchmarking” tab.
Benchmarking – Comparison The benchmarking screen is divided into three sections.
The details of the assessment that needs to be compared.
The analysis section which compares the assessment with the available sample set of data and gives the following graphs: • Performance summary graph • Performance overview graph • Performance analysis graph.
The sample set of assessments available to the assessor (based on his access rights). Options to the user to customise the sample set based on Region, Employees, Industry, etc.
Benchmarking – Performance Summary
The performance summary graph compares the overall performance of the unit with respect to the other units that are selected.
The range from the scores of the other units are represented and the score of the selected assessment is marked on the range to point out the relative position.
Range of scores from the organisation’s units.
Score of the selected assessment.
Range of scores from the sample set.
Benchmarking – Overview
Performance overview shows the comparison of the different processes in the assessment against the available data.
Benchmarking – Analysis
Performance analysis compares all the sub-process of the selected process for the assessment. The user can then select various processes to understand the sub-process level comparison.
Benchmarking – Help
Please refer to the help files in ISRS Summit for more information such as the calculation formula for comparison, etc.
