Wsi Ug01 Cis

CIS NG 1.1 User Guide

WSI_UG01_CIS

© WorldSkills International Secretariat Keizersgracht 62-64, 1015 CS Amsterdam, The Netherlands www.worldskills.org,, Tel: +31 23 5311071, Fax: +31 23 5310816 www.worldskills.org

1 of 89

Table of Contents 1

Introduction ..................................................................................................................... ................................................................................................................................................. ............................ 6

2

Installation ...................................................... ...................................................................................................................... ............................................................................................ ............................ 7 2.1 Windows Installation .................................................................................... .......................................................................................................................... ...................................... 7 2.1.1 Database...................................................... Database...................................................................................................................... .................................................................................. .................. 7 2.1.2

Download Installer Package ................................................................................ .......................................................................................................... .......................... 7

2.1.3

Start the Installer ...................................................... ...................................................................................................................... ...................................................................... ...... 7

2.1.4

Install JDK (bundled downloads only) ........................................................................................... ........................................................................................... 8

2.1.5

CIS NG Installation Welcome Screen ...................................................... ............................................................................................ ...................................... 8

2.1.6

Choose Installation Path .................................................... ................................................................................................................ ............................................................ 9

2.1.7

Installation Packs ............................................................ ........................................................................................................................... ............................................................... 9

2.1.8

New CIS NG Instance ....................................................... .................................................................................................................. ........................................................... 10

2.1.9

Server Settings ....................................................................................................................... ............................................................................................................................ ..... 11

2.1.10

Instance Settings .................................................................................................................. ..................................................................................................................... ... 12

2.1.11

Admin User ................................................. ................................................................................................................. ............................................................................. ............. 13

2.1.12

Installation of Files ........................................................................ ................................................................................................................... ........................................... 13

2.1.13

Processing ............................................................................................................................... ............................................................................................................................... 14

2.1.14

Shortcuts ............................................................................................................ .................................................................................................................................. ...................... 14

2.1.15

New Instance URL ................................................ ................................................................................................................ ................................................................... ... 15

2.1.16

Installation Complete ............................................................................................................. ............................................................................................................... .. 16

2.2 Linux Installation ......................................................................................................... .............................................................................................................................. ..................... 17 2.2.1 GUI Installation ....................................................................................................................... ............................................................................................................................ ..... 17 2.2.2

Console installation ................................................... ................................................................................................................... ................................................................... ... 18

2.2.3

Installation Path ...................................................................................................................... ........................................................................................................................... ..... 18

2.2.4

Ports on Linux ................................................. ................................................................................................................ ............................................................................. .............. 18

2.3 Upgrading an existing installation ..................................................... .................................................................................................... ............................................... 19 2.3.1 New Permissions ..................................................................................... ......................................................................................................................... .................................... 19 2.4 Adding Another CIS NG Instance ..................................................... .................................................................................................... ............................................... 19 2.4.1 New Database or Existing Database ....................................................... ........................................................................................... .................................... 19 2.4.2

Configuration Details ................................................ ................................................................................................................ ................................................................... ... 20

2.5 Configuration File ........................................................ ....................................................................................................................... ..................................................................... ...... 21 2.5.1 Port .................................................... .................................................................................................................... .......................................................................................... .......................... 22

3

2.5.2

Version ......................................................................................................... ......................................................................................................................................... ................................ 22

2.5.3

Build Number .......................................................................................................... ............................................................................................................................... ..................... 22

2.5.4

Shutdown Configur ation .............................................................................................................. .............................................................................................................. 22

2.5.5

Instance Configuration ....................................................... ................................................................................................................. .......................................................... 22

Starting/Stopping CIS NG ........................................................................................................................ ........................................................................................................................ 23 3.1 3.2 3.3 3.4 3.5

Windows Startup ................................................. ................................................................................................................. ............................................................................. ............. 23 Linux Startup ..................................................... ..................................................................................................................... ............................................................................... ............... 23 Shutting down CIS NG.................................................. .................................................................................................................. ................................................................... ... 23 Log Files .......................................................................................................................... .......................................................................................................................................... ................ 24 Troubleshooting ............................................................................................................................... ............................................................................................................................... 24

CIS NG User Guide WSI_UG01_CIS

Version: 1.4 Date: 16.11.11

2 of 89

3.5.1 4

Server won’t start ..................................................... ..................................................................................................................... .................................................................... .... 24

Setting Up The Competition ..................................................................................................................... ..................................................................................................................... 25 4.1 Logging in ........................................................................................................................................ ........................................................................................................................................ 25 4.2 CIS NG Homepage ...................................................... ...................................................................................................................... .................................................................... .... 26 4.3 Changing Password..................................................... ..................................................................................................................... .................................................................... .... 27 4.4 Config Screen ........................................................................................... .................................................................................................................................. ....................................... 27 4.4.1 Competition Name ................................................................................... ....................................................................................................................... .................................... 27 4.4.2

File System Path for Images................................................ ........................................................................................................ ........................................................ 27

4.4.3

URL of Help System .................................................................................................................... .................................................................................................................... 28

4.4.4

Secondary Logo ...................................................... ...................................................................................................................... ..................................................................... ..... 28

4.4.5

Sort Competitors by .......................................................... ..................................................................................................................... ........................................................... 28

4.4.6

Unicode Font List ..................................................... ..................................................................................................................... .................................................................... .... 28

4.4.7

Allow Multi-Skill Competition................................................ ........................................................................................................ ........................................................ 28

4.4.8

Include Multi-Skill Marks in Member Comparison Reports ...................................................... .......................................................... .... 28

4.4.9

Include Multi-Skill Medals in Member Comparison Reports .................................................... ........................................................ .... 28

4.4.10

Gold Medal Points ................................................................................................................... ................................................................................................................... 29

4.4.11

Silver Medal Points ........................................................................ .................................................................................................................. .......................................... 29

4.4.12

Bronze Medal Points ...................................................... ................................................................................................................ .......................................................... 29

4.4.13

Medallion for Excellence Medal Points ................................................. .................................................................................... ................................... 29

4.5 Setting Competition Dates .............................................................................................................. ................................................................................................................ 29 4.6 User Groups and permissions per missions ................................................. ......................................................................................................... ........................................................ 30 4.7 Positions .......................................................................................................................................... .......................................................................................................................................... 31 4.8 Members .......................................................................................................................... .......................................................................................................................................... ................ 32 4.9 Subjective Judging Rules ................................................................................................................ ................................................................................................................ 33 5 Adding Skill Information ....................................................... ....................................................................................................................... ..................................................................... ..... 34 5.1 Skills & Skill Rules ........................................................................................................................... ........................................................................................................................... 34 5.1.1 Skill Number .................................................. .................................................................................................................. .............................................................................. .............. 34 5.1.2

Name ........................................................................................................................................... ........................................................................................................................................... 34

5.1.3

Subjective Marking Rule Group .................................................................................... ................................................................................................... ............... 35

5.1.4

Identify The Judge When Entering A Score ................................................................................ ................................................................................ 35

5.1.5

Competitors Are Organised Orga nised In Groups .................................................................................... ........................................................................................ .... 35

5.1.6

Allow Compatriot Marking .................................................... ............................................................................................................ ........................................................ 35

5.1.7

Allow to generate a landscape marking form ............................................................................. ............................................................................... 35

5.1.8

Generate 500 Scale Marks And Medals ................................................... ...................................................................................... ................................... 35

5.1.9

Exclude From Member Results Comparison ..................................................... ............................................................................... .......................... 35

5.1.10

Prevent Further Editing Of Marking Scheme ................................................... ........................................................................... ........................ 35

5.2 Adding People To CIS NG ...................................................... ............................................................................................................... ......................................................... 36 5.2.1 Picture .......................................................................................................... .......................................................................................................................................... ................................ 36 5.2.2

Positions ...................................................................................................................................... ...................................................................................................................................... 36

5.2.3

Exclude From Final Results ................................................. ......................................................................................................... ........................................................ 36

5.2.4

Username and Password ............................................................................................................ ............................................................................................................ 37

5.2.5

User Group .................................................................................................................................. .................................................................................................................................. 37

5.2.6

Language .............................................................................................................................. ..................................................................................................................................... ....... 37

5.2.7

Importing From a File ................................................ ................................................................................................................ ................................................................... ... 37



3 of 89

5.3 Searching For People ........................................................... ...................................................................................................................... ........................................................... 38 5.4 Creating Teams .................................................................................................................. ............................................................................................................................... ............. 39 5.5 Deleting people .......................................................................... ................................................................................................................................ ...................................................... 40 6 Entering The Marking Scheme ....................................................... ................................................................................................................. .......................................................... 41 6.1 Entering Criteria .......................................................................... ............................................................................................................................... ..................................................... 41 6.2 Adding a Sub Criterion .................................................. .................................................................................................................. ................................................................... ... 42 6.3 Adding Subjective Aspects ..................................................... .............................................................................................................. ......................................................... 44 6.4 Adding Objective Aspects ...................................................... ................................................................................................................ .......................................................... 45 6.5 Moving Aspects ................................................. ................................................................................................................. .............................................................................. .............. 46 6.6 Objective Marking Types ............................................................................... ................................................................................................................. .................................. 47 6.6.1 Direct Mark Entry ......................................................................................................................... ......................................................................................................................... 47 6.6.2

Ranged Score ........................................................ ........................................................................................................................ ...................................................................... ...... 47

6.6.3

Percent Score Comparison.................................................. .......................................................................................................... ........................................................ 48

6.6.4

Stepped Score Comparison................................................. Comparison......................................................................................................... ........................................................ 48

6.7 Importing Data .......................................................................................................................... ................................................................................................................................. ....... 51 6.7.1 Importing a Marking Scheme ....................................................... ....................................................................................................... ................................................ 51 6.7.2

Importing People ...................................................... ...................................................................................................................... .................................................................... .... 52

6.7.3

Importing Members ................................................... ................................................................................................................... ................................................................... ... 53

6.8 Setting Marking Days................................................... ................................................................................................................... .................................................................... .... 55 6.8.1 Specific Day ........................................................................... ................................................................................................................................. ...................................................... 55 6.8.2

Any Day ............................................................... ............................................................................................................................... ........................................................................ ........ 55

6.8.3

Per Competitor ........................................................ ........................................................................................................................ ..................................................................... ..... 55

6.9 Locking a Marking Scheme ............................................................................................................. ............................................................................................................. 56 6.10 Checking That Skills Are Ready For Mark Entry .................................................... ............................................................................. ......................... 57 6.11 Marking Forms ........................................................... ........................................................................................................................... ...................................................................... ...... 58 6.11.1 Blank Forms ........................................................ ........................................................................................................................ ..................................................................... ..... 58

7

6.11.2

Marking Forms With Aspects .................................................... ................................................................................................... ............................................... 60

6.11.3

Marking Forms for Hand-Written Marks .................................................................................. .................................................................................. 62

6.11.4

Landscape Forms for Hand-Written Marks ..................................................... .............................................................................. ......................... 63

6.11.5

Marking Forms With Aspects And Marks ................................................................................ ................................................................................ 64

6.11.6

Signoff Form for Marking Scheme .............................................................. ........................................................................................... ............................. 66

6.11.7

Signoff Form for Mark Entry ...................................................... ..................................................................................................... ............................................... 67

Multi-Skills ................................................................................................................................................ ................................................................................................................................................ 68 7.1 Activating Multi-Skill functionality ...................................................... ..................................................................................................... ............................................... 68 7.2 Creating a Multi-Skill .................................................... .................................................................................................................... .................................................................... .... 69 7.3 Multi-Skill Teams ........................................................ ....................................................................................................................... ..................................................................... ...... 70 7.4 Multi-Skill Results ....................................................... ...................................................................................................................... ..................................................................... ...... 71 7.4.1 100 Scale Marks ............................................................. .......................................................................................................................... ............................................................. 71 7.4.2

8

500 Scale Marks ............................................................. .......................................................................................................................... ............................................................. 71

During the Competition ........................................................ ........................................................................................................................ ..................................................................... ..... 72 8.1 Manage Application ..................................................................................................................... ......................................................................................................................... .... 72 8.2 Entering Marks ................................................... ................................................................................................................... .............................................................................. .............. 73 8.2.1 Competitor Information ................................................................................................................ ................................................................................................................ 73 8.2.2

Sub Criterion Selection ...................................................... ................................................................................................................ .......................................................... 74

8.2.3

Objective Mark Entry ................................................................................................................... ................................................................................................................... 74

8.2.4

Subjective Mark Entry ........................................................ .................................................................................................................. .......................................................... 76

8.3

Marking Progress and Missing Marks ............................................................................................. ............................................................................................. 77



4 of 89

9

8.3.1

Marked Aspects Report ............................................................................................. ............................................................................................................... .................. 77

8.3.2

Missing Marks Report ........................................................................ .................................................................................................................. .......................................... 78

8.4 Locking Marks ................................................... ................................................................................................................... ............................................................................... ............... 79 After Mark Entry ................................................ ................................................................................................................ ........................................................................................ ........................ 80 9.1 Viewing Marks .................................................. .................................................................................................................. ............................................................................... ............... 80 9.2 500 Scale Marks & Medals ............................................................................. .............................................................................................................. ................................. 81 9.3 Competitor Certificates ................................................................................................................. .................................................................................................................... ... 82 9.4 Exporting Data ........................................................................................................... ................................................................................................................................. ...................... 83 9.4.1 Exporting a Marking Scheme....................................................................................................... Scheme....................................................................................................... 83

10

9.4.2

Exporting People ..................................................... ..................................................................................................................... .................................................................... .... 83

9.4.3

Exporting Members................................................... ................................................................................................................... ................................................................... ... 83

9.4.4

Exporting Results ..................................................... ..................................................................................................................... .................................................................... .... 83

Reports ................................................................................................................................................ ................................................................................................................................................ 84

10.1 Experts Head to Head ..................................................................................................................... ..................................................................................................................... 84 10.2 Marks by Single Expert ......................................................................... .................................................................................................................... ........................................... 85 10.3 Analysis of Experts ...................................................... ...................................................................................................................... .................................................................... .... 85 10.4 Skills Comparison ....................................................................................... ............................................................................................................................ ..................................... 86 10.5 Proportion of Objective to Subjective .............................................................................................. .............................................................................................. 86 10.6 Range of Marks ............................................................................................................................... ............................................................................................................................... 87 10.7 Albert Vidal Award ....................................................... ....................................................................................................................... .................................................................... .... 88 10.8 Member Comparison ................................................................................................................... ....................................................................................................................... .... 88 10.9 Member Medal Totals ........................................................................... ...................................................................................................................... ........................................... 88 10.10 Official Results ........................................................................ ............................................................................................................................. ..................................................... 89 10.11 Mark Entry Times..................................................... ..................................................................................................................... .................................................................... .... 89



5 of 89

1

INTRODUCTION CIS NG is the Next Generation of the Competition Information System (CIS) software. It has been rewritten from the ground up to provide a better user experience, as well as better performance and stability. The software handles many of the tasks involved in running a WorldSkills Competition, including creating marking schemes, holding Competitor information, storing Competitors’ marks, producing medal results and many other activities. This document will guide you through the installation and use of CIS NG. It details functions of the software in chronological order of when they would most likely be used, not necessarily in the order they appear in the menu.



6 of 89

2

INSTALLATION

2.1 Window s Installatio n 2.1.1

Database CIS NG gives you the choice of two different databases that can be used – MySQL or H2. The MySQL database has the advantage of being a well-known and well-supported database with many third party tools available for doing backups and other maintenance. If you wish to use MySQL with CIS NG you must install it separately prior to installing CIS NG. The H2 database requires no installation procedure for use with CIS NG. If you wish to use this database CIS NG will create the necessary files in the dat dat abases abases folder of your installation directory.

2.1.2 2.1.2

Download Installer Package The CIS NG installer for Windows comes in three different packages. You should select the one appropriate for your system. The first package assumes that you have a Java 6 JDK (not JRE) already installed on your system. If you don’t have the JDK installed (or you don’t know if you do), choose one of the other two packages. The other two packages come bundled with a JDK which will install during the CIS NG installation process. One of the packages contains the JDK for 32-bit systems, the other for 64-bit systems. Download the package you require from http://cis.worldskills.com and save it to your hard drive.

2.1.3 2.1.3

Start the Installer Simply double click the downloaded file to start the installation process.



7 of 89

2.1.4 2.1.4

Install JDK (bundled down loads only) If you downloaded one of the installation packages that is bundled with a JDK, you will see a screen similar to the following. Proceed through the JDK installation steps.

2.1.5 2.1.5

CIS NG Inst allat ion Welcom e Screen

Proceed through the installation steps as follows.



8 of 89

2.1.6 2.1.6

Choose Installati on Path Path

2.1.7 2.1.7

Installati on Packs At this stage there is only the CIS NG installation pack.



9 of 89

2.1.8 2.1.8

New CIS NG Inst ance At this step you are selecting whether to create a new instance of CIS NG or simply upgrade an existing installation. You can have multiple CIS NG instances within the one installation. Each instance has its own URL. On this screen if you wish to upgrade an existing installation without adding any new CIS NG instances, simply uncheck the checkbox and press the “Next” button. You will skip to step 2.1.12.



10 of 89

2.1.9 2.1.9

Server Setti ngs Here you need to select what port the CIS NG server will listen on for incoming requests. The default is port 80, which is the standard HTTP port used for serving web pages. You may find that other software installed on your machine such as Apache, IIS or even Skype will attempt to use port 80 and cause problems for CIS NG when it starts up. If this is the case, you can either simply not run the other software, re-configure it to use a different port, or configure CIS NG to use a different port. On this screen you also need to select what type of database you want to use for the new instance of CIS NG. You can choose to create a new database in an existing MySQL installation, or choose the H2 database which will create a file in the dat dat abases abases folder of your installation directory.



11 of 89

2.1.10 2.1.10

Instance Settings On this screen you enter the configuration details for the new CIS NG instance.

Competition Name – Name – This name appears on the top of every page, the login screen and at the top of every PDF generated by CIS NG. URL Path – Path – Each CIS NG instance is accessed at a different URL by a web browser. The part entered here comes after the machine name/address. For example, if the CIS NG screenshot above were being installed on the WorldSkills International server it would be accessed at http://www.worldskills.org/antarctica Host Name (MySQ (MySQL L on ly) – ly) – This is the host name of the computer where MySQL is installed. If it is installed on the same machine as the one CIS NG is being installed on, then it can be cal host . If MySQL is on a different machine, enter the host left at the default name of l ocal name or IP address of that machine. If the H2 database were selected in the previous step this field will not appear. Port Number (MySQL (MySQL onl y) – y) – This is the port number that the MySQL database is listening on. In most cases this will be the standard MySQL port 3306. Database Name – Name – This is the name o f the database that the new CIS NG instance will use. If the database doesn’t exist then it will be created. If it does exist then it must be empty. Username & Password fields – This is where you enter the username and password of the database user that will access the CIS NG database. For MySQL installations the user must already exist and have full permission to create and edit the database. For H2 installations these details will be used to create a new user to access the new database that will be created.



12 of 89

2.1.11 2.1.11

Adm in User This screen is where you give the username and password of the admin user that will be created for CIS NG. This will be the only user that exists once the installation is complete. The admin user will have full control o ver the CIS NG instance. It is r ecommended that you write down the username and password and keep it in a secure location.

2.1.12 2.1.12

Installati on of Files The files are transferred to the installation path



13 of 89

2.1.13

Processing During this step the configuration file is created and the new database created.

2.1.14

Shortcuts For setting up shortcuts on your machine



14 of 89

2.1.15 2.1.15

New Inst ance URL This screen gives you a URL from which you can access the new CIS NG instance once it has been started. You will note that it is your machine name with the URL Path that you supplied in step 2.1.10 appended. After you start the CIS NG server you can type this in to your web browser and you will see the CIS NG login screen. You can also access the CIS NG instance using the IP address of your machine, for example http://192.168.0.1/antarctica.. Depending on your network configuration you may also have http://192.168.0.1/antarctica other names mapped to your machine. For example, you may have domain name configured to point to your machine, so http://www.yourdomain.com/antarctica could also point to CIS NG



15 of 89

2.1.16 2.1.16

Installati on Complete This is the final screen of the installation. Note – occasionally this screen is missing the green tick and message. This is a bug in the installation software rather than CIS NG itself and does not present a problem. The installation has still been completed successfully.



16 of 89

2.2 Linu x Installati on The Linux installer is an executable jar file. This requires that you already have a Java 6 JDK (not JRE) installed on the system. You have two options for running the Linux installer. 2.2.1 2.2.1

GUI Inst allat ion If you are using a desktop environment like GNOME or KDE you can use a GUI installer that is very similar to the Windows one. Simply open a terminal window, change to the directory containing the installation jar file, and type:

j ava – j ar ci s_ i nst al l er . j ar

See the Windows installation documentation above for the data required at each step. The Linux installer differs in that it does not show the “Processing” screen at 2.1.13 because it does the processing in the background. It also skips the shortcut screen at 2.1.14 because the automatic creation of shortcuts is unavailable for the Linux installation.



17 of 89

2.2.2 2.2.2

Consol e inst allation If you only have shell access to the machine, you can run the installation in console mode. SSH on to the machine, change to the directory containing the jar file and type:

j ava - j ar ci s_ i nst al l er . j ar – consol e

The installer will ask for the same information as the Windows installer, so the above documentation can be used as a guide. 2.2.3 2.2.3

Installati on Path Path The installation path on Linux cannot have any spaces in it. If any of the folder names in the path have a space in it the installation will fail.

2.2.4 2.2.4

Ports on Linux On Linux systems TCP ports with numbers less than 1024 are reserved and can only be opened by the root user. This will cause problems trying to run CIS NG on the default HTTP port 80. The CIS NG installer suggests that you pick the port 8080, but any port above 1024 will be fine as long as it doesn’t conflict with another application. Because a port other than port 80 will be used it will mean that the port number will need to be put in the URL when accessing CIS NG, for example http://localhost:8080/antarctica You can, however, still have URLs without the port number in them by redirecting traffic from port 80 to the port that CIS NG is listening on. Here are a couple of ways you can do it: 1. Use iptables iptables to port fo rward port 80 to desired port. Below is an example iptables rule to do that. Depending on the configuration of your machine you might need to tweak this to get it to work:

i pt abl es - A PRE PREROUTI NG - t nat - i et h0 - p t cp - - dpor t 80 - j REDI RECT - - t o- por t 8080



18 of 89

2. Install Apache with t he mod_proxy module and us e reverse reverse proxies. You will need to enter a rule in to the Apache config file for each instance of CIS NG. Read the documentation for mod_proxy for detail on how to do this. Here is an example:

Pr oxyPass / ant ar cti ca ht t p: / / l ocal cal host : 8080/ ant ar cti ca Pr oxyPa xyPassR ssRe ever ver se / ant ar ct i ca ht t p: / / l oc al al hos t : 8080/ ant ar c t i c a 2.3 2.3 Upgrading Upgrading an an existing installation installation To upgrade an existing installation run the installer for the latest version of CIS NG. Select the path of the existing installation as the installation path in the new installer. The installer will detect that the path contains an existing installation of CIS NG and upgrade the installation. Also remember to uncheck the “Create new instance” checkbox in step 2.1.8 step 2.1.8 above so that it doesn’t add another database to your installation. 2.3.1 2.3.1

New New Permissio ns Some upgrades may introduce new permissions to CIS NG or modify existing ones. If there is a feature missing from CIS NG that you were expecting, first check the permissions to make sure you have access to the new feature.

2.4 Addi ng Another CIS NG Instance CIS NG can run multiple instances (or competitions) from the one installation. To add a new instance to your installation you need to run the configUpdater utility. It is located in the installation directory and is named con conf i gUpdat er . exe on Windows and con conf i gUpdat er . sh on Linux. 2.4.1 2.4.1

New Database or Exis ti ng Database You can choose to create a whole new database or connect to a database that already exists. If choosing to connect to an existing database the CIS NG configuration file is updated but no operations are performed on the database itself.



19 of 89

2.4.2 2.4.2

Config uration Details Fill in the rest of the configuration details for the new CIS NG instance. You will be asked for information similar to that requested during installation. Refer to the Windows installation procedure for further details on a specific item.



20 of 89

2.5 Config uration File CIS NG has a configuration file ci scon sconf i g. xml that it reads every time it is started. You shouldn’t normally need to touch this file, but there are a few things that should be covered just in case you do. Here is the file that has been created so far during installation and after adding an extra CIS NG instance.

80< 80 on>1. 1 on> 361< 361 8005< 8005 s age>s hut downCI downCI SNG SNG down> Ant ar ct i ca Compet i t i on / ant ant ar ct i ca >MySQL > l ocal host host 3306< 3306 c i s _ ng c i s pass pas s wor d abas e> ance> N e>Nor t h Pol Pol e / nor nor t h_pol h_pol e >H2 > ci s _ ng_nor t h_pol h_ pol e c i s 123456 abas e> ance> Let’s take a look at a couple of parts of the file.



21 of 89

2.5.1

Port

Ser ver > XML tag you can see a tag. This is the port that CIS NG listens Within the
Version This tag contains the version number of the CIS NG software.

2.5.3 2.5.3

Buil d Number The tag contains the build number that is used by the CIS NG installer when performing upgrades to existing installations. It should never be altered manually.

2.5.4 2.5.4

Shutdow n Config uratio n CIS NG should always be shut down using the shutdown script rather than just killing the running CIS NG process. This allows CIS NG to gracefully stop all the user sessions in each instance and clean up any locks held by the users. The shutdown script works by connecting to a special port that CIS NG is listening on and sending it a shutdown message. CIS NG will only accept connections on that port that originate from the same machine. Any attempt to connect to it from another machine will be rejected. This section of the configuration file allows you change the default shutdown port and the message that is shutdown message sent to CIS NG.

2.5.5 2.5.5

Instance Config uratio n Each of the competitions in the CIS NG installation is represented by an ance>tag. Here you can tweak a few of the settings if necessary. For example is the database password is changed you can update it here in the configuration file to reflect the new password. If the database is moved to a different server you can enter the details of the new server here so CIS NG will know where to find it. You can also change the URL path for the instance by ont ext Pat h>tag. changing the contents of the


22 of 89

3

STARTING/STOPPING CIS NG Now that CIS NG has been installed and configured, you can start up the CIS NG server. The CIS NG server must be started before any users can login to the system.

3.1 Window s Startup If you chose to create shortcuts during installation you can start the CIS NG server by double clicking on the desktop icon or clicking on the CIS NG application in your Start menu. Alternatively you can sng. exe file in the installation directory. double click on the ci sng Starting the CIS NG server will create a minimised window that sits in the system tray and has the CIS NG icon. The server is now running, and after a few seconds will be ready to accept requests from a web browser. If the icon in the system tray is clicked it will maximise a window that looks similar to the screenshot below:

This message shows that the configuration file has been read and all CIS NG instances have been set up and are ready to accept connections from web browsers. It gives the URL for each instance that is running in this installation. IThe screenshot above shows that there are two competitions running in this CIS NG installation. 3.2 Linu x Startup Installations on Linux should be started using the s t a r t up. s h script found in the installation directory. The same output as shown in the screenshot of the Windows startup above can be found in the nohu nohup. p. out out file. 3.3 Shutti ng dow n CIS NG The CIS NG server should always be shut down using the shutdown script. On Windows this is the shut dow down. exe file in the installation directory. There is also a shortcut to this file from the Windows Start menu. On Linux the shut shut dow down. sh script found in the installation directory should be used. Shutting down the server in this way allows CIS NG to gracefully invalidate the users’ sessions and clean up any locks or other resources they may be holding. Just closing the CIS NG window or killing the process risks leaving mark entry screen for a particular Competitor locked until the user who was entering the marks logs back in and goes the mark entry screen to reclaim the lock.



23 of 89

3.4 Log Files The log files for CIS NG can be found in the l ogs folder within the installation directory. Each instance will have its own log file where any errors or warnings are logged. There is also a log file for the server itself called s er er v er er . r l og. 3.5

Troubleshooting 3.5.1 3.5.1

Server Server won ’t start On Windows if the server won’t start you’ll see the CIS NG icon briefly appear in the Windows task bar then disappear a few seconds later. On other operating systems you will see that there is no process running. To find out what may be causing the problem, open up the s er er ver . r l og file located in the “logs” folder of the installation directory. Most commonly you will be presented with a message such as the following:

2010- 09- 10 11: 45: 17. 889: : WARN: f ai l ed Socket Socket Conne onnect ct or @0. 0. 0. 0: 80 j ava. net . Bi ndExcept ndExcept i on: Addr ess al r eady eady i n use: J VM_ Bi nd This indicates that some other software installed on your machine is currently using the port that CIS NG has been configured to use, so CIS NG is unable to start. Webserver software such as Apache, IIS or Tomcat can often cause this conflict. To resolve the conflict you can either change the port that CIS NG uses (see section 2.5.1) section 2.5.1) or or re-configure the other software that is using the port. Another piece of software that causes problems in this regard is Skype. It uses port 80 by default. To turn this off, do the following:


1.

Select Tools->Options from the menu.

2.

Click on "Advanced" then "Connection".

3.

Uncheck the box "Use port 80 and 443 as alternatives for incoming connections".

4.

Click Save.

5.

Restart Skype.


24 of 89

4

SETTING UP THE COMPETITION

4.1 Loggi ng in Once the CIS NG server has been started a user can go to the login screen with their web browser. The user interface has been designed to work with Firefox and this is the recommended web browser, although other browsers should work as well. In our case we’ll go to the login URL for our competition http://localhost/antarctica

You can see that the competition has the name that was supplied during installation. Enter the admin username and password that you provided during installation and press enter or the login button to login to CIS NG. Each user of CIS NG can only have one active session at a time. If you attempt to login with a user that has a currently active session, the active session is destroyed and the new session becomes the active one.



25 of 89

4.2 CIS NG Homepage Hom epage Upon successfully logging in, the user is presented with the CIS NG homepage.

At the top is the header with the competition name and the WorldSkills International logo. On the left is the menu that appears on every page of CIS NG. At the bottom of the menu are a few interesting things.

Here you can see the language select box. The default language is English. Changing the language results in the text of the user interface changing to the selected language. Also shown here is the user that you’re currently logged in as, as well as a “Change Password” and “Logout” button.



26 of 89

4.3 Changing Password The “Change Password” screen is reached by clicking the “Change Password” button at the bottom of the menu.

Once a new password has been saved it can be used the next time you log in. 4.4 Config Screen The first item in the menu is “Config”. Various settings for the competition can be set on the Config screen.

4.4.1 4.4.1

Competiti on Name The name of the competition can be changed here. The change will be reflected in the generated PDFs, the header of the CIS NG user interface and the login page. You will see the updated name when you next move to a new screen,

4.4.2 4.4.2

File System Path for Images Images This is the path where all uploaded images will be stored. Images can be uploaded for secondary logos, Competitor photos, etc. By default the image path is set to a folder in your installation directory i mages ages / . In this case the folder is

C: / Pr ogr am Fi l es/ CI S NG/ i mages/ Ant ar ct i ca_C ca_Co ompet i t i on/



27 of 89

4.4.3 4.4.3

URL of Help Syst em If you wish to make a help website available to your users you can enter the URL here. Once set all new CIS NG sessions will receive a “HELP” link in their menu above the “System” section of the menu. WorldSkills International has a help site located at http://cis.worldskills.org/help/ that can be used if desired. For our example competition the WorldSkills International help site will be used.

4.4.4 4.4.4

Second Second ary Logo You may want to add some branding for your competition to CIS NG. Here you can upload another logo that will be displayed in the generated PDF files, the header of the CIS NG user interface and the CIS NG login page. You need only upload one image here. CIS NG will use the uploaded version in the PDF files and create resized versions to fit the user interface. It is recommended that an image in PNG format be used. The file size should be kept to a minimum to avoid the size of the generated PDF documents getting overly inflated. About 20K seems to give a good balance between image quality and file size. For our example competition a WorldSkills Antarctica logo will be uploaded.

4.4.5 4.4.5

Sort Competit ors by Here you can set how Competitors are sorted when they appear in lists in CIS NG. The default is to sort them alphabetically by last name. Alternatively they can be sorted alphabetically by member code.

4.4.6 4.4.6

Unicod e Font List CIS NG accepts text entered in many different languages and generally does a good job of rendering the characters in the user interface. It is slightly more difficult to render these characters in the PDF documents. The default font used in the PDFs is Helvetica, but Helvetica cannot render all Unicode characters. If a character is encountered that can’t be handled with Helvetica, CIS NG looks through a list of other fonts until it encounters one that it knows will handle it. On Windows Vista and Windows 7 installations the default behaviour will likely be sufficient because there are many Unicode fonts installed by default with these versions of Windows. Other operating systems may need to have a font installed that will handle the characters. You can let CIS NG know about these fonts by putting the names of the fonts in a commaseparated list in this field, for example “MS Song, Baekmuk Batang, Kochi Mincho”.

4.4.7 4.4.7

All ow Multi-Skill Competit ion Switch on or off the ability to create “Multi-Skills” that collect the results of several skills together, such as those used in EuroSkills competitions. See sectionXXX section XXX for futher details.

4.4.8 4.4.8

Includ e Multi-Skill Marks in Member Member Compariso n Reports Add the marks for Multi-Skills to the total number of marks in the Member comparison reports.

4.4.9 4.4.9

Includ e Multi-Skill Medals Medals in Member Compariso n Reports Add the medals for Multi-Skills to the tallies in the Member comparison reports.



28 of 89

4.4.10 4.4.10

Gold Medal Poin ts The number of points that a Gold medal is worth in the Member comparison reports. The default value is 4.

4.4.11 4.4.11

Silv er Medal Poin ts The number of points that a Silver medal is worth in the Member comparison reports. The default value is 3

4.4.12 4.4.12

Bro nze Medal Poin ts The number of points that a Bronze medal is worth in the Member comparison reports. The default value is 2

4.4.13 4.4.13

Medallio Medallio n for Excellence Medal Medal Points The number of points that a Medallion for Excellence medal is worth in the Member comparison reports. The default value is 1

4.5 Setti Setti ng Competit ion Dates Dates The “Competition Dates” link in the menu will take you to the screen for setting the dates for each day of competition.

Click the “Add” button to add a new day. The date can be changed by typing it in the text field or clicking the calendar icon and selecting a date from the calendar. When you’ve finished adding dates hit the “Save” button. Dates can be removed by clicking the red minus icon on the left.



29 of 89

4.6 User Groups and permiss ions The “User Groups” menu item provides a screen for managing user groups and what they have permission to do within CIS NG. By default there is only the “Admin” user group that has permission to every part of CIS NG. This is the user group that the admin user belongs to. If you’re planning on allowing other people to log in to CIS NG, you will need to create some new user groups and set what parts of the software they are allowed to use. To delete an existing user group, select it from the drop down box and click the “Delete User Group” button with the red minus sign. For our example competition we’ll click the “New” button and create a new group called “Experts”. They will be allowed to edit their own skill’s information, edit their own skill’s marking scheme, view the PDF marking forms for their own skill, enter marks for their own skill and view total marks for their own skill.



30 of 89

4.7

Positions This screen is for defining the different relationships that people in CIS NG have to a skill.

Each position has a name and a position type. The position type is a category for the position. The screenshot above shows the positions that are created automatically during installation. You can see that there is an “Expert” position and a “Chief Expert” position. Both have the position type of “Expert”. This will allow CIS NG to be able to retrieve a list of all Experts for a skill by retrieving all people with a position type of Expert for that skill. There are three possible position types for a position – Competitor, Expert and Non Participant. Let’s say that each skill has an assistant that assists with mark entry. They will need to have a login to CIS NG and have access to just the skill they have been assigned to. Obviously they shouldn’t have a Competitor position or else they will appear on the marking forms and CIS NG will expect them to receive marks. They shouldn’t be an Expert or Chief Expert because then they will appear in places like the subjective mark entry forms as a judge for subjective marking. A new position called “Assistant” should be created, with a position type of “Non Participant”. When a user login for each assistant is created, they should be assigned to their skill with the “Assistant” position.



31 of 89

4.8 Members The “Edit Members” screen allows you to add, edit and delete members from the system. A newly created competition has all the WorldSkills International members loaded by default. Individual members can be removed by clicking the r ed minus icon next to the member. All members can be removed at once by clicking the “Delete All” button at the bottom of the page. New members can be added one at a time using the form or imported from an Excel or CSV file on the “Import Data” page (see section 6.7) section 6.7).. Once a Member has been added, their abbreviation code cannot be changed.



32 of 89

4.9 Subjecti ve Jud ging Rules This screen is where the set of rules for subjective marking are configured.

Each rule group is required to have a name. You also need to set the minimum score and the maximum score. These are usually 1 and 10 respectively. You also need to define at least one (and usually only one) rule. In the screenshot above the rule is for five judges. The maximum allowed difference between the judges’ scores is set to 4. It has also been configured to ignore the highest score and the lowest score. So any skills that have the above subjective judging rules applied to them need to have five judges assessing the subjective aspects of Competitors’ work.



33 of 89

5

ADDING SKILL INFORMATION INFORMATION

5.1 Skills & Skill Rules This screen allows you to create and delete skills from the system. You can also set various high level details about a skill.

For our example competition two skills will be created: Snowman Building and Ice Sculpting. The Ice Sculpting skill will be a team skill.

5.1.1 5.1.1

Skill Number This is a unique identifier for the skill that has a maximum length of four characters. Despite its name, it can also contain letters. This field is mandatory.

5.1.2

Name This is the name of the skill. You can add a different piece of text for the name for each of the different languages. It is mandatory to enter a name for at least one language.



34 of 89

5.1.3 5.1.3

Subjecti ve Marking Rule Group This is a list of the rules that were set up in the “Subjective Judging Rules” screen (see4.9). 4.9). It is mandatory to select one of these rules, even if your skill won’t have subjective aspects.

5.1.4 5.1.4

Identify The Judg e When Entering A Score This checkbox sets whether the identity of the judge needs to be known for each score during subjective marking. If this is checked it a llows CIS NG to produce an ana lysis of the marking patterns of each judge. See section10. section10.

5.1.5 5.1.5

Competit ors Are Organised In Groups This is used to indicate whether Competitors are grouped in to teams of two or more people for this skill.

5.1.6 5.1.6

All ow Compatrio t Markin Markin g This checkbox indicates whether an Expert is permitted to assess the work of a Competitor from the same Member organisation. This applies only to subjective marking.

5.1.7 5.1.7

All ow to generate a landsc ape marking for m Some skills may require a marking form that allows them to mark multiple competitors for the same aspect at the same time. This form lists the aspects down the left of the page and space for multiple competitors across the page and is in landscape format (as opposed to portrait). See section 6.11.4 section 6.11.4 for more detail.

5.1.8

Generate 500 Scale Marks And Medals This indicates whether a skill should have its marks converted from the 0 - 100 scale to the 500 scale and have medals assigned once marking is completed. Some skills such as Presentation Skills may not have 500 scale marks generated.

5.1.9 5.1.9

Exclu de From Member Member Results Compariso n If this checkbox is checked the skill’s 500 scale marks and medals will not count toward the Member tallies generated by reports at the end of the competition (see section 10.8). 10.8). Host Member Skills fall in this category of skill.

5.1.10 5.1.10

Prevent Further Editi ng Of Marking Scheme When the marking scheme for a skill has been finalised, this checkbox should be checked. CIS NG will check that the marks add up to 100 and that there are no other anomalies.



35 of 89

5.2 Add ing Peopl Peopl e To CIS NG The “Add Person” link under the “Personnel” section of the menu takes you to a screen where you can add the details for a person to CIS NG. Only the “First Name” and “Last Name” fields are mandatory.

5.2.1

Picture A picture of the Competitor can be uploaded that will appear on the mark entry screen when marks are being entered for that Competitor.

5.2.2

Positions This is used to map the person to a skill. The list of positions are the same that appear on the “Positions” screen (see section 4.7) section 4.7).. The list of skills are those created on the “Skills & Skill Rules” screen. To create the link between the person and the skill, click the “Add” button. To remove a link to a skill, click the red minus icon next to the skill name. In the example screenshot above Expert One has been added as an Expert in the Snowman Building skill.

5.2.3 5.2.3

Exclud e From Final Results If this is checked the Competitor will still receive a mark out of 100 but their mark will not be used in the calculation of the 500 scale marks. This can be used in cases where a Competitor



36 of 89

has not completed the competition or is ineligible to receive a result for some other reason. This field only appears if the person is linked to a skill as a Competitor. 5.2.4 5.2.4

Username and Passw ord If a username and password are provided it allows the person to log in to CIS NG. The user can change their password once they are logged in via the “Change Password” button at the bottom of the menu (see section 4.3) section 4.3)..

5.2.5 5.2.5

User Group If a username and password are entered, a user group must also be selected so that CIS NG knows what the user has permission to do when they log in. The user groups are managed on the “User Groups” screen (see section 4.6) section 4.6)..

5.2.6

Language This is the language of the CIS NG user interface for this user. In the example screenshot above, Expert One will see the user interface in German by default when she logs in.

5.2.7 5.2.7

Importi ng From a File All the required people can be entered into the system using this screen, but for anything other than a small number of people it will probably be more convenient to import them from a spreadsheet (see section 6.7) section 6.7)..



37 of 89

5.3 Searchi Searchi ng For People The “Person Search” screen allows you to find people already entered in to CIS NG.

Clicking the “Find” button without filling in any part of the form will return all users in the system. Any information entered in the form is used to narrow the results. In the screenshot above there has been a search for all Competitors in the Snowman Building skill. The “First Name” and “Last Name” fields will match names that start with the supplied text and are case insensitive. For example, if “t” were added to the Last Name field it would return Competitor Two and Competitor Three in the search results. People can also be deleted from CIS NG on the search results page. The people are selected and ticked in the checkbox. Clicking the “Delete Selected” button will delete all the currently selected people. Clicking on any of the text in the search results will take you to Edit Person page. The Edit Person page is very similar to the Add Person and contains the same fields as well as a Delete button.



38 of 89

5.4 Creatin g Teams Teams The “Manage Teams” screen is for grouping individual Competitors into teams.

To group Competitors in to a team, click on the Competitors in the left column. The selected Competitors will have green ticks next to their name. Click the “Group” button in the middle. The new team will appear in the right column and the Competitors will disappear from the left column. To remove a team, click on the team in the right column. The selected team will have a red tick on the left. Click the “Ungroup” button. The team will be removed from the right column and all the Competitors from the team will appear back in the left column.



39 of 89

5.5 Deleting Deleting people People can be deleted individually from the Edit Person page by clicking the “Delete” button. Multiple people can be deleted from CIS NG at the same time on the Person Search page. Simply search for the people to be deleted, tick the checkbox for each person then click the “Delete Selected” button.

People can only be deleted from CIS NG if: -

No marks have been entered for the person

-

The person is not part of a team (if they are in a team the team must be ungrouped first – see section 5.4) section 5.4)

-

The person is not part of a Multi-Skill team;



40 of 89

6

ENTERING THE MARKING MARK ING SCHEME

6.1 Entering Criteria

The “Assessment Criteria” link in the “Competition” section of the menu leads to a screen where you can enter each criterion of the skill. As the mark for each criterion is entered it is added to the total at the bottom of the screen. The “Marks Defined” column contains the total of the aspect marks within that criterion. When creating a new criterion as in the screenshot above, this value will obviously be zero. Once your marking scheme is complete, the number of “Marks Defined” should match the “Max Mark” for the criterion. If it doesn’t it’s a good indication that there aspects missing from the criterion. When the “Save” button is pressed or the enter key is pressed the data is saved. Once a new criterion is saved the delete and edit icons for the criterion will appear on the right. Clicking the edit icon will take you to a new screen that allows you to enter sub criteria and aspects.



41 of 89

6.2 Addi ng a Sub Criterio n At the top right of the screen there are two boxes. The “Total Sub Criterion marks” box is the total number of marks assigned to Sub Criteria in this Criterion. The “Total cumulative marks” box is the total number of marks assigned to Aspects across all Sub Criteria on this screen.

Click the “Add Sub Criterion” button with the green plus sign to add a new sub criterion with the next available ID. In the screenshot above sub criterion A1 has been created. There are a number of fields for a sub criterion. Marki Marki ng Day – Day – This can be entered on this screen or on the separate “Marking Days” screen. See section 6.8 section 6.8 for further details. Sub Criterion Descripti Descripti on – on – A text description for the sub criterion Max Mark – Mark – The maximum possible mark for this sub criterion. Marks Defined – Defined – This is the total of all aspects defined for this sub criterion and should never be more than the “Max Mark” field. As aspects are added to the sub criterion, this field is updated. Remove Remove Butto n – The red minus icon removes the sub criterion from the criterion.



42 of 89

The marking scheme for this criterion can be saved at any time on this screen by pressing the save button at the bottom of the screen. To save the criterion and go back to the screen with the list of criteria, click the save icon at the top right of the screen in the grey criterion bar (see screenshot below).



43 of 89

6.3 6.3 Adding Subjective Subjective Aspects

Click the “Add Subjective Aspect” button with the green plus sign to add a new subjective aspect. In the screenshot above aspect A1.S1 has been created. There are a number of fields for a subjective aspect. As pect pec t Des cr ipti ip ti on – on – A text description for the aspect. Max Mark – Mark – The maximum possible mark for the aspect Ad d Row – This button adds an extra line of text to the aspect description. You can have as many of these as you like. Ad d Page B reak – The first icon under the “Actions” heading will add a page break after the aspect description in the generated marking form PDF documents. Remove Remove Butt on – on – The red minus icon removes the aspect from the sub criterion.



44 of 89

6.4 6.4 Adding Objective Objective Aspects

Click the “Add Objective Aspect” button with the green plus sign to add a new objective aspect. In the screenshot above aspect A1.O1 has been created. There are a number of fields for an objective aspect. As pect pec t Des cr ipti ip ti on – on – A text description for the aspect. Max Mark – Mark – The maximum possible mark for the aspect Requirements or Nominal Size – Size – Information about the required measurements Marking Type – Type – For configuring mark calculations for the aspect. The default marking type is “Direct Mark Entry”, which means that there are no calculations performed for this aspect. See section 6.5 for further information on the different marking types. Ad d Row – This button adds an extra line of text to the aspect description. You can have as many of these as you like. Ad d Page Pag e Break Br eak – – The first icon under the “Actions” heading will add a page break after the aspect description in the generated marking form PDF documents. Remove Remove Butt on – on – The red minus icon removes the aspect from the sub criterion.



45 of 89

6.5 Moving Aspect s Aspects can be re-ordered within a Sub Criterion or be moved from one Sub Criterion to another by dragging the aspect to its new location. To drag an aspect, click near the symbol shown in the screenshot below.

While still holding down the mouse button, you can drag the aspect to its new location within the Sub Criterion. In the screenshot below, aspect A1O2 is being moved to the location after A1O5. Once the mouse button is released the aspects will be re-ordered as well as being re-numbered to reflect the new order.

In the same way, aspects can be moved from one Sub Criterion to another. Drag the aspect to anywhere on the target Sub Criterion while holding down the mouse button. When the button is released the aspect will be added as the last aspect in the Sub Criterion and re-numbered appropriately. In the screenshot below aspect A1O5 is being dragged to Sub Criterion A2, where it will become aspect A2O4.

Remember when moving aspects between Sub Criteria that the total marks for each Sub Criterion may need to be adjusted.



46 of 89

6.6 Objective Marki Marki ng Types CIS NG has the ability to perform various calculations on the values entered values entered for an aspect to produce a mark. For example, an aspect may measure the time taken to complete a task and award different marks based on that time. At the point of entering data for each Competitor for this aspect, only the value for the time taken would be entered and CIS NG would calculate the correct mark for the Competitor. Currently there are four different marking types. 6.6.1 6.6.1

Direct Mark Mark Entry This is the default marking type. No calculations are performed and marks are entered directly in to CIS NG.

6.6.2 6.6.2

Ranged Scor e This marking type calculates the Competitor’s mark based on how close a value is to a target value. It provides the capability to define up to ten ranges of values and the amount of marks to be deducted in each value range. If the Competitor’s value does not fall within any range they awarded a mark of zero. There are several parameters for the marking type: Target Value – Value – The ideal value the Competitor should achieve Mark Deduction Type – Type – In each value range, whether to deduct a number of marks or a percentage of marks Range 1 .. 10 – 10 – A number of ranges that define how many marks (or what percentage of marks) are deducted for values that fall within the range



47 of 89

In the example screenshot above the height of a wall built by a Competitor is being measured. The target height is 1200mm. The Competitors are allowed to be within +- 5mm, so the first range deducts zero marks. The second range is for walls that have a height that is between +5mm and +-10mm and deducts 0.5 marks for the Competitor. The third range is for +-10mm to +-20mm and deducts 2 marks. The fourth range is for +-20mm to +-30mm and deducts 5 marks. Any walls that have heights outside 1200mm +- 30mm will receive zero marks. It is also worth noting that if a range defines a mark deduction that is greater than the maximum mark for the aspect, a mark of zero will be awarded. It will not award negative marks. 6.6.3 6.6.3

Percent Score Compariso n This marking type compares the results of all Competitors for this aspect and awards the maximum mark to the Competitor with the best value a nd zero marks to the Competitor with the worst value. All other Competitors receive a percentage of the maximum mark depending on how close they are to the best value.

Selecting “Percent Score Comparison” from the marking type select box pops up the window shown in the screenshot above. This allows you to determine whether the best value is the highest value (for example furthest distance travelled) or the lowest value (for example the fastest time). Let’s demonstrate this with an example. An aspect has been defined where the maximum mark (5 marks) is awarded to the Competitor with the fastest time and zero marks are awarded to the Competitor with the slowest time. To set up the calculation, the “Percent Score Comparison” option is selected from the marking type drop down. In the parameters window that then pops up, the option for “Highest Mark to” should be set to “Lowest Value”. During the competition the fastest Competitor takes 10 seconds to complete the task, and the slowest Competitor takes 26 seconds, giving us a time difference of 16 seconds. After the times for all Competitors have been entered in to CIS NG the marks will be calculated as follows.

6.6.4 6.6.4

Competit or

Time

Difference to Slowest Time

Calculation

Mark

1

10

16

16 / 16 x 5 =

5

2

12

14

14 / 16 x 5 =

4.38

3

15

11

11 / 16 x 5 =

3.44

4

21

5

5 / 16 x 5 =

1.56

5

26

0

0 / 16 x 5 =

0

Stepped Score Compariso n This marking type compares the results of all Competitors for this aspect and awards the maximum mark to the Competitor with the best value. Marks for other Competitors are then



48 of 89

deducted at a specified rate. If the number of marks to deduct works out to be more than the maximum marks for the aspect the Competitor is simply awarded zero marks. The marks can be deducted at “stepped” intervals or a proportional rate. There are several parameters for the marking type: Highest Mark to – to – whether the maximum mark for the aspect goes to the highest value or the lowest Results B ased On – On – whether each “step” is measured as a numerical value or a percentage Value or Percentage Interval – the size of the “step” Marks Deducted per Difference – Difference – how many marks are deducted per step Deductions Deductions are Proportional – Proportional – whether the evaluation is stepped or a steady rate Let’s look at a couple of examples.

In the screenshot above maximum marks are awarded to the fastest time, so the highest mark is awarded to the lowest value. From the next three parameters it is determined that for every 5 seconds slower than the fastest time, the Competitor will lose one mark. Since the deductions have not been marked as proportional, the marks are calculated in a stepped fashion. So times 0 – 4 seconds slower than the fastest lose no marks, 5 – 9 seconds lose one mark, and so on. If the maximum mark for the aspect is 4 there might be marks such as: Competit or

Time

Num of 5 sec steps from fastest

Calculation

Mark

1

10

0

4 – (0 x 1) = 4

4

2

12

0

4 – (0 x 1) = 4

4

3

15

1

4 – (1 x 1) = 3

3

4

17

1

4 – (1 x 1) = 3

3

5

23

3

4 – (3 x 1) = 1

1

6

30

4

4 – (4 x 1) = 0

0

7

41

7

4 – (7 x 1) = -3

0



49 of 89

In the next example shown in the above screenshot maximum marks are awarded to the highest number of watts of power output. The next three parameters show us that for every 5% less than the highest power output, one mark is deducted. Since the deductions have been marked as proportional, marks are reduced at a steady rate rather than stepped. If the maximum mark for the aspect is 4 there may be marks like the following: Competitor Competitor

Watts Watts

% less than highest

Calculation Calculation

Mark Mark

1

800

0

4 – (0 x 1 / 5) = 4

4

2

783

2.125

4 – (2.125 x 1 / 5) = 3.575

3.58

3

730

8.75

4 – (8.75 x 1 / 5) = 2.25

2.25

4

699

12.625

4 – (12.625 x 1 / 5) = 1.475

1.48

5

680

15

4 – (15 x 1 / 5) = 1

1

6

620

22.5

4 – (22.5 x 1 / 5) = -0.5

0



50 of 89

6.7 Import ing Data To import data from a file, click the “Import Data” menu item in the “System” section. There are a number of types of data that can be imported. 6.7.1 6.7.1

Import ing a Marking Scheme The template for the marking scheme import file can be found on the CIS NG page of the WorldSkills website. Alternatively you could export a skill’s marking scheme (see section 9.4.1) section 9.4.1) and modify the resulting file (CIS NG exports marking schemes in the standard template). For the Snowman Building skill the spreadsheet looks as follows:

CIS NG will import .csv, .xls and .xlsx files containing the marking scheme defined using the Excel template.

Select “Marking Scheme” from the select box on the “Import Data” screen to produce the form shown in the above screenshot. Select Skill – Skill – The skill to import the marking scheme to. If the current login only has access to one skill, the drop down box will be replaced with the name of the skill.



51 of 89

CSV Separato Separato r – – If importing a CSV file, enter the field separator character. Excel or CSV file – file – Select the file to import Click the “Import” button to import the file. Any existing marking scheme for the skill will be erased during import and replaced with the marking scheme in the file. Please note that some users have encountered an error when importing a spreadsheet that is currently open in Excel, so it is recommended that you close the spreadsheet in Excel before importing the marking scheme.

6.7.2 6.7.2

Importi ng People CIS NG will import .csv, .xls and .xlsx files containing the list of people.

Select “People” from the select box on the “Import Data” screen to produce the form shown in the above screenshot. CSV Separato Separato r – – If importing a CSV file, enter the field separator character. Excel or CSV file – file – Select the file to import CIS NG will import files in the format used by the old CIS 2.x software or the new format. The first row of a file in the new format is a row of headers that indicate to CIS NG what the content of the column is. All headers are optional unless otherwise stated. The headers are: wiw id – id – WSI internal use only. title – title – The title of the person, for example Mr, Ms, Dr, etc first name – name – The first name of the person. This is mandatory. last name – name – The last name of the person. This is mandatory.



52 of 89

initials – initials – The person’s initials. gender – – The values can be “F” or “M”. dob do b – The person’s date of birth. email – email – The person’s contact email address. phone – phone – The person’s contact phone number. member – – The abbreviation of the member that the person belongs to, for example “AE” position – position – This is the name of a position defined on the “Position” screen (see section 4.7). 4.7). skill number – – The skill number of the skill that the person holds the position in. username – username – If the user is to have a login you can supply their username. password – password – If the user is to have a login you can supply their password. usergroup – usergroup – If the user is to have a login you can supply the name of the usergroup to which they will belong.

6.7.3 6.7.3

Import ing Members Members CIS NG will import .csv, .xls and .xlsx files containing the list of members.

Select “Members” from the select box on the “Import Data” screen to produce the form shown in the above screenshot. CSV Separato Separato r – – If importing a CSV file, enter the field separator character. Excel or CSV file – file – Select the file to import



53 of 89

The first row of a member import file is a row of headers that indicate to CIS NG what the content of the column is. The headers are: abbreviation – The abbreviation of the member, for example their two digit ISO code. name – name – The name of the member.



54 of 89

6.8 Setting Markin Markin g Days Each Sub Criterion needs to provide information about which day it should have marking completed. This can be done in the “Assessment Criteria” part of CIS NG (as shown in section 6.2) section 6.2) or or it can be done on the “Marking Days” screen as shown below.

There are three different types of Marking Days: 6.8.1 6.8.1

Specif ic Day This is a specific day of the competition where all Competitors for the skill complete the sub criterion. This is represented in the select box by entries such as “Day 1”, “Day 2”, etc.

6.8.2 6.8.2

Any An y Day This means that the sub criterion can be marked on any day of the competition. In any situation where a specific day has to be shown for the sub criterion the last day of competition is selected. For example, in the PDF marking forms a sub criterion marked as being marked on any day will show as being marked on the final day. It should also be noted that sub criteria with this type of marking day will only have its marks locked when all marking days have been locked.

6.8.3 6.8.3

Per Per Competito r This option allows different Competitors to have this sub criterion marked on different days. This is most often used for skills that are constrained by limited resources, such as skills that have less equipment than Competitors and so require that Competitors use the equipment on different days. Some skills also divide Competitors in to groups to do different modules on different days. When the “Per Competitor” option is selected from the select box the following window will be displayed.



55 of 89

Select the day of marking for each Competitor and click the “Save” button when complete. 6.9 Lock ing a Markin Markin g Scheme Before any marks can be entered for a skill it must be locked. Once all Competitors and Experts have been linked to the skill and the marking scheme is complete, go to the “Skills & Skill Rules” page (see section 5.1) section 5.1) and and check the “Prevent further editing of marking scheme” checkbox. Click the “Save” button. The marking scheme for the skill can no longer be changed.



56 of 89

6.10 6.10 Checking That Skills A re Ready Ready For Mark Mark Entr y To check that a skill is ready for mark entry it is easiest to view a report that gives us an overview of the status of all skills’ marking schemes. To view the report, click on the “Reports” menu item located in the “Competition” menu section. Then select the “Marking Scheme Defined” report.

This report shows for each skill whether the marking scheme has been locked, information about the marking scheme such as the number of criteria, sub criteria and aspects it has, as well as information about the marking days for the sub criteria. Skills that do not have a total of 100 marks defined appear in a row with a red background. In the above screenshot the Snowman Building skill has had its marking scheme locked as indicated by the lock icon next to its name. The report also shows that all of the marking days have been defined by the presence of the word “Complete” in the “Marking Day” column. This skill is ready to have marks entered. The Ice Sculpting skill in the screenshot also has a total of 100 marks defined. However, the marking scheme has not been locked and sub criteria E4 and G1 don’t have marking days selected. This skill is not ready for mark entry.



57 of 89

6.11 6.11 Marking Form s CIS NG can generate a number of different PDF forms related to marking, such as forms for Experts to record marks on while marking, forms with completed marks as recorded in the CIS, and a number of signoff forms that are used to record Experts’ approval of marking schemes and mark entry.

6.11.1 6.11.1

Blank Bl ank Forms

The generated PDF will contain one of each type of selected marking form containing no marking scheme information. The three types of marking forms are: Mark Summary Form – This gives an overview of the marks achieved for each criterion and sub criterion and indicates which day the tasks were assessed.



58 of 89

Objective Marking Form – Form – For entering assessment data and marks for objective aspects

Subjective Marking Form – Form – For entering scores for subjective aspects.



59 of 89

6.11.2 6.11.2

Marki Marki ng Forms With Aspect s

This option creates a single complete set of forms filled with criteria, sub criteria and aspect information. Competitor information and marks are not included in these forms. If you have access to more than one skill you will see a select box for choosing the skill to generate forms for. You can also choose whether to generate forms that include all sub criteria or just a single sub criterion. The forms can also be filtered to be generated for a single day of the competition. Here are some example forms for Snowman Building



60 of 89

If the marking scheme has not been locked, a “Draft” watermark is added to all pages to indicate that the marking scheme has not been finalised.



61 of 89

6.11.3 6.11.3

Marki Marki ng Forms for Hand-Writt Hand-Writt en Marks

This set of forms is for Experts to use on the workshop floor when recording marks. These forms contain Competitor information at the top of each form.

The default options on the form will generate a document that contains marking sheets for every Competitor in the skill. The form can be filtered to generate for a single sub criterion, competitor, day or combination of all three. The “Collate Marking Forms By” drop down box allows the user to choose how the forms are grouped within the generated PDF document. The forms can be grouped by Sub Criterion, Competitor or by Day.So in the screenshot above, the PDF document would contain forms for



62 of 89

all Sub Criteria for all Competitors for all days, starting with Sub Criterion A1 for all Competitors followed by A2 for all Competitors and so on. The “Hide Requirements data from Objective Marking Forms” checkbox will cause the requirements column in the generated Objective Marking Forms to be greyed out. This option exists because the requirements field may contain information that should not be revealed to the Competitor, so it needs to be removed from the copy given to the Competitors at the start of the Competition.

6.11.4 6.11.4

Landscape Forms for Hand-Writt Hand-Writt en Marks Marks

Some skills may require a marking form that allows them to mark multiple competitors for the same aspect at the same time. This form lists the aspects down the left of the page, has space for multiple competitors across the page and is in landscape format (as opposed to portrait).

These forms are harder to use when entering the data in to the CIS and should only be used if absolutely necessary.



63 of 89

6.11.5 6.11.5

Marki Marki ng Forms With Aspect s And Marks Marks

This option creates a set of forms that contains all the criteria, sub criteria and aspect information, as well as mark information. It will cr eate a set of forms for each Competitor.

If you have access to more than one skill you will see a select box for choosing the skill to generate forms for. You can also choose whether to generate forms that include all sub criteria or just a single sub criterion. You can choose to generate forms for all Competitors or a single selected Competitor. You can also choose to generate forms for a particular day.



64 of 89

The “Collate Marking Forms By” drop down box allows the user to choose how the forms are grouped within the generated PDF document. The forms can be grouped by Sub Criterion, Competitor or by Day.So in the screenshot above, the PDF document would contain forms for all Sub Criteria for all Competitors for all days, starting with Sub Criterion A1 for all Competitors followed by A2 for all Competitors and so on. If the marks have not been locked (see section 8.4) section 8.4),, a “Results Incomplete” watermark is added to all pages to indicate that the marks have not been finalised.



65 of 89

6.11.6 6.11.6

Signof f Form for Marki Marki ng Scheme

This form is a PDF document that lists each Expert for the skill and provides a space for them leave a signature to indicate their approval of the marking scheme. This form can only be generated once the marking scheme has been locked. At the top of the form is the timestamp of when the marking scheme was locked. This timestamp also appears on each of the marking forms outlined above. This allows us to check that the aspects on the marking forms being used to mark the Competitors’ work are exactly the same as the ones signed off by the Experts. If the timestamps do not match, then the marking scheme has been altered in some way since the Experts signed the form.



66 of 89

6.11.7 6.11.7

Signof f Form for Mark Mark Entry

This form is a PDF document that lists each Expert for the skill and provides a space for them leave a signature to indicate their approval that marks for their compatriot Competitor have been entered in to the CIS correctly. The user can select which day they would like to generate the form for. Days only appear in the drop down once marks have been locked for that day. At the top of the form is the timestamp of when the mark entry was locked for that day. This timestamp also appears on each of the marking forms outlined above. This allows us to check that the marks on the marking forms being are exactly the same as the ones signed off by the Experts. If the timestamps do not match, then the marks may have been altered in some way since the Experts signed the form.



67 of 89

7

MULTI-SKILLS Multi-Skill competitions allow the combination of several skills form a multi-skill. Multi-Skills don’t have a marking scheme and do not have marks entered for them. Instead they combine the results from each skill for a “Multi-Skill Team” to arrive at a mark. For example, in the EuroSkills competition there is a multi-skill named “Cross Media Publishing” that is comprised of the Web Designer, Graphic Designer and Print Technician skills. To determine the mark for the Belgian multi-skill team, the CIS takes the marks for the Belgian Competitor in Web Design, the Competitor in Graphic Design and the Competitor for the Print Technician skill, weights them accordingly and arrives at a mark out of 100 for the Belgian team. Once multi-skills have been created, they will appear in various reports and results pages along with ordinary skills.

7.1 7.1 Activating Multi-Skill Multi-Skill functi onality The multi-skill functionality must activated on the Config screen before any multi-skills can be set up. Once activated the Multi-Skill menu section will be available. See section 4.4.7 section 4.4.7 for more detail on the Config screen



68 of 89

7.2 Creatin Creatin g a Multi-Skil l The “Multi-Skills” link in the menu leads to a screen that allows the creation and editing of multi-skills. In the screenshot below a multi-skill called “Frozen Water Construction” has been created.

The first drop down field at the top of the page contains a list of the existing multi-skills. To edit a multiskill select it from this drop down. The multi-skill has been assigned a skill number and given a name in English. The “Exclude from member results comparison” checkbox will exclude that particular multi-skill from the member results (see section 10.8) section 10.8).. To exclude all multi-skills from the member results, simply leave the relevant checkboxes on the Config screen unchecked. See section 4.4.8 section 4.4.8 and 4.4.9. and 4.4.9. The next section of the screen is for adding ordinary skills to the multi-skill. All of the ordinary skills appear in the drop down box. The “Proportion” field indicates what proportion of the multi-skill marks are taken from that skill. Any whole number ca n be entered in this field. When calculating the multi-skill mark for a team, the amount from each skill is calculated by taking the competitor result for the skill and multiplying it by the proportion divided by the total of all the proportion values. So using the example in the screenshot above, the Snowman Building skill has a proportion of 2 and the total of all the proportion values is 3 (2 for Snowman Building plus 1 for Ice Sculpting), meaning that two thirds of the marks for the multi-skill are taken from Snowman Building. Since any values can be used for the proportion, it would also be valid to use values like 66 for the Snowman Building and 33 for Ice Sculpting, approximating the percentage values. The result would be the same. To remove a skill from the multi-skill, simply click the red minus button to the right of the proportion field. The buttons at the bottom of the screen are for creating a new multi-skill, saving the current multi-skill and deleting the current multi-skill.



69 of 89

7.3 Multi-Skill Teams Teams The “Multi-Skill Teams” link in the menu takes the user to a page that allows them to select the competitors for each skill to assemble in to a multi-skill team.

The multi-skill that teams are to be made for must be selected before the rest of the form will appear. The “Multi-Skill Team” drop down box contains a list of existing teams for the multi-skill. Select one to edit it. A name for the team can be specified. If the name field is left blank, the name of the Member is used instead. Each multi-skill team must have a Member. Often this is as straight forward as choosing one of the regular Members from the Member drop down, but occasionally teams need to be created that contain Competitors from different Member organisations. In this case a “pseudo-member” is required. A pseudo-member is a type of Member that only exists in the context of multi-skills and is used solely for grouping together competitors from different Members. Once a pseudo-member has been created it will appear in the drop down lists for multi-skill screens, so it can be re-used for other teams if desired. For example, in the EuroSkills competition they often use a pseudo-member named “Europe (EUR)” when creating teams that have Competitors from different Member organisations. When multi-skills are included in the member results (see section 10.8) section 10.8),, the points and medal points for pseudo-members are divided among the members of the teams. The “Assign Team Members” section is for selecting the Competitors for each of the skills to be included in the multi-skill team. The drop down box for each skill contains a list of Competitors that haven’t been assigned to any multi-skill teams for this skill. The “New” button creates a new empty team, the “Save” button saves the current team, and the “Delete” button deletes the current multi-skill team.



70 of 89

7.4 Multi-Skill Results 7.4.1 7.4.1

100 Scale Marks All multi-skills will have 100 scale marks that are calculated using whatever marks have been entered in the ordinary skills up to the present moment. These marks can be viewed on the “View Marks” screen (see section 9.1) section 9.1).. The multi-skills appear in the skill drop down box at the end of the list, after a dotted line as shown in the screenshot below.

When viewing the marks for a multi-skill it will only display the total marks, not the marks for the daily totals and not the marks per Criterion. 7.4.2 7.4.2

500 Scale Marks 500 scale marks are generated for multi-skills once all the skills contained within the multiskills have locked each day of marking. The multi-skills are in the skill drop down box the same way they are in the 100 scale mark page. All the operations that you would perform on this screen on an ordinary skill (see section 9.2) are available with multi-skills as well. The CIS NG software treats the multi-skill as if it were an ordinary skill.



71 of 89

8

DURING THE COMPETITION

8.1 Manage Manage Appl icati on The “Manage Application” menu item in the “System” section of the menu takes you to a screen that gives an overview of all the users logged in to CIS NG and some basic server information.

In the above screenshot the admin user and Expert One are logged in. The report shows that Expert One is an Expert in the Snowman Building skill. If the user’s name is clicked on the user interface is redirected to the “Edit Person” screen (see section 5.3) section 5.3) for for that user. Either of the users can be logged out by clicking the “Logout” link at the end of their row. From this screen it also possible to send a message to a group of users. Select the users you wish to send a message to, type the message in the text area and press the “Send” button. Each of the users will receive the message in a red box in the top right of the screen, similar to how an error message looks. The message will disappear after a short period of time, or the user can close the message themselves. At the bottom of the screen is the version of the CIS NG software and the version of the Java virtual machine that the software is using.



72 of 89

8.2 Entering Marks Click on the “Enter Marks” menu item in the “Assessment” section of the menu to start entering marks.

Let’s take a look at the different parts of this screen. 8.2.1 8.2.1

Competito r Informati on This section contains the summary information for the currently selected Competitor.

The first box indicates how many aspects have been marked in the current sub criterion for the selected Competitor. The second box tells us how many marks have been entered for the Competitor overall. The third box represents the amount of marks entered as a percentage. The final box gives us the Competitor’s name. If there has been an image uploaded for the Competitor, it will appear here above their name.



73 of 89

8.2.2 8.2.2

Sub Criterion Selecti Selecti on This part allows us to select a sub criterion for a particular Competitor.

If the user has access to more than one skill they will see the select box as in the screenshot above to allow them to select the skill to enter marks for. Otherwise the name of the skill the user has permission to enter marks for will appear there. The “Assessment Sub Criterion” select box will only list sub criteria available for the selected Competitor on the selected day. This information comes from the Marking Day information entered for each sub criterion (see section 6.8) section 6.8).. Changing the selected day or Competitor may result in a completely different list of sub criteria in the select box. Selecting a sub criterion will update the objective marking form and subjective marking form with the aspects contained within the sub criterion. Either side of the “Competitor” and “Assessment Sub Criterion” select boxes are arrow buttons. These can be used to scroll to the next or previous item in the list.

8.2.3 8.2.3

Objectiv e Mark Mark Entry

This form is for entering values values and marks for objective aspects. Value fields may be left left blank unless they are calculated marks (see below). The arrow keys or tab key can be used to move between fields. While marks can be entered by simply typing in the digits, there are shortcuts if the Competitor received full marks or zero marks. If the Competitor received full marks for the aspect, simply type “y” in the mark field. CIS NG will convert it to the maximum mark for the aspect. If the Competitor received zero, an “n” can be entered in the field and it will be converted to zero. This allows marks to be entered quickly by simply typing “y” or “n” and using the down arrow key. In the screenshot above the first aspect has a triangle icon before the description. This indicates that the description can be expanded to see extra description lines. Clicking on the triangle expands the description.



74 of 89

The above screenshot shows what mark entry looks like for calculated marking types. You will notice that there is a value field but no mark field. In place of a mark field there is a clock icon. This indicates that a mark cannot be calculated for this aspect until all Competitors have had their values entered.. Once all Competitors have had their values for the aspect entered in to CIS NG, the form will look like this:



75 of 89

8.2.4 8.2.4

Subjecti ve Mark Entry

This form is for entering scores for subjective aspects. CIS NG calculates the final mark based on the subjective judging rules for the skill. In the above screenshot is a skill that has a subjective marking rule set that requires five judges, so there is space for five scores for each aspect. Once all five scores for the aspect have been entered and saved, the clock icon in the “Mark Awarded” column will be replaced with the resulting mark. The mark is calculated according to the subjective marking rules selected for the skill (see section 5.1.3) section 5.1.3).. So for our example competition, the highest score and lowest score will be ignored. The average of the remaining three scores will be used to determine what percentage of the maximum mark for the aspect is awarded to the Competitor. This skill has also been set to identify judges when entering subjective scores (see section 5.1.4) so 5.1.4) so the member abbreviation of the Expert who gave the score is shown next to each score entered. In the screenshot the Austrian Expert gave a score of 5 and the Japanese Expert gave a score of 8. How is the Expert set? At the top of each column there is an icon that resembles a person. If this icon is clicked a drop down list of all Experts for the skill appears. When an Expert is clicked their member abbreviation appears next to the icon. In the screenshot above the third judge has been set to the Mexican Expert (MX). Any new scores now entered in the third column will be attributed to the Mexican Expert. Note that this only applies for entering new scores. For example, if the judge for the first column is changed to the Indian Expert, the first score for aspect A1.S1 will still be attributed to the Austrian Expert. If a score is now entered in the first column for A1.S2 it will be attributed to the Indian Expert. See the screenshot below.

If a Competitor has not attempted a subjective aspect, they can be given a mark of zero by checking the “Non Attempt” checkbox that appears to the left of the score fields as shown in the screenshot below.



76 of 89

8.3 Marki Marki ng Progress and and Missi ng Marks Marks There are two reports that are useful for tracking mark entry for each skill. They can be accessed from the “Reports” screen. 8.3.1 8.3.1

Marked Marked Aspect s Report This report shows the number of marks entered for each criterion for each skill.

The screenshot above shows the marks entered for the two skills in the example competition. The numbers are arrived at by adding the number of mark entries for each Competitor. For example, there are 5 aspects contained in criterion H of the Snowman Building skill and there are 5 Competitors, giving us a total number of expected marks of 25. Cells that are highlighted in yellow indicate that the marks for that criterion are incomplete. In the screenshot above there haven’t been many marks entered so all cells are highlighted. The last cell in the row indicates what percentage of marking has been done for the skill in total. Clicking on the contents of a cell pops up a window that breaks down the number of marks entered for each aspect of the criterion. In the screenshot below there have only been marks entered for 4 of the 5 Competitors in aspect A2.O1.



77 of 89

8.3.2 8.3.2

Missin g Marks Marks Report This report is for tracking down marks that may have been accidentally missed during mark entry. It shows the number of marks entered each day for each Competitor. Incomplete marks are highlighted in yellow.

In the above screenshot Competitor Five is missing a mark from Day 1. Clicking on the contents of the cell for Competitor Five for Day 1 will pop up a window showing all the aspects the Competitor was supposed to receive marks for.

This shows that Competitor Five is missing the mark for aspect A1.O3.



78 of 89

8.4 Lock ing Marks Marks Once all marks have been entered for a day they should be locked to prevent further mark changes. On the “Enter Marks” screen all objective and subjective mark fields for locked days will be disabled, so marks can be viewed but not changed. To get to this screen click the “Lock Marks” menu item in the “Assessment” menu section.

Days that have had all marks entered and are ready to be locked appear with a green background. To lock the marking for that day, click on the word “Unlocked” in that cell. The word will change to “Locked” and the cell background will change to grey. If there are no marks to be entered for a day then the cell will be blank.

By default the Lock Marks screen will show the locks for the first skill in the drop down list. There is an option in the drop down to show the lock status of all skills at once, but this may take some time to generate if there are many skills. Once all days have been locked the 500 scale results will be generated (see section 9.2). 9.2).



79 of 89

9

AFTER MARK ENTRY

9.1 Viewing Marks Marks Marks on the 100 scale for each Competitor can be seen on the “View Marks” screen located in the “Assessment” section of the menu.

Next to the skill select box is a second select box that provides several options for viewing the marks: Total Marks Marks Onl y – Shows just the total for each Competitor Include Daily Totals – Shows the total mark as well as the totals for each day Include Marks For Each Criterion – Shows the total mark as well as the total marks for each criterion The “View Marks” screen can also be seen during the course of the competition to show marks to that point in time.



80 of 89

9.2 500 Scale Marks & Medals Once the marks for all days have been locked for a skill CIS NG will generate the 500 scale marks. These can be viewed by clicking the “Results” menu item in the “Assessment” menu section.

CIS NG will automatically assign medals to the appropriate Competitors, as can be seen in the screenshot above. These can be changed manually by selecting a different medal from the select box and clicking the “Save” button. Occasionally it may be necessary to adjust a Competitor’s mark, for example to apply a penalty. To do this, click the green plus icon in the “Adjustments” column. The following window will pop up.

There are three different adjustment types: Fixed Value – Value – Sets the 500 scale to a specified value



81 of 89

Deduction – Deduction – Deduct the specified number of marks from the 500 scale mark Percent Deduction – Deduct the specified percentage of marks from the 500 scale mark. When the adjustment is saved, the marks are recalculated and medals re-assigned. The adjustment appears in the “Adjustments” column. In the screenshot below a 15% penalty has been applied to the Mexican Competitor.

9.3 Competito r Certific ates CIS NG can generate a certificate for each Competitor that shows a summary of their marks, their final 500 scale score and their position in the skill. Clicking on the “Certificates” link in the menu presents the following screen.

The form can be left blank to generate a certificate for every Competitor in the competition, or list of certificates can be filtered by skill and by Member.



82 of 89

9.4 Export ing Data To export data to a file, click the “Export Data” menu item in the “System” section. There are a number of types of data that can be exported. 9.4.1 9.4.1

Export ing a Marking Scheme A skill’s marking scheme can be exported to the standard skill template. The exported file is able to be altered and/or imported in to CIS NG (either the same competition or a different one) without any further editing of the file (see section 6.7.1 section 6.7.1 for more details on importing a marking scheme).

9.4.2 9.4.2

Export ing People People All of the people data stored in CIS NG is able to be exported to either an Excel spreadsheet or a CSV file. The exported file is in the correct format to be uploaded to CIS NG (see section 6.7.2). 6.7.2). Please note that passwords are not included in the exported file.

9.4.3 9.4.3

Export ing Members Members All members stored in CIS NG are able to be exported to either an Excel spreadsheet or a CSV file. The exported file is in the correct format to be uploaded to another competition in CIS NG (see section 6.7.3) section 6.7.3)..

9.4.4 9.4.4

Export ing Results The Competitor results for each skill can also be exported to an Excel spreadsheet. There is also an “Export medallists only” checkbox that allows the user to hide any results that aren’t medals.



83 of 89

10 REPORTS 10.1 Experts Head to Head This report provides an analysis of the subjective marking of each Expert for a skill. It shows the number of assessments performed by each Expert, the number of times they gave the highest and lowest scores, and the number of times they were above or below the average score. Clicking on the name of an Expert will display the “Marks by Single Expert” report for that Expert.



84 of 89

10.2 10.2 Marks by Single Expert This report provides an analysis of subjective marking performed by a single Expert. It shows the number of assessments the Expert performed for each Competitor, the number of times they gave the Competitor the highest or lowest score, and the number of times they gave scores above or below the average score.

10.3 Analysis of Experts This report is another that provides analysis of subjective marking. There are four different measurements that can be viewed: highest score, lowest score, above average score, below average score.



85 of 89

10.4 Skills Comparison This report is for comparing statistics such as highest mark, average mark, etc between skills. Any number of skills can be added to the report.

10.5 Proportion of Objective to Subjective This report shows the number of objective and subjective aspects for each skill. It can display the overall number for the skill or break it down to show per criterion.



86 of 89

10.6 Range of Marks This report is used to assess whether the skill had an appropriate level of difficulty and produced a sufficient spread of marks. Each Competitor’s mark is broken down by criterion and displayed as a chart, as well as having various statistics like average mark and median mark for each criterion.



87 of 89

10.7 10.7 Alb ert Vidal Award This report determines the top Competitor across all skills by comparing marks in the 500 scale.

10.8 10.8 Member Compariso n This report screen is used to generate PDF documents that rank the various members. There are five different comparison reports: Member (ordered alphabetically), Total Medal Points, Average Medal Points, Total Point Score and Average Point Score. Each report shows the number of Competitors for each member and the total number of each medal type the member gained. 10.9 Member Medal Totals This report screen is used to generate a PDF document that lists the Competitors for each member and what their 500 scale mark was and what, if any, medal the Co mpetitor won.



88 of 89

10.10 10.10

Offic ial Results

This report screen is used to generate a zip file containing all of the official results PDF documents. It contains reports such as the Albert Vidal Award, the member comparison reports, the marking forms for each skill grouped by member and skill, etc.

The “File Prefix” field supplies a prefix for each of the generated PDF file names. The field accepts standard filename characters and has no restriction on length. There is also a field for selecting a temporary folder to be used while generating the results. By default it selects a path within the competition’s images folder. The folder used should be empty. Since the generation of the official results can be a lengthy process, CIS NG assumes that if there are already files in the folder then someone else is in the middle of generating official results using the same folder and it won’t proceed. The user will receive an error notifying them that it cannot generate the results. 10.11 10.11

Mark Entr y Times

This report screen is used to generate an Excel spreadsheet that shows the percentage of marks entered for each skill over time.



89 of 89

Wsi Ug01 Cis

Recommend Documents