It is important that all the candidates follow the rules and maintain integrity during the tests. Yet there is always a probability for some to try and slant the regulations. We have included some anti-cheating measures in our plan to prevent such instances. This article is relevant to all users.
Here is what you will get in this article:
Anti-cheating measures
Anti-cheating monitors
IP Based Location Tracking
Snapshots
Full-screen Tracking
Mouse in Window
Commonly Asked Questions
Anti-cheating Measures
We implement the following anti-cheating measures to maintain the integrity of our tests and give every candidate a fair chance in the assessments -
Disable Copy And Paste: We do not allow copying and pasting text from the questions. This ensures that the appearing candidates can’t use copy-paste to find the answers.
Cycled Questions: Our library features question banks with around a hundred different questions. Our test algorithm in place ensures that different individual questions or sets of questions are selected and presented every time a test is selected. This makes it highly unlikely that the candidates will face the same questions again - even when they take the test for a different company.
Questions have a specific exposure count: To further protect our test integrity, we have set a specific exposure limit for each question. Once a question exceeds the exposure limit, we retire that specific question and replace it with a new one.
Study Prevention: This comes in two parts -
Candidates will have no idea about the assessment ahead of the test time. They will know about the tests only when they start attempting them. Once they start the tests, the timer will begin and they will not be able to leave the test without you knowing.
We do not allow the candidates to register as new customers to prevent them from attempting the tests beforehand. Only users with business domains can register for accounts - no personal or educational email addresses are allowed. This prevents students from using Testlify as a study aid.
Hidden Questions and Answers: To protect the integrity of our tests, we keep the questions and answers hidden. None of our customers can see any information related to the tests - not even those users who might bypass our account creation filters. Additionally, if this information was available, the risk of the content making its way to the internet would increase. In such cases, simple Google research would reveal the answers to the candidates. The questions will be visible only when a candidate starts the test.
Multiple-Attempt Prevention: Our system can detect if a candidate is trying to register for another attempt at an assessment, and block them from doing so. One attempt per email address is what we allow.
Timed Tests: Timed tests are one of the most effective ways to evaluate a candidate based on the knowledge they have while adding pressure. Since there is time pressure, the candidates risk being unable to complete the test should they try to search for the answer. Once the test starts, the counter will start running, even when the candidate closes the test window.
Anti-cheating Monitors
In addition to the above features, we also monitor a candidate’s activity throughout the test through certain AI proctored measures. Below listed are the measures that we use -
IP Based Location Tracking
Snapshots
Full-screen Tracking
Mouse in Window
IP Based Location Tracking
Our system records the location of the candidates using their IP address once they allow doing so. This is done to help you identify candidates that may have made it past our email filters, allowing them to take the assessment more than once.
How it appears
The question that appears for the candidates is “Filled out only once from IP address?” with a Yes or a No as options to choose.
How to interpret
A Green Tick mark means that the candidate has used the IP address only once to attempt the test. A Red Cross means that the assessment was taken multiple times by computers that are using the same IP address. This could mean anything -
The same candidate attempted the assessment more than once by using two different email addresses.
The same candidate failed the qualifying questions the first time and tried again.
Multiple candidates used the same device from the same internet connection to take the same assessment.
Multiple candidates used different devices that share one internet router to take the same assessment, such as two people in the same room or cafeteria.
Snapshots
We take snapshots of the candidates every 30 seconds using the camera of the device that the candidate is using. We do this to ensure that the candidate is the one taking the test without any outside help. You can’t disable this feature for any assessment.
How it appears
The question that appears for the candidates is “Webcam enabled” with a Yes or a No as options to choose.
A timeline of snapshots that you can toggle through if the webcam is enabled.
How to interpret
A Green Tick mark means that the candidate has the webcam turned on during the entire assessment. A Red Cross means that the webcam was turned off. This might be because of the following reasons -
The candidate does not have a webcam enabled on the device.
They have somebody with them to help with the test.
They are facing technical issues.
They have some internet issues or slow internet.
You can scroll through the screenshots taken to check the candidates’ actions during the entire assessment. This can indicate the following situations -
A second person in the frame could mean that the candidate is taking the help. But it also might be someone delivering some important news other than the test.
The candidate looking at their phone could be them looking for an answer, but it could also be something important that they need to attend to.
If you do not find the candidate in the frame, he might be busy with some urgent work!
Full-screen Tracking
Keeping the full-screen mode always active is a mandatory for a candidate during the entire assessment. If any candidate tries to exit the full-screen mode, our system will detect it and notify you.
But if the candidate is taking the test on a dual display or virtual second desktop, they can leave the assessment window without exiting the full-screen mode.
How it appears
The question that appears for the candidates is “Full-screen mode always active” with a Yes or a No as options to choose.
How to interpret
A Green Tick mark means that the candidate has the full-screen mode active during the entire assessment. A Red Cross means that the full-screen mode was inactive. This might be because of the following reasons -
They left the test with the purpose of completing it later.
They used another browser window/tab to search for answers.
You have added certain custom questions that require them to leave the full-screen mode to get information - their LinkedIn profile, for example.
Mouse in Window
Our system can also detect if the candidate’s mouse pointer leaves the assessment window. This will give you an idea if the candidate moved to a second window while still remaining in full-screen mode.
How it appears
The question that appears for the candidates is “Mouse always in assessment window” with a Yes or a No as options to choose.
How to interpret
A Green Tick mark means that the candidate’s mouse pointer has not left the assessment window during the entire test. A Red Cross means that the candidate left the assessment screen.
It is possible to leave the full-screen mode but still have the mouse remain in the assessment window. But a Red Cross could potentially mean -
The mouse was being used on a different browser window or second display.
They were closing a notification that appeared.
They answered an incoming call.
The mouse got moved by mistake.
Commonly Asked Questions
1. How do I know that a candidate has cheated?
The anti-cheating measures are designed to check the candidates’ actions during the entire assessment and might be worth looking at.
While these anti-cheating features can’t guarantee you that the candidate has cheated, you can look deeper into it. For example, a webcam red cross could be because the webcam of a candidate shut down midway due to some technical issues.
If you find any red crosses, we recommend you contact the candidate directly since they may have a valid excuse for it. The rejection of a candidate should not be based on this information alone.
2. How can I disable the anti-cheating settings?
Currently, we do not offer the feature where you can disable these anti-cheating measures. These are compulsory features in every assessment.
3. Can I see the content of a question if you hide the questions and answers?
No, you can’t do so. To maintain the fairness of the tests, none of our users are allowed to see the questions or the answers.
But the best way to see the questions is to invite yourself to take the assessment. You will be able to see the exact questions asked in your tests but you will not be able to view the correct answers.
4. Should I immediately disqualify someone who has cheated?
Testlify never recommends using the information from the anti-cheating measures as conclusive proof to immediately reject the candidates. If you find any red cross, it is better to bring it to the candidates' attention first since they could have a valid excuse.
5. Do the anti-cheating measures prove that a candidate has cheated?
No, the anti-cheating measures only keep the track of the candidates’ actions during the entire assessment. This information should not be the base of any definitive proof about a candidate cheating or the rejection of any candidate.