We tested AI communication tools. Here is what we found.

After one year of the covid-19 epidemic, millions of people are job search in the United States. The AI ​​communication program claims to help fellow employers find the right people for the job. These technology companies say business growth during the plague.

But as the demand for these technologies increases, so does it questions about their accuracy and reliability. In a recent section of MIT Technology Review’s podcast “We Trust in Machines,” we tested programs from two well-known companies for AI queries, My Interview and Interesting. And we have found the predicted variability and many similar matching functions that raise concerns about what these algorithms are testing.

Getting to know you

MyInterview tests the conditions considered in the Big Person Personality Test, a psychometric analysis used to recruit people. These qualities include openness, conscience, resistance, acceptance, and stability. Focus That also tests personality traits, but instead of the Big Five, candidates are tested on other factors, such as humility and perseverance.

Algorithms analyze the responses of curious people to determine the form. MyInterview also includes a number of features that show how a competitor can be very similar to what is known in hiring managers as the best in the position.

To complete our test, we started installing the software. We published a fake office post / researcher on MyInterview and Curious Thing. We then created a competitor by selecting personality traits when guided by the system.

At MyInterview, we selected the form as the most interesting detail and placed it at the required level. We also selected the interview questions, which are displayed on the screen where the candidates write the video answers. At Curious Thing, we chose traits such as humility, flexibility, and perseverance.

One of us, Hilke, asked to take over the role and ended up interviewing them on MyInterview and Curious Thing.

Our nominee ended the phone interview with Curious Thing. She started asking questions on a regular basis at work and received 8.5 out of 9 in the English language. In the second attempt, the interviewer asked the same questions, and answered each one by reading the Wikipedia psychometric journal in Germany.

However Curious Thing gave him a 6 out of 9 for knowing English. He finished the interview again and received the same score.

HILKE SCHELLMANN

Our nominee turned on MyInterview and repeated the test. He read the same thing in Wikipedia aloud in German. The algorithms not only restored personality analysis, but also predicted that candidates would be 73% match-fixing, placing him at the top of the list for all those we asked to register.