A new study by the Israeli company LawGeex examined who is more successful in legal practice: human lawyers, or artificial intelligence. Want to guess who won?
In short: the artificial intelligence beat the human experts square on the hip, in the particular field on which it was trained and tested. The twenty professional lawyers had to go through five nondisclosure agreements (agreements to maintain confidentiality), and identify problematic clauses that could get the seal into trouble later on. The artificial intelligence… had to do the exact same thing.
At the end of the test, the results were pretty clear: the AI finished with an accuracy score of 94%, and the human lawyers with a score of only 85%. And if that's not enough, while the lawyers needed 92 minutes on average to go through all the contracts, the artificial intelligence needed 26 seconds. Yes, seconds.
It can certainly be argued that the test, by the way, put the lawyers in a position that should have been favorable to them, since they were completely focused on reading the contracts. They didn't have to go through them while waiting for a plane at the airport, or under time pressure of other work. They were completely focused on the task - and even so, they were defeated by the AI, and it still took them a little over two hundred times longer to complete the task.
All this does not mean that lawyers will be replaced by artificial intelligence tomorrow morning. Some companies need very individual contracts that suit a particular employee, and to develop these a human lawyer will still (still! for now!) be needed. Similarly, we will need human lawyers to negotiate with clients, provide emotional support in complex cases, and various other tasks. But for all the other routine tasks - those where the lawyer does relatively simple work and charges a few thousand shekels for it - it will be possible to rely on artificial intelligence that will provide advice in a few minutes, and at a ridiculous cost compared to the working hours of a lawyer today.
And if we end by paraphrasing a well-known joke: "What do you call a situation where tens of thousands of lawyers are looking for a new job? A good start".
You are invited to read more about artificial intelligence and the future of work in my book who control the future, in the selected bookstores (and those that are just fine).
See more on the subject on the science website:
6 תגובות
This is the future that will replace us all
It is very interesting what the cars will do in the future, it also depends on the infrastructure.
An interesting comparison.
Thank you.
Believe that the machines will do a better job when it comes to standard documents like confidentiality agreements. Not sure about other more complex legal tasks
Amazing, a summary of what awaits us in the future,
The general direction from which these systems are getting even better, 26 seconds will become decimals of a second like a Google search,
What used to be a profession for the squeamish minds among us will become a query on Google, uploading documents to the cloud and receiving answers,
But it should not be expected that this will remain only in the field of law, for example some areas of medical expertise are similar to law where there is cross-referencing of information against large databases of knowledge comparing data and cutting the data to get an answer, this is a specialist doctor who sits at the keyboard barely looking at the patient sitting in front of him and he relies on On many years of intuition experience, etc.. It is simply built for such systems
The diagnostics can start at home in front of the mobile without the limitation of these 10 minutes without a limited time for questions and answers
When expert systems have access to all personal data, including the world, including the latest solutions in every medical field, what will be the last jobs that the human race will hold in the end?
Can there even be any area left in which we will be better than these systems?
This competition doesn't mean much, because the task is quite simple.
Artificial intelligence will find it difficult to compete with a professional lawyer in somewhat more complex tasks, for example preparing prosecution/defense arguments, and even more so in setting a trial management strategy, or preparing witness investigations, arguments in summaries, in particular counterarguments, etc.
In the field of developing innovative arguments or legal theories, diverse skills are needed at such a high level, in particular great creativity, that it is difficult to see when artificial intelligence will be able to cope with human ability, and if at all it will ever be able to surpass it.
Interesting thanks!