Might be interesting…
https://www.bespacific.com/vals-legal-ai-report/
Vals Legal AI Report
Vals Legal AI Report [free-registration required] “This first-of-its-kind study evaluates how four legal AI tools perform across seven legal tasks, benchmarking their results against those produced by a lawyer control group (the Lawyer Baseline). The seven tasks evaluated in this study were Data Extraction, Document Q&A, Document Summarization, Redlining, Transcript Analysis, Chronology Generation, and EDGAR Research, representing a range of functions commonly performed by legal professionals. The evaluated tools were CoCounsel (from Thomson Reuters), Vincent AI (from vLex), Harvey Assistant (from Harvey), and Oliver (from Vecflow). Lexis+AI (from LexisNexis) was initially evaluated but withdrew from the sections studied in this report. The percentages below represent each tool’s accuracy or performance scores based on predefined evaluation criteria for each legal task. Higher percentages indicate stronger performance relative to other AI tools and the Lawyer Baseline. Some key takeaways include:
Harvey opted into six out of seven tasks. They received the top scores of the participating AI tools on five tasks and placed second on one task. In four tasks, they outperformed the Lawyer Baseline.
CoCounsel is the only other vendor whose AI tool received a top score. It consistently ranked among the top-performing tools for the four evaluated tasks, with scores ranging from 73.2% to 89.6%.
The Lawyer Baseline outperformed the AI tools on two tasks and matched the best-performing tool on one task. In the four remaining tasks, at least one AI tool surpassed the Lawyer Baseline.
Beyond these headline findings, a more detailed analysis of each tool’s performance reveals additional insights into their relative strengths, limitations, and areas for improvement.”
Perspective.
Half of Americans regularly use artificial intelligence tech like ChatGPT, survey says
Half of Americans are now using artificial intelligence models like ChatGPT and Gemini, according to a new survey from researchers at Elon University.
… "Younger, well-educated, relatively wealthy, and employed adults are somewhat more likely than others to be using LLMs now. Yet, it is also the case that half of those living in households earning less than $50,000 (53%) use the tools," the researchers said.
The technology is more popular among Hispanic adults (66%) and Black adults (57%) than White adults (47%), the survey found. It's also slightly more popular among women than men.
How often the LLMs are used varies: 34% said they use them at least once a day, 18% said they use them several times a week and 10% said they use the tools “almost constantly.”
No comments:
Post a Comment