Wednesday, December 13, 2023
HomeBig DataMicrosoft releases Phi-2, a robust small language mannequin AI

Microsoft releases Phi-2, a robust small language mannequin AI


Are you able to convey extra consciousness to your model? Take into account turning into a sponsor for The AI Affect Tour. Be taught extra concerning the alternatives right here.


The fast tempo of generative AI information and bulletins isn’t slowing down, at the same time as we attain the ultimate stretches of 2023 and the standard winter vacation quiet interval.

Simply check out Microsoft Analysis, the blue sky division of the software program large, which right this moment introduced the launch of its Phi-2 small language mannequin (SML), a text-to-text AI program that’s “sufficiently small to run on a laptop computer or cellular gadget,” based on a publish on X.

On the similar time, Phi-2 with its 2.7 billion parameters (connections between synthetic neurons) boasts efficiency that’s similar to different, a lot bigger fashions together with Meta’s Llama 2-7B with its 7 billion parameters and even Mistral-7B, one other 7 billion parameter mannequin.

Chart evaluating Microsoft Analysis Phi-2 mannequin to different main open supply and closed supply fashions. Credit score: Microsoft Analysis

Microsoft researchers additionally famous of their weblog publish on the Phi-2 launch that it outperforms Google’s model new Gemini Nano 2 mannequin regardless of it having half a billion extra parameters, and delivers much less “toxicity” and bias in its responses than Llama 2.

VB Occasion

The AI Affect Tour

Join with the enterprise AI neighborhood at VentureBeat’s AI Affect Tour coming to a metropolis close to you!

 


Be taught Extra

Microsoft additionally couldn’t resist taking somewhat dig at Google’s now much-criticized, staged demo video for Gemini during which it confirmed off how its forthcoming largest and strongest new AI mannequin, Gemini Extremely, was in a position to clear up pretty complicated physics issues and even right college students’ errors on them. Because it turned out, although it’s possible a fraction of the scale of Gemini Extremely, Phi-2 additionally was in a position to accurately reply the query and proper the scholar utilizing the identical prompts.

Promotional screenshot displaying Phi-2’s reply to a physics query immediate. Credit score: Microsoft Analysis

Nevertheless, regardless of these encouraging findings, there’s a massive limitation with Phi-2, no less than in the interim: it’s licensed just for “analysis functions solely,” not business utilization, beneath a customized Microsoft Analysis License, which additional states Phi-2 could solely be used for “non-commercial, non-revenue producing, analysis functions.” So, companies trying to construct merchandise atop it are out of luck.

VentureBeat’s mission is to be a digital city sq. for technical decision-makers to achieve data about transformative enterprise expertise and transact. Uncover our Briefings.





Supply hyperlink

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

- Advertisment -
Google search engine

Most Popular

Recent Comments