GPT-4 AI Clears Bar Exams; Will It Replace Universities? 

GPT-4 Resonating Human-Level Performance In Bar Exams

[{"selector":"#anim-bae2104d-2f3b-42a8-b4e1-cbdfb9ab0bdb","keyframes":{"transform":["translate3d(126.37361%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-bd0bdeaf-f727-48e1-a112-c4c5ed02b987","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-97bbb033-64a9-4d11-89fa-48ff3ec030af","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] [{"selector":"#anim-2513d420-f550-4917-bc31-c35e207139d7","keyframes":{"transform":["translate3d(-373.7704%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .8, 1)","fill":"both"}] [{"selector":"#anim-20ce7e67-6112-4cd0-ac6e-64a7552c4310","keyframes":{"transform":["rotateZ(-180deg)","rotateZ(0deg)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(.2, 0, .5, 1)","fill":"forwards"}] March 15, 2023 Story: Ramsha Naushad

OpenAI announced GPT-4, a large multimodal model that exhibits human-level performance on various professional and academic benchmarks.

[{"selector":"#anim-7d3c68af-c116-4398-8253-5633bc7d2eaf","keyframes":{"transform":["translate3d(126.76580%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-1c0c31bd-3932-49de-9f2b-807d23a5a327","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d7de7235-a9a8-45dc-8b7f-43adcde65354","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

"It passes a simulated bar exam with a score around the top 10% of test takers," writes OpenAI in its announcement. "In contrast, GPT-3.5’s score was around the bottom 10%."

[{"selector":"#anim-dc58de65-c970-4433-9bb5-555f101488b2","keyframes":{"transform":["translate3d(120.27492%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-00013102-787a-4386-a989-fe81d91f870b","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-cd5a4457-15fb-4663-a1be-d0a19d576368","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

Ethan Mollick praised GPT in his tweet

[{"selector":"#anim-ddf6fba1-3e3a-42a8-9b12-77bbfcfffb08","keyframes":{"transform":["translate3d(109.65732%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-966790da-c99f-4a40-b699-673f433e26ed","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-26578d00-b7f6-4cd7-853e-4518f12405a9","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

OpenAI also released a technical paper describing GPT-4's capabilities and a system model card describing its limitations in detail.

[{"selector":"#anim-b6375689-d15a-43ed-95db-2bcb2e81ec58","keyframes":{"transform":["translate3d(118.21306%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-98df7e13-2fa0-47f9-bd7d-b40bd1da6f3c","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-9308e24a-44a4-4bbb-ab08-2aa0fc8750a1","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

OpenAI made the model take tests like the Uniform Bar Exam, the Law School Admission Test (LSAT), the Graduate Record Examination (GRE) Quantitative, and various AP subject tests.

[{"selector":"#anim-ed5130c7-9203-463b-ac0e-9e5814e2c9be","keyframes":{"transform":["translate3d(121.60280%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-dc6356f0-2dca-4e0e-b71a-749316a5b85a","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-adf09328-d9cb-41bc-935d-34398fda8f1a","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

Results: If GPT-4 were a person being judged solely on test-taking ability, it could get into law school—and likely many universities as well.

[{"selector":"#anim-c5d1f6e0-07db-4d61-981f-100354f9bb84","keyframes":{"transform":["translate3d(121.52779%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-25bd5bed-aa62-4237-9613-8dfd83d235f3","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-e024ec0d-7dee-42b7-9294-538d6b6a11b1","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}]

OpenAI CEO Sam Altman tweeted, "It is still flawed, still limited, and it still seems more impressive on first use than it does after you spend more time with it."

[{"selector":"#anim-d8e524b5-5072-47b8-a3d1-c2ddfee6f727","keyframes":{"transform":["translate3d(110.67961%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ee93cbed-8b8c-4e94-accc-e6ef580a2e17","keyframes":{"opacity":[0,1]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"both"}] [{"selector":"#anim-dca730a7-7dcf-41a2-bdb4-e30a74e54a07","keyframes":{"transform":["scale(0.15)","scale(1)"]},"delay":0,"duration":1000,"easing":"cubic-bezier(0.4, 0.4, 0.0, 1)","fill":"forwards"}] [{"selector":"#anim-cbd3d134-ff65-498d-9140-6bdb778ba2a1","keyframes":{"transform":["rotate(-540deg) scale(0.1)","none"],"opacity":[0,1]},"delay":0,"duration":1000,"fill":"both","iterations":1}] Read More Stories